Exploring “Big Data” Storage and Related Technologies

We live in a world that’s literally awash in digital data.  According to the research firm IDC, we will create 1.8 zettabytes of new data in 2011.  That is one billion terabytes of data created in the current year alone!

In 2007 I’d written a paper about managing petabyte storageAt the time it was difficult to find any organizations with that amount of content on spinning disk.  Today, a petabyte of data is relatively common among larger corporations and government agencies.  It has almost become blase’.  The scientific community is now looking at ways to process and store exabytes of data!  Whew!

In the coming months I plan to use this forum to explore some of the issues and challenges storing and managing vast quantities of data present.  Some of the emerging technologies and advanced methods for managing information in this brave new world.  With a little luck it will generate a valuable dialog among readers as to what works and/or doesn’t work when faced with these challenges.  We’ll also examine some vendor solutions and try to filter out some of the facts from the “marketware” to determine how effective a given solution may actually be.

If you  have a moment, stop past our website, http://www.dc-ei.com and see what’s new.  Anyway, please try to be gentle with me.  This is my first blog.  …And as Scottie said in Star Trek’s movie The Voyage Home, “Hold on tight, Lassie.  It gets bumpy from here.”

About Big Data Challenges

Mr. Randy Cochran is a Senior Storage Architect at Data Center Enhancements Inc.. He has over 42-years of experience as an IT professional, with specific expertise in large and complex SAN/NAS/DAS storage architectures. He is recoginzed as a Subject Matter Expert in the enterprise storage field. For the past five years his primary focus has been on addressing the operational requirements and challenges presented by petabyte-level storage.

Posted on November 18, 2011, in General and tagged , , , . Bookmark the permalink. Leave a comment.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: