“Big Data” Getting Bigger? Beware of the Ripple Effect…

Everyone seems to be concerned about the “tsunami of data” that is overwhelming the IT world. However, relatively few people appear to be worried about the “ripple effect” of this growth on other areas that are directly or indirectly impacted by this phenomenon.

Storage growth does not occur in a vacuum.   Every gigabyte of data written to disk must also be backed up, managed, transferred, secured, analyzed, protected, and supported.   It has a “ripple effect” that can spread throughout the organization, creating problems and resource shortages in many other areas.

A case-in point is the backup & recovery process.  Every gigabyte stored must be scheduled for backup, so if we’re experiencing a 50% CAGR data growth rate, then we are also subjected to a 50% growth rate in demand for backup & recovery services.  In addition, most companies keep more than one copy of data in the form of supplementary backups, clones, replications, and other forms of duplication.  Therefore a single gigabyte of data can exist in multiple areas throughout the organization.

The ripple effect of storage growth and the areas that are impacted

Areas that are directly or indirectly affected by storage growth.

The picture above identifies at least (36) specific areas that are impacted by data growth.  I’m sure there are others.  Gone are the days when problems could quickly be resolved by “just buying more disk”.

It’s time to “think outside the box”.  This is no longer a localized issue that can be solved by stove-piped departments and back-room technologists.  It is an enterprise-wide challenge that needs the creative minds of many individuals from diverse areas of the organization.  Consider bringing in independent Subject Matter Experts from the outside to analyze complex problems, stimulate creative thinking, and discuss how others have attacked similar challenges.

In today’s world of “big data”, there needs to be far greater emphasis on comprehensive planning, designing in architectural efficiency, minimizing the impact on IT infrastructure, and improving the manageability of our entire IT environment.  Your future depends on it.

About Big Data Challenges

Mr. Randy Cochran is a Senior Storage Architect at Data Center Enhancements Inc.. He has over 42-years of experience as an IT professional, with specific expertise in large and complex SAN/NAS/DAS storage architectures. He is recoginzed as a Subject Matter Expert in the enterprise storage field. For the past five years his primary focus has been on addressing the operational requirements and challenges presented by petabyte-level storage.

Posted on March 2, 2012, in Infrastructure and tagged , , , , , , , . Bookmark the permalink. Leave a comment.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: