jump to navigation

Big Data July 13, 2013

Posted by stewsutton in Architecture, Big Data, business analytics, Cloud, Cloud Computing, Information Technology, Knowledge Management.
trackback

Perhaps you have heard of the term “big data.” Well does it seem to be rising atop the curve of inflated expectations? It is probably a healthy perspective to be just a bit suspicious of “big data” solutions coming to the rescue where all others have been unsuccessful.

There are certainly examples where scientists compare approaches to problem solving and this includes conversations about big data. Big problems need solutions that can operate at “big” scale, and the phenomenon of big data is certainly real. The three Vs of volume, velocity and variety, coined by the Gartner Group, have helped us to frame the characteristics of what we understand as big data.

Ultimately it is how these “problems” get solved by using distributed data and distributed processing. Some will do things “internally” while others will take to the cloud. But as many have already experienced, some of the “cloud benefits” (related to “bursty” allocation against resource) are not there for “big data” configurations.

Said more simply, the benefits of lightly touching the cloud resources and getting the financial benefit of this time-sharing is diminished for big data problems that keep the resources fully utilized and thereby incur the highest order of expense against the cloud infrastructure. This reality affects how we must architect solutions that cross into the cloud and make use of “heavy lifting” within our own corporate intranet infrastructure. It keeps the “big data” problem interesting for sure.

With all of that being said, it’s quite another thing when you start to hear how big data is going to upend everything. It is quite unlikely that big data will usher in a “revolution” to transform how we live, work, and think. We do well to approach the topic of big data as just a new tool in the toolkit and use it for those problems where it makes sense.

Advertisements

Comments»

No comments yet — be the first.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: