In a recent Forbes magazine article, Howard Baldwin took an opportunity to whack the reader with an “obvious stick”. In this age of the ever accelerating freight train that is “Moore’s Law”, its becoming easier every day to succumb to the fear of missing out. This is no more prevalent than with the topic of Big Data. It is my fear that once we forget that “Big Data” is, at its core (and center and surface for that matter), our long familiar friend data, albeit with a new hairstyle, we face not the possibility, but rather the likelihood of repeating data disasters of the past. We suffered for too many years and endured too much pain and anguish to allow a bit of buzzword excitement to blind us to reality or the obvious. We cannot afford to forget the data lessons of decades gone by.
Lest I be misunderstood, I am by no means advocating putting on the brakes and calling for an international summit and standards organization to be formed around Big Data before we continue on our merry way. I am saying, though, that if we back-burner any of the controls we currently have in place for the sake of expediency in this brave new Big Data world, that we do so with our eyes wide open and with the clear understanding of what controls we’re relaxing and why.
From the article:
Big data doesn’t make data management easier. It makes it harder. Companies that have had a difficult time mastering structured data aren’t going to magically master unstructured data. There are little stumbling blocks such as taxonomies, consistency, hierarchies, and so on that have always made getting to a single source of truth a challenge. Is it a zip code or a postal code? Is it a car, a truck, or a vehicle?
Without applying some rules, you could end up being more confused, with data that’s less reliable and less trustworthy than before. My advice: don’t start tackling big data unless you’re really confident that you’ve mastered data of any size.
Lastly, to Baldwin’s point, if you’ve not mastered ‘small data’, or at the very least went and got the T-shirt and you are still heading down the ‘Big Data’ trail with guns-a-blazin’, I wish you luck and invite you to give me a call when you’re mid-tunnel and discover that the light you’ve been heading toward is in fact an oncoming locomotive and not daylight as you had hoped.
The article mentioned can be found at: Big Data’s Little Details – Forbes
- What’s Big Data anyway? (hughewilliams.com)
- Big data can fail, but still worth it (nirupamsrivastava.wordpress.com)
- In the Age of Cloud, Big Data, Mobile and Social, Could Amazon Emerge a Leader? (cmswire.com)