2013 was the year that big data became big business, says Alex Handy in his San Diego Times article, “Big Data 2013: Another Big Year.” Handy explains that big data made the transformation when enterprises deployed Hadoop in production environments and NoSQL people spread data around on servers. These two combined situations resulted in disseminating massive amounts of data and employing enterprise systems to manage the information.
Hadoop 2.0 was the key player in big data getting bigger, because the software went from needing an experienced user to handle it to a more general-purpose usage along with map/reduce as the batch processing method. Hadoop was not the only item that helped make big data grow. Many other projects and software had a hand in making big data a burgeoning market. The one most comparable to Hadoop 2.0 was NoSQL databases:
“NoSQL databases continued to gain traction thanks to a never-ending need to spread data around the globe in a highly available and consistent form. To that end, a number of new transactional databases, some calling themselves “New SQLs,” cropped up this past year. NuoDB, FoundationDB and VoltDB all brought databases to market in 2013 that offered transactional support based on the ideas and techniques shown in the Google Spanner paper.”
The established NoSQL names: DataStax, Cassandra, MongoDB, and Crouchbase, however, squabbled over asserting their dominance in the market. The new year looks to be another big data year and the article implies that Basho, Sqrrl, and Hortonworks are the names to keep an eye out for. At this point in the big data game, everything needs to be watched out for.
Whitney Grace, January 10, 2014