Hosted MapReduce and Hadoop offerings
Today’s question is: where are we regarding MapReduce/Hadoop in the cloud? That is, what are the offerings of Hadoop-as-a-Service or other hosted MapReduce implementations, currently?
A year ago, InfoQ ran a story Hadoop-as-a-Service from Amazon, Cloudera, Microsoft and IBM which will serve us as a baseline here. This article contains the following statement:
According to a 2011 TDWI survey, 34% of the companies use big data analytics to help them making decisions. Big data and Hadoop seem to be playing an important role in the future.
One year later, we learn from a recent MarketsAndMarkets study, Hadoop & Big Data Analytics Market – Trends, Geographical Analysis & Worldwide Market Forecasts (2012 – 2017) that …
The Hadoop market in 2012 is worth $1.5 billion and is expected to grow to about $13.9 billion by 2017, at a [Compound Annual Growth Rate] of 54.9% from 2012 to 2017.
In the past year there have also been some quite vivid discussions around the topic ‘Hadoop in the cloud’.
So, here are some current offerings and announcements I’m aware of:
- Amazon’s Elastic MapReduce (EMR), featuring MapR’s rock-solid and fast Hadoop distribution.
- Google’s App Engine, a PaaS offering, allows for experimental MapReduce processing in Python.
- Microsoft’s Azure, also a PaaS offering, now has Hadoop support.
- VMware has launched Project Serengeti to enable rapid deployment of Hadoop clusters in their Cloud Foundry environment.
- HStreaming’s Cloud Beta hooked up with AWS as well.
- There is a report on a PaaS on Hadoop Yarn – Idea and Prototype available.
… and now it’s up to you dear reader – I would appreciate it if you could point me to more offerings and/or announcements you know of, concerning MapReduce and Hadoop in the cloud!
Filed under: Big Data, Cloud Computing, FYI