Dataconomy
  • News
    • Artificial Intelligence
    • Cybersecurity
    • DeFi & Blockchain
    • Finance
    • Gaming
    • Startups
    • Tech
  • Industry
  • Research
  • Resources
    • Articles
    • Guides
    • Case Studies
    • Glossary
    • Whitepapers
  • Newsletter
  • + More
    • Conversations
    • Events
    • About
      • About
      • Contact
      • Imprint
      • Legal & Privacy
      • Partner With Us
Subscribe
No Result
View All Result
  • AI
  • Tech
  • Cybersecurity
  • Finance
  • DeFi & Blockchain
  • Startups
  • Gaming
Dataconomy
  • News
    • Artificial Intelligence
    • Cybersecurity
    • DeFi & Blockchain
    • Finance
    • Gaming
    • Startups
    • Tech
  • Industry
  • Research
  • Resources
    • Articles
    • Guides
    • Case Studies
    • Glossary
    • Whitepapers
  • Newsletter
  • + More
    • Conversations
    • Events
    • About
      • About
      • Contact
      • Imprint
      • Legal & Privacy
      • Partner With Us
Subscribe
No Result
View All Result
Dataconomy
No Result
View All Result

Move Over, MapReduce- Google’s Cloud Dataflow Has Arrived

byEileen McNulty
June 26, 2014
in News
Home News

Several big announcements came out of the Google I/O Conference in San Francisco yesterday, one of the more significant of which was Google’s decision to do away with MapReduce, the system which originally inspired Hadoop. Google apparently stopped relying on MapReduce “years ago”, according to Urs Hölzle, Google’s Senior VP of Technical Infrastructure. Their replacement solution is a newly-announced cloud analytics platform known as Cloud Dataflow.

“Cloud Dataflow is the result of over a decade of experience in analytics,” Hölzle said. “It will run faster and scale better than pretty much any other system out there.” The need for a new system came about, he explained, when MapReduce became unable to handle to amount of data Google has to work with. Apparently performance begins to decline dramatically once your dataset exceeds a couple of petabytes in size.

Cloud Dataflow, in contrast, is much more scalable. It also takes out alot of the legwork in creating complex pipelines, as deployment, management and scaling are automated. Some other data management products in Google’s roster of announcements include:

  • Cloud Save- An API which automatically saves user’s data so it can be used without any coding from the server. It will be a feature of Google’s App Engine and Compute Engine.
  • Cloud Debugging- Makes the process of rummaging through lines of code to identify bugs easier
  • Cloud Tracing- Provides latency statistics and analysis
  • Cloud Monitoring- An intelligent monitoring system which integrates Stackdriver (a startup Google recently acquired). It monitors infrastructural resources like disks and virtual machines, as well as a dozen open-source packages outside the Google product line

It will be interesting to see if Cloud Dataflow really is faster and more scalable than any other system, and what the announcement will do to public confidence in MapReduce, and also Apache Hadoop.
Read more here.
(Image credit: Flickr)

Follow @DataconomyMedia


Interested in more content like this? Sign up to our newsletter, and you wont miss a thing!

[mc4wp_form]

 

Stay Ahead of the Curve!

Don't miss out on the latest insights, trends, and analysis in the world of data, technology, and startups. Subscribe to our newsletter and get exclusive content delivered straight to your inbox.

Tags: cloudGoogle

Related Posts

Xiaomi to launch 17, 17 Pro, and 17 Pro Max series in China on September 25

Xiaomi to launch 17, 17 Pro, and 17 Pro Max series in China on September 25

September 23, 2025
Next-gen PCIe 8.0 standard promises 1TB/s bandwidth for AI and quantum workloads

Next-gen PCIe 8.0 standard promises 1TB/s bandwidth for AI and quantum workloads

September 23, 2025
Nvidia Drive AGX Thor to power robotaxi project

Nvidia Drive AGX Thor to power robotaxi project

September 23, 2025
Poll: Half of Taiwan fears TSMC becoming US-SMC

Poll: Half of Taiwan fears TSMC becoming US-SMC

September 23, 2025
From Pilot to Policy: RYT Gathers Global Leaders at TOKEN2049

From Pilot to Policy: RYT Gathers Global Leaders at TOKEN2049

September 23, 2025
Nvidia and OpenAI announce landmark 0 billion partnership, igniting global stock rally

Nvidia and OpenAI announce landmark $100 billion partnership, igniting global stock rally

September 23, 2025
Please login to join discussion

LATEST NEWS

Xiaomi to launch 17, 17 Pro, and 17 Pro Max series in China on September 25

Next-gen PCIe 8.0 standard promises 1TB/s bandwidth for AI and quantum workloads

Nvidia Drive AGX Thor to power robotaxi project

Poll: Half of Taiwan fears TSMC becoming US-SMC

From Pilot to Policy: RYT Gathers Global Leaders at TOKEN2049

Nvidia and OpenAI announce landmark $100 billion partnership, igniting global stock rally

Dataconomy

COPYRIGHT © DATACONOMY MEDIA GMBH, ALL RIGHTS RESERVED.

  • About
  • Imprint
  • Contact
  • Legal & Privacy

Follow Us

  • News
    • Artificial Intelligence
    • Cybersecurity
    • DeFi & Blockchain
    • Finance
    • Gaming
    • Startups
    • Tech
  • Industry
  • Research
  • Resources
    • Articles
    • Guides
    • Case Studies
    • Glossary
    • Whitepapers
  • Newsletter
  • + More
    • Conversations
    • Events
    • About
      • About
      • Contact
      • Imprint
      • Legal & Privacy
      • Partner With Us
No Result
View All Result
Subscribe

This website uses cookies. By continuing to use this website you are giving consent to cookies being used. Visit our Privacy Policy.