While the field of data science is not tied directly to Big Data, advances in one tends to produce advances in the other. Big Data increases our ability to harvest and process data, while data science allows us to dig into it for insights.
For several years now, much of the hype surrounding big data has been connected with Hadoop. Companies have simply seen Hadoop as intertwined with the big data movement; where one goes, the other follows, and as a result, the future was bright for Hadoop and the vendors who offered it.
Strata + Hadoop World, happening September 29 – October 1 in New York, is where cutting-edge science and new business fundamentals intersect. It’s a deep-immersion event where data scientists, analysts, and executives explore the latest in emerging techniques and technologies by dissecting case studies, developing new skills through in-depth tutorials,
The travel industry is no stranger to Data Science disruption – especially air travel. Online flight finders have been snapping up data scientists from other industries in order to make better use of the available data, and airlines have been building and opening APIs. Many services are using this opportunity
Being Berlin based, and a cornerstone of the Data Science community, Data Science Retreat has been a pretty regular feature of our coverage. We covered their launch back in April last year, the success of their early batches, and some of the student projects. Jose Quesada, DSR’s founder and director,
It isn’t a surprise that the amount of data generated in the past few years is astounding—in fact, the data generated within the last two years is close to 90 percent of all data ever generated. However, 80 percent of all enterprise data is unstructured as the numbers continue to
Data science is one of the most recent buzzwords that is gaining popularity in tech circles. With the number of job advertisements on the rise, one may think that data science and their professionals, data scientists, would become one of the most sought-after professionals in the technology job market over
With the fast-growing interest in data lakes — a storage solution that allows structured and semi-structured data to live in the same place — attention is turning toward metadata as a way to organize large amounts of diverse enterprise data. Metadata is an ambiguous and generic term, but it most
During one of our data-munging sessions here at Coralogix, we found ourselves needing to assess the cardinality of large data sets. Getting the accurate result is seemingly trivial: you simply iterate over the data, and count the number of unique elements. In reality, however, the task is more troublesome, mainly
When both NASA and the Pope are speaking out about climate change, you know something is up. Yesterday the NASA Earth Exchange (NEX) unveiled a public data set showing how rainfall, temperature and CO2 levels will change over the next 85 years. The high-resolution data, which is as granular as
‘Streams in the Beginning, Graphs in the End’ is a three-part series by Dataconomy contributor and Senior Director of Product Management at Cray, Inc., Venkat Krishnamurthy – focusing on how big changes are afoot in data management, driven by a very different set of use cases around sensor data processing.