While the field of data science is not tied directly to Big Data, advances in one tends to produce advances in the other. Big Data increases our ability to harvest and process data, while data science allows us to dig into it for insights.
With the fast-growing interest in data lakes — a storage solution that allows structured and semi-structured data to live in the same place — attention is turning toward metadata as a way to organize large amounts of diverse enterprise data. Metadata is an ambiguous and generic term, but it most
During one of our data-munging sessions here at Coralogix, we found ourselves needing to assess the cardinality of large data sets. Getting the accurate result is seemingly trivial: you simply iterate over the data, and count the number of unique elements. In reality, however, the task is more troublesome, mainly
When both NASA and the Pope are speaking out about climate change, you know something is up. Yesterday the NASA Earth Exchange (NEX) unveiled a public data set showing how rainfall, temperature and CO2 levels will change over the next 85 years. The high-resolution data, which is as granular as
‘Streams in the Beginning, Graphs in the End’ is a three-part series by Dataconomy contributor and Senior Director of Product Management at Cray, Inc., Venkat Krishnamurthy – focusing on how big changes are afoot in data management, driven by a very different set of use cases around sensor data processing.
‘Streams in the Beginning, Graphs in the End’ — Part I: Data Management for the Internet of Everything
‘Streams in the Beginning, Graphs in the End’ is a three-part series by Dataconomy contributor and Senior Director of Product Management at Cray, Inc., Venkat Krishnamurthy – focusing on how big changes are afoot in data management, driven by a very different set of use cases around sensor data processing. In this first part, we’ll talk
“Important Questions About The Human Condition Should Be Addressed with Data Science”: An Interview with Data Scientist Thomas Levi.
Thomas Levi is a Data Scientist at Plenty of Fish (POF), a free online dating website based in Vancouver. Thomas has a background in theoretical physics and at one point worked in string theory. Much of his work has involved topic models and other cool algorithms Follow Peadar’s series of
The sheer volumes involved with Big Data can sometimes be staggering. So if you want to get value from the time and money you put into a data analysis project, a structured and strategic approach is very important. The phenomenon of Big Data is giving us ever-growing volume and variety
These days, every business is exploring ways to use data and new technologies to gain a competitive edge. While there’s no questioning the value to be found in big data analytics, organizations have had a low success rate to date when it comes to rolling out data initiatives. A recent
#Unit festival is a new tech event with a message, promoting the power of unicorns in the technology community. 40+ top tech speakers delivering insights from a range of backgrounds. Music performances, interactive installations and thought-provoking entertainment. A dynamic networking experience with the opportunity to make an abundance of new
Everyone likes to save money–and when you’re running a huge business like Zalando, saving money by making your systems more efficient can mean saving millions of Euros. That’s why I’m excited to tell you that the Zalando Data Intelligence team recently found a way to save us piles of money.