With the fast-growing interest in data lakes — a storage solution that allows structured and semi-structured data to live in the same place — attention is turning toward metadata as a way to organize large amounts of diverse enterprise data. Metadata is an ambiguous and generic term, but it most

During one of our data-munging sessions here at Coralogix, we found ourselves needing to assess the cardinality of large data sets. Getting the accurate result is seemingly trivial: you simply iterate over the data, and count the number of unique elements. In reality, however, the task is more troublesome, mainly

When both NASA and the Pope are speaking out about climate change, you know something is up. Yesterday the NASA Earth Exchange (NEX) unveiled a public data set showing how rainfall, temperature and CO2 levels will change over the next 85 years. The high-resolution data, which is as granular as

‘Streams in the Beginning, Graphs in the End’ is a three-part series by Dataconomy contributor and Senior Director of Product Management at Cray, Inc., Venkat Krishnamurthy – focusing on how big changes are afoot in data management, driven by a very different set of use cases around sensor data processing.

‘Streams in the Beginning, Graphs in the End’ is a three-part series by Dataconomy contributor and Senior Director of Product Management at Cray, Inc., Venkat Krishnamurthy – focusing on how big changes are afoot in data management, driven by a very different set of use cases around sensor data processing. In this first part, we’ll talk

Thomas Levi is a Data Scientist at Plenty of Fish (POF), a free online dating website based in Vancouver. Thomas has a background in theoretical physics and at one point worked in string theory. Much of his work has involved topic models and other cool algorithms Follow Peadar’s series of

The sheer volumes involved with Big Data can sometimes be staggering. So if you want to get value from the time and money you put into a data analysis project, a structured and strategic approach is very important. The phenomenon of Big Data is giving us ever-growing volume and variety

These days, every business is exploring ways to use data and new technologies to gain a competitive edge. While there’s no questioning the value to be found in big data analytics, organizations have had a low success rate to date when it comes to rolling out data initiatives. A recent

#Unit festival is a new tech event with a message, promoting the power of unicorns in the technology community. 40+ top tech speakers delivering insights from a range of backgrounds. Music performances, interactive installations and thought-provoking entertainment. A dynamic networking experience with the opportunity to make an abundance of new

Everyone likes to save money–and when you’re running a huge business like Zalando, saving money by making your systems more efficient can mean saving millions of Euros. That’s why I’m excited to tell you that the Zalando Data Intelligence team recently found a way to save us piles of money.