It’s no news that unstructured data has been a highly sought after source since its inception, first for determining public topical insights and now for training machine learning algorithms. The critical question to answer is whether you should outsource the collection to overcome business challenges or not? Mike Madarasz explains

Data processing today is done in form of pipelines which include various steps like aggregation, sanitization, filtering and finally generating insights by applying various statistical models. Amazon Kinesis is a platform to build pipelines for streaming data at the scale of terabytes per hour. Parts of the Kinesis platform are

Introduction A couple of months ago a client of mine asked me the following question: “What is the faster data structure object in Python for Big Data analysis today?” I get questions like this one all the time. Some of them are not easy to solve at all and it

One of the coolest things about being a data scientist is being industry-agnostic. You could dive into gigabytes or even petabytes of data from any industry and derive meaningful interpretations that may catch even the industry insiders by surprise. When the global financial crisis hit the American market in 2008, few

The future of crime fighting is moving away from reacting to incidents as they occur and towards ‘predicting’ crime in order to prevent it. The LAPD have already spoken about using earthquake models to predict crime ‘aftershocks‘; now, The Australian Crime Comission are scanning massive sets of data to examine

Yesterday IBM announced that it was making new investments in its US Federal Healthcare Practice to provide for the ever increasing tech needs of the health institutions.  Big data solutions will be used, among others, to improve the level of care, lower costs, as well as combine and then analyse

Predicting future crime has left the realm of the futuristic science fiction and is now part of the very day reality, at least for the officers of the LAPD.  These officers are now using the power of big data to determine hotspots for crime and as a result lowering crime

A novel service from Swan Island Networks crunches through and filters, then combines and aggregates information from a broad variety of big data sources to produce targeted alerts for cities.  First rolled out in 2004, the technology is currently in use by over 250 commercial customers to connect different agencies and

Masdar Institute of Science and Technology’s project for the Telecom Italia Big Data and Trentino Open Data Challenge 2014 has been listed as one of the ten finalists.   Their submission, entitled “Misery Loves Company: Twitter Sentiment Reveals Assortative Mixing of Aggregate Happiness in Urban Communication Networks”, focused on looking at the

We met up with Jean Louis Andorin, COO of Precogs recently. Jean Louis gave us a brief insight into Precogs. Precogs is a business analytics company offering visibility on the risk of adverse events in  the electronic manufacturing supply chain. Who are you?