Hadoop for RAW Storage

Some of our products require us to store all data, not just aggregated, as it is the case of an IPS event (or will be in a near future with a more general log). As the OLAP engine stores aggregated data only, we needed a way to store this RAW data.

Initially we considered Couchbase for this, but our main client convinced us to stick to Hadoop as it is becoming the de facto standard for Big Data.

While not fully exploitable in this release, we hope to add significant features around this side of the product in the near term.