Introduction

The Big Data framework we have designed for the different redborder products is a very powerful solution that has not only enabled us to create both redborder IPS and redborder Flow but that will ease the pave for future products. While in Mobile World Congress Barcelona 2013 we discovered the MySQL based technology we employed at the time was going to be unable to cope with the data volumes we expected to see in the environments we were targeting commercially. Thus, we replaced it with redborder Big Data, not a product by itself, but the foundation to all of them. Of course, we have taken ideas and code from the Internet leaders like Facebook, Twitter, Netflix and Linkedin, but we believe ours is the first time such technologies are glued together in an available product, not just the technology, and whats best, an open source product. The main elements of the architecture are: Scale out and cloud ready. Apache Kafka as message bus. OLAP engine for interactive data visualization. Hadoop for RAW data storage. And Storm for realtime data processing (Upcoming in next release). While this framework is exploited at its full capacity in our product vision, we have received inquires from many other fields about in, from things like Smart Cities, Stock Market and Social Media Analytics. We believe the foundations are so strong, any of those is doable directly by it.