Scalability and Big Data Based Backend

While our new Big Data based backend is explained in detail here, we can just say this is the main reason behind 3.0 announcement.

In its basic essence, redborder Flow is a gateway transforming a legacy protocol (Netflow, sFlow, IPFIX, …) into Apache Kafk messages. This messages enter the collector and are processed and stored exclusively in the OLAP engine.

As the OLAP engine is designed mainly for slice and dice data manipulation, it enables us to offer very powerful visualizations of the traffic.

This new architecture not only provides us with the capability to infinitely grow the collector capacity (in the Enterprise version) but also will allow us to include preprocessing stages before the data is actually stored. This will be the main focus of the next redborder release.