Flink

Apache Flink is an open-source, scalable platform for real-time stream processing and batch analytics. It provides exactly-once state consistency, event-time processing, highly flexible deployment options, and APIs for SQL as well as DataStream-based programming. Flink is suitable for building event-driven applications, running analytical jobs over both real-time and batch data, and constructing data pipelines and ETL processes at enterprise scale.