Skip to content

A benchmark of stream processing frameworks : Apache Kafka, Apache Flink and Apache Spark

Notifications You must be signed in to change notification settings

annis-souames/Stream-Processing-Benchmark

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Stream Processing Benchmark

A benchmark of performances between three different stream processors: Kafka Streams, Apache Flink and Spark Streaming.

Technologies:

This benchmark uses Java for simulating a CPU intensive workload that is sent to three different stream processors:

  • Kafka Streams KafkaProcessor
  • Apache Flink : FlinkProcessor
  • Spark Streaming: SparkProcessor

We used JMX to collect the performance metrics and we stored them in Prometheus, Grafana is used for displaying results.

Results

Below are example of results for Kafka Streams with Grafana.

alt text for screen readers

About

A benchmark of stream processing frameworks : Apache Kafka, Apache Flink and Apache Spark

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published