Stream Processing and War Stories
We just renamed the group from SMACK to Fast Data and would like to host the second meetup. We will attempt to host this every two months, so please do not hesitate if you have any cool talks! See you around! Agenda for the evening:
SMACK stack from the trenches (Achim Nierbeck)
In this talk, I will give an overview about the SMACK – Stack (Streaming, Mesos, Akka, Cassandra, Kafka) and tell about the experiences made with this stack and how to fine-tune it for massive data. For a better understanding of how a SMACK stack might work, a demonstration showing how to stream live bus data from Los Angeles with Spark and Flink is shown.
Stream Processing Comparison (Matthias Niehoff)
In this talk, I will give an overview of various concepts used in data stream processing. Most of them are used for solving problems in the field of time, focussing on processing time compared to event time. The techniques shown include the Dataflow API as it was introduced by Google and the concepts of stream and table duality. But I will also come up with other problems like data lookup and deployment of streaming applications and various strategies for solving these problems. In the end, I will give a brief outline on the implementation status of those strategies in the popular streaming frameworks Apache Spark Streaming, Apache Flink, and Kafka Streams.
As always Drinks and Pizza are on us! Please care, Please share!