Big Data Tech presents FREE ONLINE WEBINARS
Join our online webinars, during which, we will focus on the Big Data, Real Streaming, Apache Kafka, Flink, SQL and many matters around those subjects!
Through the online meetings, we will prepare for this year's conference and gain some practical knowledge. This is a chance to meet online! Take part in our competition during the meetings and win an invitation to the Big Data Technology Summit 2022 and access to the recordings from the last edition! Information, agenda and registration below.
Real-time streaming webinar
During this meeting we will talk about the Apache Kafka and Flink: Stateful Streaming Data Pipelines made easy with SQL and Stream Processing with Apache Flink.
Take a part in our competition and WIN an invitation to the Big Data Technology Summit 2022 and access to the recordings from the last edition!
14.50 – 15.00 Introduction and presentation of experts
GetInData | Part of Xebia
15.00 – 15.30 Apache Kafka and Flink: Stateful Streaming Data Pipelines made easy with SQL
A stateful streaming data pipeline needs both a solid base and an engine to drive the data. Apache Kafka is an excellent choice for storing and transmitting high throughput and low latency messages. Apache Flink adds the cherry on top with a distributed stateful compute engine available in a variety of languages, including SQL. In this session we'll explore how Apache Flink operates in conjunction with Apache Kafka to build stateful streaming data pipelines, and the problems we can solve with this combination. We will explore Flink's SQL client, showing how to define connections and transformations with the most known and beloved language in the data industry. This session is aimed at data professionals who want to reduce the barrier to streaming data pipelines by making them configurable as set of simple SQL commands.
15.30 – 15.40 Q&A Session
15.40 – 16.10 Flink's Table & DataStream API: A Perfect Symbiosis
The Table API is not a new kid on the block. But the community has worked hard on reshaping its future. Today, it is one of the core abstractions in Flink next to the DataStream API. The Table API can deal with bounded and unbounded streams in a unified and highly optimized ecosystem inspired by databases and SQL. Various connectors and catalogs integrate with the outside world. But this doesn't mean that the DataStream API will become obsolete any time soon. In this talk, we would like to demo what Table API is capable of today. We present how the API solves different scenarios: as a batch processor, a changelog processor, or a streaming ETL tool with many built-in functions and operators for deduplicating, joining, and aggregating data. We discuss the main differences between Table and DataStream APIs and elaborate on their preferred usage. We also show hybrid pipelines in which both APIs interact in symbiosis and contribute their unique strengths.
16.10 – 16.20 Q&A Session
16.20 – 16.30 – The annouoncement of the competition winners!