From the course: Apache Flink: Real-Time Data Engineering
Join today to access over 22,600 courses taught by industry experts or purchase this course individually.
Merging multiple streams - Flink Tutorial
From the course: Apache Flink: Real-Time Data Engineering
Merging multiple streams
- [Instructor] In the next video, I will show you how to combine two streams of different formats with the connect operator. Please note that this is a real time streaming scenario, the content of two streams are not deterministic and cannot be assumed to have any kind of synchronization. Hence, a real horizontal combine like a SQL join type operation is not possible unless there is a window. But we can combine two streams vertically using the connect operator. For this example, we will use the data streams we created in the earlier example. Customer trail and sales rep trail. Both streams are of different formats. One is a POJO object called audit trail and the other is a tuple. We can combine them together and push them in the same format using the connect function. We use the connect function on the first data stream to connect it to the second data stream and deliver a connected streams object called merge trail.…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.