From the course: Apache Flink: Real-Time Data Engineering
Join today to access over 22,600 courses taught by industry experts or purchase this course individually.
ProcessFunction - Flink Tutorial
From the course: Apache Flink: Real-Time Data Engineering
ProcessFunction
- [Instructor] In this video, we will discuss concepts around Process Functions, Context and Side Outputs. We will use them in examples in our later videos. What is a Process Function. A Process Function is a low-level processing function. Operators like Map and Filter are high-level functions that provide out-of-the-box functionality but limited flexibility. On the other hand, a Process Function provides more flexibility and access to more resources, but needs more coding effort. It provides access to Events, State management elements, Timers and Side outputs. It helps add custom controls in stream processing. Flink has the concept of a Runtime Context, that keeps track of active elements in the processing stream. The Process function provides access to the runtime context. The runtime context contains access to Accumulators, Broadcast variables, Cache, Configuration elements and State elements. Most of these are advanced…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.