Learn the steps needed to set up state variables in Apache Flink. Use Flink context for restoring states.
- [Instructor] In this video, I will show you … how to set up stateful operations in Flink. … The code for this example … is in the StatefulOperations class … under the Chapter Five package. … In this example, we again use CSV file stream … and create an auditTrailStr object. … The goal for this exercise … is to make sure the time interval … within two delete operations by the same user. … If the two deletes happen … within 10 seconds for the same user, … we then send an alert event. … For this, we first convert the auditTrailStr … to an auditTrailState tuple. … We only keep the user, the operation, … and the time stamp for this exercise. … Next, we use a keyBy operation by the user … to create keys on a user basis. … In order to use state, … we need to use the RichMailFunction, … as it provides access to the initial open function … for setting up the state. … This function will walk through each event … and manage state on a per-user basis. … For tracking delete operation time stamps, …
- Streaming with Apache Flink
- Using the DataStream API for basic stream processing
- Working with process functions
- Windowing and joins
- Setting up event-time processing
- State management in Flink
Skill Level Advanced
1. Apache Flink
2. DataStream API
4. Event Time Processing
5. State Management
6. Use Case Project
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.Cancel
Take notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.