Use a Flink transformation and aggregation pipeline to compute summary counts as required by the use case problem. Review the recommended solution.
- [Narrator] In this video, I will show you how to solve … the first problem in the use case. … Namely the by user, by action, … total counts every 10 seconds. … The code for this exercise is available … under the chapter six package. … First, let's look at the browser data stream generator. … This code is similar to the file stream data generator … we used earlier in the course. … We use a random generator to pick the user name … as well as the operation. … This is based on a list of available values. … We also use randomly paced timestamps. … The data directory for this would be … the Rob browser events directory. … Let's now review the code inside … the course use case class. … We read CSV files … from the Rob browser events directory. … We read them as a data stream of strings. … We then convert this data stream into … a couple of three attributes, … namely the user, the action, and the timestamp. … To compute the ten second summary, … we first run it through a map operation to get the user, …
- Streaming with Apache Flink
- Using the DataStream API for basic stream processing
- Working with process functions
- Windowing and joins
- Setting up event-time processing
- State management in Flink
Skill Level Advanced
1. Apache Flink
2. DataStream API
4. Event Time Processing
5. State Management
6. Use Case Project
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.Cancel
Take notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.