Learn how to execute a WordCount algorithm which operates on a data-stream instead of bound data.
- [Voiceover] So we've talked a lot about stream processing,…but we haven't really seen it in action yet.…So, I thought now we could run the built in word count…algorithm on a data stream.…Now that data stream here is going to come…from a file that we create.…So I want to make sure that I am in the directory…where I extracted Kafka earlier, so I'll just take a look.…Not there, so I'll go over to that directory.…Now I'm going to create a file in here,…which just has a few lines on it.…And I'm just going to pipe that out to you,…a new file called file dash input.…
From there what I need to do is create a new topic…that I'm going to use for my stream processing.…And I'm going to do this using the Kafka…Topics Script, which comes with it.…I'll tell it to create it where ZooKeeper's running…the replication factor of one in partitions of one.…I'm not really worried about the replication here,…just want to illustrate how this word count algorithm works.…Then for a name I'll call it streams-file-input.…So I'll just copy this into the command line here.…
- Understanding the Kafka log
- Creating topics
- Partitioning topics across brokers
- Installing and testing Kafka locally
- Sending and receiving messages
- Setting up a multibroker cluster
- Testing fault tolerance
Skill Level Intermediate
Transitioning from Data Warehousing to Big Datawith Alan Simon1h 50m Intermediate
Big Data Foundations: Program Managementwith Alan Simon1h 11m Intermediate
1. Why Use Kafka?
2. Core Concepts
4. Installing and Testing Kafka Locally
5. Real-World Examples
6. Distributions and Packaging
Next steps1m 4s
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.Cancel
Take notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.