Learn how to send and receive some messages in a test Kafka topic running locally on a machine.
- [Instructor] Now, let's take a look at using Kafka…to send and receive messages.…So, what we need to do is have a couple more…terminal windows here…and in one, what we're going to have is the producer…and in the other one we'll have the consumer.…And then we'll type messages into one…and see it pop up in the other window.…So, we already have Zookeeper running…and Kafka server running in the background.…And I'm going to minimize this just for now,…so we have more real estate to work with here.…Now, we created a topic for test.…
And so, what I want to do first is…just run the producer by calling the script file…that Kafka gives us.…And I'll just copy this from the exercise files here.…Now with that running, anything I type into this command…will actually be sent into my Kafka cluster.…But in order to make sense of that,…I'm going to create a new terminal window here,…I'm going to open up a new one.…And just below it, what I'll do is…I will set up the consumer.…That way, any messages I type in,…you'll see them instantly pop into the consumer.…
- Understanding the Kafka log
- Creating topics
- Partitioning topics across brokers
- Installing and testing Kafka locally
- Sending and receiving messages
- Setting up a multibroker cluster
- Testing fault tolerance
Skill Level Intermediate
Transitioning from Data Warehousing to Big Datawith Alan Simon1h 50m Intermediate
Big Data Foundations: Program Managementwith Alan Simon1h 11m Intermediate
1. Why Use Kafka?
2. Core Concepts
4. Installing and Testing Kafka Locally
5. Real-World Examples
6. Distributions and Packaging
Next steps1m 4s
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.Cancel
Take notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.