Learn how to set up a multibroker cluster on a local machine, simulating a more realistic environment.
- [Instructor] Now we're going to get…a little but more advanced…and set up a multi broker cluster.…And this is a more real world scenario,…whereas before we were just really looking at the basic ways…of sending messages through Kafka and how to set that up.…So I already have Zookeeper and Kafka running,…that's still going from earlier,…and what I want to do now is create some config files…to use for my different brokers.…So I'm going to open up a new terminal window.…Make that a little bit bigger so you can read it.…
So here what I want to do is create…new property files for each of my brokers.…And I'm going to copy those from the template…that is already in my config directory.…So make sure that you're in that directory,…so we need to go over, and if you were following along,…I have it in Downloads, and then Kafka.…And again, the version I'm using may be different…than the one you have.…So make sure you're just using…whatever that folder is where you extract that.…Now, under here I have a config folder.…And I can just copy this from there…
- Understanding the Kafka log
- Creating topics
- Partitioning topics across brokers
- Installing and testing Kafka locally
- Sending and receiving messages
- Setting up a multibroker cluster
- Testing fault tolerance
Skill Level Intermediate
Transitioning from Data Warehousing to Big Datawith Alan Simon1h 50m Intermediate
Big Data Foundations: Program Managementwith Alan Simon1h 11m Intermediate
1. Why Use Kafka?
2. Core Concepts
4. Installing and Testing Kafka Locally
5. Real-World Examples
6. Distributions and Packaging
Next steps1m 4s
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.Cancel
Take notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.