Learn how to create a local file and import it into a Kafka topic using the standard connector.
- [Instructor] Now, we've just been using…the terminal window itself to send data through Kafka,…but often what you're going to do is need to set up connectors…that look for changes to things, whether it be a database,…or a flat file, and it will automatically pull those in.…So that's what we're going to do here,…we're going to import and export some data into Kafka…using a connector.…I'll start by opening up a new terminal window,…I'm going to resize it a little bit, so you can see it there.…Now I just want to create a file here, so I'll just say…echo -e, foo, backslash n for new line, and bar.…
So it's going to be two lines, foo and bar.…And I'll send this over to test.txt file.…Now we need to set up a connector, and point it at that.…So I'm going to jump over to where I have Kafka running,…in the Downloads folder.…And in fact, I'm going to copy that file…back from my main directory, into this one here.…Just to check and see it's there,…you can see I have test.txt, there we go.…
So now that we have our file setup,…
- Understanding the Kafka log
- Creating topics
- Partitioning topics across brokers
- Installing and testing Kafka locally
- Sending and receiving messages
- Setting up a multibroker cluster
- Testing fault tolerance
Skill Level Intermediate
Transitioning from Data Warehousing to Big Datawith Alan Simon1h 50m Intermediate
Big Data Foundations: Program Managementwith Alan Simon1h 11m Intermediate
1. Why Use Kafka?
2. Core Concepts
4. Installing and Testing Kafka Locally
5. Real-World Examples
6. Distributions and Packaging
Next steps1m 4s
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.Cancel
Take notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.