Learn what auditing options are available in Kafka.
- [Narrator] Auditing is another thing…that you're going to want to pay close attention to…when running Kafka in a production environment.…And, when we're talking about auditing,…what we're talking about is verifying…that all the messages are being handled properly,…and making sure that they're being delivered…and they're being processed…and everything is in sync,…and you're not losing messages or losing data.…There are three types of auditing…that I'll talk about here,…but there are lots more options…that you can explore.…The first one is just the,…what is called Kafka Audit.…
And this is essentially a methodology…of creating an auditing system…that you roll yourself.…You roll your own.…Now, the way that works is…you have multiple data centers…and you use mirror maker to mirror essentially…the different messages going back and forth,…and then you use a third data center…to compare the results and see if what's happening…across those two data centers is in fact correct.…If it in fact does match up.…The second option I'll talk about here,…
- Understanding the Kafka log
- Creating topics
- Partitioning topics across brokers
- Installing and testing Kafka locally
- Sending and receiving messages
- Setting up a multibroker cluster
- Testing fault tolerance
Skill Level Intermediate
Transitioning from Data Warehousing to Big Datawith Alan Simon1h 50m Intermediate
Big Data Foundations: Program Managementwith Alan Simon1h 11m Intermediate
1. Why Use Kafka?
2. Core Concepts
4. Installing and Testing Kafka Locally
5. Real-World Examples
6. Distributions and Packaging
Next steps1m 4s
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.Cancel
Take notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.