Learn about the Confluent platform and how it's related to Kafka.
- [Instructor] Now, I can't leave here without mentioning Confluent. They are a company that was founded by the people that invented Kafka, and they've created a new open source platform that does all the things that Kafka does with some additional bits added. Now, they have two versions of the platform. There's the free version, which is the community, the open source version. And then they have the enterprise version. They upload some really features too, that a lot of people seem to like when running Kafka. And first here is the Confluent Control Center.
This is something that lets you dive into your partitions, and your brokers, and your topics, and see what's going on with all of them. You can set up your connections, and you can kind of have this really good admin panel in the Confluent Control Center. Another big thing that they offer is the Multi-Datacenter Replication. As I mentioned earlier in the course, this is a challenge, especially when you need to have analytics across both data centers, and you need to have a really high throughput, and if these things are separated by large geographic areas, it can cause some problems with the operations.
So, they built into their platform, have a way to help you with this Multi-Datacenter Replication. Of course, they make their money on Professional Services, so they offer training, support, and setup, and all those kinds of things. They'll certify your install, and get everything going for you. So, if you're an enterprise, and you need to get going with this quickly, and maybe you don't have all the time to hire new people, or train everybody right now, you can hire them, and they'll get you going from the ground up. They'll get everything you need setup, so you can start running with streaming analytics.
They also have something really interesting, which are these Certified Connectors. Now, as I mentioned earlier in the course, one of the ways that you want to pull data in, and we looked at this as well. One of the ways you want to pull data into your Kafka cluster is using these connectors, that way, it's listening for changes to something like a MySQL database, and anytime those changes occur, it automatically pulls them in, and then you can send them out. You can log them. You can do what you need to do with them. So they have a bunch of connectors that they've built, which are certified by them, and that they offer support for.
So, if you are running any of these additional services, you probably aren't going to want to build these connectors yourself. You can use theirs, if you choose the Confluent platform. And as you can see there, quite number of them here available to you. Now, the last thing I'll point you at when it comes to Confluent is their comparison page, and the page here shows you the difference between just regular Kafka, the open source version of Confluent, and the enterprise version of Confluent. So if you're a company, and you're looking at streaming analytics as a new way to advance your applications and your products and services, I highly recommend that you explore their webpage, and try to learn as much as you can about it, before you get too far along in the decision-making process.
- Understanding the Kafka log
- Creating topics
- Partitioning topics across brokers
- Installing and testing Kafka locally
- Sending and receiving messages
- Setting up a multibroker cluster
- Testing fault tolerance