Kafka architecture

- [Instructor] To understand just a bit more…about core Kafka architecture,…take a look at this drawing…and consider some of the key features.…So, Kafka clusters, as I mentioned previously,…generally consist of multiple servers…with multiple processes.…They are associated to consumer groups…who also have multiple processes running on them.…Now, some of the features of Kafka…make it really appealing as an ingest pipeline…for modern Hadoop architectures.…

Those include both Pub/Sub and message queuing.…Many of the ingest services offer only Pub/Sub,…like Google Cloud Pub/Sub,…or only queuing, such as message queuing services.…In addition, in using Kafka,…you have guarantees around in-order messages,…fault tolerance, and of course, support for streaming.…For more information about Kafka,…I found a great resource to be the core Kafka Apache site.…You can go to this link to get to that site…and see examples and more information…about setting up Kafka.…