Why Kafka require zookeeper?

Kafka uses zookeeper to manage brokers. Kafka uses zookeeper

a.   To elect a Kafka Broker and topic partition pairs.

b.   Kafka uses zookeeper to get notifications, in case any new topic added, broker dies, any new broker added, any topic deleted etc.,

What is Zookeeper?

ZooKeeper is a centralised service for maintaining configuration information, naming, providing distributed synchronisation, and providing group services.

How Zookeeper works?

Zookeeper works on simple client-server principle. There are multiple servers that together form a zookeeper service, and client can use of the services provided by zookeeper.

When the zookeeper service started, one node from the server nodes elected as a leader. When a client issues write request, the server which receives this request, pass this request to leader node. Leader issues same write request to all the server nodes in zookeeper cluster.

Previous                                                    Next                                                    Home