13. KAFKA : Sample Program11 : Cluster Mirroring

13. KAFKA : Sample Program11 : Cluster Mirroring

Cluster Mirroring

#############################

- Cluster1 - Cluster2 (copy of cluster1)

3 Options we can do mirroring

-------------------------------

1. from 3 kafka cluster -> pour to central cluster for analysis

2. exact copy of another

3. /bin/kafka-mirroring.sh

create copy zookeeper.properties -> zookeeper1.properties

clientPort=2182

create copy of server.properties  -> serverzoo2.properties

listeners=PLAINTEXT://:9095

zookeeper.connect=localhost:2182

cd kafka_2.12-2.2.1

bin/zookeeper-server-start.sh config/zookeeper1.properties

bin/kafka-server-start.sh config/serverzoo2.properties

bin/kafka-topics.sh --zookeeper localhost:2182 --create --topic MyNewClusterTopic --partitions 3 --replication-factor 1

bin/kafka-topics.sh --zookeeper localhost:2182 --list 

bin/zookeeper-shell.sh localhost:2182

ls /brokers/ids

ls /brokers

ls /brokers/topics