Setting up Kafka with zookeeper

[Mich Talebzadeh <mi...@gmail.com>]

Hi,

In DEV, Kafka and Zookeeper services can be co- located on the same
physical hosts

In Prod moving forward do we need to set up Zookeeper on its own cluster
not sharing with Hadoop cluster? Can these services be shared within the
Hadoop cluster?

Additionally if there many topics for Kafka what would be an optimum setup
specifically with separation of hard disks

How best to set up Zookeeper that is needed for Kafka for use with Spark
Streaming?

In the diagram below

[image: Inline images 1]

there is one topic "My Topic". How would there be if you have multiple
topics. Wouk there be one set of partitions for each topic, say for two
topics there will be 6 patitions?

Thanks


Dr Mich Talebzadeh



LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*



http://talebzadehmich.wordpress.com


*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.