You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@atlas.apache.org by Jiaxin Ye <ji...@airbnb.com> on 2019/10/28 19:06:06 UTC

Does the partition of Kafka for Atlas have to be 1?

Hi All,

 

I am setting up the Atlas server with Kafka as the notification queue. From the code, it seems that the number of kafka partition has to be 1 to guarantee sequencing.  How does it scale if there is too many message that needs to be sent to the Kafka topic? My current use case is around 50 QPS. It does not seem the Atlas server can keep up with that through put.

 

Thanks,

Jiaxin