You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by Paul Mackles <pm...@adobe.com> on 2015/02/13 22:02:58 UTC

MetadataRequest vs Zookeeper

I noticed that the standard Kafka storm spout gets topic metadata from zookeeper (under "/brokers/topics/") instead of issuing MetadataRequests to one of the brokers. Aside from possible encapsulation issues, are there any other downsides to using ZK this way? Are there significant cases where ZK can be out-of-sync with the brokers?


I can see that the high-level consumer gets is topic metadata by issuing MetadataRequests? to the brokers so I always assumed that was preferred.


Thanks,

Paul

Re: MetadataRequest vs Zookeeper

Posted by Harsha <ka...@harsha.io>.

Paul,
         There is ongoing work to move to Kafka API instead of making
         calls to zookeeper. 
Here is the JIRA https://issues.apache.org/jira/browse/STORM-650 .
-Harsha

On Fri, Feb 13, 2015, at 01:02 PM, Paul Mackles wrote:
> I noticed that the standard Kafka storm spout gets topic metadata from
> zookeeper (under "/brokers/topics/") instead of issuing MetadataRequests
> to one of the brokers. Aside from possible encapsulation issues, are
> there any other downsides to using ZK this way? Are there significant
> cases where ZK can be out-of-sync with the brokers?
> 
> 
> I can see that the high-level consumer gets is topic metadata by issuing
> MetadataRequests? to the brokers so I always assumed that was preferred.
> 
> 
> Thanks,
> 
> Paul
> 
>