You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Guozhang Wang (JIRA)" <ji...@apache.org> on 2016/04/27 23:03:12 UTC

[jira] [Updated] (KAFKA-3113) Kafka simple consumer inconsistent result

     [ https://issues.apache.org/jira/browse/KAFKA-3113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Guozhang Wang updated KAFKA-3113:
---------------------------------
    Component/s:     (was: streams)

> Kafka simple consumer inconsistent result
> -----------------------------------------
>
>                 Key: KAFKA-3113
>                 URL: https://issues.apache.org/jira/browse/KAFKA-3113
>             Project: Kafka
>          Issue Type: Bug
>            Reporter: Goutam Chowdhury
>
> I am trying to read kafka messages using spart api in batch mode.To achieve  
> this , I need start and last offset of the mentioned topic. To get start and last offset I am creating simple consumer with below code
> -----------------------------------------------------------------------------------------
> var consumer = new SimpleConsumer(seedBroker, seedBrokerPort, 100000, 64 * 1024, clientName);
> var topicAndPartition = new TopicAndPartition(topic, partition.toInt)
> var requestInfo = new HashMap[TopicAndPartition,PartitionOffsetRequestInfo];
>  requestInfo.put(topicAndPartition, new PartitionOffsetRequestInfo(whichTime, 1))
>  logger.info("requestInfo - " + requestInfo);
> var request = new kafka.javaapi.OffsetRequest(requestInfo, OffsetRequest.CurrentVersion, clientName);
> var response =consumer.getOffsetsBefore(request);
> -------------------------------------------------------------------
> I am using BIG IP addresses for seed broker  which actually has four brokers . Now if I do spark submit then some times it get exception with below response 
> response - OffsetResponse(0,Map([ecp.demo.patents.control,0] -> error: kafka.common.UnknownTopicOrPartitionException offsets: ))
> but some time i get proper response..... could anybody explain why it is like that? 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)