You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Guozhang Wang (JIRA)" <ji...@apache.org> on 2016/04/27 23:03:12 UTC
[jira] [Updated] (KAFKA-3113) Kafka simple consumer inconsistent
result
[ https://issues.apache.org/jira/browse/KAFKA-3113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Guozhang Wang updated KAFKA-3113:
---------------------------------
Component/s: (was: streams)
> Kafka simple consumer inconsistent result
> -----------------------------------------
>
> Key: KAFKA-3113
> URL: https://issues.apache.org/jira/browse/KAFKA-3113
> Project: Kafka
> Issue Type: Bug
> Reporter: Goutam Chowdhury
>
> I am trying to read kafka messages using spart api in batch mode.To achieve
> this , I need start and last offset of the mentioned topic. To get start and last offset I am creating simple consumer with below code
> -----------------------------------------------------------------------------------------
> var consumer = new SimpleConsumer(seedBroker, seedBrokerPort, 100000, 64 * 1024, clientName);
> var topicAndPartition = new TopicAndPartition(topic, partition.toInt)
> var requestInfo = new HashMap[TopicAndPartition,PartitionOffsetRequestInfo];
> requestInfo.put(topicAndPartition, new PartitionOffsetRequestInfo(whichTime, 1))
> logger.info("requestInfo - " + requestInfo);
> var request = new kafka.javaapi.OffsetRequest(requestInfo, OffsetRequest.CurrentVersion, clientName);
> var response =consumer.getOffsetsBefore(request);
> -------------------------------------------------------------------
> I am using BIG IP addresses for seed broker which actually has four brokers . Now if I do spark submit then some times it get exception with below response
> response - OffsetResponse(0,Map([ecp.demo.patents.control,0] -> error: kafka.common.UnknownTopicOrPartitionException offsets: ))
> but some time i get proper response..... could anybody explain why it is like that?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)