You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Hudong Wang <ju...@hotmail.com> on 2015/12/03 23:41:06 UTC

consumergroup not working

Hi, I am trying to read data from kafka in zookeeper mode with following code.
    val kafkaParams = Map[String, String] (      "zookeeper.connect" -> zookeeper,      "metadata.broker.list" -> brokers,      "group.id" -> consumerGroup,      "auto.offset.reset" -> autoOffsetReset    )
    return KafkaUtils.createStream[String, String, kafka.serializer.StringDecoder, kafka.serializer.StringDecoder](        ssc,        kafkaParams,        Map(topic -> 1),        StorageLevel.MEMORY_AND_DISK_SER_2)
I specified the group.id but in zookeeper I don't see my consumer group, though I see other people's consumer groups. 
Did I do something wrong in my code? Is there any way I can troubleshoot?
Thanks,Tony