You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by RK <pr...@yahoo.com.INVALID> on 2015/01/01 20:26:04 UTC

Incorrect information in the UI about data received by KafkaReceiver???

I have a job running with kafkaReceiverCount set to 1 and numThreads set to 1.
    val kafkaDStreams = (1 to kafkaReceiverCount.toInt).map { _ =>      KafkaUtils.createStream(ssc, zkQuorum, group, Map(topic -> numThreads.toInt)).map(_._2)    }

In the spark stages page, I see different stages reading and writing data.


However, in the streaming information page it says that the KafkaReceiver is not getting any records.


Why is this discrepancy happening?
Thanks,RK