You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by "castlv@163.com" <ca...@163.com> on 2015/07/25 02:59:53 UTC

Stop condition Spark reading from Kafka with ReliableKafkaReceiver

Hi All,
        Now I am writting a test code for reading messages from topic of Kafka,I used the ReliableKafkaReceiver,
However,when i created the KafkaInputDStream and store all received message in an foreachRDD action,I don't know when all the messages have been consumed comletely?
in other words, is there any API or methods I can use to check if all the messages are consumed?

Anyone can help me?

Any suggestions are welcome!

Best regards,

cast





castlv@163.com