You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by sathyanarayanan mudhaliyar <sa...@gmail.com> on 2017/03/13 04:31:15 UTC

spark-streaming stopping

 I am not able to stop Spark-streaming job.
Let me explain briefly
* getting data from Kafka topic
* splitting data to create a JavaRDD
* mapping the JavaRDD to JavaPairRDD to do a reduceByKey transformation
* writing the JavaPairRDD into the C* DB   // something going wrong here
    the message in the Kafka topic is exhausted but still the program is
running, the staging is happening though there is no data from Kafka, so
when I tried to kill the program manually there was no output into the
database C*.