You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by bsikander <be...@gmail.com> on 2018/07/29 18:56:38 UTC

[SparkContext] will application immediately stop after sc.stop()?

Is it possible that a job keeps on running for some time after
onApplicationEnd is fired?

For example,
I have a spark job which has 10 batches still to process and let's say that
the processing them will take 10 minutes. If I execute sparkContext.stop(),
I will receive onApplicationEnd immediately according to  this code
<https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/SparkContext.scala#L1902> 
. But after receiving the event, will my spark job still continue to run for
10 minutes and finish the batch execution?



--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org