[jira] [Created] (SPARK-16541) SparkTC application could not shutdown successfully

["Yesha Vora (JIRA)" <ji...@apache.org>]

Yesha Vora created SPARK-16541:
----------------------------------

             Summary:  SparkTC application could not shutdown successfully
                 Key: SPARK-16541
                 URL: https://issues.apache.org/jira/browse/SPARK-16541
             Project: Spark
          Issue Type: Bug
    Affects Versions: 2.0.0
            Reporter: Yesha Vora


SparkTC application in yarn-client mode was stuck at 10% progress.
{code} spark-submit  --class org.apache.spark.examples.SparkTC --master yarn-client spark-examples-assembly_*.jar {code}

It seems like SparkTC application tasks finished and printed "TC has 6254 edges.". after that while shutting down, spark application kept getting "ERROR LiveListenerBus: SparkListenerBus has already stopped! Dropping event SparkListenerExecutorMetricsUpdate"

{code}
16/07/13 08:43:37 INFO DAGScheduler: ResultStage 283 (count at SparkTC.scala:71) finished in 42.357 s
16/07/13 08:43:37 INFO DAGScheduler: Job 13 finished: count at SparkTC.scala:71, took 43.137408 s
TC has 6254 edges.
16/07/13 08:43:37 INFO ServerConnector: Stopped ServerConnector@5e0054a2{HTTP/1.1}{0.0.0.0:4040}
16/07/13 08:43:37 INFO ContextHandler: Stopped o.s.j.s.ServletContextHandler@7350a22{/stages/stage/kill,null,UNAVAILABLE}
16/07/13 08:43:37 INFO ContextHandler: Stopped o.s.j.s.ServletContextHandler@54d56a49{/api,null,UNAVAILABLE}
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org