You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "t7s (JIRA)" <ji...@apache.org> on 2016/03/14 07:04:33 UTC
[jira] [Created] (SPARK-13851) spark streaming web ui remains
completed jobs as active jobs
t7s created SPARK-13851:
---------------------------
Summary: spark streaming web ui remains completed jobs as active jobs
Key: SPARK-13851
URL: https://issues.apache.org/jira/browse/SPARK-13851
Project: Spark
Issue Type: Bug
Components: Streaming
Affects Versions: 1.4.1
Environment: yarn 2.3.0-cdh5.1.0
Reporter: t7s
Priority: Minor
!http://apache-spark-user-list.1001560.n3.nabble.com/file/n26474/34%E5%B1%8F%E5%B9%95%E6%88%AA%E5%9B%BE.png!
env: yarn 2.3.0-cdh5.1.0
--master yarn-cluster
--conf "spark.driver.cores=2"
--conf "spark.akka.threads=16"
I am sure these job completed according to the log
For example, job 9816
This is info about job 9816 in log:
[2016-03-14 07:15:05,088] INFO Job 9816 finished: transform at ErrorStreaming2.scala:396, took 8.218500 s (org.apache.spark.scheduler.DAGScheduler)
Stages in job 9816 are completed too according to the log
But job 9816 is still in active job of web ui, why?
How can I clear these remaining jobs?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org