You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Deegue (JIRA)" <ji...@apache.org> on 2018/06/29 03:06:00 UTC
[jira] [Reopened] (SPARK-24672) No job is running but there are
active tasks
[ https://issues.apache.org/jira/browse/SPARK-24672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Deegue reopened SPARK-24672:
----------------------------
Coditions to this issue:
When the amount of data I selected is larger than spark.driver.maxResultSize , It returns the info below and the job failed automatically .
!image4.png!
After that , there are several active tasks remain that occupy executors.
!image2.png!
Thanks a lot for your comment.
> No job is running but there are active tasks
> --------------------------------------------
>
> Key: SPARK-24672
> URL: https://issues.apache.org/jira/browse/SPARK-24672
> Project: Spark
> Issue Type: Bug
> Components: Optimizer, Spark Core, SQL
> Affects Versions: 2.2.1
> Environment: hadoop 2.6.0
> spark 2.2.1
> CDH 5.8.3
> java 1.8.0
>
> More info :
> image1.png in Attachments
> Reporter: Deegue
> Priority: Major
> Attachments: image1.png, image2.png, image3.png, image4.png
>
> Original Estimate: 120h
> Remaining Estimate: 120h
>
> Issues:
>
> There are active tasks while no job is running.
> These active tasks occupy the executors(resources) , and I don't know why they haven't been killed or stopped after its jobs failed.
>
> More info :
> image2.png & image3.png in Attachments
>
> I'd be very appreciated it if anyone can help me...
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org