You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/06/08 05:13:00 UTC
[jira] [Commented] (SPARK-35637) 2 active tasks shown in Spark UI
but executor core is 1 and task cpu is 1
[ https://issues.apache.org/jira/browse/SPARK-35637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359041#comment-17359041 ]
Kousuke Saruta commented on SPARK-35637:
----------------------------------------
Hmm, the cause seems task-result-getter thread runs asynchronously and post the task completion event.
> 2 active tasks shown in Spark UI but executor core is 1 and task cpu is 1
> -------------------------------------------------------------------------
>
> Key: SPARK-35637
> URL: https://issues.apache.org/jira/browse/SPARK-35637
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 3.0.2
> Reporter: L. C. Hsieh
> Priority: Minor
>
> We see an incorrect element on UI. We set executor core as 1, and task cpu as 1, but we sometimes see 2 active tasks for one executor in "Executors" tab on Spark UI.
> It seems to be UI-only issue, because from the event timeline diagram, two tasks are not actually run at the same time. The second one begins to run after first one finishes.
> Note that two tasks have very short duration 0.7s and 1s.
> So it looks like there is a delay on UI to reflect correct active tasks.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org