You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Attila Zsolt Piros (Jira)" <ji...@apache.org> on 2022/10/03 13:32:00 UTC
[jira] [Resolved] (SPARK-40617) Assertion failed in ExecutorMetricsPoller "task count shouldn't below 0"
[ https://issues.apache.org/jira/browse/SPARK-40617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Attila Zsolt Piros resolved SPARK-40617.
----------------------------------------
Fix Version/s: 3.4.0
3.3.1
Resolution: Fixed
Issue resolved by pull request 38056
https://github.com/apache/spark/pull/38056
> Assertion failed in ExecutorMetricsPoller "task count shouldn't below 0"
> ------------------------------------------------------------------------
>
> Key: SPARK-40617
> URL: https://issues.apache.org/jira/browse/SPARK-40617
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 3.2.0, 3.2.1, 3.3.0, 3.2.2
> Reporter: Attila Zsolt Piros
> Assignee: Attila Zsolt Piros
> Priority: Major
> Fix For: 3.4.0, 3.3.1
>
>
> Spurious failures because of the assert:
> {noformat}
> 22/09/29 09:46:24 ERROR SparkUncaughtExceptionHandler: Uncaught exception in thread Thread[Executor task launch worker for task 3063.0 in stage 1997.0 (TID 677249),5,main]
> java.lang.AssertionError: assertion failed: task count shouldn't below 0
> at scala.Predef$.assert(Predef.scala:223)
> at org.apache.spark.executor.ExecutorMetricsPoller.decrementCount$1(ExecutorMetricsPoller.scala:130)
> at org.apache.spark.executor.ExecutorMetricsPoller.$anonfun$onTaskCompletion$3(ExecutorMetricsPoller.scala:135)
> at java.base/java.util.concurrent.ConcurrentHashMap.computeIfPresent(ConcurrentHashMap.java:1822)
> at org.apache.spark.executor.ExecutorMetricsPoller.onTaskCompletion(ExecutorMetricsPoller.scala:135)
> at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:737)
> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:829)
> 22/09/29 09:46:24 INFO MemoryStore: MemoryStore cleared
> 22/09/29 09:46:24 INFO BlockManager: BlockManager stopped
> 22/09/29 09:46:24 INFO ShutdownHookManager: Shutdown hook called
> 22/09/29 09:46:24 INFO ShutdownHookManager: Deleting directory /mnt/yarn/usercache/hadoop/appcache/application_1664443624160_0001/spark-93efc2d4-84de-494b-a3b7-2cb1c3a45426
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org