You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2019/05/21 22:03:00 UTC
[jira] [Reopened] (SPARK-20547) ExecutorClassLoader's findClass may
not work correctly when a task is cancelled.
[ https://issues.apache.org/jira/browse/SPARK-20547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shixiong Zhu reopened SPARK-20547:
----------------------------------
Assignee: Shixiong Zhu
> ExecutorClassLoader's findClass may not work correctly when a task is cancelled.
> --------------------------------------------------------------------------------
>
> Key: SPARK-20547
> URL: https://issues.apache.org/jira/browse/SPARK-20547
> Project: Spark
> Issue Type: Bug
> Components: Spark Shell
> Affects Versions: 2.1.0, 2.2.0
> Reporter: Shixiong Zhu
> Assignee: Shixiong Zhu
> Priority: Minor
> Labels: bulk-closed
>
> ExecutorClassLoader's findClass may throw some transient exception. For example, when a task is cancelled, if ExecutorClassLoader is running, you may see InterruptedException or IOException, even if this class can be loaded. Then the result of findClass will be cached by JVM, and later when the same class is being loaded (note: in this case, this class may be still loadable), it will just throw NoClassDefFoundError.
> We should make ExecutorClassLoader retry on transient exceptions.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org