You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Jose Torres (JIRA)" <ji...@apache.org> on 2019/04/05 19:58:00 UTC
[jira] [Resolved] (SPARK-27391) deadlock in ContinuousExecution
unit tests
[ https://issues.apache.org/jira/browse/SPARK-27391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jose Torres resolved SPARK-27391.
---------------------------------
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24301
[https://github.com/apache/spark/pull/24301]
> deadlock in ContinuousExecution unit tests
> ------------------------------------------
>
> Key: SPARK-27391
> URL: https://issues.apache.org/jira/browse/SPARK-27391
> Project: Spark
> Issue Type: Bug
> Components: Structured Streaming
> Affects Versions: 2.4.0
> Reporter: Jose Torres
> Priority: Major
> Fix For: 3.0.0
>
>
> ContinuousExecution (in the final query execution phrase) holds the lazy val lock of its IncrementalExecution for the entire duration of the (indefinite length) job. This can cause deadlocks in unit tests, which hook into internal APIs and try to instantiate other lazy vals.
>
> (Note that this should not be able to affect production.)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org