You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2019/04/05 20:01:00 UTC
[jira] [Assigned] (SPARK-27391) deadlock in ContinuousExecution
unit tests
[ https://issues.apache.org/jira/browse/SPARK-27391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun reassigned SPARK-27391:
-------------------------------------
Assignee: Jose Torres
> deadlock in ContinuousExecution unit tests
> ------------------------------------------
>
> Key: SPARK-27391
> URL: https://issues.apache.org/jira/browse/SPARK-27391
> Project: Spark
> Issue Type: Bug
> Components: Structured Streaming
> Affects Versions: 2.4.0
> Reporter: Jose Torres
> Assignee: Jose Torres
> Priority: Major
> Fix For: 3.0.0
>
>
> ContinuousExecution (in the final query execution phrase) holds the lazy val lock of its IncrementalExecution for the entire duration of the (indefinite length) job. This can cause deadlocks in unit tests, which hook into internal APIs and try to instantiate other lazy vals.
>
> (Note that this should not be able to affect production.)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org