You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2020/12/17 09:40:00 UTC

[jira] [Resolved] (SPARK-33816) Make stateful operations reuse previous state store

     [ https://issues.apache.org/jira/browse/SPARK-33816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

L. C. Hsieh resolved SPARK-33816.
---------------------------------
    Resolution: Invalid

> Make stateful operations reuse previous state store
> ---------------------------------------------------
>
>                 Key: SPARK-33816
>                 URL: https://issues.apache.org/jira/browse/SPARK-33816
>             Project: Spark
>          Issue Type: Improvement
>          Components: Structured Streaming
>    Affects Versions: 3.2.0
>            Reporter: L. C. Hsieh
>            Assignee: L. C. Hsieh
>            Priority: Major
>
> Currently Spark SS can schedule stateful operations to active state store locations. For some reasons, Spark might not be able to schedule tasks to active state store locations. In the case, we should be able to schedule the tasks to sub-optimal locations.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org