You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Jing Zhan (Jira)" <ji...@apache.org> on 2024/03/12 17:14:00 UTC

[jira] [Created] (SPARK-47363) Initial State without state reader implementation for State API v2.

Jing Zhan created SPARK-47363:
---------------------------------

             Summary: Initial State without state reader implementation for State API v2.
                 Key: SPARK-47363
                 URL: https://issues.apache.org/jira/browse/SPARK-47363
             Project: Spark
          Issue Type: Task
          Components: Structured Streaming
    Affects Versions: 4.0.0
            Reporter: Jing Zhan


This PR adds support for users to provide a Dataframe that can be used to instantiate state for the query in the first batch for arbitrary state API v2.

Note that populating the initial state will only happen for the first batch of the new streaming query. Trying to re-initialize state for the same grouping key will result in an error.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org