[jira] [Assigned] (SPARK-46731) Do not register state store provider into coordinator in state data source - reader

["Jungtaek Lim (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-46731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jungtaek Lim reassigned SPARK-46731:
------------------------------------

    Assignee: Jungtaek Lim

> Do not register state store provider into coordinator in state data source - reader
> -----------------------------------------------------------------------------------
>
>                 Key: SPARK-46731
>                 URL: https://issues.apache.org/jira/browse/SPARK-46731
>             Project: Spark
>          Issue Type: Improvement
>          Components: Structured Streaming
>    Affects Versions: 4.0.0
>            Reporter: Jungtaek Lim
>            Assignee: Jungtaek Lim
>            Priority: Major
>              Labels: pull-request-available
>
> Currently we initialize state store instance via StateStore.get() which initializes state store provider instance and registers the provider instance to the coordinator. This involves unnecessary overheads e.g. maintenance task could be triggered for this provider.
> The state data source should just initialize the provider and manage the provider instance by itself.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org