You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/07/21 00:23:00 UTC

[jira] [Resolved] (SPARK-44252) Add error class for the case when loading state from DFS fails

     [ https://issues.apache.org/jira/browse/SPARK-44252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jungtaek Lim resolved SPARK-44252.
----------------------------------
    Fix Version/s: 4.0.0
       Resolution: Fixed

Issue resolved by pull request 41705
[https://github.com/apache/spark/pull/41705]

> Add error class for the case when loading state from DFS fails
> --------------------------------------------------------------
>
>                 Key: SPARK-44252
>                 URL: https://issues.apache.org/jira/browse/SPARK-44252
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Spark Core, SQL
>    Affects Versions: 3.2.0
>            Reporter: Lucy Yao
>            Assignee: Lucy Yao
>            Priority: Major
>             Fix For: 4.0.0
>
>
> This is part of [https://github.com/apache/spark/pull/41705.]
> Wrap the exception during the loading state, to assign error class properly. With assigning error class, we can classify the errors which help us to determine what errors customers are struggling much. StateStoreProvider.getStore() & StateStoreProvider.getReadStore() is the entry point.
> This ticket also covers failedToReadDeltaFileError and failedToReadSnapshotFileError from [https://issues.apache.org/jira/browse/SPARK-36305|http://example.com/].



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org