You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Wenchen Fan (Jira)" <ji...@apache.org> on 2025/04/01 09:48:00 UTC

[jira] [Resolved] (SPARK-51668) Collect metrics for data source V2 in case the command fails

     [ https://issues.apache.org/jira/browse/SPARK-51668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wenchen Fan resolved SPARK-51668.
---------------------------------
    Fix Version/s: 4.0.0
       Resolution: Fixed

Issue resolved by pull request 50413
[https://github.com/apache/spark/pull/50413]

> Collect metrics for data source V2 in case the command fails
> ------------------------------------------------------------
>
>                 Key: SPARK-51668
>                 URL: https://issues.apache.org/jira/browse/SPARK-51668
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 4.0.0
>            Reporter: Jan-Ole Sasse
>            Assignee: Jan-Ole Sasse
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.0.0
>
>
> If a data source V2 write fails the commit, all the metrics collected up to this point are lost because they are not posted to the drive. We should make sure metrics that have been collected are reported.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org