You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "wypoon (via GitHub)" <gi...@apache.org> on 2025/05/31 19:40:52 UTC

Re: [PR] Spark 3.4: Fix RewriteDataFiles with partial progress enabled and max-failed-commits larger than total-file-group [iceberg]

wypoon commented on code in PR #12701:
URL: https://github.com/apache/iceberg/pull/12701#discussion_r2118190084


##########
spark/v3.4/spark/src/test/java/org/apache/iceberg/spark/actions/TestRewriteDataFilesAction.java:
##########
@@ -1320,6 +1320,34 @@ public void testParallelPartialProgressWithMaxFailedCommits() {
     shouldHaveACleanCache(table);
   }
 
+  @TestTemplate
+  public void testParallelPartialProgressWithMaxFailedCommitsLargerThanTotalFileGroup() {

Review Comment:
   This test seems to be flaky.
   I have encountered it failing in the CI for PRs unrelated to `RewriteDataFilesSparkAction`. I don't have access to manually retrigger the CI, so I have to use some trivial changes to the PRs to retrigger it and then the test passes.
   Nevertheless, this is a problem.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org