[jira] [Created] (SPARK-58028) Retry Docker image pull in DockerJDBCIntegrationSuite to avoid transient registry errors aborting the suite

["Hyukjin Kwon (Jira)" <ji...@apache.org>]

Hyukjin Kwon created SPARK-58028:
------------------------------------

             Summary: Retry Docker image pull in DockerJDBCIntegrationSuite to avoid transient registry errors aborting the suite
                 Key: SPARK-58028
                 URL: https://issues.apache.org/jira/browse/SPARK-58028
             Project: Spark
          Issue Type: Bug
          Components: Tests
    Affects Versions: 5.0.0
            Reporter: Hyukjin Kwon


Docker-backed JDBC integration suites (e.g. PostgresKrbIntegrationSuite) pull their Docker image in beforeAll with a single attempt. A transient registry/proxy error (observed on GitHub Actions: HTTP 502 Bad Gateway) or a one-off pull timeout aborts the entire suite even though the rest of the run has zero test failures. This has been seen aborting the scheduled build_java17 workflow on branch-4.1.

Wrap the image pull in a bounded retry loop (spark.test.docker.imagePullAttempts, default 3) with linear backoff, so a transient failure no longer aborts the suite. The final failure is rethrown when all attempts are exhausted.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org