(spark) branch master updated: [SPARK-52258][BUILD] Increase the number of retries and decrease the parallelism in the release script

[gu...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/master by this push:
     new 086fdfdff965 [SPARK-52258][BUILD] Increase the number of retries and decrease the parallelism in the release script
086fdfdff965 is described below

commit 086fdfdff965ffd4e591278d09148d573d2c5afe
Author: Hyukjin Kwon <gu...@apache.org>
AuthorDate: Thu May 22 13:16:10 2025 +0900

    [SPARK-52258][BUILD] Increase the number of retries and decrease the parallelism in the release script
    
    ### What changes were proposed in this pull request?
    
    This PR increases the number of retries and decrease the parallelism in release script
    
    ### Why are the changes needed?
    
    To make the release stable.
    
    ### Does this PR introduce _any_ user-facing change?
    
    No, dev-only.
    
    ### How was this patch tested?
    
    Manually.
    
    ### Was this patch authored or co-authored using generative AI tooling?
    
    No.
    
    Closes #50980 from HyukjinKwon/SPARK-52176.
    
    Authored-by: Hyukjin Kwon <gu...@apache.org>
    Signed-off-by: Hyukjin Kwon <gu...@apache.org>
---
 dev/create-release/release-build.sh | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/dev/create-release/release-build.sh b/dev/create-release/release-build.sh
index 04c59d3d9590..86adbe1c336b 100755
--- a/dev/create-release/release-build.sh
+++ b/dev/create-release/release-build.sh
@@ -568,12 +568,12 @@ if [[ "$1" == "publish-release" ]]; then
     error_flag_file=$(mktemp)
 
     find . -type f | sed -e 's|^\./||' | \
-    xargs -P 8 -n 1 -I {} bash -c '
+    xargs -P 4 -n 1 -I {} bash -c '
       file_short="{}"
       dest_url="'$NEXUS_ROOT'/deployByRepositoryId/'$staged_repo_id'/org/apache/spark/$file_short"
       echo "[START] $file_short"
 
-      if curl --retry 3 --retry-all-errors -sS -u "$ASF_USERNAME:$ASF_PASSWORD" \
+      if curl --retry 10 --retry-all-errors -sS -u "$ASF_USERNAME:$ASF_PASSWORD" \
           --upload-file "$file_short" "$dest_url"; then
         echo "[ OK  ] $file_short"
       else


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org