You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ho...@apache.org on 2020/06/01 22:52:31 UTC
[spark] branch branch-2.4 updated: [SPARK-31889][BUILD] Docker
release script does not allocate enough memory to reliably publish
This is an automated email from the ASF dual-hosted git repository.
holden pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new ac59a8c [SPARK-31889][BUILD] Docker release script does not allocate enough memory to reliably publish
ac59a8c is described below
commit ac59a8ccee0f3121fd87477b99223c6d3690a936
Author: Holden Karau <hk...@apple.com>
AuthorDate: Mon Jun 1 15:49:17 2020 -0700
[SPARK-31889][BUILD] Docker release script does not allocate enough memory to reliably publish
### What changes were proposed in this pull request?
Allow overriding the zinc options in the docker release and set a higher so the publish step can succeed consistently.
### Why are the changes needed?
The publish step experiences memory pressure.
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
Running test locally with fake user to see if publish step (besides svn part) succeeds
Closes #28698 from holdenk/SPARK-31889-docker-release-script-does-not-allocate-enough-memory-to-reliably-publish.
Authored-by: Holden Karau <hk...@apple.com>
Signed-off-by: Holden Karau <hk...@apple.com>
(cherry picked from commit ab9e5a2fe9a0e9e93301096a027d7409fc3c9b64)
Signed-off-by: Holden Karau <hk...@apple.com>
---
dev/create-release/do-release-docker.sh | 1 +
1 file changed, 1 insertion(+)
diff --git a/dev/create-release/do-release-docker.sh b/dev/create-release/do-release-docker.sh
index f643c06..8ea75b8 100755
--- a/dev/create-release/do-release-docker.sh
+++ b/dev/create-release/do-release-docker.sh
@@ -128,6 +128,7 @@ ASF_PASSWORD=$ASF_PASSWORD
GPG_PASSPHRASE=$GPG_PASSPHRASE
RELEASE_STEP=$RELEASE_STEP
USER=$USER
+ZINC_OPTS=${RELEASE_ZINC_OPTS:-"-Xmx4g -XX:ReservedCodeCacheSize=2g"}
EOF
JAVA_VOL=
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org