You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ho...@apache.org on 2020/06/01 22:50:05 UTC
[spark] branch master updated: [SPARK-31889][BUILD] Docker release
script does not allocate enough memory to reliably publish
This is an automated email from the ASF dual-hosted git repository.
holden pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new ab9e5a2 [SPARK-31889][BUILD] Docker release script does not allocate enough memory to reliably publish
ab9e5a2 is described below
commit ab9e5a2fe9a0e9e93301096a027d7409fc3c9b64
Author: Holden Karau <hk...@apple.com>
AuthorDate: Mon Jun 1 15:49:17 2020 -0700
[SPARK-31889][BUILD] Docker release script does not allocate enough memory to reliably publish
### What changes were proposed in this pull request?
Allow overriding the zinc options in the docker release and set a higher so the publish step can succeed consistently.
### Why are the changes needed?
The publish step experiences memory pressure.
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
Running test locally with fake user to see if publish step (besides svn part) succeeds
Closes #28698 from holdenk/SPARK-31889-docker-release-script-does-not-allocate-enough-memory-to-reliably-publish.
Authored-by: Holden Karau <hk...@apple.com>
Signed-off-by: Holden Karau <hk...@apple.com>
---
dev/create-release/do-release-docker.sh | 1 +
1 file changed, 1 insertion(+)
diff --git a/dev/create-release/do-release-docker.sh b/dev/create-release/do-release-docker.sh
index 2f794c0..8f53f4a 100755
--- a/dev/create-release/do-release-docker.sh
+++ b/dev/create-release/do-release-docker.sh
@@ -128,6 +128,7 @@ ASF_PASSWORD=$ASF_PASSWORD
GPG_PASSPHRASE=$GPG_PASSPHRASE
RELEASE_STEP=$RELEASE_STEP
USER=$USER
+ZINC_OPTS=${RELEASE_ZINC_OPTS:-"-Xmx4g -XX:ReservedCodeCacheSize=2g"}
EOF
JAVA_VOL=
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org