You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by gu...@apache.org on 2023/07/27 05:08:37 UTC
[spark] branch branch-3.4 updated: [SPARK-44557][INFRA] Clean up untracked/ignored files before running pip packaging test in GitHub Actions
This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch branch-3.4
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.4 by this push:
new 4f9d6d077ff [SPARK-44557][INFRA] Clean up untracked/ignored files before running pip packaging test in GitHub Actions
4f9d6d077ff is described below
commit 4f9d6d077ff1d3f359774d21d32833cb80a193b7
Author: Hyukjin Kwon <gu...@apache.org>
AuthorDate: Thu Jul 27 14:08:09 2023 +0900
[SPARK-44557][INFRA] Clean up untracked/ignored files before running pip packaging test in GitHub Actions
### What changes were proposed in this pull request?
This PR proposes to remove untracked/ignored files before running pip packaging test in GitHub Actions.
### Why are the changes needed?
In order to fix the flakiness in the test such as:
```
...
creating dist
Creating tar archive
error: [Errno 28] No space left on device
Cleaning up temporary directory - /tmp/tmp.CvSzgB7Kyy
```
See also https://github.com/apache/spark/actions/runs/5665869112/job/15351515539.
### Does this PR introduce _any_ user-facing change?
No, test-only.
### How was this patch tested?
GitHub Actions build in this PR.
Closes #42159 from HyukjinKwon/debug-ci-failure.
Lead-authored-by: Hyukjin Kwon <gu...@apache.org>
Co-authored-by: Hyukjin Kwon <gu...@gmail.com>
Signed-off-by: Hyukjin Kwon <gu...@apache.org>
(cherry picked from commit 77aab6edb7c2b7be54cb19d40c0eeeb2c699f0f7)
Signed-off-by: Hyukjin Kwon <gu...@apache.org>
---
dev/run-pip-tests | 7 +++++++
1 file changed, 7 insertions(+)
diff --git a/dev/run-pip-tests b/dev/run-pip-tests
index 5da231495a2..773611d9d92 100755
--- a/dev/run-pip-tests
+++ b/dev/run-pip-tests
@@ -25,6 +25,13 @@ shopt -s nullglob
FWDIR="$(cd "$(dirname "$0")"/..; pwd)"
cd "$FWDIR"
+# Clean ignored/untracked files that do not need
+# for pip packaging test. Machines in GitHub Action do not have
+# enough space, see also SPARK-44557.
+if [[ ! -z "${GITHUB_ACTIONS}" ]]; then
+ git clean -d -f -x -e assembly
+fi
+
echo "Constructing virtual env for testing"
VIRTUALENV_BASE=$(mktemp -d)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org