You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2020/05/18 05:15:54 UTC
[spark] branch branch-2.4 updated: [SPARK-31740][K8S][TESTS] Use
github URL instead of a broken link
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new 5c57171 [SPARK-31740][K8S][TESTS] Use github URL instead of a broken link
5c57171 is described below
commit 5c571716a061ee06260c540b481e976ad3316ff8
Author: William Hyun <wi...@gmail.com>
AuthorDate: Sun May 17 22:11:21 2020 -0700
[SPARK-31740][K8S][TESTS] Use github URL instead of a broken link
This PR aims to use GitHub URL instead of a broken link in `BasicTestsSuite.scala`.
Currently, K8s integration test is broken:
https://amplab.cs.berkeley.edu/jenkins/view/Spark%20K8s%20Builds/job/spark-master-test-k8s/534/console
```
- Run SparkRemoteFileTest using a remote data file *** FAILED ***
The code passed to eventually never returned normally. Attempted 130 times over 2.00109555135 minutes. Last failure message: false was not true. (KubernetesSuite.scala:370)
```
No.
Pass the K8s integration test.
Closes #28561 from williamhyun/williamhyun-patch-1.
Authored-by: williamhyun <62...@users.noreply.github.com>
Signed-off-by: Dongjoon Hyun <do...@apache.org>
(cherry picked from commit 5bb1a09b5f3a0f91409c7245847ab428c3c58322)
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
.../org/apache/spark/deploy/k8s/integrationtest/BasicTestsSuite.scala | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/BasicTestsSuite.scala b/resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/BasicTestsSuite.scala
index 3c1d9ea..1e9f830 100644
--- a/resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/BasicTestsSuite.scala
+++ b/resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/BasicTestsSuite.scala
@@ -104,6 +104,6 @@ private[spark] object BasicTestsSuite {
val CONTAINER_LOCAL_DOWNLOADED_PAGE_RANK_DATA_FILE =
s"$CONTAINER_LOCAL_FILE_DOWNLOAD_PATH/pagerank_data.txt"
val REMOTE_PAGE_RANK_DATA_FILE =
- "https://storage.googleapis.com/spark-k8s-integration-tests/files/pagerank_data.txt"
+ "https://raw.githubusercontent.com/apache/spark/master/data/mllib/pagerank_data.txt"
val REMOTE_PAGE_RANK_FILE_NAME = "pagerank_data.txt"
}
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org