You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2019/09/24 17:55:41 UTC

[spark] branch branch-2.4 updated: [SPARK-29229][SQL] Change the additional remote repository in IsolatedClientLoader to google minor

This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/branch-2.4 by this push:
     new 5267e6e  [SPARK-29229][SQL] Change the additional remote repository in IsolatedClientLoader to google minor
5267e6e is described below

commit 5267e6e5bdc189a5ae876c726d96038b3ac3db66
Author: Yuanjian Li <xy...@gmail.com>
AuthorDate: Wed Sep 25 00:49:50 2019 +0800

    [SPARK-29229][SQL] Change the additional remote repository in IsolatedClientLoader to google minor
    
    ### What changes were proposed in this pull request?
    Change the remote repo used in IsolatedClientLoader from datanucleus to google mirror.
    
    ### Why are the changes needed?
    We need to connect the Maven repositories in IsolatedClientLoader for downloading Hive jars. The repository currently used is "http://www.datanucleus.org/downloads/maven2", which is [no longer maintained](http://www.datanucleus.org:15080/downloads/maven2/README.txt). This will cause downloading failure and make hive test cases flaky while Jenkins host is blocked by maven central repo.
    
    ### Does this PR introduce any user-facing change?
    No
    
    ### How was this patch tested?
    Existing UT.
    
    Closes #25915 from xuanyuanking/SPARK-29229.
    
    Authored-by: Yuanjian Li <xy...@gmail.com>
    Signed-off-by: Wenchen Fan <we...@databricks.com>
    (cherry picked from commit b3e9be470c09b3b5ea305ac83ee511ba8d023fa9)
    Signed-off-by: Dongjoon Hyun <dh...@apple.com>
---
 .../scala/org/apache/spark/sql/hive/client/IsolatedClientLoader.scala   | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/IsolatedClientLoader.scala b/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/IsolatedClientLoader.scala
index 2f34f69..8a12673 100644
--- a/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/IsolatedClientLoader.scala
+++ b/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/IsolatedClientLoader.scala
@@ -115,7 +115,7 @@ private[hive] object IsolatedClientLoader extends Logging {
       SparkSubmitUtils.resolveMavenCoordinates(
         hiveArtifacts.mkString(","),
         SparkSubmitUtils.buildIvySettings(
-          Some("http://www.datanucleus.org/downloads/maven2"),
+          Some("https://maven-central.storage-download.googleapis.com/repos/central/data/"),
           ivyPath),
         exclusions = version.exclusions)
     }


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org