You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zeppelin.apache.org by Xiaohui Liu <he...@gmail.com> on 2018/03/19 04:20:13 UTC
Build zeppelin 0.8 with spark 2.3
Hi,
I am building zep 0.8 with Spark 2.3.
>> ./dev/change_scala_version.sh 2.11
>> mvn clean package -Pspark-2.3 -Pr -Pscala-2.11 -Pbuild-distr -DskipTests
But it fails with the following error:
[ERROR] Failed to execute goal on project spark-scala-2.10: Could not
resolve dependencies for project
org.apache.zeppelin:spark-scala-2.10:jar:0.8.0-SNAPSHOT: The following
artifacts could not be resolve
d: org.apache.spark:spark-repl_2.10:jar:2.3.0,
org.apache.spark:spark-core_2.10:jar:2.3.0,
org.apache.spark:spark-hive_2.10:jar:2.3.0: Failure to find
org.apache.spark:spark-repl_2.10:jar:2.3.0 in https:/
/repo.maven.apache.org/maven2 was cached in the local repository,
resolution will not be reattempted until the update interval of central has
elapsed or updates are forced -> [Help 1]
This is because that there is no scala_2.10 build for spark-core version
2.3 (https://mvnrepository.com/artifact/org.apache.spark/spark-core).
Any suggestion to mitigate this problem?
Regards
Re: Build zeppelin 0.8 with spark 2.3
Posted by Jeff Zhang <zj...@gmail.com>.
You don't need to build with spark 2.3 to make zeppelin support spark 2.3.
Starting from branch-0.8, you can build zeppelin without specifying any
spark profile and it would support all versions of spark.
mvn clean package -DskipTests
Felix Cheung <fe...@hotmail.com>于2018年3月20日周二 上午12:50写道：
> Are you running with branch-0.8? I think there is a recent change in
> master for this.
>
> ________________________________
> From: Felix Cheung <fe...@hotmail.com>
> Sent: Monday, March 19, 2018 9:49:10 AM
> To: dev@zeppelin.apache.org; dev@zeppelin.apache.org
> Subject: Re: Build zeppelin 0.8 with spark 2.3
>
> Spark 2.3 does not support Scala 2.10. There should be a script to switch
> Zeppelin to build for Scala 2.11 only...
>
> ________________________________
> From: Xiaohui Liu <he...@gmail.com>
> Sent: Sunday, March 18, 2018 9:20:13 PM
> To: dev@zeppelin.apache.org
> Subject: Build zeppelin 0.8 with spark 2.3
>
> Hi,
>
> I am building zep 0.8 with Spark 2.3.
>
> >> ./dev/change_scala_version.sh 2.11
>
> >> mvn clean package -Pspark-2.3 -Pr -Pscala-2.11 -Pbuild-distr -DskipTests
>
> But it fails with the following error:
>
> [ERROR] Failed to execute goal on project spark-scala-2.10: Could not
> resolve dependencies for project
> org.apache.zeppelin:spark-scala-2.10:jar:0.8.0-SNAPSHOT: The following
> artifacts could not be resolve
> d: org.apache.spark:spark-repl_2.10:jar:2.3.0,
> org.apache.spark:spark-core_2.10:jar:2.3.0,
> org.apache.spark:spark-hive_2.10:jar:2.3.0: Failure to find
> org.apache.spark:spark-repl_2.10:jar:2.3.0 in https:/
> /repo.maven.apache.org/maven2 was cached in the local repository,
> resolution will not be reattempted until the update interval of central has
> elapsed or updates are forced -> [Help 1]
>
>
> This is because that there is no scala_2.10 build for spark-core version
> 2.3 (https://mvnrepository.com/artifact/org.apache.spark/spark-core).
>
> Any suggestion to mitigate this problem?
>
> Regards
>
Re: Build zeppelin 0.8 with spark 2.3
Posted by Felix Cheung <fe...@hotmail.com>.
Are you running with branch-0.8? I think there is a recent change in master for this.
________________________________
From: Felix Cheung <fe...@hotmail.com>
Sent: Monday, March 19, 2018 9:49:10 AM
To: dev@zeppelin.apache.org; dev@zeppelin.apache.org
Subject: Re: Build zeppelin 0.8 with spark 2.3
Spark 2.3 does not support Scala 2.10. There should be a script to switch Zeppelin to build for Scala 2.11 only...
________________________________
From: Xiaohui Liu <he...@gmail.com>
Sent: Sunday, March 18, 2018 9:20:13 PM
To: dev@zeppelin.apache.org
Subject: Build zeppelin 0.8 with spark 2.3
Hi,
I am building zep 0.8 with Spark 2.3.
>> ./dev/change_scala_version.sh 2.11
>> mvn clean package -Pspark-2.3 -Pr -Pscala-2.11 -Pbuild-distr -DskipTests
But it fails with the following error:
[ERROR] Failed to execute goal on project spark-scala-2.10: Could not
resolve dependencies for project
org.apache.zeppelin:spark-scala-2.10:jar:0.8.0-SNAPSHOT: The following
artifacts could not be resolve
d: org.apache.spark:spark-repl_2.10:jar:2.3.0,
org.apache.spark:spark-core_2.10:jar:2.3.0,
org.apache.spark:spark-hive_2.10:jar:2.3.0: Failure to find
org.apache.spark:spark-repl_2.10:jar:2.3.0 in https:/
/repo.maven.apache.org/maven2 was cached in the local repository,
resolution will not be reattempted until the update interval of central has
elapsed or updates are forced -> [Help 1]
This is because that there is no scala_2.10 build for spark-core version
2.3 (https://mvnrepository.com/artifact/org.apache.spark/spark-core).
Any suggestion to mitigate this problem?
Regards
Re: Build zeppelin 0.8 with spark 2.3
Posted by Felix Cheung <fe...@hotmail.com>.
Spark 2.3 does not support Scala 2.10. There should be a script to switch Zeppelin to build for Scala 2.11 only...
________________________________
From: Xiaohui Liu <he...@gmail.com>
Sent: Sunday, March 18, 2018 9:20:13 PM
To: dev@zeppelin.apache.org
Subject: Build zeppelin 0.8 with spark 2.3
Hi,
I am building zep 0.8 with Spark 2.3.
>> ./dev/change_scala_version.sh 2.11
>> mvn clean package -Pspark-2.3 -Pr -Pscala-2.11 -Pbuild-distr -DskipTests
But it fails with the following error:
[ERROR] Failed to execute goal on project spark-scala-2.10: Could not
resolve dependencies for project
org.apache.zeppelin:spark-scala-2.10:jar:0.8.0-SNAPSHOT: The following
artifacts could not be resolve
d: org.apache.spark:spark-repl_2.10:jar:2.3.0,
org.apache.spark:spark-core_2.10:jar:2.3.0,
org.apache.spark:spark-hive_2.10:jar:2.3.0: Failure to find
org.apache.spark:spark-repl_2.10:jar:2.3.0 in https:/
/repo.maven.apache.org/maven2 was cached in the local repository,
resolution will not be reattempted until the update interval of central has
elapsed or updates are forced -> [Help 1]
This is because that there is no scala_2.10 build for spark-core version
2.3 (https://mvnrepository.com/artifact/org.apache.spark/spark-core).
Any suggestion to mitigate this problem?
Regards