You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by mingda li <li...@gmail.com> on 2016/10/07 20:06:33 UTC

Some problem of using Zeppelin with Spark

Dear all,

Hi, we are using Zeppelin with Spark and AsterixDB now. The Spark will get
data from AsterixDB and Zeppelin can let users operate the data in Spark.
Now, we can run an example well in Spark's shell. But once we come to
Zeppelin, the example cannot run. There are some problem that org.SLF4J
couldn't be initialized. I don't know why.

Has anyone met such problem before?

And when I want to rebuild the Zeppelin, I also face some problem as
following:
when i use the command
JAVA_HOME=/home/clash/asterixdb/jdk1.8.0_101
SCALA_HOME=/home/clash/scala-2.11.8
$MAVEN_HOME/bin/mvn clean package -DskipTests -Pspark-1.6 -Phadoop-1
-Pscala-2.11

INFO] Zeppelin ........................................... SUCCESS [  1.501
s]

[INFO] Zeppelin: Interpreter .............................. SUCCESS [
4.940 s]

[INFO] Zeppelin: Zengine .................................. SUCCESS [
2.459 s]

[INFO] Zeppelin: Display system apis ...................... SUCCESS [
6.152 s]

[INFO] Zeppelin: Spark dependencies ....................... FAILURE [
0.258 s]

[INFO] Zeppelin: Spark .................................... SKIPPED

[INFO] Zeppelin: Markdown interpreter ..................... SKIPPED

[INFO] Zeppelin: Angular interpreter ...................... SKIPPED

[INFO] Zeppelin: Shell interpreter ........................ SKIPPED

[INFO] Zeppelin: Livy interpreter ......................... SKIPPED

[INFO] Zeppelin: HBase interpreter ........................ SKIPPED

[INFO] Zeppelin: PostgreSQL interpreter ................... SKIPPED

[INFO] Zeppelin: JDBC interpreter ......................... SKIPPED

[INFO] Zeppelin: File System Interpreters ................. SKIPPED

[INFO] Zeppelin: Flink .................................... SKIPPED

[INFO] Zeppelin: Apache Ignite interpreter ................ SKIPPED

[INFO] Zeppelin: Kylin interpreter ........................ SKIPPED

[INFO] Zeppelin: Python interpreter ....................... SKIPPED

[INFO] Zeppelin: Lens interpreter ......................... SKIPPED

[INFO] Zeppelin: Apache Cassandra interpreter ............. SKIPPED

[INFO] Zeppelin: Elasticsearch interpreter ................ SKIPPED

[INFO] Zeppelin: BigQuery interpreter ..................... SKIPPED

[INFO] Zeppelin: Alluxio interpreter ...................... SKIPPED

[INFO] Zeppelin: web Application .......................... SKIPPED

[INFO] Zeppelin: Server ................................... SKIPPED

[INFO] Zeppelin: Packaging distribution ................... SKIPPED

[INFO]
------------------------------------------------------------------------

[INFO] BUILD FAILURE

[INFO]
------------------------------------------------------------------------

[INFO] Total time: 15.543 s

[INFO] Finished at: 2016-10-07T12:58:20-07:00

[INFO] Final Memory: 72M/1247M

[INFO]
------------------------------------------------------------------------

[ERROR] Failed to execute goal on project zeppelin-spark-dependencies_2.10:
Could not resolve dependencies for project
org.apache.zeppelin:zeppelin-spark-dependencies_2.10:jar:0.7.0-SNAPSHOT:
The following artifacts could not be resolved:
org.spark-project.akka:akka-actor_2.11:jar:2.3.11,
org.spark-project.akka:akka-remote_2.11:jar:2.3.11,
org.spark-project.akka:akka-slf4j_2.11:jar:2.3.11,
org.spark-project.akka:akka-testkit_2.11:jar:2.3.11,
org.spark-project.akka:akka-zeromq_2.11:jar:2.3.11: Failure to find
org.spark-project.akka:akka-actor_2.11:jar:2.3.11 in
https://repo.maven.apache.org/maven2 was cached in the local repository,
resolution will not be reattempted until the update interval of central has
elapsed or updates are forced -> [Help 1]

[ERROR]

[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.

[ERROR] Re-run Maven using the -X switch to enable full debug logging.

[ERROR]

[ERROR] For more information about the errors and possible solutions,
please read the following articles:

[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException

[ERROR]

[ERROR] After correcting the problems, you can resume the build with the
command

[ERROR]   mvn <goals> -rf :zeppelin-spark-dependencies_2.10

clash@SCAI01:~/zeppelinFinal/zeppelin/incubator-zeppelin$


Bests,
Mingda

Re: Some problem of using Zeppelin with Spark

Posted by mingda li <li...@gmail.com>.
Thanks for your reply. There is another problem after I get the Zeppelin
run.
Now, I want to run this on Zeppelin:

scala> val textFile = sc.textFile("README.md")
scala> textFile.count()


[image: Inline image 1]
But it seems run forever. When I check the Spark cluster on 8080. I find
the problem:

Exception in thread "main" java.lang.NoSuchMethodError:
org.slf4j.impl.StaticLoggerBinder.getSingleton()Lorg/slf4j/impl/StaticLoggerBinder;

[image: Inline image 2]

On Fri, Oct 7, 2016 at 1:33 PM, mingda li <li...@gmail.com> wrote:

> Dear DuyHai,
>
> Thanks. But the problem is not solved after I run JAVA_HOME=/home/clash/
> asterixdb/jdk1.8.0_101  SCALA_HOME=/home/clash/scala-2.11.8
> $MAVEN_HOME/bin/mvn clean package -U -DskipTests -Pspark-1.6 -Phadoop-1
> -Pscala-2.11
>
> I get:
>
> [INFO] Reactor Summary:
>
> [INFO]
>
> [INFO] Zeppelin ........................................... SUCCESS [
> 1.353 s]
>
> [INFO] Zeppelin: Interpreter .............................. SUCCESS [
> 4.842 s]
>
> [INFO] Zeppelin: Zengine .................................. SUCCESS [
> 2.437 s]
>
> [INFO] Zeppelin: Display system apis ...................... SUCCESS [
> 6.453 s]
>
> [INFO] Zeppelin: Spark dependencies ....................... FAILURE [
> 5.405 s]
>
> [INFO] Zeppelin: Spark .................................... SKIPPED
>
> [INFO] Zeppelin: Markdown interpreter ..................... SKIPPED
>
> [INFO] Zeppelin: Angular interpreter ...................... SKIPPED
>
> [INFO] Zeppelin: Shell interpreter ........................ SKIPPED
>
> [INFO] Zeppelin: Livy interpreter ......................... SKIPPED
>
> [INFO] Zeppelin: HBase interpreter ........................ SKIPPED
>
> [INFO] Zeppelin: PostgreSQL interpreter ................... SKIPPED
>
> [INFO] Zeppelin: JDBC interpreter ......................... SKIPPED
>
> [INFO] Zeppelin: File System Interpreters ................. SKIPPED
>
> [INFO] Zeppelin: Flink .................................... SKIPPED
>
> [INFO] Zeppelin: Apache Ignite interpreter ................ SKIPPED
>
> [INFO] Zeppelin: Kylin interpreter ........................ SKIPPED
>
> [INFO] Zeppelin: Python interpreter ....................... SKIPPED
>
> [INFO] Zeppelin: Lens interpreter ......................... SKIPPED
>
> [INFO] Zeppelin: Apache Cassandra interpreter ............. SKIPPED
>
> [INFO] Zeppelin: Elasticsearch interpreter ................ SKIPPED
>
> [INFO] Zeppelin: BigQuery interpreter ..................... SKIPPED
>
> [INFO] Zeppelin: Alluxio interpreter ...................... SKIPPED
>
> [INFO] Zeppelin: web Application .......................... SKIPPED
>
> [INFO] Zeppelin: Server ................................... SKIPPED
>
> [INFO] Zeppelin: Packaging distribution ................... SKIPPED
>
> [INFO] ------------------------------------------------------------
> ------------
>
> [INFO] BUILD FAILURE
>
> [INFO] ------------------------------------------------------------
> ------------
>
> [INFO] Total time: 20.728 s
>
> [INFO] Finished at: 2016-10-07T13:32:18-07:00
>
> [INFO] Final Memory: 79M/1248M
>
> [INFO] ------------------------------------------------------------
> ------------
>
> [ERROR] Failed to execute goal on project zeppelin-spark-dependencies_2.10:
> Could not resolve dependencies for project org.apache.zeppelin:zeppelin-
> spark-dependencies_2.10:jar:0.7.0-SNAPSHOT: The following artifacts could
> not be resolved: org.spark-project.akka:akka-actor_2.11:jar:2.3.11,
> org.spark-project.akka:akka-remote_2.11:jar:2.3.11,
> org.spark-project.akka:akka-slf4j_2.11:jar:2.3.11,
> org.spark-project.akka:akka-testkit_2.11:jar:2.3.11,
> org.spark-project.akka:akka-zeromq_2.11:jar:2.3.11: Could not find
> artifact org.spark-project.akka:akka-actor_2.11:jar:2.3.11 in central (
> https://repo.maven.apache.org/maven2) -> [Help 1]
>
> [ERROR]
>
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
>
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>
> [ERROR]
>
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
>
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/
> DependencyResolutionException
>
> [ERROR]
>
> [ERROR] After correcting the problems, you can resume the build with the
> command
>
> [ERROR]   mvn <goals> -rf :zeppelin-spark-dependencies_2.10
>
> clash@SCAI01:~/zeppelinFinal/zeppelin/incubator-zeppelin$
>
>
> On Fri, Oct 7, 2016 at 1:20 PM, DuyHai Doan <do...@gmail.com> wrote:
>
>> Try adding -U   before   -DskipTests
>>
>> On Fri, Oct 7, 2016 at 10:06 PM, mingda li <li...@gmail.com>
>> wrote:
>>
>>> Dear all,
>>>
>>> Hi, we are using Zeppelin with Spark and AsterixDB now. The Spark will
>>> get data from AsterixDB and Zeppelin can let users operate the data in
>>> Spark.
>>> Now, we can run an example well in Spark's shell. But once we come to
>>> Zeppelin, the example cannot run. There are some problem that org.SLF4J
>>> couldn't be initialized. I don't know why.
>>>
>>> Has anyone met such problem before?
>>>
>>> And when I want to rebuild the Zeppelin, I also face some problem as
>>> following:
>>> when i use the command
>>> JAVA_HOME=/home/clash/asterixdb/jdk1.8.0_101
>>> SCALA_HOME=/home/clash/scala-2.11.8 $MAVEN_HOME/bin/mvn clean package
>>> -DskipTests -Pspark-1.6 -Phadoop-1 -Pscala-2.11
>>>
>>> INFO] Zeppelin ........................................... SUCCESS [
>>> 1.501 s]
>>>
>>> [INFO] Zeppelin: Interpreter .............................. SUCCESS [
>>> 4.940 s]
>>>
>>> [INFO] Zeppelin: Zengine .................................. SUCCESS [
>>> 2.459 s]
>>>
>>> [INFO] Zeppelin: Display system apis ...................... SUCCESS [
>>> 6.152 s]
>>>
>>> [INFO] Zeppelin: Spark dependencies ....................... FAILURE [
>>> 0.258 s]
>>>
>>> [INFO] Zeppelin: Spark .................................... SKIPPED
>>>
>>> [INFO] Zeppelin: Markdown interpreter ..................... SKIPPED
>>>
>>> [INFO] Zeppelin: Angular interpreter ...................... SKIPPED
>>>
>>> [INFO] Zeppelin: Shell interpreter ........................ SKIPPED
>>>
>>> [INFO] Zeppelin: Livy interpreter ......................... SKIPPED
>>>
>>> [INFO] Zeppelin: HBase interpreter ........................ SKIPPED
>>>
>>> [INFO] Zeppelin: PostgreSQL interpreter ................... SKIPPED
>>>
>>> [INFO] Zeppelin: JDBC interpreter ......................... SKIPPED
>>>
>>> [INFO] Zeppelin: File System Interpreters ................. SKIPPED
>>>
>>> [INFO] Zeppelin: Flink .................................... SKIPPED
>>>
>>> [INFO] Zeppelin: Apache Ignite interpreter ................ SKIPPED
>>>
>>> [INFO] Zeppelin: Kylin interpreter ........................ SKIPPED
>>>
>>> [INFO] Zeppelin: Python interpreter ....................... SKIPPED
>>>
>>> [INFO] Zeppelin: Lens interpreter ......................... SKIPPED
>>>
>>> [INFO] Zeppelin: Apache Cassandra interpreter ............. SKIPPED
>>>
>>> [INFO] Zeppelin: Elasticsearch interpreter ................ SKIPPED
>>>
>>> [INFO] Zeppelin: BigQuery interpreter ..................... SKIPPED
>>>
>>> [INFO] Zeppelin: Alluxio interpreter ...................... SKIPPED
>>>
>>> [INFO] Zeppelin: web Application .......................... SKIPPED
>>>
>>> [INFO] Zeppelin: Server ................................... SKIPPED
>>>
>>> [INFO] Zeppelin: Packaging distribution ................... SKIPPED
>>>
>>> [INFO] ------------------------------------------------------------
>>> ------------
>>>
>>> [INFO] BUILD FAILURE
>>>
>>> [INFO] ------------------------------------------------------------
>>> ------------
>>>
>>> [INFO] Total time: 15.543 s
>>>
>>> [INFO] Finished at: 2016-10-07T12:58:20-07:00
>>>
>>> [INFO] Final Memory: 72M/1247M
>>>
>>> [INFO] ------------------------------------------------------------
>>> ------------
>>>
>>> [ERROR] Failed to execute goal on project zeppelin-spark-dependencies_2.10:
>>> Could not resolve dependencies for project org.apache.zeppelin:zeppelin-s
>>> park-dependencies_2.10:jar:0.7.0-SNAPSHOT: The following artifacts
>>> could not be resolved: org.spark-project.akka:akka-actor_2.11:jar:2.3.11,
>>> org.spark-project.akka:akka-remote_2.11:jar:2.3.11,
>>> org.spark-project.akka:akka-slf4j_2.11:jar:2.3.11,
>>> org.spark-project.akka:akka-testkit_2.11:jar:2.3.11,
>>> org.spark-project.akka:akka-zeromq_2.11:jar:2.3.11: Failure to find
>>> org.spark-project.akka:akka-actor_2.11:jar:2.3.11 in
>>> https://repo.maven.apache.org/maven2 was cached in the local
>>> repository, resolution will not be reattempted until the update interval of
>>> central has elapsed or updates are forced -> [Help 1]
>>>
>>> [ERROR]
>>>
>>> [ERROR] To see the full stack trace of the errors, re-run Maven with the
>>> -e switch.
>>>
>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>>
>>> [ERROR]
>>>
>>> [ERROR] For more information about the errors and possible solutions,
>>> please read the following articles:
>>>
>>> [ERROR] [Help 1] http://cwiki.apache.org/conflu
>>> ence/display/MAVEN/DependencyResolutionException
>>>
>>> [ERROR]
>>>
>>> [ERROR] After correcting the problems, you can resume the build with the
>>> command
>>>
>>> [ERROR]   mvn <goals> -rf :zeppelin-spark-dependencies_2.10
>>>
>>> clash@SCAI01:~/zeppelinFinal/zeppelin/incubator-zeppelin$
>>>
>>>
>>> Bests,
>>> Mingda
>>>
>>
>>
>

Re: Some problem of using Zeppelin with Spark

Posted by mingda li <li...@gmail.com>.
Dear DuyHai,

Thanks. But the problem is not solved after I run
JAVA_HOME=/home/clash/asterixdb/jdk1.8.0_101
SCALA_HOME=/home/clash/scala-2.11.8
$MAVEN_HOME/bin/mvn clean package -U -DskipTests -Pspark-1.6 -Phadoop-1
-Pscala-2.11

I get:

[INFO] Reactor Summary:

[INFO]

[INFO] Zeppelin ........................................... SUCCESS [
1.353 s]

[INFO] Zeppelin: Interpreter .............................. SUCCESS [
4.842 s]

[INFO] Zeppelin: Zengine .................................. SUCCESS [
2.437 s]

[INFO] Zeppelin: Display system apis ...................... SUCCESS [
6.453 s]

[INFO] Zeppelin: Spark dependencies ....................... FAILURE [
5.405 s]

[INFO] Zeppelin: Spark .................................... SKIPPED

[INFO] Zeppelin: Markdown interpreter ..................... SKIPPED

[INFO] Zeppelin: Angular interpreter ...................... SKIPPED

[INFO] Zeppelin: Shell interpreter ........................ SKIPPED

[INFO] Zeppelin: Livy interpreter ......................... SKIPPED

[INFO] Zeppelin: HBase interpreter ........................ SKIPPED

[INFO] Zeppelin: PostgreSQL interpreter ................... SKIPPED

[INFO] Zeppelin: JDBC interpreter ......................... SKIPPED

[INFO] Zeppelin: File System Interpreters ................. SKIPPED

[INFO] Zeppelin: Flink .................................... SKIPPED

[INFO] Zeppelin: Apache Ignite interpreter ................ SKIPPED

[INFO] Zeppelin: Kylin interpreter ........................ SKIPPED

[INFO] Zeppelin: Python interpreter ....................... SKIPPED

[INFO] Zeppelin: Lens interpreter ......................... SKIPPED

[INFO] Zeppelin: Apache Cassandra interpreter ............. SKIPPED

[INFO] Zeppelin: Elasticsearch interpreter ................ SKIPPED

[INFO] Zeppelin: BigQuery interpreter ..................... SKIPPED

[INFO] Zeppelin: Alluxio interpreter ...................... SKIPPED

[INFO] Zeppelin: web Application .......................... SKIPPED

[INFO] Zeppelin: Server ................................... SKIPPED

[INFO] Zeppelin: Packaging distribution ................... SKIPPED

[INFO]
------------------------------------------------------------------------

[INFO] BUILD FAILURE

[INFO]
------------------------------------------------------------------------

[INFO] Total time: 20.728 s

[INFO] Finished at: 2016-10-07T13:32:18-07:00

[INFO] Final Memory: 79M/1248M

[INFO]
------------------------------------------------------------------------

[ERROR] Failed to execute goal on project zeppelin-spark-dependencies_2.10:
Could not resolve dependencies for project
org.apache.zeppelin:zeppelin-spark-dependencies_2.10:jar:0.7.0-SNAPSHOT:
The following artifacts could not be resolved:
org.spark-project.akka:akka-actor_2.11:jar:2.3.11,
org.spark-project.akka:akka-remote_2.11:jar:2.3.11,
org.spark-project.akka:akka-slf4j_2.11:jar:2.3.11,
org.spark-project.akka:akka-testkit_2.11:jar:2.3.11,
org.spark-project.akka:akka-zeromq_2.11:jar:2.3.11: Could not find artifact
org.spark-project.akka:akka-actor_2.11:jar:2.3.11 in central (
https://repo.maven.apache.org/maven2) -> [Help 1]

[ERROR]

[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.

[ERROR] Re-run Maven using the -X switch to enable full debug logging.

[ERROR]

[ERROR] For more information about the errors and possible solutions,
please read the following articles:

[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException

[ERROR]

[ERROR] After correcting the problems, you can resume the build with the
command

[ERROR]   mvn <goals> -rf :zeppelin-spark-dependencies_2.10

clash@SCAI01:~/zeppelinFinal/zeppelin/incubator-zeppelin$


On Fri, Oct 7, 2016 at 1:20 PM, DuyHai Doan <do...@gmail.com> wrote:

> Try adding -U   before   -DskipTests
>
> On Fri, Oct 7, 2016 at 10:06 PM, mingda li <li...@gmail.com> wrote:
>
>> Dear all,
>>
>> Hi, we are using Zeppelin with Spark and AsterixDB now. The Spark will
>> get data from AsterixDB and Zeppelin can let users operate the data in
>> Spark.
>> Now, we can run an example well in Spark's shell. But once we come to
>> Zeppelin, the example cannot run. There are some problem that org.SLF4J
>> couldn't be initialized. I don't know why.
>>
>> Has anyone met such problem before?
>>
>> And when I want to rebuild the Zeppelin, I also face some problem as
>> following:
>> when i use the command
>> JAVA_HOME=/home/clash/asterixdb/jdk1.8.0_101
>> SCALA_HOME=/home/clash/scala-2.11.8 $MAVEN_HOME/bin/mvn clean package
>> -DskipTests -Pspark-1.6 -Phadoop-1 -Pscala-2.11
>>
>> INFO] Zeppelin ........................................... SUCCESS [
>> 1.501 s]
>>
>> [INFO] Zeppelin: Interpreter .............................. SUCCESS [
>> 4.940 s]
>>
>> [INFO] Zeppelin: Zengine .................................. SUCCESS [
>> 2.459 s]
>>
>> [INFO] Zeppelin: Display system apis ...................... SUCCESS [
>> 6.152 s]
>>
>> [INFO] Zeppelin: Spark dependencies ....................... FAILURE [
>> 0.258 s]
>>
>> [INFO] Zeppelin: Spark .................................... SKIPPED
>>
>> [INFO] Zeppelin: Markdown interpreter ..................... SKIPPED
>>
>> [INFO] Zeppelin: Angular interpreter ...................... SKIPPED
>>
>> [INFO] Zeppelin: Shell interpreter ........................ SKIPPED
>>
>> [INFO] Zeppelin: Livy interpreter ......................... SKIPPED
>>
>> [INFO] Zeppelin: HBase interpreter ........................ SKIPPED
>>
>> [INFO] Zeppelin: PostgreSQL interpreter ................... SKIPPED
>>
>> [INFO] Zeppelin: JDBC interpreter ......................... SKIPPED
>>
>> [INFO] Zeppelin: File System Interpreters ................. SKIPPED
>>
>> [INFO] Zeppelin: Flink .................................... SKIPPED
>>
>> [INFO] Zeppelin: Apache Ignite interpreter ................ SKIPPED
>>
>> [INFO] Zeppelin: Kylin interpreter ........................ SKIPPED
>>
>> [INFO] Zeppelin: Python interpreter ....................... SKIPPED
>>
>> [INFO] Zeppelin: Lens interpreter ......................... SKIPPED
>>
>> [INFO] Zeppelin: Apache Cassandra interpreter ............. SKIPPED
>>
>> [INFO] Zeppelin: Elasticsearch interpreter ................ SKIPPED
>>
>> [INFO] Zeppelin: BigQuery interpreter ..................... SKIPPED
>>
>> [INFO] Zeppelin: Alluxio interpreter ...................... SKIPPED
>>
>> [INFO] Zeppelin: web Application .......................... SKIPPED
>>
>> [INFO] Zeppelin: Server ................................... SKIPPED
>>
>> [INFO] Zeppelin: Packaging distribution ................... SKIPPED
>>
>> [INFO] ------------------------------------------------------------
>> ------------
>>
>> [INFO] BUILD FAILURE
>>
>> [INFO] ------------------------------------------------------------
>> ------------
>>
>> [INFO] Total time: 15.543 s
>>
>> [INFO] Finished at: 2016-10-07T12:58:20-07:00
>>
>> [INFO] Final Memory: 72M/1247M
>>
>> [INFO] ------------------------------------------------------------
>> ------------
>>
>> [ERROR] Failed to execute goal on project zeppelin-spark-dependencies_2.10:
>> Could not resolve dependencies for project org.apache.zeppelin:zeppelin-s
>> park-dependencies_2.10:jar:0.7.0-SNAPSHOT: The following artifacts could
>> not be resolved: org.spark-project.akka:akka-actor_2.11:jar:2.3.11,
>> org.spark-project.akka:akka-remote_2.11:jar:2.3.11,
>> org.spark-project.akka:akka-slf4j_2.11:jar:2.3.11,
>> org.spark-project.akka:akka-testkit_2.11:jar:2.3.11,
>> org.spark-project.akka:akka-zeromq_2.11:jar:2.3.11: Failure to find
>> org.spark-project.akka:akka-actor_2.11:jar:2.3.11 in
>> https://repo.maven.apache.org/maven2 was cached in the local repository,
>> resolution will not be reattempted until the update interval of central has
>> elapsed or updates are forced -> [Help 1]
>>
>> [ERROR]
>>
>> [ERROR] To see the full stack trace of the errors, re-run Maven with the
>> -e switch.
>>
>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>
>> [ERROR]
>>
>> [ERROR] For more information about the errors and possible solutions,
>> please read the following articles:
>>
>> [ERROR] [Help 1] http://cwiki.apache.org/conflu
>> ence/display/MAVEN/DependencyResolutionException
>>
>> [ERROR]
>>
>> [ERROR] After correcting the problems, you can resume the build with the
>> command
>>
>> [ERROR]   mvn <goals> -rf :zeppelin-spark-dependencies_2.10
>>
>> clash@SCAI01:~/zeppelinFinal/zeppelin/incubator-zeppelin$
>>
>>
>> Bests,
>> Mingda
>>
>
>

Re: Some problem of using Zeppelin with Spark

Posted by DuyHai Doan <do...@gmail.com>.
Try adding -U   before   -DskipTests

On Fri, Oct 7, 2016 at 10:06 PM, mingda li <li...@gmail.com> wrote:

> Dear all,
>
> Hi, we are using Zeppelin with Spark and AsterixDB now. The Spark will get
> data from AsterixDB and Zeppelin can let users operate the data in Spark.
> Now, we can run an example well in Spark's shell. But once we come to
> Zeppelin, the example cannot run. There are some problem that org.SLF4J
> couldn't be initialized. I don't know why.
>
> Has anyone met such problem before?
>
> And when I want to rebuild the Zeppelin, I also face some problem as
> following:
> when i use the command
> JAVA_HOME=/home/clash/asterixdb/jdk1.8.0_101
> SCALA_HOME=/home/clash/scala-2.11.8 $MAVEN_HOME/bin/mvn clean package
> -DskipTests -Pspark-1.6 -Phadoop-1 -Pscala-2.11
>
> INFO] Zeppelin ........................................... SUCCESS [
> 1.501 s]
>
> [INFO] Zeppelin: Interpreter .............................. SUCCESS [
> 4.940 s]
>
> [INFO] Zeppelin: Zengine .................................. SUCCESS [
> 2.459 s]
>
> [INFO] Zeppelin: Display system apis ...................... SUCCESS [
> 6.152 s]
>
> [INFO] Zeppelin: Spark dependencies ....................... FAILURE [
> 0.258 s]
>
> [INFO] Zeppelin: Spark .................................... SKIPPED
>
> [INFO] Zeppelin: Markdown interpreter ..................... SKIPPED
>
> [INFO] Zeppelin: Angular interpreter ...................... SKIPPED
>
> [INFO] Zeppelin: Shell interpreter ........................ SKIPPED
>
> [INFO] Zeppelin: Livy interpreter ......................... SKIPPED
>
> [INFO] Zeppelin: HBase interpreter ........................ SKIPPED
>
> [INFO] Zeppelin: PostgreSQL interpreter ................... SKIPPED
>
> [INFO] Zeppelin: JDBC interpreter ......................... SKIPPED
>
> [INFO] Zeppelin: File System Interpreters ................. SKIPPED
>
> [INFO] Zeppelin: Flink .................................... SKIPPED
>
> [INFO] Zeppelin: Apache Ignite interpreter ................ SKIPPED
>
> [INFO] Zeppelin: Kylin interpreter ........................ SKIPPED
>
> [INFO] Zeppelin: Python interpreter ....................... SKIPPED
>
> [INFO] Zeppelin: Lens interpreter ......................... SKIPPED
>
> [INFO] Zeppelin: Apache Cassandra interpreter ............. SKIPPED
>
> [INFO] Zeppelin: Elasticsearch interpreter ................ SKIPPED
>
> [INFO] Zeppelin: BigQuery interpreter ..................... SKIPPED
>
> [INFO] Zeppelin: Alluxio interpreter ...................... SKIPPED
>
> [INFO] Zeppelin: web Application .......................... SKIPPED
>
> [INFO] Zeppelin: Server ................................... SKIPPED
>
> [INFO] Zeppelin: Packaging distribution ................... SKIPPED
>
> [INFO] ------------------------------------------------------------
> ------------
>
> [INFO] BUILD FAILURE
>
> [INFO] ------------------------------------------------------------
> ------------
>
> [INFO] Total time: 15.543 s
>
> [INFO] Finished at: 2016-10-07T12:58:20-07:00
>
> [INFO] Final Memory: 72M/1247M
>
> [INFO] ------------------------------------------------------------
> ------------
>
> [ERROR] Failed to execute goal on project zeppelin-spark-dependencies_2.10:
> Could not resolve dependencies for project org.apache.zeppelin:zeppelin-
> spark-dependencies_2.10:jar:0.7.0-SNAPSHOT: The following artifacts could
> not be resolved: org.spark-project.akka:akka-actor_2.11:jar:2.3.11,
> org.spark-project.akka:akka-remote_2.11:jar:2.3.11,
> org.spark-project.akka:akka-slf4j_2.11:jar:2.3.11,
> org.spark-project.akka:akka-testkit_2.11:jar:2.3.11,
> org.spark-project.akka:akka-zeromq_2.11:jar:2.3.11: Failure to find
> org.spark-project.akka:akka-actor_2.11:jar:2.3.11 in
> https://repo.maven.apache.org/maven2 was cached in the local repository,
> resolution will not be reattempted until the update interval of central has
> elapsed or updates are forced -> [Help 1]
>
> [ERROR]
>
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
>
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>
> [ERROR]
>
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
>
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/
> DependencyResolutionException
>
> [ERROR]
>
> [ERROR] After correcting the problems, you can resume the build with the
> command
>
> [ERROR]   mvn <goals> -rf :zeppelin-spark-dependencies_2.10
>
> clash@SCAI01:~/zeppelinFinal/zeppelin/incubator-zeppelin$
>
>
> Bests,
> Mingda
>