You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Diwakar Dhanuskodi <di...@gmail.com> on 2016/08/30 20:30:43 UTC
Spark build 1.6.2 error
Hi,
While building Spark 1.6.2 , getting below error in spark-sql. Much
appreciate for any help.
ERROR] missing or invalid dependency detected while loading class file
'WebUI.class'.
Could not access term eclipse in package org,
because it (or its dependencies) are missing. Check your build definition
for
missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see
the problematic classpath.)
A full rebuild may help if 'WebUI.class' was compiled against an
incompatible version of org.
[ERROR] missing or invalid dependency detected while loading class file
'WebUI.class'.
Could not access term jetty in value org.eclipse,
because it (or its dependencies) are missing. Check your build definition
for
missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see
the problematic classpath.)
A full rebuild may help if 'WebUI.class' was compiled against an
incompatible version of org.eclipse.
[WARNING] 17 warnings found
[ERROR] two errors found
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM .......................... SUCCESS [4.399s]
[INFO] Spark Project Test Tags ........................... SUCCESS [3.443s]
[INFO] Spark Project Launcher ............................ SUCCESS [10.131s]
[INFO] Spark Project Networking .......................... SUCCESS [11.849s]
[INFO] Spark Project Shuffle Streaming Service ........... SUCCESS [6.641s]
[INFO] Spark Project Unsafe .............................. SUCCESS [19.765s]
[INFO] Spark Project Core ................................ SUCCESS
[4:16.511s]
[INFO] Spark Project Bagel ............................... SUCCESS [13.401s]
[INFO] Spark Project GraphX .............................. SUCCESS
[1:08.824s]
[INFO] Spark Project Streaming ........................... SUCCESS
[2:18.844s]
[INFO] Spark Project Catalyst ............................ SUCCESS
[2:43.695s]
[INFO] Spark Project SQL ................................. FAILURE
[1:01.762s]
[INFO] Spark Project ML Library .......................... SKIPPED
[INFO] Spark Project Tools ............................... SKIPPED
[INFO] Spark Project Hive ................................ SKIPPED
[INFO] Spark Project Docker Integration Tests ............ SKIPPED
[INFO] Spark Project REPL ................................ SKIPPED
[INFO] Spark Project YARN Shuffle Service ................ SKIPPED
[INFO] Spark Project YARN ................................ SKIPPED
[INFO] Spark Project Assembly ............................ SKIPPED
[INFO] Spark Project External Twitter .................... SKIPPED
[INFO] Spark Project External Flume Sink ................. SKIPPED
[INFO] Spark Project External Flume ...................... SKIPPED
[INFO] Spark Project External Flume Assembly ............. SKIPPED
[INFO] Spark Project External MQTT ....................... SKIPPED
[INFO] Spark Project External MQTT Assembly .............. SKIPPED
[INFO] Spark Project External ZeroMQ ..................... SKIPPED
[INFO] Spark Project External Kafka ...................... SKIPPED
[INFO] Spark Project Examples ............................ SKIPPED
[INFO] Spark Project External Kafka Assembly ............. SKIPPED
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 12:40.525s
[INFO] Finished at: Wed Aug 31 01:56:50 IST 2016
[INFO] Final Memory: 71M/830M
[INFO]
------------------------------------------------------------------------
[ERROR] Failed to execute goal
net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first)
on project spark-sql_2.11: Execution scala-compile-first of goal
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed
-> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR] mvn <goals> -rf :spark-sql_2.11
Re: Spark build 1.6.2 error
Posted by Adam Roberts <AR...@uk.ibm.com>.
Looks familiar, got the zinc server running and using a shared dev box?
ps -ef | grep "com.typesafe zinc.Nailgun", look for the zinc server
process, kill it and try again, Spark branch-1.6 builds great here from
scratch, had plenty of problems thanks to running the zinc server here
(started with build/mvn)
From: Nachiketa <na...@gmail.com>
To: Diwakar Dhanuskodi <di...@gmail.com>
Cc: user <us...@spark.apache.org>
Date: 31/08/2016 12:17
Subject: Re: Spark build 1.6.2 error
Hi Diwakar,
Could you please share the entire maven command that you are using to
build ? And also the JDK version you are using ?
Also could you please confirm that you did execute the script for change
scala version to 2.11 before starting the build ? Thanks.
Regards,
Nachiketa
On Wed, Aug 31, 2016 at 2:00 AM, Diwakar Dhanuskodi <
diwakar.dhanuskodi@gmail.com> wrote:
Hi,
While building Spark 1.6.2 , getting below error in spark-sql. Much
appreciate for any help.
ERROR] missing or invalid dependency detected while loading class file
'WebUI.class'.
Could not access term eclipse in package org,
because it (or its dependencies) are missing. Check your build definition
for
missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see
the problematic classpath.)
A full rebuild may help if 'WebUI.class' was compiled against an
incompatible version of org.
[ERROR] missing or invalid dependency detected while loading class file
'WebUI.class'.
Could not access term jetty in value org.eclipse,
because it (or its dependencies) are missing. Check your build definition
for
missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see
the problematic classpath.)
A full rebuild may help if 'WebUI.class' was compiled against an
incompatible version of org.eclipse.
[WARNING] 17 warnings found
[ERROR] two errors found
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM .......................... SUCCESS
[4.399s]
[INFO] Spark Project Test Tags ........................... SUCCESS
[3.443s]
[INFO] Spark Project Launcher ............................ SUCCESS
[10.131s]
[INFO] Spark Project Networking .......................... SUCCESS
[11.849s]
[INFO] Spark Project Shuffle Streaming Service ........... SUCCESS
[6.641s]
[INFO] Spark Project Unsafe .............................. SUCCESS
[19.765s]
[INFO] Spark Project Core ................................ SUCCESS
[4:16.511s]
[INFO] Spark Project Bagel ............................... SUCCESS
[13.401s]
[INFO] Spark Project GraphX .............................. SUCCESS
[1:08.824s]
[INFO] Spark Project Streaming ........................... SUCCESS
[2:18.844s]
[INFO] Spark Project Catalyst ............................ SUCCESS
[2:43.695s]
[INFO] Spark Project SQL ................................. FAILURE
[1:01.762s]
[INFO] Spark Project ML Library .......................... SKIPPED
[INFO] Spark Project Tools ............................... SKIPPED
[INFO] Spark Project Hive ................................ SKIPPED
[INFO] Spark Project Docker Integration Tests ............ SKIPPED
[INFO] Spark Project REPL ................................ SKIPPED
[INFO] Spark Project YARN Shuffle Service ................ SKIPPED
[INFO] Spark Project YARN ................................ SKIPPED
[INFO] Spark Project Assembly ............................ SKIPPED
[INFO] Spark Project External Twitter .................... SKIPPED
[INFO] Spark Project External Flume Sink ................. SKIPPED
[INFO] Spark Project External Flume ...................... SKIPPED
[INFO] Spark Project External Flume Assembly ............. SKIPPED
[INFO] Spark Project External MQTT ....................... SKIPPED
[INFO] Spark Project External MQTT Assembly .............. SKIPPED
[INFO] Spark Project External ZeroMQ ..................... SKIPPED
[INFO] Spark Project External Kafka ...................... SKIPPED
[INFO] Spark Project Examples ............................ SKIPPED
[INFO] Spark Project External Kafka Assembly ............. SKIPPED
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 12:40.525s
[INFO] Finished at: Wed Aug 31 01:56:50 IST 2016
[INFO] Final Memory: 71M/830M
[INFO]
------------------------------------------------------------------------
[ERROR] Failed to execute goal
net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first)
on project spark-sql_2.11: Execution scala-compile-first of goal
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed
-> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the
-e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR] mvn <goals> -rf :spark-sql_2.11
--
Regards,
-- Nachiketa
Unless stated otherwise above:
IBM United Kingdom Limited - Registered in England and Wales with number
741598.
Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU
Re: Spark build 1.6.2 error
Posted by Nachiketa <na...@gmail.com>.
Hi Diwakar,
Could you please share the entire maven command that you are using to build
? And also the JDK version you are using ?
Also could you please confirm that you did execute the script for change
scala version to 2.11 before starting the build ? Thanks.
Regards,
Nachiketa
On Wed, Aug 31, 2016 at 2:00 AM, Diwakar Dhanuskodi <
diwakar.dhanuskodi@gmail.com> wrote:
> Hi,
>
> While building Spark 1.6.2 , getting below error in spark-sql. Much
> appreciate for any help.
>
> ERROR] missing or invalid dependency detected while loading class file
> 'WebUI.class'.
> Could not access term eclipse in package org,
> because it (or its dependencies) are missing. Check your build definition
> for
> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see
> the problematic classpath.)
> A full rebuild may help if 'WebUI.class' was compiled against an
> incompatible version of org.
> [ERROR] missing or invalid dependency detected while loading class file
> 'WebUI.class'.
> Could not access term jetty in value org.eclipse,
> because it (or its dependencies) are missing. Check your build definition
> for
> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see
> the problematic classpath.)
> A full rebuild may help if 'WebUI.class' was compiled against an
> incompatible version of org.eclipse.
> [WARNING] 17 warnings found
> [ERROR] two errors found
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Spark Project Parent POM .......................... SUCCESS [4.399s]
> [INFO] Spark Project Test Tags ........................... SUCCESS [3.443s]
> [INFO] Spark Project Launcher ............................ SUCCESS
> [10.131s]
> [INFO] Spark Project Networking .......................... SUCCESS
> [11.849s]
> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS [6.641s]
> [INFO] Spark Project Unsafe .............................. SUCCESS
> [19.765s]
> [INFO] Spark Project Core ................................ SUCCESS
> [4:16.511s]
> [INFO] Spark Project Bagel ............................... SUCCESS
> [13.401s]
> [INFO] Spark Project GraphX .............................. SUCCESS
> [1:08.824s]
> [INFO] Spark Project Streaming ........................... SUCCESS
> [2:18.844s]
> [INFO] Spark Project Catalyst ............................ SUCCESS
> [2:43.695s]
> [INFO] Spark Project SQL ................................. FAILURE
> [1:01.762s]
> [INFO] Spark Project ML Library .......................... SKIPPED
> [INFO] Spark Project Tools ............................... SKIPPED
> [INFO] Spark Project Hive ................................ SKIPPED
> [INFO] Spark Project Docker Integration Tests ............ SKIPPED
> [INFO] Spark Project REPL ................................ SKIPPED
> [INFO] Spark Project YARN Shuffle Service ................ SKIPPED
> [INFO] Spark Project YARN ................................ SKIPPED
> [INFO] Spark Project Assembly ............................ SKIPPED
> [INFO] Spark Project External Twitter .................... SKIPPED
> [INFO] Spark Project External Flume Sink ................. SKIPPED
> [INFO] Spark Project External Flume ...................... SKIPPED
> [INFO] Spark Project External Flume Assembly ............. SKIPPED
> [INFO] Spark Project External MQTT ....................... SKIPPED
> [INFO] Spark Project External MQTT Assembly .............. SKIPPED
> [INFO] Spark Project External ZeroMQ ..................... SKIPPED
> [INFO] Spark Project External Kafka ...................... SKIPPED
> [INFO] Spark Project Examples ............................ SKIPPED
> [INFO] Spark Project External Kafka Assembly ............. SKIPPED
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] Total time: 12:40.525s
> [INFO] Finished at: Wed Aug 31 01:56:50 IST 2016
> [INFO] Final Memory: 71M/830M
> [INFO] ------------------------------------------------------------
> ------------
> [ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> (scala-compile-first) on project spark-sql_2.11: Execution
> scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> failed. CompileFailed -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/
> PluginExecutionException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR] mvn <goals> -rf :spark-sql_2.11
>
>
>
--
Regards,
-- Nachiketa
Re: Spark build 1.6.2 error
Posted by Diwakar Dhanuskodi <di...@gmail.com>.
Sorry my bad. In both the runs I included -Dscala-2.11
On Sat, Sep 3, 2016 at 12:39 PM, Nachiketa <na...@gmail.com>
wrote:
> I think the difference was the -Dscala2.11 to the command line.
>
> I have seen this show up when I miss that.
>
> Regards,
> Nachiketa
>
> On Sat 3 Sep, 2016, 12:14 PM Diwakar Dhanuskodi, <
> diwakar.dhanuskodi@gmail.com> wrote:
>
>> Hi,
>>
>> Just re-ran again without killing zinc server process
>>
>> /make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive
>> -Pyarn -Dmaven.version=3.0.4 -Dscala-2.11 -X -rf :spark-sql_2.11
>>
>> Build is success. Not sure how it worked with just re-running command
>> again.
>>
>> On Sat, Sep 3, 2016 at 11:44 AM, Diwakar Dhanuskodi <
>> diwakar.dhanuskodi@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> java version 7
>>>
>>> mvn command
>>> ./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive
>>> -Phive-thriftserver -Pyarn -Dmaven.version=3.0.4
>>>
>>>
>>> yes, I executed script to change scala version to 2.11
>>> killed "com.typesafe zinc.Nailgun" process
>>>
>>> re-ran mvn with below command again
>>>
>>> ./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive
>>> -Phive-thriftserver -Pyarn -Dmaven.version=3.0.4 -X -rf :spark-sql_2.11
>>>
>>> Getting same error
>>>
>>> [warn] /home/cloudera/Downloads/spark-1.6.2/sql/core/src/main/
>>> scala/org/apache/spark/sql/sources/interfaces.scala:911: method isDir
>>> in class FileStatus is deprecated: see corresponding Javadoc for more
>>> information.
>>> [warn] status.isDir,
>>> [warn] ^
>>> [error] missing or invalid dependency detected while loading class file
>>> 'WebUI.class'.
>>> [error] Could not access term eclipse in package org,
>>> [error] because it (or its dependencies) are missing. Check your build
>>> definition for
>>> [error] missing or conflicting dependencies. (Re-run with
>>> `-Ylog-classpath` to see the problematic classpath.)
>>> [error] A full rebuild may help if 'WebUI.class' was compiled against an
>>> incompatible version of org.
>>> [error] missing or invalid dependency detected while loading class file
>>> 'WebUI.class'.
>>> [error] Could not access term jetty in value org.eclipse,
>>> [error] because it (or its dependencies) are missing. Check your build
>>> definition for
>>> [error] missing or conflicting dependencies. (Re-run with
>>> `-Ylog-classpath` to see the problematic classpath.)
>>> [error] A full rebuild may help if 'WebUI.class' was compiled against an
>>> incompatible version of org.eclipse.
>>> [warn] 17 warnings found
>>> [error] two errors found
>>> [debug] Compilation failed (CompilerInterface)
>>> [error] Compile failed at Sep 3, 2016 11:28:34 AM [21.611s]
>>> [INFO] ------------------------------------------------------------
>>> ------------
>>> [INFO] Reactor Summary:
>>> [INFO]
>>> [INFO] Spark Project Parent POM .......................... SUCCESS
>>> [5.583s]
>>> [INFO] Spark Project Test Tags ........................... SUCCESS
>>> [4.189s]
>>> [INFO] Spark Project Launcher ............................ SUCCESS
>>> [12.226s]
>>> [INFO] Spark Project Networking .......................... SUCCESS
>>> [13.386s]
>>> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS
>>> [6.723s]
>>> [INFO] Spark Project Unsafe .............................. SUCCESS
>>> [21.231s]
>>> [INFO] Spark Project Core ................................ SUCCESS
>>> [3:46.334s]
>>> [INFO] Spark Project Bagel ............................... SUCCESS
>>> [7.032s]
>>> [INFO] Spark Project GraphX .............................. SUCCESS
>>> [19.558s]
>>> [INFO] Spark Project Streaming ........................... SUCCESS
>>> [50.452s]
>>> [INFO] Spark Project Catalyst ............................ SUCCESS
>>> [1:14.172s]
>>> [INFO] Spark Project SQL ................................. FAILURE
>>> [23.222s]
>>> [INFO] Spark Project ML Library .......................... SKIPPED
>>> [INFO] Spark Project Tools ............................... SKIPPED
>>> [INFO] Spark Project Hive ................................ SKIPPED
>>> [INFO] Spark Project Docker Integration Tests ............ SKIPPED
>>> [INFO] Spark Project REPL ................................ SKIPPED
>>> [INFO] Spark Project YARN Shuffle Service ................ SKIPPED
>>> [INFO] Spark Project YARN ................................ SKIPPED
>>> [INFO] Spark Project Assembly ............................ SKIPPED
>>> [INFO] Spark Project External Twitter .................... SKIPPED
>>> [INFO] Spark Project External Flume Sink ................. SKIPPED
>>> [INFO] Spark Project External Flume ...................... SKIPPED
>>> [INFO] Spark Project External Flume Assembly ............. SKIPPED
>>> [INFO] Spark Project External MQTT ....................... SKIPPED
>>> [INFO] Spark Project External MQTT Assembly .............. SKIPPED
>>> [INFO] Spark Project External ZeroMQ ..................... SKIPPED
>>> [INFO] Spark Project External Kafka ...................... SKIPPED
>>> [INFO] Spark Project Examples ............................ SKIPPED
>>> [INFO] Spark Project External Kafka Assembly ............. SKIPPED
>>> [INFO] ------------------------------------------------------------
>>> ------------
>>> [INFO] BUILD FAILURE
>>> [INFO] ------------------------------------------------------------
>>> ------------
>>> [INFO] Total time: 7:45.641s
>>> [INFO] Finished at: Sat Sep 03 11:28:34 IST 2016
>>> [INFO] Final Memory: 49M/415M
>>> [INFO] ------------------------------------------------------------
>>> ------------
>>> [ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>>> (scala-compile-first) on project spark-sql_2.11: Execution
>>> scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>>> failed. CompileFailed -> [Help 1]
>>> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to
>>> execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>>> (scala-compile-first) on project spark-sql_2.11: Execution
>>> scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>>> failed.
>>> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
>>> MojoExecutor.java:225)
>>> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
>>> MojoExecutor.java:153)
>>> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
>>> MojoExecutor.java:145)
>>> at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.
>>> buildProject(LifecycleModuleBuilder.java:84)
>>> at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.
>>> buildProject(LifecycleModuleBuilder.java:59)
>>> at org.apache.maven.lifecycle.internal.LifecycleStarter.
>>> singleThreadedBuild(LifecycleStarter.java:183)
>>> at org.apache.maven.lifecycle.internal.LifecycleStarter.
>>> execute(LifecycleStarter.java:161)
>>> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
>>> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
>>> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
>>> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
>>> at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke(
>>> NativeMethodAccessorImpl.java:57)
>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
>>> DelegatingMethodAccessorImpl.java:43)
>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>> at org.codehaus.plexus.classworlds.launcher.Launcher.
>>> launchEnhanced(Launcher.java:290)
>>> at org.codehaus.plexus.classworlds.launcher.Launcher.
>>> launch(Launcher.java:230)
>>> at org.codehaus.plexus.classworlds.launcher.Launcher.
>>> mainWithExitCode(Launcher.java:409)
>>> at org.codehaus.plexus.classworlds.launcher.Launcher.
>>> main(Launcher.java:352)
>>> Caused by: org.apache.maven.plugin.PluginExecutionException: Execution
>>> scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>>> failed.
>>> at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(
>>> DefaultBuildPluginManager.java:110)
>>> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
>>> MojoExecutor.java:209)
>>> ... 19 more
>>> Caused by: Compile failed via zinc server
>>> at sbt_inc.SbtIncrementalCompiler.zincCompile(
>>> SbtIncrementalCompiler.java:136)
>>> at sbt_inc.SbtIncrementalCompiler.compile(SbtIncrementalCompiler.java:
>>> 86)
>>> at scala_maven.ScalaCompilerSupport.incrementalCompile(
>>> ScalaCompilerSupport.java:303)
>>> at scala_maven.ScalaCompilerSupport.compile(
>>> ScalaCompilerSupport.java:119)
>>> at scala_maven.ScalaCompilerSupport.doExecute(
>>> ScalaCompilerSupport.java:99)
>>> at scala_maven.ScalaMojoSupport.execute(ScalaMojoSupport.java:482)
>>> at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(
>>> DefaultBuildPluginManager.java:101)
>>> ... 20 more
>>> [ERROR]
>>> [ERROR]
>>> [ERROR] For more information about the errors and possible solutions,
>>> please read the following articles:
>>> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/
>>> PluginExecutionException
>>> [ERROR]
>>> [ERROR] After correcting the problems, you can resume the build with the
>>> command
>>> [ERROR] mvn <goals> -rf :spark-sql_2.11
>>>
>>>
>>> On Thu, Sep 1, 2016 at 8:23 AM, Divya Gehlot <di...@gmail.com>
>>> wrote:
>>>
>>>> Which java version are you using ?
>>>>
>>>> On 31 August 2016 at 04:30, Diwakar Dhanuskodi <
>>>> diwakar.dhanuskodi@gmail.com> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> While building Spark 1.6.2 , getting below error in spark-sql. Much
>>>>> appreciate for any help.
>>>>>
>>>>> ERROR] missing or invalid dependency detected while loading class file
>>>>> 'WebUI.class'.
>>>>> Could not access term eclipse in package org,
>>>>> because it (or its dependencies) are missing. Check your build
>>>>> definition for
>>>>> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to
>>>>> see the problematic classpath.)
>>>>> A full rebuild may help if 'WebUI.class' was compiled against an
>>>>> incompatible version of org.
>>>>> [ERROR] missing or invalid dependency detected while loading class
>>>>> file 'WebUI.class'.
>>>>> Could not access term jetty in value org.eclipse,
>>>>> because it (or its dependencies) are missing. Check your build
>>>>> definition for
>>>>> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to
>>>>> see the problematic classpath.)
>>>>> A full rebuild may help if 'WebUI.class' was compiled against an
>>>>> incompatible version of org.eclipse.
>>>>> [WARNING] 17 warnings found
>>>>> [ERROR] two errors found
>>>>> [INFO] ------------------------------------------------------------
>>>>> ------------
>>>>> [INFO] Reactor Summary:
>>>>> [INFO]
>>>>> [INFO] Spark Project Parent POM .......................... SUCCESS
>>>>> [4.399s]
>>>>> [INFO] Spark Project Test Tags ........................... SUCCESS
>>>>> [3.443s]
>>>>> [INFO] Spark Project Launcher ............................ SUCCESS
>>>>> [10.131s]
>>>>> [INFO] Spark Project Networking .......................... SUCCESS
>>>>> [11.849s]
>>>>> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS
>>>>> [6.641s]
>>>>> [INFO] Spark Project Unsafe .............................. SUCCESS
>>>>> [19.765s]
>>>>> [INFO] Spark Project Core ................................ SUCCESS
>>>>> [4:16.511s]
>>>>> [INFO] Spark Project Bagel ............................... SUCCESS
>>>>> [13.401s]
>>>>> [INFO] Spark Project GraphX .............................. SUCCESS
>>>>> [1:08.824s]
>>>>> [INFO] Spark Project Streaming ........................... SUCCESS
>>>>> [2:18.844s]
>>>>> [INFO] Spark Project Catalyst ............................ SUCCESS
>>>>> [2:43.695s]
>>>>> [INFO] Spark Project SQL ................................. FAILURE
>>>>> [1:01.762s]
>>>>> [INFO] Spark Project ML Library .......................... SKIPPED
>>>>> [INFO] Spark Project Tools ............................... SKIPPED
>>>>> [INFO] Spark Project Hive ................................ SKIPPED
>>>>> [INFO] Spark Project Docker Integration Tests ............ SKIPPED
>>>>> [INFO] Spark Project REPL ................................ SKIPPED
>>>>> [INFO] Spark Project YARN Shuffle Service ................ SKIPPED
>>>>> [INFO] Spark Project YARN ................................ SKIPPED
>>>>> [INFO] Spark Project Assembly ............................ SKIPPED
>>>>> [INFO] Spark Project External Twitter .................... SKIPPED
>>>>> [INFO] Spark Project External Flume Sink ................. SKIPPED
>>>>> [INFO] Spark Project External Flume ...................... SKIPPED
>>>>> [INFO] Spark Project External Flume Assembly ............. SKIPPED
>>>>> [INFO] Spark Project External MQTT ....................... SKIPPED
>>>>> [INFO] Spark Project External MQTT Assembly .............. SKIPPED
>>>>> [INFO] Spark Project External ZeroMQ ..................... SKIPPED
>>>>> [INFO] Spark Project External Kafka ...................... SKIPPED
>>>>> [INFO] Spark Project Examples ............................ SKIPPED
>>>>> [INFO] Spark Project External Kafka Assembly ............. SKIPPED
>>>>> [INFO] ------------------------------------------------------------
>>>>> ------------
>>>>> [INFO] BUILD FAILURE
>>>>> [INFO] ------------------------------------------------------------
>>>>> ------------
>>>>> [INFO] Total time: 12:40.525s
>>>>> [INFO] Finished at: Wed Aug 31 01:56:50 IST 2016
>>>>> [INFO] Final Memory: 71M/830M
>>>>> [INFO] ------------------------------------------------------------
>>>>> ------------
>>>>> [ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>>>>> (scala-compile-first) on project spark-sql_2.11: Execution
>>>>> scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>>>>> failed. CompileFailed -> [Help 1]
>>>>> [ERROR]
>>>>> [ERROR] To see the full stack trace of the errors, re-run Maven with
>>>>> the -e switch.
>>>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>>>> [ERROR]
>>>>> [ERROR] For more information about the errors and possible solutions,
>>>>> please read the following articles:
>>>>> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/
>>>>> PluginExecutionException
>>>>> [ERROR]
>>>>> [ERROR] After correcting the problems, you can resume the build with
>>>>> the command
>>>>> [ERROR] mvn <goals> -rf :spark-sql_2.11
>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
Re: Spark build 1.6.2 error
Posted by Nachiketa <na...@gmail.com>.
I think the difference was the -Dscala2.11 to the command line.
I have seen this show up when I miss that.
Regards,
Nachiketa
On Sat 3 Sep, 2016, 12:14 PM Diwakar Dhanuskodi, <
diwakar.dhanuskodi@gmail.com> wrote:
> Hi,
>
> Just re-ran again without killing zinc server process
>
> /make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive
> -Pyarn -Dmaven.version=3.0.4 -Dscala-2.11 -X -rf :spark-sql_2.11
>
> Build is success. Not sure how it worked with just re-running command
> again.
>
> On Sat, Sep 3, 2016 at 11:44 AM, Diwakar Dhanuskodi <
> diwakar.dhanuskodi@gmail.com> wrote:
>
>> Hi,
>>
>> java version 7
>>
>> mvn command
>> ./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive
>> -Phive-thriftserver -Pyarn -Dmaven.version=3.0.4
>>
>>
>> yes, I executed script to change scala version to 2.11
>> killed "com.typesafe zinc.Nailgun" process
>>
>> re-ran mvn with below command again
>>
>> ./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive
>> -Phive-thriftserver -Pyarn -Dmaven.version=3.0.4 -X -rf :spark-sql_2.11
>>
>> Getting same error
>>
>> [warn]
>> /home/cloudera/Downloads/spark-1.6.2/sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala:911:
>> method isDir in class FileStatus is deprecated: see corresponding Javadoc
>> for more information.
>> [warn] status.isDir,
>> [warn] ^
>> [error] missing or invalid dependency detected while loading class file
>> 'WebUI.class'.
>> [error] Could not access term eclipse in package org,
>> [error] because it (or its dependencies) are missing. Check your build
>> definition for
>> [error] missing or conflicting dependencies. (Re-run with
>> `-Ylog-classpath` to see the problematic classpath.)
>> [error] A full rebuild may help if 'WebUI.class' was compiled against an
>> incompatible version of org.
>> [error] missing or invalid dependency detected while loading class file
>> 'WebUI.class'.
>> [error] Could not access term jetty in value org.eclipse,
>> [error] because it (or its dependencies) are missing. Check your build
>> definition for
>> [error] missing or conflicting dependencies. (Re-run with
>> `-Ylog-classpath` to see the problematic classpath.)
>> [error] A full rebuild may help if 'WebUI.class' was compiled against an
>> incompatible version of org.eclipse.
>> [warn] 17 warnings found
>> [error] two errors found
>> [debug] Compilation failed (CompilerInterface)
>> [error] Compile failed at Sep 3, 2016 11:28:34 AM [21.611s]
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Reactor Summary:
>> [INFO]
>> [INFO] Spark Project Parent POM .......................... SUCCESS
>> [5.583s]
>> [INFO] Spark Project Test Tags ........................... SUCCESS
>> [4.189s]
>> [INFO] Spark Project Launcher ............................ SUCCESS
>> [12.226s]
>> [INFO] Spark Project Networking .......................... SUCCESS
>> [13.386s]
>> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS
>> [6.723s]
>> [INFO] Spark Project Unsafe .............................. SUCCESS
>> [21.231s]
>> [INFO] Spark Project Core ................................ SUCCESS
>> [3:46.334s]
>> [INFO] Spark Project Bagel ............................... SUCCESS
>> [7.032s]
>> [INFO] Spark Project GraphX .............................. SUCCESS
>> [19.558s]
>> [INFO] Spark Project Streaming ........................... SUCCESS
>> [50.452s]
>> [INFO] Spark Project Catalyst ............................ SUCCESS
>> [1:14.172s]
>> [INFO] Spark Project SQL ................................. FAILURE
>> [23.222s]
>> [INFO] Spark Project ML Library .......................... SKIPPED
>> [INFO] Spark Project Tools ............................... SKIPPED
>> [INFO] Spark Project Hive ................................ SKIPPED
>> [INFO] Spark Project Docker Integration Tests ............ SKIPPED
>> [INFO] Spark Project REPL ................................ SKIPPED
>> [INFO] Spark Project YARN Shuffle Service ................ SKIPPED
>> [INFO] Spark Project YARN ................................ SKIPPED
>> [INFO] Spark Project Assembly ............................ SKIPPED
>> [INFO] Spark Project External Twitter .................... SKIPPED
>> [INFO] Spark Project External Flume Sink ................. SKIPPED
>> [INFO] Spark Project External Flume ...................... SKIPPED
>> [INFO] Spark Project External Flume Assembly ............. SKIPPED
>> [INFO] Spark Project External MQTT ....................... SKIPPED
>> [INFO] Spark Project External MQTT Assembly .............. SKIPPED
>> [INFO] Spark Project External ZeroMQ ..................... SKIPPED
>> [INFO] Spark Project External Kafka ...................... SKIPPED
>> [INFO] Spark Project Examples ............................ SKIPPED
>> [INFO] Spark Project External Kafka Assembly ............. SKIPPED
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] BUILD FAILURE
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 7:45.641s
>> [INFO] Finished at: Sat Sep 03 11:28:34 IST 2016
>> [INFO] Final Memory: 49M/415M
>> [INFO]
>> ------------------------------------------------------------------------
>> [ERROR] Failed to execute goal
>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first)
>> on project spark-sql_2.11: Execution scala-compile-first of goal
>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed
>> -> [Help 1]
>> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
>> goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>> (scala-compile-first) on project spark-sql_2.11: Execution
>> scala-compile-first of goal
>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed.
>> at
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:225)
>> at
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>> at
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>> at
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
>> at
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
>> at
>> org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
>> at
>> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
>> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
>> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
>> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
>> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
>> at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:606)
>> at
>> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
>> at
>> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
>> at
>> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
>> at
>> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
>> Caused by: org.apache.maven.plugin.PluginExecutionException: Execution
>> scala-compile-first of goal
>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed.
>> at
>> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:110)
>> at
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
>> ... 19 more
>> Caused by: Compile failed via zinc server
>> at
>> sbt_inc.SbtIncrementalCompiler.zincCompile(SbtIncrementalCompiler.java:136)
>> at sbt_inc.SbtIncrementalCompiler.compile(SbtIncrementalCompiler.java:86)
>> at
>> scala_maven.ScalaCompilerSupport.incrementalCompile(ScalaCompilerSupport.java:303)
>> at scala_maven.ScalaCompilerSupport.compile(ScalaCompilerSupport.java:119)
>> at
>> scala_maven.ScalaCompilerSupport.doExecute(ScalaCompilerSupport.java:99)
>> at scala_maven.ScalaMojoSupport.execute(ScalaMojoSupport.java:482)
>> at
>> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
>> ... 20 more
>> [ERROR]
>> [ERROR]
>> [ERROR] For more information about the errors and possible solutions,
>> please read the following articles:
>> [ERROR] [Help 1]
>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>> [ERROR]
>> [ERROR] After correcting the problems, you can resume the build with the
>> command
>> [ERROR] mvn <goals> -rf :spark-sql_2.11
>>
>>
>> On Thu, Sep 1, 2016 at 8:23 AM, Divya Gehlot <di...@gmail.com>
>> wrote:
>>
>>> Which java version are you using ?
>>>
>>> On 31 August 2016 at 04:30, Diwakar Dhanuskodi <
>>> diwakar.dhanuskodi@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> While building Spark 1.6.2 , getting below error in spark-sql. Much
>>>> appreciate for any help.
>>>>
>>>> ERROR] missing or invalid dependency detected while loading class file
>>>> 'WebUI.class'.
>>>> Could not access term eclipse in package org,
>>>> because it (or its dependencies) are missing. Check your build
>>>> definition for
>>>> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to
>>>> see the problematic classpath.)
>>>> A full rebuild may help if 'WebUI.class' was compiled against an
>>>> incompatible version of org.
>>>> [ERROR] missing or invalid dependency detected while loading class file
>>>> 'WebUI.class'.
>>>> Could not access term jetty in value org.eclipse,
>>>> because it (or its dependencies) are missing. Check your build
>>>> definition for
>>>> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to
>>>> see the problematic classpath.)
>>>> A full rebuild may help if 'WebUI.class' was compiled against an
>>>> incompatible version of org.eclipse.
>>>> [WARNING] 17 warnings found
>>>> [ERROR] two errors found
>>>> [INFO]
>>>> ------------------------------------------------------------------------
>>>> [INFO] Reactor Summary:
>>>> [INFO]
>>>> [INFO] Spark Project Parent POM .......................... SUCCESS
>>>> [4.399s]
>>>> [INFO] Spark Project Test Tags ........................... SUCCESS
>>>> [3.443s]
>>>> [INFO] Spark Project Launcher ............................ SUCCESS
>>>> [10.131s]
>>>> [INFO] Spark Project Networking .......................... SUCCESS
>>>> [11.849s]
>>>> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS
>>>> [6.641s]
>>>> [INFO] Spark Project Unsafe .............................. SUCCESS
>>>> [19.765s]
>>>> [INFO] Spark Project Core ................................ SUCCESS
>>>> [4:16.511s]
>>>> [INFO] Spark Project Bagel ............................... SUCCESS
>>>> [13.401s]
>>>> [INFO] Spark Project GraphX .............................. SUCCESS
>>>> [1:08.824s]
>>>> [INFO] Spark Project Streaming ........................... SUCCESS
>>>> [2:18.844s]
>>>> [INFO] Spark Project Catalyst ............................ SUCCESS
>>>> [2:43.695s]
>>>> [INFO] Spark Project SQL ................................. FAILURE
>>>> [1:01.762s]
>>>> [INFO] Spark Project ML Library .......................... SKIPPED
>>>> [INFO] Spark Project Tools ............................... SKIPPED
>>>> [INFO] Spark Project Hive ................................ SKIPPED
>>>> [INFO] Spark Project Docker Integration Tests ............ SKIPPED
>>>> [INFO] Spark Project REPL ................................ SKIPPED
>>>> [INFO] Spark Project YARN Shuffle Service ................ SKIPPED
>>>> [INFO] Spark Project YARN ................................ SKIPPED
>>>> [INFO] Spark Project Assembly ............................ SKIPPED
>>>> [INFO] Spark Project External Twitter .................... SKIPPED
>>>> [INFO] Spark Project External Flume Sink ................. SKIPPED
>>>> [INFO] Spark Project External Flume ...................... SKIPPED
>>>> [INFO] Spark Project External Flume Assembly ............. SKIPPED
>>>> [INFO] Spark Project External MQTT ....................... SKIPPED
>>>> [INFO] Spark Project External MQTT Assembly .............. SKIPPED
>>>> [INFO] Spark Project External ZeroMQ ..................... SKIPPED
>>>> [INFO] Spark Project External Kafka ...................... SKIPPED
>>>> [INFO] Spark Project Examples ............................ SKIPPED
>>>> [INFO] Spark Project External Kafka Assembly ............. SKIPPED
>>>> [INFO]
>>>> ------------------------------------------------------------------------
>>>> [INFO] BUILD FAILURE
>>>> [INFO]
>>>> ------------------------------------------------------------------------
>>>> [INFO] Total time: 12:40.525s
>>>> [INFO] Finished at: Wed Aug 31 01:56:50 IST 2016
>>>> [INFO] Final Memory: 71M/830M
>>>> [INFO]
>>>> ------------------------------------------------------------------------
>>>> [ERROR] Failed to execute goal
>>>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first)
>>>> on project spark-sql_2.11: Execution scala-compile-first of goal
>>>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed
>>>> -> [Help 1]
>>>> [ERROR]
>>>> [ERROR] To see the full stack trace of the errors, re-run Maven with
>>>> the -e switch.
>>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>>> [ERROR]
>>>> [ERROR] For more information about the errors and possible solutions,
>>>> please read the following articles:
>>>> [ERROR] [Help 1]
>>>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>>>> [ERROR]
>>>> [ERROR] After correcting the problems, you can resume the build with
>>>> the command
>>>> [ERROR] mvn <goals> -rf :spark-sql_2.11
>>>>
>>>>
>>>>
>>>
>>
>
Re: Spark build 1.6.2 error
Posted by Diwakar Dhanuskodi <di...@gmail.com>.
Hi,
Just re-ran again without killing zinc server process
/make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive -Pyarn
-Dmaven.version=3.0.4 -Dscala-2.11 -X -rf :spark-sql_2.11
Build is success. Not sure how it worked with just re-running command
again.
On Sat, Sep 3, 2016 at 11:44 AM, Diwakar Dhanuskodi <
diwakar.dhanuskodi@gmail.com> wrote:
> Hi,
>
> java version 7
>
> mvn command
> ./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive
> -Phive-thriftserver -Pyarn -Dmaven.version=3.0.4
>
>
> yes, I executed script to change scala version to 2.11
> killed "com.typesafe zinc.Nailgun" process
>
> re-ran mvn with below command again
>
> ./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive
> -Phive-thriftserver -Pyarn -Dmaven.version=3.0.4 -X -rf :spark-sql_2.11
>
> Getting same error
>
> [warn] /home/cloudera/Downloads/spark-1.6.2/sql/core/src/main/
> scala/org/apache/spark/sql/sources/interfaces.scala:911: method isDir in
> class FileStatus is deprecated: see corresponding Javadoc for more
> information.
> [warn] status.isDir,
> [warn] ^
> [error] missing or invalid dependency detected while loading class file
> 'WebUI.class'.
> [error] Could not access term eclipse in package org,
> [error] because it (or its dependencies) are missing. Check your build
> definition for
> [error] missing or conflicting dependencies. (Re-run with
> `-Ylog-classpath` to see the problematic classpath.)
> [error] A full rebuild may help if 'WebUI.class' was compiled against an
> incompatible version of org.
> [error] missing or invalid dependency detected while loading class file
> 'WebUI.class'.
> [error] Could not access term jetty in value org.eclipse,
> [error] because it (or its dependencies) are missing. Check your build
> definition for
> [error] missing or conflicting dependencies. (Re-run with
> `-Ylog-classpath` to see the problematic classpath.)
> [error] A full rebuild may help if 'WebUI.class' was compiled against an
> incompatible version of org.eclipse.
> [warn] 17 warnings found
> [error] two errors found
> [debug] Compilation failed (CompilerInterface)
> [error] Compile failed at Sep 3, 2016 11:28:34 AM [21.611s]
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Spark Project Parent POM .......................... SUCCESS [5.583s]
> [INFO] Spark Project Test Tags ........................... SUCCESS [4.189s]
> [INFO] Spark Project Launcher ............................ SUCCESS
> [12.226s]
> [INFO] Spark Project Networking .......................... SUCCESS
> [13.386s]
> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS [6.723s]
> [INFO] Spark Project Unsafe .............................. SUCCESS
> [21.231s]
> [INFO] Spark Project Core ................................ SUCCESS
> [3:46.334s]
> [INFO] Spark Project Bagel ............................... SUCCESS
> [7.032s]
> [INFO] Spark Project GraphX .............................. SUCCESS
> [19.558s]
> [INFO] Spark Project Streaming ........................... SUCCESS
> [50.452s]
> [INFO] Spark Project Catalyst ............................ SUCCESS
> [1:14.172s]
> [INFO] Spark Project SQL ................................. FAILURE
> [23.222s]
> [INFO] Spark Project ML Library .......................... SKIPPED
> [INFO] Spark Project Tools ............................... SKIPPED
> [INFO] Spark Project Hive ................................ SKIPPED
> [INFO] Spark Project Docker Integration Tests ............ SKIPPED
> [INFO] Spark Project REPL ................................ SKIPPED
> [INFO] Spark Project YARN Shuffle Service ................ SKIPPED
> [INFO] Spark Project YARN ................................ SKIPPED
> [INFO] Spark Project Assembly ............................ SKIPPED
> [INFO] Spark Project External Twitter .................... SKIPPED
> [INFO] Spark Project External Flume Sink ................. SKIPPED
> [INFO] Spark Project External Flume ...................... SKIPPED
> [INFO] Spark Project External Flume Assembly ............. SKIPPED
> [INFO] Spark Project External MQTT ....................... SKIPPED
> [INFO] Spark Project External MQTT Assembly .............. SKIPPED
> [INFO] Spark Project External ZeroMQ ..................... SKIPPED
> [INFO] Spark Project External Kafka ...................... SKIPPED
> [INFO] Spark Project Examples ............................ SKIPPED
> [INFO] Spark Project External Kafka Assembly ............. SKIPPED
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] Total time: 7:45.641s
> [INFO] Finished at: Sat Sep 03 11:28:34 IST 2016
> [INFO] Final Memory: 49M/415M
> [INFO] ------------------------------------------------------------
> ------------
> [ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> (scala-compile-first) on project spark-sql_2.11: Execution
> scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> failed. CompileFailed -> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> (scala-compile-first) on project spark-sql_2.11: Execution
> scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> failed.
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> MojoExecutor.java:225)
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> MojoExecutor.java:153)
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> MojoExecutor.java:145)
> at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.
> buildProject(LifecycleModuleBuilder.java:84)
> at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.
> buildProject(LifecycleModuleBuilder.java:59)
> at org.apache.maven.lifecycle.internal.LifecycleStarter.
> singleThreadedBuild(LifecycleStarter.java:183)
> at org.apache.maven.lifecycle.internal.LifecycleStarter.
> execute(LifecycleStarter.java:161)
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.codehaus.plexus.classworlds.launcher.Launcher.
> launchEnhanced(Launcher.java:290)
> at org.codehaus.plexus.classworlds.launcher.Launcher.
> launch(Launcher.java:230)
> at org.codehaus.plexus.classworlds.launcher.Launcher.
> mainWithExitCode(Launcher.java:409)
> at org.codehaus.plexus.classworlds.launcher.Launcher.
> main(Launcher.java:352)
> Caused by: org.apache.maven.plugin.PluginExecutionException: Execution
> scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> failed.
> at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(
> DefaultBuildPluginManager.java:110)
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> MojoExecutor.java:209)
> ... 19 more
> Caused by: Compile failed via zinc server
> at sbt_inc.SbtIncrementalCompiler.zincCompile(SbtIncrementalCompiler.java:
> 136)
> at sbt_inc.SbtIncrementalCompiler.compile(SbtIncrementalCompiler.java:86)
> at scala_maven.ScalaCompilerSupport.incrementalCompile(
> ScalaCompilerSupport.java:303)
> at scala_maven.ScalaCompilerSupport.compile(ScalaCompilerSupport.java:119)
> at scala_maven.ScalaCompilerSupport.doExecute(
> ScalaCompilerSupport.java:99)
> at scala_maven.ScalaMojoSupport.execute(ScalaMojoSupport.java:482)
> at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(
> DefaultBuildPluginManager.java:101)
> ... 20 more
> [ERROR]
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/
> PluginExecutionException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR] mvn <goals> -rf :spark-sql_2.11
>
>
> On Thu, Sep 1, 2016 at 8:23 AM, Divya Gehlot <di...@gmail.com>
> wrote:
>
>> Which java version are you using ?
>>
>> On 31 August 2016 at 04:30, Diwakar Dhanuskodi <
>> diwakar.dhanuskodi@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> While building Spark 1.6.2 , getting below error in spark-sql. Much
>>> appreciate for any help.
>>>
>>> ERROR] missing or invalid dependency detected while loading class file
>>> 'WebUI.class'.
>>> Could not access term eclipse in package org,
>>> because it (or its dependencies) are missing. Check your build
>>> definition for
>>> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to
>>> see the problematic classpath.)
>>> A full rebuild may help if 'WebUI.class' was compiled against an
>>> incompatible version of org.
>>> [ERROR] missing or invalid dependency detected while loading class file
>>> 'WebUI.class'.
>>> Could not access term jetty in value org.eclipse,
>>> because it (or its dependencies) are missing. Check your build
>>> definition for
>>> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to
>>> see the problematic classpath.)
>>> A full rebuild may help if 'WebUI.class' was compiled against an
>>> incompatible version of org.eclipse.
>>> [WARNING] 17 warnings found
>>> [ERROR] two errors found
>>> [INFO] ------------------------------------------------------------
>>> ------------
>>> [INFO] Reactor Summary:
>>> [INFO]
>>> [INFO] Spark Project Parent POM .......................... SUCCESS
>>> [4.399s]
>>> [INFO] Spark Project Test Tags ........................... SUCCESS
>>> [3.443s]
>>> [INFO] Spark Project Launcher ............................ SUCCESS
>>> [10.131s]
>>> [INFO] Spark Project Networking .......................... SUCCESS
>>> [11.849s]
>>> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS
>>> [6.641s]
>>> [INFO] Spark Project Unsafe .............................. SUCCESS
>>> [19.765s]
>>> [INFO] Spark Project Core ................................ SUCCESS
>>> [4:16.511s]
>>> [INFO] Spark Project Bagel ............................... SUCCESS
>>> [13.401s]
>>> [INFO] Spark Project GraphX .............................. SUCCESS
>>> [1:08.824s]
>>> [INFO] Spark Project Streaming ........................... SUCCESS
>>> [2:18.844s]
>>> [INFO] Spark Project Catalyst ............................ SUCCESS
>>> [2:43.695s]
>>> [INFO] Spark Project SQL ................................. FAILURE
>>> [1:01.762s]
>>> [INFO] Spark Project ML Library .......................... SKIPPED
>>> [INFO] Spark Project Tools ............................... SKIPPED
>>> [INFO] Spark Project Hive ................................ SKIPPED
>>> [INFO] Spark Project Docker Integration Tests ............ SKIPPED
>>> [INFO] Spark Project REPL ................................ SKIPPED
>>> [INFO] Spark Project YARN Shuffle Service ................ SKIPPED
>>> [INFO] Spark Project YARN ................................ SKIPPED
>>> [INFO] Spark Project Assembly ............................ SKIPPED
>>> [INFO] Spark Project External Twitter .................... SKIPPED
>>> [INFO] Spark Project External Flume Sink ................. SKIPPED
>>> [INFO] Spark Project External Flume ...................... SKIPPED
>>> [INFO] Spark Project External Flume Assembly ............. SKIPPED
>>> [INFO] Spark Project External MQTT ....................... SKIPPED
>>> [INFO] Spark Project External MQTT Assembly .............. SKIPPED
>>> [INFO] Spark Project External ZeroMQ ..................... SKIPPED
>>> [INFO] Spark Project External Kafka ...................... SKIPPED
>>> [INFO] Spark Project Examples ............................ SKIPPED
>>> [INFO] Spark Project External Kafka Assembly ............. SKIPPED
>>> [INFO] ------------------------------------------------------------
>>> ------------
>>> [INFO] BUILD FAILURE
>>> [INFO] ------------------------------------------------------------
>>> ------------
>>> [INFO] Total time: 12:40.525s
>>> [INFO] Finished at: Wed Aug 31 01:56:50 IST 2016
>>> [INFO] Final Memory: 71M/830M
>>> [INFO] ------------------------------------------------------------
>>> ------------
>>> [ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>>> (scala-compile-first) on project spark-sql_2.11: Execution
>>> scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>>> failed. CompileFailed -> [Help 1]
>>> [ERROR]
>>> [ERROR] To see the full stack trace of the errors, re-run Maven with the
>>> -e switch.
>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>> [ERROR]
>>> [ERROR] For more information about the errors and possible solutions,
>>> please read the following articles:
>>> [ERROR] [Help 1] http://cwiki.apache.org/conflu
>>> ence/display/MAVEN/PluginExecutionException
>>> [ERROR]
>>> [ERROR] After correcting the problems, you can resume the build with the
>>> command
>>> [ERROR] mvn <goals> -rf :spark-sql_2.11
>>>
>>>
>>>
>>
>
Re: Spark build 1.6.2 error
Posted by Diwakar Dhanuskodi <di...@gmail.com>.
Hi,
java version 7
mvn command
./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive
-Phive-thriftserver -Pyarn -Dmaven.version=3.0.4
yes, I executed script to change scala version to 2.11
killed "com.typesafe zinc.Nailgun" process
re-ran mvn with below command again
./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive
-Phive-thriftserver -Pyarn -Dmaven.version=3.0.4 -X -rf :spark-sql_2.11
Getting same error
[warn]
/home/cloudera/Downloads/spark-1.6.2/sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala:911:
method isDir in class FileStatus is deprecated: see corresponding Javadoc
for more information.
[warn] status.isDir,
[warn] ^
[error] missing or invalid dependency detected while loading class file
'WebUI.class'.
[error] Could not access term eclipse in package org,
[error] because it (or its dependencies) are missing. Check your build
definition for
[error] missing or conflicting dependencies. (Re-run with `-Ylog-classpath`
to see the problematic classpath.)
[error] A full rebuild may help if 'WebUI.class' was compiled against an
incompatible version of org.
[error] missing or invalid dependency detected while loading class file
'WebUI.class'.
[error] Could not access term jetty in value org.eclipse,
[error] because it (or its dependencies) are missing. Check your build
definition for
[error] missing or conflicting dependencies. (Re-run with `-Ylog-classpath`
to see the problematic classpath.)
[error] A full rebuild may help if 'WebUI.class' was compiled against an
incompatible version of org.eclipse.
[warn] 17 warnings found
[error] two errors found
[debug] Compilation failed (CompilerInterface)
[error] Compile failed at Sep 3, 2016 11:28:34 AM [21.611s]
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM .......................... SUCCESS [5.583s]
[INFO] Spark Project Test Tags ........................... SUCCESS [4.189s]
[INFO] Spark Project Launcher ............................ SUCCESS [12.226s]
[INFO] Spark Project Networking .......................... SUCCESS [13.386s]
[INFO] Spark Project Shuffle Streaming Service ........... SUCCESS [6.723s]
[INFO] Spark Project Unsafe .............................. SUCCESS [21.231s]
[INFO] Spark Project Core ................................ SUCCESS
[3:46.334s]
[INFO] Spark Project Bagel ............................... SUCCESS [7.032s]
[INFO] Spark Project GraphX .............................. SUCCESS [19.558s]
[INFO] Spark Project Streaming ........................... SUCCESS [50.452s]
[INFO] Spark Project Catalyst ............................ SUCCESS
[1:14.172s]
[INFO] Spark Project SQL ................................. FAILURE [23.222s]
[INFO] Spark Project ML Library .......................... SKIPPED
[INFO] Spark Project Tools ............................... SKIPPED
[INFO] Spark Project Hive ................................ SKIPPED
[INFO] Spark Project Docker Integration Tests ............ SKIPPED
[INFO] Spark Project REPL ................................ SKIPPED
[INFO] Spark Project YARN Shuffle Service ................ SKIPPED
[INFO] Spark Project YARN ................................ SKIPPED
[INFO] Spark Project Assembly ............................ SKIPPED
[INFO] Spark Project External Twitter .................... SKIPPED
[INFO] Spark Project External Flume Sink ................. SKIPPED
[INFO] Spark Project External Flume ...................... SKIPPED
[INFO] Spark Project External Flume Assembly ............. SKIPPED
[INFO] Spark Project External MQTT ....................... SKIPPED
[INFO] Spark Project External MQTT Assembly .............. SKIPPED
[INFO] Spark Project External ZeroMQ ..................... SKIPPED
[INFO] Spark Project External Kafka ...................... SKIPPED
[INFO] Spark Project Examples ............................ SKIPPED
[INFO] Spark Project External Kafka Assembly ............. SKIPPED
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 7:45.641s
[INFO] Finished at: Sat Sep 03 11:28:34 IST 2016
[INFO] Final Memory: 49M/415M
[INFO]
------------------------------------------------------------------------
[ERROR] Failed to execute goal
net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first)
on project spark-sql_2.11: Execution scala-compile-first of goal
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed
-> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
(scala-compile-first) on project spark-sql_2.11: Execution
scala-compile-first of goal
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed.
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:225)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
at
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
Caused by: org.apache.maven.plugin.PluginExecutionException: Execution
scala-compile-first of goal
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed.
at
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:110)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
... 19 more
Caused by: Compile failed via zinc server
at
sbt_inc.SbtIncrementalCompiler.zincCompile(SbtIncrementalCompiler.java:136)
at sbt_inc.SbtIncrementalCompiler.compile(SbtIncrementalCompiler.java:86)
at
scala_maven.ScalaCompilerSupport.incrementalCompile(ScalaCompilerSupport.java:303)
at scala_maven.ScalaCompilerSupport.compile(ScalaCompilerSupport.java:119)
at scala_maven.ScalaCompilerSupport.doExecute(ScalaCompilerSupport.java:99)
at scala_maven.ScalaMojoSupport.execute(ScalaMojoSupport.java:482)
at
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
... 20 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR] mvn <goals> -rf :spark-sql_2.11
On Thu, Sep 1, 2016 at 8:23 AM, Divya Gehlot <di...@gmail.com>
wrote:
> Which java version are you using ?
>
> On 31 August 2016 at 04:30, Diwakar Dhanuskodi <
> diwakar.dhanuskodi@gmail.com> wrote:
>
>> Hi,
>>
>> While building Spark 1.6.2 , getting below error in spark-sql. Much
>> appreciate for any help.
>>
>> ERROR] missing or invalid dependency detected while loading class file
>> 'WebUI.class'.
>> Could not access term eclipse in package org,
>> because it (or its dependencies) are missing. Check your build definition
>> for
>> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to
>> see the problematic classpath.)
>> A full rebuild may help if 'WebUI.class' was compiled against an
>> incompatible version of org.
>> [ERROR] missing or invalid dependency detected while loading class file
>> 'WebUI.class'.
>> Could not access term jetty in value org.eclipse,
>> because it (or its dependencies) are missing. Check your build definition
>> for
>> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to
>> see the problematic classpath.)
>> A full rebuild may help if 'WebUI.class' was compiled against an
>> incompatible version of org.eclipse.
>> [WARNING] 17 warnings found
>> [ERROR] two errors found
>> [INFO] ------------------------------------------------------------
>> ------------
>> [INFO] Reactor Summary:
>> [INFO]
>> [INFO] Spark Project Parent POM .......................... SUCCESS
>> [4.399s]
>> [INFO] Spark Project Test Tags ........................... SUCCESS
>> [3.443s]
>> [INFO] Spark Project Launcher ............................ SUCCESS
>> [10.131s]
>> [INFO] Spark Project Networking .......................... SUCCESS
>> [11.849s]
>> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS
>> [6.641s]
>> [INFO] Spark Project Unsafe .............................. SUCCESS
>> [19.765s]
>> [INFO] Spark Project Core ................................ SUCCESS
>> [4:16.511s]
>> [INFO] Spark Project Bagel ............................... SUCCESS
>> [13.401s]
>> [INFO] Spark Project GraphX .............................. SUCCESS
>> [1:08.824s]
>> [INFO] Spark Project Streaming ........................... SUCCESS
>> [2:18.844s]
>> [INFO] Spark Project Catalyst ............................ SUCCESS
>> [2:43.695s]
>> [INFO] Spark Project SQL ................................. FAILURE
>> [1:01.762s]
>> [INFO] Spark Project ML Library .......................... SKIPPED
>> [INFO] Spark Project Tools ............................... SKIPPED
>> [INFO] Spark Project Hive ................................ SKIPPED
>> [INFO] Spark Project Docker Integration Tests ............ SKIPPED
>> [INFO] Spark Project REPL ................................ SKIPPED
>> [INFO] Spark Project YARN Shuffle Service ................ SKIPPED
>> [INFO] Spark Project YARN ................................ SKIPPED
>> [INFO] Spark Project Assembly ............................ SKIPPED
>> [INFO] Spark Project External Twitter .................... SKIPPED
>> [INFO] Spark Project External Flume Sink ................. SKIPPED
>> [INFO] Spark Project External Flume ...................... SKIPPED
>> [INFO] Spark Project External Flume Assembly ............. SKIPPED
>> [INFO] Spark Project External MQTT ....................... SKIPPED
>> [INFO] Spark Project External MQTT Assembly .............. SKIPPED
>> [INFO] Spark Project External ZeroMQ ..................... SKIPPED
>> [INFO] Spark Project External Kafka ...................... SKIPPED
>> [INFO] Spark Project Examples ............................ SKIPPED
>> [INFO] Spark Project External Kafka Assembly ............. SKIPPED
>> [INFO] ------------------------------------------------------------
>> ------------
>> [INFO] BUILD FAILURE
>> [INFO] ------------------------------------------------------------
>> ------------
>> [INFO] Total time: 12:40.525s
>> [INFO] Finished at: Wed Aug 31 01:56:50 IST 2016
>> [INFO] Final Memory: 71M/830M
>> [INFO] ------------------------------------------------------------
>> ------------
>> [ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>> (scala-compile-first) on project spark-sql_2.11: Execution
>> scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>> failed. CompileFailed -> [Help 1]
>> [ERROR]
>> [ERROR] To see the full stack trace of the errors, re-run Maven with the
>> -e switch.
>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>> [ERROR]
>> [ERROR] For more information about the errors and possible solutions,
>> please read the following articles:
>> [ERROR] [Help 1] http://cwiki.apache.org/conflu
>> ence/display/MAVEN/PluginExecutionException
>> [ERROR]
>> [ERROR] After correcting the problems, you can resume the build with the
>> command
>> [ERROR] mvn <goals> -rf :spark-sql_2.11
>>
>>
>>
>
Re: Spark build 1.6.2 error
Posted by Divya Gehlot <di...@gmail.com>.
Which java version are you using ?
On 31 August 2016 at 04:30, Diwakar Dhanuskodi <diwakar.dhanuskodi@gmail.com
> wrote:
> Hi,
>
> While building Spark 1.6.2 , getting below error in spark-sql. Much
> appreciate for any help.
>
> ERROR] missing or invalid dependency detected while loading class file
> 'WebUI.class'.
> Could not access term eclipse in package org,
> because it (or its dependencies) are missing. Check your build definition
> for
> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see
> the problematic classpath.)
> A full rebuild may help if 'WebUI.class' was compiled against an
> incompatible version of org.
> [ERROR] missing or invalid dependency detected while loading class file
> 'WebUI.class'.
> Could not access term jetty in value org.eclipse,
> because it (or its dependencies) are missing. Check your build definition
> for
> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see
> the problematic classpath.)
> A full rebuild may help if 'WebUI.class' was compiled against an
> incompatible version of org.eclipse.
> [WARNING] 17 warnings found
> [ERROR] two errors found
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Spark Project Parent POM .......................... SUCCESS [4.399s]
> [INFO] Spark Project Test Tags ........................... SUCCESS [3.443s]
> [INFO] Spark Project Launcher ............................ SUCCESS
> [10.131s]
> [INFO] Spark Project Networking .......................... SUCCESS
> [11.849s]
> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS [6.641s]
> [INFO] Spark Project Unsafe .............................. SUCCESS
> [19.765s]
> [INFO] Spark Project Core ................................ SUCCESS
> [4:16.511s]
> [INFO] Spark Project Bagel ............................... SUCCESS
> [13.401s]
> [INFO] Spark Project GraphX .............................. SUCCESS
> [1:08.824s]
> [INFO] Spark Project Streaming ........................... SUCCESS
> [2:18.844s]
> [INFO] Spark Project Catalyst ............................ SUCCESS
> [2:43.695s]
> [INFO] Spark Project SQL ................................. FAILURE
> [1:01.762s]
> [INFO] Spark Project ML Library .......................... SKIPPED
> [INFO] Spark Project Tools ............................... SKIPPED
> [INFO] Spark Project Hive ................................ SKIPPED
> [INFO] Spark Project Docker Integration Tests ............ SKIPPED
> [INFO] Spark Project REPL ................................ SKIPPED
> [INFO] Spark Project YARN Shuffle Service ................ SKIPPED
> [INFO] Spark Project YARN ................................ SKIPPED
> [INFO] Spark Project Assembly ............................ SKIPPED
> [INFO] Spark Project External Twitter .................... SKIPPED
> [INFO] Spark Project External Flume Sink ................. SKIPPED
> [INFO] Spark Project External Flume ...................... SKIPPED
> [INFO] Spark Project External Flume Assembly ............. SKIPPED
> [INFO] Spark Project External MQTT ....................... SKIPPED
> [INFO] Spark Project External MQTT Assembly .............. SKIPPED
> [INFO] Spark Project External ZeroMQ ..................... SKIPPED
> [INFO] Spark Project External Kafka ...................... SKIPPED
> [INFO] Spark Project Examples ............................ SKIPPED
> [INFO] Spark Project External Kafka Assembly ............. SKIPPED
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] Total time: 12:40.525s
> [INFO] Finished at: Wed Aug 31 01:56:50 IST 2016
> [INFO] Final Memory: 71M/830M
> [INFO] ------------------------------------------------------------
> ------------
> [ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> (scala-compile-first) on project spark-sql_2.11: Execution
> scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> failed. CompileFailed -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/
> PluginExecutionException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR] mvn <goals> -rf :spark-sql_2.11
>
>
>