You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Divya Gehlot <di...@gmail.com> on 2016/09/01 02:53:13 UTC
Re: Spark build 1.6.2 error
Which java version are you using ?
On 31 August 2016 at 04:30, Diwakar Dhanuskodi <diwakar.dhanuskodi@gmail.com
> wrote:
> Hi,
>
> While building Spark 1.6.2 , getting below error in spark-sql. Much
> appreciate for any help.
>
> ERROR] missing or invalid dependency detected while loading class file
> 'WebUI.class'.
> Could not access term eclipse in package org,
> because it (or its dependencies) are missing. Check your build definition
> for
> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see
> the problematic classpath.)
> A full rebuild may help if 'WebUI.class' was compiled against an
> incompatible version of org.
> [ERROR] missing or invalid dependency detected while loading class file
> 'WebUI.class'.
> Could not access term jetty in value org.eclipse,
> because it (or its dependencies) are missing. Check your build definition
> for
> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see
> the problematic classpath.)
> A full rebuild may help if 'WebUI.class' was compiled against an
> incompatible version of org.eclipse.
> [WARNING] 17 warnings found
> [ERROR] two errors found
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Spark Project Parent POM .......................... SUCCESS [4.399s]
> [INFO] Spark Project Test Tags ........................... SUCCESS [3.443s]
> [INFO] Spark Project Launcher ............................ SUCCESS
> [10.131s]
> [INFO] Spark Project Networking .......................... SUCCESS
> [11.849s]
> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS [6.641s]
> [INFO] Spark Project Unsafe .............................. SUCCESS
> [19.765s]
> [INFO] Spark Project Core ................................ SUCCESS
> [4:16.511s]
> [INFO] Spark Project Bagel ............................... SUCCESS
> [13.401s]
> [INFO] Spark Project GraphX .............................. SUCCESS
> [1:08.824s]
> [INFO] Spark Project Streaming ........................... SUCCESS
> [2:18.844s]
> [INFO] Spark Project Catalyst ............................ SUCCESS
> [2:43.695s]
> [INFO] Spark Project SQL ................................. FAILURE
> [1:01.762s]
> [INFO] Spark Project ML Library .......................... SKIPPED
> [INFO] Spark Project Tools ............................... SKIPPED
> [INFO] Spark Project Hive ................................ SKIPPED
> [INFO] Spark Project Docker Integration Tests ............ SKIPPED
> [INFO] Spark Project REPL ................................ SKIPPED
> [INFO] Spark Project YARN Shuffle Service ................ SKIPPED
> [INFO] Spark Project YARN ................................ SKIPPED
> [INFO] Spark Project Assembly ............................ SKIPPED
> [INFO] Spark Project External Twitter .................... SKIPPED
> [INFO] Spark Project External Flume Sink ................. SKIPPED
> [INFO] Spark Project External Flume ...................... SKIPPED
> [INFO] Spark Project External Flume Assembly ............. SKIPPED
> [INFO] Spark Project External MQTT ....................... SKIPPED
> [INFO] Spark Project External MQTT Assembly .............. SKIPPED
> [INFO] Spark Project External ZeroMQ ..................... SKIPPED
> [INFO] Spark Project External Kafka ...................... SKIPPED
> [INFO] Spark Project Examples ............................ SKIPPED
> [INFO] Spark Project External Kafka Assembly ............. SKIPPED
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] Total time: 12:40.525s
> [INFO] Finished at: Wed Aug 31 01:56:50 IST 2016
> [INFO] Final Memory: 71M/830M
> [INFO] ------------------------------------------------------------
> ------------
> [ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> (scala-compile-first) on project spark-sql_2.11: Execution
> scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> failed. CompileFailed -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/
> PluginExecutionException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR] mvn <goals> -rf :spark-sql_2.11
>
>
>
Re: Spark build 1.6.2 error
Posted by Diwakar Dhanuskodi <di...@gmail.com>.
Sorry my bad. In both the runs I included -Dscala-2.11
On Sat, Sep 3, 2016 at 12:39 PM, Nachiketa <na...@gmail.com>
wrote:
> I think the difference was the -Dscala2.11 to the command line.
>
> I have seen this show up when I miss that.
>
> Regards,
> Nachiketa
>
> On Sat 3 Sep, 2016, 12:14 PM Diwakar Dhanuskodi, <
> diwakar.dhanuskodi@gmail.com> wrote:
>
>> Hi,
>>
>> Just re-ran again without killing zinc server process
>>
>> /make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive
>> -Pyarn -Dmaven.version=3.0.4 -Dscala-2.11 -X -rf :spark-sql_2.11
>>
>> Build is success. Not sure how it worked with just re-running command
>> again.
>>
>> On Sat, Sep 3, 2016 at 11:44 AM, Diwakar Dhanuskodi <
>> diwakar.dhanuskodi@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> java version 7
>>>
>>> mvn command
>>> ./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive
>>> -Phive-thriftserver -Pyarn -Dmaven.version=3.0.4
>>>
>>>
>>> yes, I executed script to change scala version to 2.11
>>> killed "com.typesafe zinc.Nailgun" process
>>>
>>> re-ran mvn with below command again
>>>
>>> ./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive
>>> -Phive-thriftserver -Pyarn -Dmaven.version=3.0.4 -X -rf :spark-sql_2.11
>>>
>>> Getting same error
>>>
>>> [warn] /home/cloudera/Downloads/spark-1.6.2/sql/core/src/main/
>>> scala/org/apache/spark/sql/sources/interfaces.scala:911: method isDir
>>> in class FileStatus is deprecated: see corresponding Javadoc for more
>>> information.
>>> [warn] status.isDir,
>>> [warn] ^
>>> [error] missing or invalid dependency detected while loading class file
>>> 'WebUI.class'.
>>> [error] Could not access term eclipse in package org,
>>> [error] because it (or its dependencies) are missing. Check your build
>>> definition for
>>> [error] missing or conflicting dependencies. (Re-run with
>>> `-Ylog-classpath` to see the problematic classpath.)
>>> [error] A full rebuild may help if 'WebUI.class' was compiled against an
>>> incompatible version of org.
>>> [error] missing or invalid dependency detected while loading class file
>>> 'WebUI.class'.
>>> [error] Could not access term jetty in value org.eclipse,
>>> [error] because it (or its dependencies) are missing. Check your build
>>> definition for
>>> [error] missing or conflicting dependencies. (Re-run with
>>> `-Ylog-classpath` to see the problematic classpath.)
>>> [error] A full rebuild may help if 'WebUI.class' was compiled against an
>>> incompatible version of org.eclipse.
>>> [warn] 17 warnings found
>>> [error] two errors found
>>> [debug] Compilation failed (CompilerInterface)
>>> [error] Compile failed at Sep 3, 2016 11:28:34 AM [21.611s]
>>> [INFO] ------------------------------------------------------------
>>> ------------
>>> [INFO] Reactor Summary:
>>> [INFO]
>>> [INFO] Spark Project Parent POM .......................... SUCCESS
>>> [5.583s]
>>> [INFO] Spark Project Test Tags ........................... SUCCESS
>>> [4.189s]
>>> [INFO] Spark Project Launcher ............................ SUCCESS
>>> [12.226s]
>>> [INFO] Spark Project Networking .......................... SUCCESS
>>> [13.386s]
>>> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS
>>> [6.723s]
>>> [INFO] Spark Project Unsafe .............................. SUCCESS
>>> [21.231s]
>>> [INFO] Spark Project Core ................................ SUCCESS
>>> [3:46.334s]
>>> [INFO] Spark Project Bagel ............................... SUCCESS
>>> [7.032s]
>>> [INFO] Spark Project GraphX .............................. SUCCESS
>>> [19.558s]
>>> [INFO] Spark Project Streaming ........................... SUCCESS
>>> [50.452s]
>>> [INFO] Spark Project Catalyst ............................ SUCCESS
>>> [1:14.172s]
>>> [INFO] Spark Project SQL ................................. FAILURE
>>> [23.222s]
>>> [INFO] Spark Project ML Library .......................... SKIPPED
>>> [INFO] Spark Project Tools ............................... SKIPPED
>>> [INFO] Spark Project Hive ................................ SKIPPED
>>> [INFO] Spark Project Docker Integration Tests ............ SKIPPED
>>> [INFO] Spark Project REPL ................................ SKIPPED
>>> [INFO] Spark Project YARN Shuffle Service ................ SKIPPED
>>> [INFO] Spark Project YARN ................................ SKIPPED
>>> [INFO] Spark Project Assembly ............................ SKIPPED
>>> [INFO] Spark Project External Twitter .................... SKIPPED
>>> [INFO] Spark Project External Flume Sink ................. SKIPPED
>>> [INFO] Spark Project External Flume ...................... SKIPPED
>>> [INFO] Spark Project External Flume Assembly ............. SKIPPED
>>> [INFO] Spark Project External MQTT ....................... SKIPPED
>>> [INFO] Spark Project External MQTT Assembly .............. SKIPPED
>>> [INFO] Spark Project External ZeroMQ ..................... SKIPPED
>>> [INFO] Spark Project External Kafka ...................... SKIPPED
>>> [INFO] Spark Project Examples ............................ SKIPPED
>>> [INFO] Spark Project External Kafka Assembly ............. SKIPPED
>>> [INFO] ------------------------------------------------------------
>>> ------------
>>> [INFO] BUILD FAILURE
>>> [INFO] ------------------------------------------------------------
>>> ------------
>>> [INFO] Total time: 7:45.641s
>>> [INFO] Finished at: Sat Sep 03 11:28:34 IST 2016
>>> [INFO] Final Memory: 49M/415M
>>> [INFO] ------------------------------------------------------------
>>> ------------
>>> [ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>>> (scala-compile-first) on project spark-sql_2.11: Execution
>>> scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>>> failed. CompileFailed -> [Help 1]
>>> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to
>>> execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>>> (scala-compile-first) on project spark-sql_2.11: Execution
>>> scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>>> failed.
>>> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
>>> MojoExecutor.java:225)
>>> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
>>> MojoExecutor.java:153)
>>> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
>>> MojoExecutor.java:145)
>>> at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.
>>> buildProject(LifecycleModuleBuilder.java:84)
>>> at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.
>>> buildProject(LifecycleModuleBuilder.java:59)
>>> at org.apache.maven.lifecycle.internal.LifecycleStarter.
>>> singleThreadedBuild(LifecycleStarter.java:183)
>>> at org.apache.maven.lifecycle.internal.LifecycleStarter.
>>> execute(LifecycleStarter.java:161)
>>> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
>>> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
>>> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
>>> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
>>> at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke(
>>> NativeMethodAccessorImpl.java:57)
>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
>>> DelegatingMethodAccessorImpl.java:43)
>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>> at org.codehaus.plexus.classworlds.launcher.Launcher.
>>> launchEnhanced(Launcher.java:290)
>>> at org.codehaus.plexus.classworlds.launcher.Launcher.
>>> launch(Launcher.java:230)
>>> at org.codehaus.plexus.classworlds.launcher.Launcher.
>>> mainWithExitCode(Launcher.java:409)
>>> at org.codehaus.plexus.classworlds.launcher.Launcher.
>>> main(Launcher.java:352)
>>> Caused by: org.apache.maven.plugin.PluginExecutionException: Execution
>>> scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>>> failed.
>>> at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(
>>> DefaultBuildPluginManager.java:110)
>>> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
>>> MojoExecutor.java:209)
>>> ... 19 more
>>> Caused by: Compile failed via zinc server
>>> at sbt_inc.SbtIncrementalCompiler.zincCompile(
>>> SbtIncrementalCompiler.java:136)
>>> at sbt_inc.SbtIncrementalCompiler.compile(SbtIncrementalCompiler.java:
>>> 86)
>>> at scala_maven.ScalaCompilerSupport.incrementalCompile(
>>> ScalaCompilerSupport.java:303)
>>> at scala_maven.ScalaCompilerSupport.compile(
>>> ScalaCompilerSupport.java:119)
>>> at scala_maven.ScalaCompilerSupport.doExecute(
>>> ScalaCompilerSupport.java:99)
>>> at scala_maven.ScalaMojoSupport.execute(ScalaMojoSupport.java:482)
>>> at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(
>>> DefaultBuildPluginManager.java:101)
>>> ... 20 more
>>> [ERROR]
>>> [ERROR]
>>> [ERROR] For more information about the errors and possible solutions,
>>> please read the following articles:
>>> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/
>>> PluginExecutionException
>>> [ERROR]
>>> [ERROR] After correcting the problems, you can resume the build with the
>>> command
>>> [ERROR] mvn <goals> -rf :spark-sql_2.11
>>>
>>>
>>> On Thu, Sep 1, 2016 at 8:23 AM, Divya Gehlot <di...@gmail.com>
>>> wrote:
>>>
>>>> Which java version are you using ?
>>>>
>>>> On 31 August 2016 at 04:30, Diwakar Dhanuskodi <
>>>> diwakar.dhanuskodi@gmail.com> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> While building Spark 1.6.2 , getting below error in spark-sql. Much
>>>>> appreciate for any help.
>>>>>
>>>>> ERROR] missing or invalid dependency detected while loading class file
>>>>> 'WebUI.class'.
>>>>> Could not access term eclipse in package org,
>>>>> because it (or its dependencies) are missing. Check your build
>>>>> definition for
>>>>> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to
>>>>> see the problematic classpath.)
>>>>> A full rebuild may help if 'WebUI.class' was compiled against an
>>>>> incompatible version of org.
>>>>> [ERROR] missing or invalid dependency detected while loading class
>>>>> file 'WebUI.class'.
>>>>> Could not access term jetty in value org.eclipse,
>>>>> because it (or its dependencies) are missing. Check your build
>>>>> definition for
>>>>> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to
>>>>> see the problematic classpath.)
>>>>> A full rebuild may help if 'WebUI.class' was compiled against an
>>>>> incompatible version of org.eclipse.
>>>>> [WARNING] 17 warnings found
>>>>> [ERROR] two errors found
>>>>> [INFO] ------------------------------------------------------------
>>>>> ------------
>>>>> [INFO] Reactor Summary:
>>>>> [INFO]
>>>>> [INFO] Spark Project Parent POM .......................... SUCCESS
>>>>> [4.399s]
>>>>> [INFO] Spark Project Test Tags ........................... SUCCESS
>>>>> [3.443s]
>>>>> [INFO] Spark Project Launcher ............................ SUCCESS
>>>>> [10.131s]
>>>>> [INFO] Spark Project Networking .......................... SUCCESS
>>>>> [11.849s]
>>>>> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS
>>>>> [6.641s]
>>>>> [INFO] Spark Project Unsafe .............................. SUCCESS
>>>>> [19.765s]
>>>>> [INFO] Spark Project Core ................................ SUCCESS
>>>>> [4:16.511s]
>>>>> [INFO] Spark Project Bagel ............................... SUCCESS
>>>>> [13.401s]
>>>>> [INFO] Spark Project GraphX .............................. SUCCESS
>>>>> [1:08.824s]
>>>>> [INFO] Spark Project Streaming ........................... SUCCESS
>>>>> [2:18.844s]
>>>>> [INFO] Spark Project Catalyst ............................ SUCCESS
>>>>> [2:43.695s]
>>>>> [INFO] Spark Project SQL ................................. FAILURE
>>>>> [1:01.762s]
>>>>> [INFO] Spark Project ML Library .......................... SKIPPED
>>>>> [INFO] Spark Project Tools ............................... SKIPPED
>>>>> [INFO] Spark Project Hive ................................ SKIPPED
>>>>> [INFO] Spark Project Docker Integration Tests ............ SKIPPED
>>>>> [INFO] Spark Project REPL ................................ SKIPPED
>>>>> [INFO] Spark Project YARN Shuffle Service ................ SKIPPED
>>>>> [INFO] Spark Project YARN ................................ SKIPPED
>>>>> [INFO] Spark Project Assembly ............................ SKIPPED
>>>>> [INFO] Spark Project External Twitter .................... SKIPPED
>>>>> [INFO] Spark Project External Flume Sink ................. SKIPPED
>>>>> [INFO] Spark Project External Flume ...................... SKIPPED
>>>>> [INFO] Spark Project External Flume Assembly ............. SKIPPED
>>>>> [INFO] Spark Project External MQTT ....................... SKIPPED
>>>>> [INFO] Spark Project External MQTT Assembly .............. SKIPPED
>>>>> [INFO] Spark Project External ZeroMQ ..................... SKIPPED
>>>>> [INFO] Spark Project External Kafka ...................... SKIPPED
>>>>> [INFO] Spark Project Examples ............................ SKIPPED
>>>>> [INFO] Spark Project External Kafka Assembly ............. SKIPPED
>>>>> [INFO] ------------------------------------------------------------
>>>>> ------------
>>>>> [INFO] BUILD FAILURE
>>>>> [INFO] ------------------------------------------------------------
>>>>> ------------
>>>>> [INFO] Total time: 12:40.525s
>>>>> [INFO] Finished at: Wed Aug 31 01:56:50 IST 2016
>>>>> [INFO] Final Memory: 71M/830M
>>>>> [INFO] ------------------------------------------------------------
>>>>> ------------
>>>>> [ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>>>>> (scala-compile-first) on project spark-sql_2.11: Execution
>>>>> scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>>>>> failed. CompileFailed -> [Help 1]
>>>>> [ERROR]
>>>>> [ERROR] To see the full stack trace of the errors, re-run Maven with
>>>>> the -e switch.
>>>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>>>> [ERROR]
>>>>> [ERROR] For more information about the errors and possible solutions,
>>>>> please read the following articles:
>>>>> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/
>>>>> PluginExecutionException
>>>>> [ERROR]
>>>>> [ERROR] After correcting the problems, you can resume the build with
>>>>> the command
>>>>> [ERROR] mvn <goals> -rf :spark-sql_2.11
>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
Re: Spark build 1.6.2 error
Posted by Nachiketa <na...@gmail.com>.
I think the difference was the -Dscala2.11 to the command line.
I have seen this show up when I miss that.
Regards,
Nachiketa
On Sat 3 Sep, 2016, 12:14 PM Diwakar Dhanuskodi, <
diwakar.dhanuskodi@gmail.com> wrote:
> Hi,
>
> Just re-ran again without killing zinc server process
>
> /make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive
> -Pyarn -Dmaven.version=3.0.4 -Dscala-2.11 -X -rf :spark-sql_2.11
>
> Build is success. Not sure how it worked with just re-running command
> again.
>
> On Sat, Sep 3, 2016 at 11:44 AM, Diwakar Dhanuskodi <
> diwakar.dhanuskodi@gmail.com> wrote:
>
>> Hi,
>>
>> java version 7
>>
>> mvn command
>> ./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive
>> -Phive-thriftserver -Pyarn -Dmaven.version=3.0.4
>>
>>
>> yes, I executed script to change scala version to 2.11
>> killed "com.typesafe zinc.Nailgun" process
>>
>> re-ran mvn with below command again
>>
>> ./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive
>> -Phive-thriftserver -Pyarn -Dmaven.version=3.0.4 -X -rf :spark-sql_2.11
>>
>> Getting same error
>>
>> [warn]
>> /home/cloudera/Downloads/spark-1.6.2/sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala:911:
>> method isDir in class FileStatus is deprecated: see corresponding Javadoc
>> for more information.
>> [warn] status.isDir,
>> [warn] ^
>> [error] missing or invalid dependency detected while loading class file
>> 'WebUI.class'.
>> [error] Could not access term eclipse in package org,
>> [error] because it (or its dependencies) are missing. Check your build
>> definition for
>> [error] missing or conflicting dependencies. (Re-run with
>> `-Ylog-classpath` to see the problematic classpath.)
>> [error] A full rebuild may help if 'WebUI.class' was compiled against an
>> incompatible version of org.
>> [error] missing or invalid dependency detected while loading class file
>> 'WebUI.class'.
>> [error] Could not access term jetty in value org.eclipse,
>> [error] because it (or its dependencies) are missing. Check your build
>> definition for
>> [error] missing or conflicting dependencies. (Re-run with
>> `-Ylog-classpath` to see the problematic classpath.)
>> [error] A full rebuild may help if 'WebUI.class' was compiled against an
>> incompatible version of org.eclipse.
>> [warn] 17 warnings found
>> [error] two errors found
>> [debug] Compilation failed (CompilerInterface)
>> [error] Compile failed at Sep 3, 2016 11:28:34 AM [21.611s]
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Reactor Summary:
>> [INFO]
>> [INFO] Spark Project Parent POM .......................... SUCCESS
>> [5.583s]
>> [INFO] Spark Project Test Tags ........................... SUCCESS
>> [4.189s]
>> [INFO] Spark Project Launcher ............................ SUCCESS
>> [12.226s]
>> [INFO] Spark Project Networking .......................... SUCCESS
>> [13.386s]
>> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS
>> [6.723s]
>> [INFO] Spark Project Unsafe .............................. SUCCESS
>> [21.231s]
>> [INFO] Spark Project Core ................................ SUCCESS
>> [3:46.334s]
>> [INFO] Spark Project Bagel ............................... SUCCESS
>> [7.032s]
>> [INFO] Spark Project GraphX .............................. SUCCESS
>> [19.558s]
>> [INFO] Spark Project Streaming ........................... SUCCESS
>> [50.452s]
>> [INFO] Spark Project Catalyst ............................ SUCCESS
>> [1:14.172s]
>> [INFO] Spark Project SQL ................................. FAILURE
>> [23.222s]
>> [INFO] Spark Project ML Library .......................... SKIPPED
>> [INFO] Spark Project Tools ............................... SKIPPED
>> [INFO] Spark Project Hive ................................ SKIPPED
>> [INFO] Spark Project Docker Integration Tests ............ SKIPPED
>> [INFO] Spark Project REPL ................................ SKIPPED
>> [INFO] Spark Project YARN Shuffle Service ................ SKIPPED
>> [INFO] Spark Project YARN ................................ SKIPPED
>> [INFO] Spark Project Assembly ............................ SKIPPED
>> [INFO] Spark Project External Twitter .................... SKIPPED
>> [INFO] Spark Project External Flume Sink ................. SKIPPED
>> [INFO] Spark Project External Flume ...................... SKIPPED
>> [INFO] Spark Project External Flume Assembly ............. SKIPPED
>> [INFO] Spark Project External MQTT ....................... SKIPPED
>> [INFO] Spark Project External MQTT Assembly .............. SKIPPED
>> [INFO] Spark Project External ZeroMQ ..................... SKIPPED
>> [INFO] Spark Project External Kafka ...................... SKIPPED
>> [INFO] Spark Project Examples ............................ SKIPPED
>> [INFO] Spark Project External Kafka Assembly ............. SKIPPED
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] BUILD FAILURE
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 7:45.641s
>> [INFO] Finished at: Sat Sep 03 11:28:34 IST 2016
>> [INFO] Final Memory: 49M/415M
>> [INFO]
>> ------------------------------------------------------------------------
>> [ERROR] Failed to execute goal
>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first)
>> on project spark-sql_2.11: Execution scala-compile-first of goal
>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed
>> -> [Help 1]
>> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
>> goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>> (scala-compile-first) on project spark-sql_2.11: Execution
>> scala-compile-first of goal
>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed.
>> at
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:225)
>> at
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>> at
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>> at
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
>> at
>> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
>> at
>> org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
>> at
>> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
>> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
>> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
>> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
>> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
>> at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:606)
>> at
>> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
>> at
>> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
>> at
>> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
>> at
>> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
>> Caused by: org.apache.maven.plugin.PluginExecutionException: Execution
>> scala-compile-first of goal
>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed.
>> at
>> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:110)
>> at
>> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
>> ... 19 more
>> Caused by: Compile failed via zinc server
>> at
>> sbt_inc.SbtIncrementalCompiler.zincCompile(SbtIncrementalCompiler.java:136)
>> at sbt_inc.SbtIncrementalCompiler.compile(SbtIncrementalCompiler.java:86)
>> at
>> scala_maven.ScalaCompilerSupport.incrementalCompile(ScalaCompilerSupport.java:303)
>> at scala_maven.ScalaCompilerSupport.compile(ScalaCompilerSupport.java:119)
>> at
>> scala_maven.ScalaCompilerSupport.doExecute(ScalaCompilerSupport.java:99)
>> at scala_maven.ScalaMojoSupport.execute(ScalaMojoSupport.java:482)
>> at
>> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
>> ... 20 more
>> [ERROR]
>> [ERROR]
>> [ERROR] For more information about the errors and possible solutions,
>> please read the following articles:
>> [ERROR] [Help 1]
>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>> [ERROR]
>> [ERROR] After correcting the problems, you can resume the build with the
>> command
>> [ERROR] mvn <goals> -rf :spark-sql_2.11
>>
>>
>> On Thu, Sep 1, 2016 at 8:23 AM, Divya Gehlot <di...@gmail.com>
>> wrote:
>>
>>> Which java version are you using ?
>>>
>>> On 31 August 2016 at 04:30, Diwakar Dhanuskodi <
>>> diwakar.dhanuskodi@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> While building Spark 1.6.2 , getting below error in spark-sql. Much
>>>> appreciate for any help.
>>>>
>>>> ERROR] missing or invalid dependency detected while loading class file
>>>> 'WebUI.class'.
>>>> Could not access term eclipse in package org,
>>>> because it (or its dependencies) are missing. Check your build
>>>> definition for
>>>> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to
>>>> see the problematic classpath.)
>>>> A full rebuild may help if 'WebUI.class' was compiled against an
>>>> incompatible version of org.
>>>> [ERROR] missing or invalid dependency detected while loading class file
>>>> 'WebUI.class'.
>>>> Could not access term jetty in value org.eclipse,
>>>> because it (or its dependencies) are missing. Check your build
>>>> definition for
>>>> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to
>>>> see the problematic classpath.)
>>>> A full rebuild may help if 'WebUI.class' was compiled against an
>>>> incompatible version of org.eclipse.
>>>> [WARNING] 17 warnings found
>>>> [ERROR] two errors found
>>>> [INFO]
>>>> ------------------------------------------------------------------------
>>>> [INFO] Reactor Summary:
>>>> [INFO]
>>>> [INFO] Spark Project Parent POM .......................... SUCCESS
>>>> [4.399s]
>>>> [INFO] Spark Project Test Tags ........................... SUCCESS
>>>> [3.443s]
>>>> [INFO] Spark Project Launcher ............................ SUCCESS
>>>> [10.131s]
>>>> [INFO] Spark Project Networking .......................... SUCCESS
>>>> [11.849s]
>>>> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS
>>>> [6.641s]
>>>> [INFO] Spark Project Unsafe .............................. SUCCESS
>>>> [19.765s]
>>>> [INFO] Spark Project Core ................................ SUCCESS
>>>> [4:16.511s]
>>>> [INFO] Spark Project Bagel ............................... SUCCESS
>>>> [13.401s]
>>>> [INFO] Spark Project GraphX .............................. SUCCESS
>>>> [1:08.824s]
>>>> [INFO] Spark Project Streaming ........................... SUCCESS
>>>> [2:18.844s]
>>>> [INFO] Spark Project Catalyst ............................ SUCCESS
>>>> [2:43.695s]
>>>> [INFO] Spark Project SQL ................................. FAILURE
>>>> [1:01.762s]
>>>> [INFO] Spark Project ML Library .......................... SKIPPED
>>>> [INFO] Spark Project Tools ............................... SKIPPED
>>>> [INFO] Spark Project Hive ................................ SKIPPED
>>>> [INFO] Spark Project Docker Integration Tests ............ SKIPPED
>>>> [INFO] Spark Project REPL ................................ SKIPPED
>>>> [INFO] Spark Project YARN Shuffle Service ................ SKIPPED
>>>> [INFO] Spark Project YARN ................................ SKIPPED
>>>> [INFO] Spark Project Assembly ............................ SKIPPED
>>>> [INFO] Spark Project External Twitter .................... SKIPPED
>>>> [INFO] Spark Project External Flume Sink ................. SKIPPED
>>>> [INFO] Spark Project External Flume ...................... SKIPPED
>>>> [INFO] Spark Project External Flume Assembly ............. SKIPPED
>>>> [INFO] Spark Project External MQTT ....................... SKIPPED
>>>> [INFO] Spark Project External MQTT Assembly .............. SKIPPED
>>>> [INFO] Spark Project External ZeroMQ ..................... SKIPPED
>>>> [INFO] Spark Project External Kafka ...................... SKIPPED
>>>> [INFO] Spark Project Examples ............................ SKIPPED
>>>> [INFO] Spark Project External Kafka Assembly ............. SKIPPED
>>>> [INFO]
>>>> ------------------------------------------------------------------------
>>>> [INFO] BUILD FAILURE
>>>> [INFO]
>>>> ------------------------------------------------------------------------
>>>> [INFO] Total time: 12:40.525s
>>>> [INFO] Finished at: Wed Aug 31 01:56:50 IST 2016
>>>> [INFO] Final Memory: 71M/830M
>>>> [INFO]
>>>> ------------------------------------------------------------------------
>>>> [ERROR] Failed to execute goal
>>>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first)
>>>> on project spark-sql_2.11: Execution scala-compile-first of goal
>>>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed
>>>> -> [Help 1]
>>>> [ERROR]
>>>> [ERROR] To see the full stack trace of the errors, re-run Maven with
>>>> the -e switch.
>>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>>> [ERROR]
>>>> [ERROR] For more information about the errors and possible solutions,
>>>> please read the following articles:
>>>> [ERROR] [Help 1]
>>>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>>>> [ERROR]
>>>> [ERROR] After correcting the problems, you can resume the build with
>>>> the command
>>>> [ERROR] mvn <goals> -rf :spark-sql_2.11
>>>>
>>>>
>>>>
>>>
>>
>
Re: Spark build 1.6.2 error
Posted by Diwakar Dhanuskodi <di...@gmail.com>.
Hi,
Just re-ran again without killing zinc server process
/make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive -Pyarn
-Dmaven.version=3.0.4 -Dscala-2.11 -X -rf :spark-sql_2.11
Build is success. Not sure how it worked with just re-running command
again.
On Sat, Sep 3, 2016 at 11:44 AM, Diwakar Dhanuskodi <
diwakar.dhanuskodi@gmail.com> wrote:
> Hi,
>
> java version 7
>
> mvn command
> ./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive
> -Phive-thriftserver -Pyarn -Dmaven.version=3.0.4
>
>
> yes, I executed script to change scala version to 2.11
> killed "com.typesafe zinc.Nailgun" process
>
> re-ran mvn with below command again
>
> ./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive
> -Phive-thriftserver -Pyarn -Dmaven.version=3.0.4 -X -rf :spark-sql_2.11
>
> Getting same error
>
> [warn] /home/cloudera/Downloads/spark-1.6.2/sql/core/src/main/
> scala/org/apache/spark/sql/sources/interfaces.scala:911: method isDir in
> class FileStatus is deprecated: see corresponding Javadoc for more
> information.
> [warn] status.isDir,
> [warn] ^
> [error] missing or invalid dependency detected while loading class file
> 'WebUI.class'.
> [error] Could not access term eclipse in package org,
> [error] because it (or its dependencies) are missing. Check your build
> definition for
> [error] missing or conflicting dependencies. (Re-run with
> `-Ylog-classpath` to see the problematic classpath.)
> [error] A full rebuild may help if 'WebUI.class' was compiled against an
> incompatible version of org.
> [error] missing or invalid dependency detected while loading class file
> 'WebUI.class'.
> [error] Could not access term jetty in value org.eclipse,
> [error] because it (or its dependencies) are missing. Check your build
> definition for
> [error] missing or conflicting dependencies. (Re-run with
> `-Ylog-classpath` to see the problematic classpath.)
> [error] A full rebuild may help if 'WebUI.class' was compiled against an
> incompatible version of org.eclipse.
> [warn] 17 warnings found
> [error] two errors found
> [debug] Compilation failed (CompilerInterface)
> [error] Compile failed at Sep 3, 2016 11:28:34 AM [21.611s]
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Spark Project Parent POM .......................... SUCCESS [5.583s]
> [INFO] Spark Project Test Tags ........................... SUCCESS [4.189s]
> [INFO] Spark Project Launcher ............................ SUCCESS
> [12.226s]
> [INFO] Spark Project Networking .......................... SUCCESS
> [13.386s]
> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS [6.723s]
> [INFO] Spark Project Unsafe .............................. SUCCESS
> [21.231s]
> [INFO] Spark Project Core ................................ SUCCESS
> [3:46.334s]
> [INFO] Spark Project Bagel ............................... SUCCESS
> [7.032s]
> [INFO] Spark Project GraphX .............................. SUCCESS
> [19.558s]
> [INFO] Spark Project Streaming ........................... SUCCESS
> [50.452s]
> [INFO] Spark Project Catalyst ............................ SUCCESS
> [1:14.172s]
> [INFO] Spark Project SQL ................................. FAILURE
> [23.222s]
> [INFO] Spark Project ML Library .......................... SKIPPED
> [INFO] Spark Project Tools ............................... SKIPPED
> [INFO] Spark Project Hive ................................ SKIPPED
> [INFO] Spark Project Docker Integration Tests ............ SKIPPED
> [INFO] Spark Project REPL ................................ SKIPPED
> [INFO] Spark Project YARN Shuffle Service ................ SKIPPED
> [INFO] Spark Project YARN ................................ SKIPPED
> [INFO] Spark Project Assembly ............................ SKIPPED
> [INFO] Spark Project External Twitter .................... SKIPPED
> [INFO] Spark Project External Flume Sink ................. SKIPPED
> [INFO] Spark Project External Flume ...................... SKIPPED
> [INFO] Spark Project External Flume Assembly ............. SKIPPED
> [INFO] Spark Project External MQTT ....................... SKIPPED
> [INFO] Spark Project External MQTT Assembly .............. SKIPPED
> [INFO] Spark Project External ZeroMQ ..................... SKIPPED
> [INFO] Spark Project External Kafka ...................... SKIPPED
> [INFO] Spark Project Examples ............................ SKIPPED
> [INFO] Spark Project External Kafka Assembly ............. SKIPPED
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] Total time: 7:45.641s
> [INFO] Finished at: Sat Sep 03 11:28:34 IST 2016
> [INFO] Final Memory: 49M/415M
> [INFO] ------------------------------------------------------------
> ------------
> [ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> (scala-compile-first) on project spark-sql_2.11: Execution
> scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> failed. CompileFailed -> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> (scala-compile-first) on project spark-sql_2.11: Execution
> scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> failed.
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> MojoExecutor.java:225)
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> MojoExecutor.java:153)
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> MojoExecutor.java:145)
> at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.
> buildProject(LifecycleModuleBuilder.java:84)
> at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.
> buildProject(LifecycleModuleBuilder.java:59)
> at org.apache.maven.lifecycle.internal.LifecycleStarter.
> singleThreadedBuild(LifecycleStarter.java:183)
> at org.apache.maven.lifecycle.internal.LifecycleStarter.
> execute(LifecycleStarter.java:161)
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.codehaus.plexus.classworlds.launcher.Launcher.
> launchEnhanced(Launcher.java:290)
> at org.codehaus.plexus.classworlds.launcher.Launcher.
> launch(Launcher.java:230)
> at org.codehaus.plexus.classworlds.launcher.Launcher.
> mainWithExitCode(Launcher.java:409)
> at org.codehaus.plexus.classworlds.launcher.Launcher.
> main(Launcher.java:352)
> Caused by: org.apache.maven.plugin.PluginExecutionException: Execution
> scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> failed.
> at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(
> DefaultBuildPluginManager.java:110)
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> MojoExecutor.java:209)
> ... 19 more
> Caused by: Compile failed via zinc server
> at sbt_inc.SbtIncrementalCompiler.zincCompile(SbtIncrementalCompiler.java:
> 136)
> at sbt_inc.SbtIncrementalCompiler.compile(SbtIncrementalCompiler.java:86)
> at scala_maven.ScalaCompilerSupport.incrementalCompile(
> ScalaCompilerSupport.java:303)
> at scala_maven.ScalaCompilerSupport.compile(ScalaCompilerSupport.java:119)
> at scala_maven.ScalaCompilerSupport.doExecute(
> ScalaCompilerSupport.java:99)
> at scala_maven.ScalaMojoSupport.execute(ScalaMojoSupport.java:482)
> at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(
> DefaultBuildPluginManager.java:101)
> ... 20 more
> [ERROR]
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/
> PluginExecutionException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR] mvn <goals> -rf :spark-sql_2.11
>
>
> On Thu, Sep 1, 2016 at 8:23 AM, Divya Gehlot <di...@gmail.com>
> wrote:
>
>> Which java version are you using ?
>>
>> On 31 August 2016 at 04:30, Diwakar Dhanuskodi <
>> diwakar.dhanuskodi@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> While building Spark 1.6.2 , getting below error in spark-sql. Much
>>> appreciate for any help.
>>>
>>> ERROR] missing or invalid dependency detected while loading class file
>>> 'WebUI.class'.
>>> Could not access term eclipse in package org,
>>> because it (or its dependencies) are missing. Check your build
>>> definition for
>>> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to
>>> see the problematic classpath.)
>>> A full rebuild may help if 'WebUI.class' was compiled against an
>>> incompatible version of org.
>>> [ERROR] missing or invalid dependency detected while loading class file
>>> 'WebUI.class'.
>>> Could not access term jetty in value org.eclipse,
>>> because it (or its dependencies) are missing. Check your build
>>> definition for
>>> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to
>>> see the problematic classpath.)
>>> A full rebuild may help if 'WebUI.class' was compiled against an
>>> incompatible version of org.eclipse.
>>> [WARNING] 17 warnings found
>>> [ERROR] two errors found
>>> [INFO] ------------------------------------------------------------
>>> ------------
>>> [INFO] Reactor Summary:
>>> [INFO]
>>> [INFO] Spark Project Parent POM .......................... SUCCESS
>>> [4.399s]
>>> [INFO] Spark Project Test Tags ........................... SUCCESS
>>> [3.443s]
>>> [INFO] Spark Project Launcher ............................ SUCCESS
>>> [10.131s]
>>> [INFO] Spark Project Networking .......................... SUCCESS
>>> [11.849s]
>>> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS
>>> [6.641s]
>>> [INFO] Spark Project Unsafe .............................. SUCCESS
>>> [19.765s]
>>> [INFO] Spark Project Core ................................ SUCCESS
>>> [4:16.511s]
>>> [INFO] Spark Project Bagel ............................... SUCCESS
>>> [13.401s]
>>> [INFO] Spark Project GraphX .............................. SUCCESS
>>> [1:08.824s]
>>> [INFO] Spark Project Streaming ........................... SUCCESS
>>> [2:18.844s]
>>> [INFO] Spark Project Catalyst ............................ SUCCESS
>>> [2:43.695s]
>>> [INFO] Spark Project SQL ................................. FAILURE
>>> [1:01.762s]
>>> [INFO] Spark Project ML Library .......................... SKIPPED
>>> [INFO] Spark Project Tools ............................... SKIPPED
>>> [INFO] Spark Project Hive ................................ SKIPPED
>>> [INFO] Spark Project Docker Integration Tests ............ SKIPPED
>>> [INFO] Spark Project REPL ................................ SKIPPED
>>> [INFO] Spark Project YARN Shuffle Service ................ SKIPPED
>>> [INFO] Spark Project YARN ................................ SKIPPED
>>> [INFO] Spark Project Assembly ............................ SKIPPED
>>> [INFO] Spark Project External Twitter .................... SKIPPED
>>> [INFO] Spark Project External Flume Sink ................. SKIPPED
>>> [INFO] Spark Project External Flume ...................... SKIPPED
>>> [INFO] Spark Project External Flume Assembly ............. SKIPPED
>>> [INFO] Spark Project External MQTT ....................... SKIPPED
>>> [INFO] Spark Project External MQTT Assembly .............. SKIPPED
>>> [INFO] Spark Project External ZeroMQ ..................... SKIPPED
>>> [INFO] Spark Project External Kafka ...................... SKIPPED
>>> [INFO] Spark Project Examples ............................ SKIPPED
>>> [INFO] Spark Project External Kafka Assembly ............. SKIPPED
>>> [INFO] ------------------------------------------------------------
>>> ------------
>>> [INFO] BUILD FAILURE
>>> [INFO] ------------------------------------------------------------
>>> ------------
>>> [INFO] Total time: 12:40.525s
>>> [INFO] Finished at: Wed Aug 31 01:56:50 IST 2016
>>> [INFO] Final Memory: 71M/830M
>>> [INFO] ------------------------------------------------------------
>>> ------------
>>> [ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>>> (scala-compile-first) on project spark-sql_2.11: Execution
>>> scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>>> failed. CompileFailed -> [Help 1]
>>> [ERROR]
>>> [ERROR] To see the full stack trace of the errors, re-run Maven with the
>>> -e switch.
>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>> [ERROR]
>>> [ERROR] For more information about the errors and possible solutions,
>>> please read the following articles:
>>> [ERROR] [Help 1] http://cwiki.apache.org/conflu
>>> ence/display/MAVEN/PluginExecutionException
>>> [ERROR]
>>> [ERROR] After correcting the problems, you can resume the build with the
>>> command
>>> [ERROR] mvn <goals> -rf :spark-sql_2.11
>>>
>>>
>>>
>>
>
Re: Spark build 1.6.2 error
Posted by Diwakar Dhanuskodi <di...@gmail.com>.
Hi,
java version 7
mvn command
./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive
-Phive-thriftserver -Pyarn -Dmaven.version=3.0.4
yes, I executed script to change scala version to 2.11
killed "com.typesafe zinc.Nailgun" process
re-ran mvn with below command again
./make-distribution.sh --name custom-spark --tgz -Phadoop-2.6 -Phive
-Phive-thriftserver -Pyarn -Dmaven.version=3.0.4 -X -rf :spark-sql_2.11
Getting same error
[warn]
/home/cloudera/Downloads/spark-1.6.2/sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala:911:
method isDir in class FileStatus is deprecated: see corresponding Javadoc
for more information.
[warn] status.isDir,
[warn] ^
[error] missing or invalid dependency detected while loading class file
'WebUI.class'.
[error] Could not access term eclipse in package org,
[error] because it (or its dependencies) are missing. Check your build
definition for
[error] missing or conflicting dependencies. (Re-run with `-Ylog-classpath`
to see the problematic classpath.)
[error] A full rebuild may help if 'WebUI.class' was compiled against an
incompatible version of org.
[error] missing or invalid dependency detected while loading class file
'WebUI.class'.
[error] Could not access term jetty in value org.eclipse,
[error] because it (or its dependencies) are missing. Check your build
definition for
[error] missing or conflicting dependencies. (Re-run with `-Ylog-classpath`
to see the problematic classpath.)
[error] A full rebuild may help if 'WebUI.class' was compiled against an
incompatible version of org.eclipse.
[warn] 17 warnings found
[error] two errors found
[debug] Compilation failed (CompilerInterface)
[error] Compile failed at Sep 3, 2016 11:28:34 AM [21.611s]
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM .......................... SUCCESS [5.583s]
[INFO] Spark Project Test Tags ........................... SUCCESS [4.189s]
[INFO] Spark Project Launcher ............................ SUCCESS [12.226s]
[INFO] Spark Project Networking .......................... SUCCESS [13.386s]
[INFO] Spark Project Shuffle Streaming Service ........... SUCCESS [6.723s]
[INFO] Spark Project Unsafe .............................. SUCCESS [21.231s]
[INFO] Spark Project Core ................................ SUCCESS
[3:46.334s]
[INFO] Spark Project Bagel ............................... SUCCESS [7.032s]
[INFO] Spark Project GraphX .............................. SUCCESS [19.558s]
[INFO] Spark Project Streaming ........................... SUCCESS [50.452s]
[INFO] Spark Project Catalyst ............................ SUCCESS
[1:14.172s]
[INFO] Spark Project SQL ................................. FAILURE [23.222s]
[INFO] Spark Project ML Library .......................... SKIPPED
[INFO] Spark Project Tools ............................... SKIPPED
[INFO] Spark Project Hive ................................ SKIPPED
[INFO] Spark Project Docker Integration Tests ............ SKIPPED
[INFO] Spark Project REPL ................................ SKIPPED
[INFO] Spark Project YARN Shuffle Service ................ SKIPPED
[INFO] Spark Project YARN ................................ SKIPPED
[INFO] Spark Project Assembly ............................ SKIPPED
[INFO] Spark Project External Twitter .................... SKIPPED
[INFO] Spark Project External Flume Sink ................. SKIPPED
[INFO] Spark Project External Flume ...................... SKIPPED
[INFO] Spark Project External Flume Assembly ............. SKIPPED
[INFO] Spark Project External MQTT ....................... SKIPPED
[INFO] Spark Project External MQTT Assembly .............. SKIPPED
[INFO] Spark Project External ZeroMQ ..................... SKIPPED
[INFO] Spark Project External Kafka ...................... SKIPPED
[INFO] Spark Project Examples ............................ SKIPPED
[INFO] Spark Project External Kafka Assembly ............. SKIPPED
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 7:45.641s
[INFO] Finished at: Sat Sep 03 11:28:34 IST 2016
[INFO] Final Memory: 49M/415M
[INFO]
------------------------------------------------------------------------
[ERROR] Failed to execute goal
net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first)
on project spark-sql_2.11: Execution scala-compile-first of goal
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed
-> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
(scala-compile-first) on project spark-sql_2.11: Execution
scala-compile-first of goal
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed.
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:225)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
at
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
Caused by: org.apache.maven.plugin.PluginExecutionException: Execution
scala-compile-first of goal
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed.
at
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:110)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
... 19 more
Caused by: Compile failed via zinc server
at
sbt_inc.SbtIncrementalCompiler.zincCompile(SbtIncrementalCompiler.java:136)
at sbt_inc.SbtIncrementalCompiler.compile(SbtIncrementalCompiler.java:86)
at
scala_maven.ScalaCompilerSupport.incrementalCompile(ScalaCompilerSupport.java:303)
at scala_maven.ScalaCompilerSupport.compile(ScalaCompilerSupport.java:119)
at scala_maven.ScalaCompilerSupport.doExecute(ScalaCompilerSupport.java:99)
at scala_maven.ScalaMojoSupport.execute(ScalaMojoSupport.java:482)
at
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
... 20 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR] mvn <goals> -rf :spark-sql_2.11
On Thu, Sep 1, 2016 at 8:23 AM, Divya Gehlot <di...@gmail.com>
wrote:
> Which java version are you using ?
>
> On 31 August 2016 at 04:30, Diwakar Dhanuskodi <
> diwakar.dhanuskodi@gmail.com> wrote:
>
>> Hi,
>>
>> While building Spark 1.6.2 , getting below error in spark-sql. Much
>> appreciate for any help.
>>
>> ERROR] missing or invalid dependency detected while loading class file
>> 'WebUI.class'.
>> Could not access term eclipse in package org,
>> because it (or its dependencies) are missing. Check your build definition
>> for
>> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to
>> see the problematic classpath.)
>> A full rebuild may help if 'WebUI.class' was compiled against an
>> incompatible version of org.
>> [ERROR] missing or invalid dependency detected while loading class file
>> 'WebUI.class'.
>> Could not access term jetty in value org.eclipse,
>> because it (or its dependencies) are missing. Check your build definition
>> for
>> missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to
>> see the problematic classpath.)
>> A full rebuild may help if 'WebUI.class' was compiled against an
>> incompatible version of org.eclipse.
>> [WARNING] 17 warnings found
>> [ERROR] two errors found
>> [INFO] ------------------------------------------------------------
>> ------------
>> [INFO] Reactor Summary:
>> [INFO]
>> [INFO] Spark Project Parent POM .......................... SUCCESS
>> [4.399s]
>> [INFO] Spark Project Test Tags ........................... SUCCESS
>> [3.443s]
>> [INFO] Spark Project Launcher ............................ SUCCESS
>> [10.131s]
>> [INFO] Spark Project Networking .......................... SUCCESS
>> [11.849s]
>> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS
>> [6.641s]
>> [INFO] Spark Project Unsafe .............................. SUCCESS
>> [19.765s]
>> [INFO] Spark Project Core ................................ SUCCESS
>> [4:16.511s]
>> [INFO] Spark Project Bagel ............................... SUCCESS
>> [13.401s]
>> [INFO] Spark Project GraphX .............................. SUCCESS
>> [1:08.824s]
>> [INFO] Spark Project Streaming ........................... SUCCESS
>> [2:18.844s]
>> [INFO] Spark Project Catalyst ............................ SUCCESS
>> [2:43.695s]
>> [INFO] Spark Project SQL ................................. FAILURE
>> [1:01.762s]
>> [INFO] Spark Project ML Library .......................... SKIPPED
>> [INFO] Spark Project Tools ............................... SKIPPED
>> [INFO] Spark Project Hive ................................ SKIPPED
>> [INFO] Spark Project Docker Integration Tests ............ SKIPPED
>> [INFO] Spark Project REPL ................................ SKIPPED
>> [INFO] Spark Project YARN Shuffle Service ................ SKIPPED
>> [INFO] Spark Project YARN ................................ SKIPPED
>> [INFO] Spark Project Assembly ............................ SKIPPED
>> [INFO] Spark Project External Twitter .................... SKIPPED
>> [INFO] Spark Project External Flume Sink ................. SKIPPED
>> [INFO] Spark Project External Flume ...................... SKIPPED
>> [INFO] Spark Project External Flume Assembly ............. SKIPPED
>> [INFO] Spark Project External MQTT ....................... SKIPPED
>> [INFO] Spark Project External MQTT Assembly .............. SKIPPED
>> [INFO] Spark Project External ZeroMQ ..................... SKIPPED
>> [INFO] Spark Project External Kafka ...................... SKIPPED
>> [INFO] Spark Project Examples ............................ SKIPPED
>> [INFO] Spark Project External Kafka Assembly ............. SKIPPED
>> [INFO] ------------------------------------------------------------
>> ------------
>> [INFO] BUILD FAILURE
>> [INFO] ------------------------------------------------------------
>> ------------
>> [INFO] Total time: 12:40.525s
>> [INFO] Finished at: Wed Aug 31 01:56:50 IST 2016
>> [INFO] Final Memory: 71M/830M
>> [INFO] ------------------------------------------------------------
>> ------------
>> [ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>> (scala-compile-first) on project spark-sql_2.11: Execution
>> scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>> failed. CompileFailed -> [Help 1]
>> [ERROR]
>> [ERROR] To see the full stack trace of the errors, re-run Maven with the
>> -e switch.
>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>> [ERROR]
>> [ERROR] For more information about the errors and possible solutions,
>> please read the following articles:
>> [ERROR] [Help 1] http://cwiki.apache.org/conflu
>> ence/display/MAVEN/PluginExecutionException
>> [ERROR]
>> [ERROR] After correcting the problems, you can resume the build with the
>> command
>> [ERROR] mvn <goals> -rf :spark-sql_2.11
>>
>>
>>
>