You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Nirman Narang (JIRA)" <ji...@apache.org> on 2016/10/10 12:55:20 UTC
[jira] [Commented] (SPARK-10590) Spark with YARN build is broken
[ https://issues.apache.org/jira/browse/SPARK-10590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15562236#comment-15562236 ]
Nirman Narang commented on SPARK-10590:
---------------------------------------
Facing the same issue:
Ubuntu 14.04
Maven 3.0.5
Spark v1.6.2
openjdk version "1.8.0_91"
Arch: ppc64le
Scala 2.11.4
Build command: mvn -Pyarn -Phadoop-2.6 -Dhadoop.version=2.6.0 -Dscala-2.11 -DskipTests clean package
[ERROR] missing or invalid dependency detected while loading class file 'WebUI.class'.
Could not access term eclipse in package org,
because it (or its dependencies) are missing. Check your build definition for
missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.)
A full rebuild may help if 'WebUI.class' was compiled against an incompatible version of org.
[ERROR] missing or invalid dependency detected while loading class file 'WebUI.class'.
Could not access term jetty in value org.eclipse,
because it (or its dependencies) are missing. Check your build definition for
missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.)
A full rebuild may help if 'WebUI.class' was compiled against an incompatible version of org.eclipse.
[WARNING] 17 warnings found
[ERROR] two errors found
[DEBUG] Compilation failed (CompilerInterface)
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM .......................... SUCCESS [38.424s]
[INFO] Spark Project Test Tags ........................... SUCCESS [1:01.608s]
[INFO] Spark Project Core ................................ SUCCESS [3:25.582s]
[INFO] Spark Project Bagel ............................... SUCCESS [12.245s]
[INFO] Spark Project GraphX .............................. SUCCESS [44.636s]
[INFO] Spark Project ML Library .......................... SUCCESS [2:32.465s]
[INFO] Spark Project Tools ............................... SUCCESS [10.229s]
[INFO] Spark Project Networking .......................... SUCCESS [11.065s]
[INFO] Spark Project Shuffle Streaming Service ........... SUCCESS [8.356s]
[INFO] Spark Project Streaming ........................... SUCCESS [1:32.166s]
[INFO] Spark Project Catalyst ............................ SUCCESS [1:55.814s]
[INFO] Spark Project SQL ................................. FAILURE [42.195s]
> Spark with YARN build is broken
> -------------------------------
>
> Key: SPARK-10590
> URL: https://issues.apache.org/jira/browse/SPARK-10590
> Project: Spark
> Issue Type: Bug
> Affects Versions: 1.5.0
> Environment: CentOS 6.5
> Oracle JDK 1.7.0_75
> Maven 3.3.3
> Hadoop 2.6.0
> Spark 1.5.0
> Reporter: Kevin Tsai
>
> Hi, After upgrade to v1.5.0 and trying to build it.
> It shows:
> [ERROR] missing or invalid dependency detected while loading class file 'WebUI.class'
> It was working on Spark 1.4.1
> Build command: mvn -Pyarn -Phadoop-2.6 -Dhadoop.version=2.6.0 -Phive -Phive-thriftserver -Dscala-2.11 -DskipTests clean package
> Hope it helps.
> Regards,
> Kevin
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org