You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by jamborta <ja...@gmail.com> on 2014/11/11 00:26:17 UTC

Building spark from source - assertion failed: org.eclipse.jetty.server.DispatcherType

Hello,

I am trying to build Spark from source using the following:

export MAVEN_OPTS="-Xmx2g -XX:MaxPermSize=512M
-XX:ReservedCodeCacheSize=512m"

mvn -Pyarn -Phadoop-2.3 -Dhadoop.version=2.3.0 -Phive -DskipTests clean
package

this works OK with branch-1.1, when I switch to branch-1.2, I get the
following error while building spark-core:

[WARNING] Class org.eclipse.jetty.server.DispatcherType not found -
continuing with a stub.
[WARNING] Class org.eclipse.jetty.server.DispatcherType not found -
continuing with a stub.
[WARNING] Class org.eclipse.jetty.server.DispatcherType not found -
continuing with a stub.
[WARNING] Class org.eclipse.jetty.server.DispatcherType not found -
continuing with a stub.
[WARNING] Class org.eclipse.jetty.server.DispatcherType not found -
continuing with a stub.
[WARNING] Class org.eclipse.jetty.server.DispatcherType not found -
continuing with a stub.
[WARNING] Class org.eclipse.jetty.server.DispatcherType not found -
continuing with a stub.
[WARNING]
/home/spark/core/src/main/scala/org/apache/spark/scheduler/TaskResultGetter.scala:50:
inferred existential type (org.apache.spark.scheduler.DirectTaskResult[_$1],
Int) forSome { type _$1 }, which cannot be expressed by wildcards,  should
be enabled
by making the implicit value scala.language.existentials visible.
This can be achieved by adding the import clause 'import
scala.language.existentials'
or by setting the compiler option -language:existentials.
See the Scala docs for value scala.language.existentials for a discussion
why the feature should be explicitly enabled.
[WARNING]           val (result, size) =
serializer.get().deserialize[TaskResult[_]](serializedData) match {
[WARNING]               ^
[WARNING] Class org.eclipse.jetty.server.DispatcherType not found -
continuing with a stub.
[WARNING] Class org.eclipse.jetty.server.DispatcherType not found -
continuing with a stub.
[ERROR] 
     while compiling:
/home/spark/core/src/main/scala/org/apache/spark/ui/JettyUtils.scala
        during phase: typer
     library version: version 2.10.4
    compiler version: version 2.10.4

...

Exception in thread "main" java.lang.AssertionError: assertion failed:
org.eclipse.jetty.server.DispatcherType
	at scala.reflect.internal.Symbols$Symbol.info(Symbols.scala:1212)
	at
scala.reflect.internal.Types$ClassTypeRef$class.baseType(Types.scala:2186)
	at scala.reflect.internal.Types$TypeRef$$anon$6.baseType(Types.scala:2544)
	at scala.reflect.internal.Types$class.firstTry$1(Types.scala:6043)
	at scala.reflect.internal.Types$class.isSubType2(Types.scala:6207)
	at scala.reflect.internal.Types$class.isSubType(Types.scala:5816)
	at scala.reflect.internal.SymbolTable.isSubType(SymbolTable.scala:13)
	at scala.reflect.internal.Types$class.isSubArg$1(Types.scala:6005)
	at
scala.reflect.internal.Types$$anonfun$isSubArgs$2.apply(Types.scala:6007)




--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Building-spark-from-source-assertion-failed-org-eclipse-jetty-server-DispatcherType-tp18529.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Re: Building spark from source - assertion failed: org.eclipse.jetty.server.DispatcherType

Posted by jamborta <ja...@gmail.com>.
ah, thanks, reverted a few days, works now.



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Building-spark-from-source-assertion-failed-org-eclipse-jetty-server-DispatcherType-tp18529p18532.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Re: Building spark from source - assertion failed: org.eclipse.jetty.server.DispatcherType

Posted by sadhan <sa...@gmail.com>.
I ran into the same issue, reverting this commit seems to work
https://github.com/apache/spark/commit/bd86cb1738800a0aa4c88b9afdba2f97ac6cbf25



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Building-spark-from-source-assertion-failed-org-eclipse-jetty-server-DispatcherType-tp18529p18530.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org