You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Genmao Yu (JIRA)" <ji...@apache.org> on 2016/10/27 08:38:58 UTC
[jira] [Updated] (SPARK-18135) Failed to access Spark UI and
HistoryServer UI
[ https://issues.apache.org/jira/browse/SPARK-18135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Genmao Yu updated SPARK-18135:
------------------------------
Description:
h2. Environment
1. Spark package: build with Hadoop-2.7.2 {code}./dev/make-distribution.sh --name hadoop2.7 --tgz -Psparkr -Phadoop-2.6 -Dhadoop.version=2.7.2 -Phive -Phive-thriftserver -Pyarn{code}
2. Run Spark on Yarn(2.7.2)
h2. Failed to access Spark UI with following exception:
{code}
16/10/27 16:00:07 WARN server.HttpChannel: /jobs/
java.lang.NoSuchMethodError: javax.servlet.http.HttpServletRequest.isAsyncStarted()Z
at org.spark_project.jetty.servlets.gzip.GzipHandler.handle(GzipHandler.java:484)
at org.spark_project.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
at org.spark_project.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
at org.spark_project.jetty.server.Server.handle(Server.java:499)
at org.spark_project.jetty.server.HttpChannel.handle(HttpChannel.java:311)
at org.spark_project.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at org.spark_project.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
at org.spark_project.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at org.spark_project.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.lang.Thread.run(Thread.java:745)
16/10/27 16:00:07 WARN thread.QueuedThreadPool:
java.lang.NoSuchMethodError: javax.servlet.http.HttpServletResponse.getStatus()I
at org.spark_project.jetty.server.handler.ErrorHandler.handle(ErrorHandler.java:112)
at org.spark_project.jetty.server.Response.sendError(Response.java:597)
at org.spark_project.jetty.server.HttpChannel.handleException(HttpChannel.java:487)
at org.spark_project.jetty.server.HttpConnection$HttpChannelOverHttp.handleException(HttpConnection.java:594)
at org.spark_project.jetty.server.HttpChannel.handle(HttpChannel.java:387)
at org.spark_project.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at org.spark_project.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
at org.spark_project.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at org.spark_project.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.lang.Thread.run(Thread.java:745)
{code}
Fix: Remove servlet-api-2.5.jar from SPARK_HOME/jars
h2. Failed to HistoryServer UI with following exceptions in log:
{code}
16/10/27 08:08:27 WARN ServletHandler: Error for /api/v1/applications
java.lang.NoSuchMethodError: javax.ws.rs.core.Application.getProperties()Ljava/util/Map;
at org.glassfish.jersey.server.ApplicationHandler.<init>(ApplicationHandler.java:331)
at org.glassfish.jersey.servlet.WebComponent.<init>(WebComponent.java:392)
at org.glassfish.jersey.servlet.ServletContainer.init(ServletContainer.java:177)
at org.glassfish.jersey.servlet.ServletContainer.init(ServletContainer.java:369)
at javax.servlet.GenericServlet.init(GenericServlet.java:244)
at org.spark_project.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:616)
at org.spark_project.jetty.servlet.ServletHolder.getServlet(ServletHolder.java:472)
at org.spark_project.jetty.servlet.ServletHolder.ensureInstance(ServletHolder.java:767)
at org.spark_project.jetty.servlet.ServletHolder.prepare(ServletHolder.java:752)
at org.spark_project.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
at org.spark_project.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
at org.spark_project.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
at org.spark_project.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
at org.spark_project.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.spark_project.jetty.servlets.gzip.GzipHandler.handle(GzipHandler.java:479)
at org.spark_project.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
at org.spark_project.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
at org.spark_project.jetty.server.Server.handle(Server.java:499)
at org.spark_project.jetty.server.HttpChannel.handle(HttpChannel.java:311)
at org.spark_project.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at org.spark_project.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
at org.spark_project.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at org.spark_project.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.lang.Thread.run(Thread.java:745)
16/10/27 08:08:33 WARN ServletHandler: /api/v1/applications
java.lang.NullPointerException
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388)
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341)
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228)
at org.spark_project.jetty.servlet.ServletHolder.handle(ServletHolder.java:812)
at org.spark_project.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:587)
at org.spark_project.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
at org.spark_project.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
at org.spark_project.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
at org.spark_project.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.spark_project.jetty.servlets.gzip.GzipHandler.handle(GzipHandler.java:479)
at org.spark_project.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
at org.spark_project.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
at org.spark_project.jetty.server.Server.handle(Server.java:499)
at org.spark_project.jetty.server.HttpChannel.handle(HttpChannel.java:311)
at org.spark_project.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at org.spark_project.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
at org.spark_project.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at org.spark_project.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.lang.Thread.run(Thread.java:745)
{code}
Root cause: In my SPARK_HOME/jars, there are both jersey*-1.9.jar and jersey*-2.22.2.jar. Conflict.
Tick off: remove jersey*-1.9.jar from SPARK_HOME/jars.
h2. Confusing
I think this problem is not an accident.
was:
h2. Environment
1. Spark package: build with Hadoop-2.7.2 {code}./dev/make-distribution.sh --name hadoop2.7 --tgz -Psparkr -Phadoop-2.6 -Dhadoop.version=2.7.2 -Phive -Phive-thriftserver -Pyarn{code}
2. Run Spark on Yarn(2.7.2)
h2. Failed to access Spark UI with following exception:
{code}
16/10/27 16:00:07 WARN server.HttpChannel: /jobs/
java.lang.NoSuchMethodError: javax.servlet.http.HttpServletRequest.isAsyncStarted()Z
at org.spark_project.jetty.servlets.gzip.GzipHandler.handle(GzipHandler.java:484)
at org.spark_project.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
at org.spark_project.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
at org.spark_project.jetty.server.Server.handle(Server.java:499)
at org.spark_project.jetty.server.HttpChannel.handle(HttpChannel.java:311)
at org.spark_project.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at org.spark_project.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
at org.spark_project.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at org.spark_project.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.lang.Thread.run(Thread.java:745)
16/10/27 16:00:07 WARN thread.QueuedThreadPool:
java.lang.NoSuchMethodError: javax.servlet.http.HttpServletResponse.getStatus()I
at org.spark_project.jetty.server.handler.ErrorHandler.handle(ErrorHandler.java:112)
at org.spark_project.jetty.server.Response.sendError(Response.java:597)
at org.spark_project.jetty.server.HttpChannel.handleException(HttpChannel.java:487)
at org.spark_project.jetty.server.HttpConnection$HttpChannelOverHttp.handleException(HttpConnection.java:594)
at org.spark_project.jetty.server.HttpChannel.handle(HttpChannel.java:387)
at org.spark_project.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at org.spark_project.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
at org.spark_project.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at org.spark_project.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.lang.Thread.run(Thread.java:745)
{code}
Root cause: In Spark-sbumit classpath, the javax.servlet-api-3.1.0.jar is loaded before jetty-*
Tick:
1. remove servlet-api-2.5.jar from SPARK_HOME/jars
h2. Failed to HistoryServer UI with following exceptions in log:
{code}
16/10/27 08:08:27 WARN ServletHandler: Error for /api/v1/applications
java.lang.NoSuchMethodError: javax.ws.rs.core.Application.getProperties()Ljava/util/Map;
at org.glassfish.jersey.server.ApplicationHandler.<init>(ApplicationHandler.java:331)
at org.glassfish.jersey.servlet.WebComponent.<init>(WebComponent.java:392)
at org.glassfish.jersey.servlet.ServletContainer.init(ServletContainer.java:177)
at org.glassfish.jersey.servlet.ServletContainer.init(ServletContainer.java:369)
at javax.servlet.GenericServlet.init(GenericServlet.java:244)
at org.spark_project.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:616)
at org.spark_project.jetty.servlet.ServletHolder.getServlet(ServletHolder.java:472)
at org.spark_project.jetty.servlet.ServletHolder.ensureInstance(ServletHolder.java:767)
at org.spark_project.jetty.servlet.ServletHolder.prepare(ServletHolder.java:752)
at org.spark_project.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
at org.spark_project.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
at org.spark_project.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
at org.spark_project.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
at org.spark_project.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.spark_project.jetty.servlets.gzip.GzipHandler.handle(GzipHandler.java:479)
at org.spark_project.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
at org.spark_project.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
at org.spark_project.jetty.server.Server.handle(Server.java:499)
at org.spark_project.jetty.server.HttpChannel.handle(HttpChannel.java:311)
at org.spark_project.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at org.spark_project.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
at org.spark_project.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at org.spark_project.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.lang.Thread.run(Thread.java:745)
16/10/27 08:08:33 WARN ServletHandler: /api/v1/applications
java.lang.NullPointerException
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388)
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341)
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228)
at org.spark_project.jetty.servlet.ServletHolder.handle(ServletHolder.java:812)
at org.spark_project.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:587)
at org.spark_project.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
at org.spark_project.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
at org.spark_project.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
at org.spark_project.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.spark_project.jetty.servlets.gzip.GzipHandler.handle(GzipHandler.java:479)
at org.spark_project.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
at org.spark_project.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
at org.spark_project.jetty.server.Server.handle(Server.java:499)
at org.spark_project.jetty.server.HttpChannel.handle(HttpChannel.java:311)
at org.spark_project.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at org.spark_project.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
at org.spark_project.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at org.spark_project.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.lang.Thread.run(Thread.java:745)
{code}
Root cause: In my SPARK_HOME/jars, there are both jersey*-1.9.jar and jersey*-2.22.2.jar. Conflict.
Tick off: remove jersey*-1.9.jar from SPARK_HOME/jars.
h2. Confusing
I think this problem is not an accident.
> Failed to access Spark UI and HistoryServer UI
> ----------------------------------------------
>
> Key: SPARK-18135
> URL: https://issues.apache.org/jira/browse/SPARK-18135
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.0.1
> Reporter: Genmao Yu
>
> h2. Environment
> 1. Spark package: build with Hadoop-2.7.2 {code}./dev/make-distribution.sh --name hadoop2.7 --tgz -Psparkr -Phadoop-2.6 -Dhadoop.version=2.7.2 -Phive -Phive-thriftserver -Pyarn{code}
> 2. Run Spark on Yarn(2.7.2)
> h2. Failed to access Spark UI with following exception:
> {code}
> 16/10/27 16:00:07 WARN server.HttpChannel: /jobs/
> java.lang.NoSuchMethodError: javax.servlet.http.HttpServletRequest.isAsyncStarted()Z
> at org.spark_project.jetty.servlets.gzip.GzipHandler.handle(GzipHandler.java:484)
> at org.spark_project.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
> at org.spark_project.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
> at org.spark_project.jetty.server.Server.handle(Server.java:499)
> at org.spark_project.jetty.server.HttpChannel.handle(HttpChannel.java:311)
> at org.spark_project.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
> at org.spark_project.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
> at org.spark_project.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
> at org.spark_project.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
> at java.lang.Thread.run(Thread.java:745)
> 16/10/27 16:00:07 WARN thread.QueuedThreadPool:
> java.lang.NoSuchMethodError: javax.servlet.http.HttpServletResponse.getStatus()I
> at org.spark_project.jetty.server.handler.ErrorHandler.handle(ErrorHandler.java:112)
> at org.spark_project.jetty.server.Response.sendError(Response.java:597)
> at org.spark_project.jetty.server.HttpChannel.handleException(HttpChannel.java:487)
> at org.spark_project.jetty.server.HttpConnection$HttpChannelOverHttp.handleException(HttpConnection.java:594)
> at org.spark_project.jetty.server.HttpChannel.handle(HttpChannel.java:387)
> at org.spark_project.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
> at org.spark_project.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
> at org.spark_project.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
> at org.spark_project.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
> at java.lang.Thread.run(Thread.java:745)
> {code}
> Fix: Remove servlet-api-2.5.jar from SPARK_HOME/jars
> h2. Failed to HistoryServer UI with following exceptions in log:
> {code}
> 16/10/27 08:08:27 WARN ServletHandler: Error for /api/v1/applications
> java.lang.NoSuchMethodError: javax.ws.rs.core.Application.getProperties()Ljava/util/Map;
> at org.glassfish.jersey.server.ApplicationHandler.<init>(ApplicationHandler.java:331)
> at org.glassfish.jersey.servlet.WebComponent.<init>(WebComponent.java:392)
> at org.glassfish.jersey.servlet.ServletContainer.init(ServletContainer.java:177)
> at org.glassfish.jersey.servlet.ServletContainer.init(ServletContainer.java:369)
> at javax.servlet.GenericServlet.init(GenericServlet.java:244)
> at org.spark_project.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:616)
> at org.spark_project.jetty.servlet.ServletHolder.getServlet(ServletHolder.java:472)
> at org.spark_project.jetty.servlet.ServletHolder.ensureInstance(ServletHolder.java:767)
> at org.spark_project.jetty.servlet.ServletHolder.prepare(ServletHolder.java:752)
> at org.spark_project.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
> at org.spark_project.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
> at org.spark_project.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
> at org.spark_project.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
> at org.spark_project.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
> at org.spark_project.jetty.servlets.gzip.GzipHandler.handle(GzipHandler.java:479)
> at org.spark_project.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
> at org.spark_project.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
> at org.spark_project.jetty.server.Server.handle(Server.java:499)
> at org.spark_project.jetty.server.HttpChannel.handle(HttpChannel.java:311)
> at org.spark_project.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
> at org.spark_project.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
> at org.spark_project.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
> at org.spark_project.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
> at java.lang.Thread.run(Thread.java:745)
> 16/10/27 08:08:33 WARN ServletHandler: /api/v1/applications
> java.lang.NullPointerException
> at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388)
> at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341)
> at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228)
> at org.spark_project.jetty.servlet.ServletHolder.handle(ServletHolder.java:812)
> at org.spark_project.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:587)
> at org.spark_project.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
> at org.spark_project.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
> at org.spark_project.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
> at org.spark_project.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
> at org.spark_project.jetty.servlets.gzip.GzipHandler.handle(GzipHandler.java:479)
> at org.spark_project.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
> at org.spark_project.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
> at org.spark_project.jetty.server.Server.handle(Server.java:499)
> at org.spark_project.jetty.server.HttpChannel.handle(HttpChannel.java:311)
> at org.spark_project.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
> at org.spark_project.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
> at org.spark_project.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
> at org.spark_project.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
> at java.lang.Thread.run(Thread.java:745)
> {code}
> Root cause: In my SPARK_HOME/jars, there are both jersey*-1.9.jar and jersey*-2.22.2.jar. Conflict.
> Tick off: remove jersey*-1.9.jar from SPARK_HOME/jars.
> h2. Confusing
> I think this problem is not an accident.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org