You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by Sangjin Lee <sj...@apache.org> on 2015/03/26 01:55:43 UTC
trunk issue?
I just pulled the latest trunk, and ran some unit tests that involve
starting up the mini YARN cluster. The RM fails to come up with the
following error:
2015-03-25 17:52:55,573 WARN [RM-0] mortbay.log (Slf4jLog.java:warn(89)) -
Failed startup of context org.mortbay.jetty.webapp.WebAppContext@2122b536
{/,jar:file:/Users/sjlee/.m2/repository/org/apache/hadoop/hadoop-yarn-common/3.0.0-SNAPSHOT/hadoop-yarn-common-3.0.0-SNAPSHOT.jar!/webapps/cluster}
javax.servlet.ServletException: java.lang.RuntimeException: Could not read
signature secret file: /Users/sjlee/hadoop-http-auth-signature-secret
at
org.apache.hadoop.security.authentication.server.AuthenticationFilter.initializeSecretProvider(AuthenticationFilter.java:266)
at
org.apache.hadoop.security.authentication.server.AuthenticationFilter.init(AuthenticationFilter.java:225)
at
org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.init(DelegationTokenAuthenticationFilter.java:161)
at
org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter.init(RMAuthenticationFilter.java:53)
at org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:97)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:713)
at org.mortbay.jetty.servlet.Context.startContext(Context.java:140)
at
org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1282)
at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518)
at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
at
org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:156)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
at org.mortbay.jetty.Server.doStart(Server.java:224)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:773)
at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:274)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startWepApp(ResourceManager.java:974)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceStart(ResourceManager.java:1074)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at
org.apache.hadoop.yarn.server.MiniYARNCluster$2.run(MiniYARNCluster.java:312)
Caused by: java.lang.RuntimeException: Could not read signature secret
file: /Users/sjlee/hadoop-http-auth-signature-secret
at
org.apache.hadoop.security.authentication.util.FileSignerSecretProvider.init(FileSignerSecretProvider.java:59)
at
org.apache.hadoop.security.authentication.server.AuthenticationFilter.initializeSecretProvider(AuthenticationFilter.java:264)
... 23 more
Is this a known issue? Could this be related to HADOOP-10670
<https://issues.apache.org/jira/browse/HADOOP-10670>?
Thanks,
Sangjin
Re: trunk issue?
Posted by Sangjin Lee <sj...@apache.org>.
Filed https://issues.apache.org/jira/browse/HADOOP-11754.
On Wed, Mar 25, 2015 at 9:04 PM, Sangjin Lee <sj...@gmail.com> wrote:
> It's clearly in the insecure mode. All I did is to pull the trunk and ran
> a unit test (thus the mini YARN cluster). For example,
>
> mvn clean install -DskipTests
> cd
> hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/
> mvn test -Dtest=TestUberAM#testConfVerificationWithClassloader
>
> Sangjin
>
> On Wed, Mar 25, 2015 at 8:38 PM, Mai Haohui <ri...@gmail.com> wrote:
>
>> It looks like it is related to HADOOP-10670. Are you running in secure
>> mode? It's a bug if you see this error in insecure mode.
>>
>> ~Haohui
>>
>> On Wed, Mar 25, 2015 at 5:55 PM, Sangjin Lee <sj...@apache.org> wrote:
>> > I just pulled the latest trunk, and ran some unit tests that involve
>> > starting up the mini YARN cluster. The RM fails to come up with the
>> > following error:
>> >
>> > 2015-03-25 17:52:55,573 WARN [RM-0] mortbay.log
>> (Slf4jLog.java:warn(89)) -
>> > Failed startup of context
>> org.mortbay.jetty.webapp.WebAppContext@2122b536
>> >
>> {/,jar:file:/Users/sjlee/.m2/repository/org/apache/hadoop/hadoop-yarn-common/3.0.0-SNAPSHOT/hadoop-yarn-common-3.0.0-SNAPSHOT.jar!/webapps/cluster}
>> > javax.servlet.ServletException: java.lang.RuntimeException: Could not
>> read
>> > signature secret file: /Users/sjlee/hadoop-http-auth-signature-secret
>> > at
>> >
>> org.apache.hadoop.security.authentication.server.AuthenticationFilter.initializeSecretProvider(AuthenticationFilter.java:266)
>> > at
>> >
>> org.apache.hadoop.security.authentication.server.AuthenticationFilter.init(AuthenticationFilter.java:225)
>> > at
>> >
>> org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.init(DelegationTokenAuthenticationFilter.java:161)
>> > at
>> >
>> org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter.init(RMAuthenticationFilter.java:53)
>> > at org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:97)
>> > at
>> org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
>> > at
>> >
>> org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:713)
>> > at org.mortbay.jetty.servlet.Context.startContext(Context.java:140)
>> > at
>> >
>> org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1282)
>> > at
>> org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518)
>> > at
>> org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
>> > at
>> org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
>> > at
>> >
>> org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
>> > at
>> >
>> org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:156)
>> > at
>> org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
>> > at
>> org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
>> > at org.mortbay.jetty.Server.doStart(Server.java:224)
>> > at
>> org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
>> > at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:773)
>> > at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:274)
>> > at
>> >
>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startWepApp(ResourceManager.java:974)
>> > at
>> >
>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceStart(ResourceManager.java:1074)
>> > at
>> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
>> > at
>> >
>> org.apache.hadoop.yarn.server.MiniYARNCluster$2.run(MiniYARNCluster.java:312)
>> > Caused by: java.lang.RuntimeException: Could not read signature secret
>> > file: /Users/sjlee/hadoop-http-auth-signature-secret
>> > at
>> >
>> org.apache.hadoop.security.authentication.util.FileSignerSecretProvider.init(FileSignerSecretProvider.java:59)
>> > at
>> >
>> org.apache.hadoop.security.authentication.server.AuthenticationFilter.initializeSecretProvider(AuthenticationFilter.java:264)
>> > ... 23 more
>> >
>> > Is this a known issue? Could this be related to HADOOP-10670
>> > <https://issues.apache.org/jira/browse/HADOOP-10670>?
>> >
>> > Thanks,
>> > Sangjin
>>
>
>
Re: trunk issue?
Posted by Sangjin Lee <sj...@gmail.com>.
It's clearly in the insecure mode. All I did is to pull the trunk and ran a
unit test (thus the mini YARN cluster). For example,
mvn clean install -DskipTests
cd
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/
mvn test -Dtest=TestUberAM#testConfVerificationWithClassloader
Sangjin
On Wed, Mar 25, 2015 at 8:38 PM, Mai Haohui <ri...@gmail.com> wrote:
> It looks like it is related to HADOOP-10670. Are you running in secure
> mode? It's a bug if you see this error in insecure mode.
>
> ~Haohui
>
> On Wed, Mar 25, 2015 at 5:55 PM, Sangjin Lee <sj...@apache.org> wrote:
> > I just pulled the latest trunk, and ran some unit tests that involve
> > starting up the mini YARN cluster. The RM fails to come up with the
> > following error:
> >
> > 2015-03-25 17:52:55,573 WARN [RM-0] mortbay.log
> (Slf4jLog.java:warn(89)) -
> > Failed startup of context org.mortbay.jetty.webapp.WebAppContext@2122b536
> >
> {/,jar:file:/Users/sjlee/.m2/repository/org/apache/hadoop/hadoop-yarn-common/3.0.0-SNAPSHOT/hadoop-yarn-common-3.0.0-SNAPSHOT.jar!/webapps/cluster}
> > javax.servlet.ServletException: java.lang.RuntimeException: Could not
> read
> > signature secret file: /Users/sjlee/hadoop-http-auth-signature-secret
> > at
> >
> org.apache.hadoop.security.authentication.server.AuthenticationFilter.initializeSecretProvider(AuthenticationFilter.java:266)
> > at
> >
> org.apache.hadoop.security.authentication.server.AuthenticationFilter.init(AuthenticationFilter.java:225)
> > at
> >
> org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.init(DelegationTokenAuthenticationFilter.java:161)
> > at
> >
> org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter.init(RMAuthenticationFilter.java:53)
> > at org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:97)
> > at
> org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
> > at
> >
> org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:713)
> > at org.mortbay.jetty.servlet.Context.startContext(Context.java:140)
> > at
> >
> org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1282)
> > at
> org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518)
> > at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
> > at
> org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
> > at
> >
> org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
> > at
> >
> org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:156)
> > at
> org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
> > at
> org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
> > at org.mortbay.jetty.Server.doStart(Server.java:224)
> > at
> org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
> > at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:773)
> > at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:274)
> > at
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startWepApp(ResourceManager.java:974)
> > at
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceStart(ResourceManager.java:1074)
> > at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> > at
> >
> org.apache.hadoop.yarn.server.MiniYARNCluster$2.run(MiniYARNCluster.java:312)
> > Caused by: java.lang.RuntimeException: Could not read signature secret
> > file: /Users/sjlee/hadoop-http-auth-signature-secret
> > at
> >
> org.apache.hadoop.security.authentication.util.FileSignerSecretProvider.init(FileSignerSecretProvider.java:59)
> > at
> >
> org.apache.hadoop.security.authentication.server.AuthenticationFilter.initializeSecretProvider(AuthenticationFilter.java:264)
> > ... 23 more
> >
> > Is this a known issue? Could this be related to HADOOP-10670
> > <https://issues.apache.org/jira/browse/HADOOP-10670>?
> >
> > Thanks,
> > Sangjin
>
Re: trunk issue?
Posted by Mai Haohui <ri...@gmail.com>.
It looks like it is related to HADOOP-10670. Are you running in secure
mode? It's a bug if you see this error in insecure mode.
~Haohui
On Wed, Mar 25, 2015 at 5:55 PM, Sangjin Lee <sj...@apache.org> wrote:
> I just pulled the latest trunk, and ran some unit tests that involve
> starting up the mini YARN cluster. The RM fails to come up with the
> following error:
>
> 2015-03-25 17:52:55,573 WARN [RM-0] mortbay.log (Slf4jLog.java:warn(89)) -
> Failed startup of context org.mortbay.jetty.webapp.WebAppContext@2122b536
> {/,jar:file:/Users/sjlee/.m2/repository/org/apache/hadoop/hadoop-yarn-common/3.0.0-SNAPSHOT/hadoop-yarn-common-3.0.0-SNAPSHOT.jar!/webapps/cluster}
> javax.servlet.ServletException: java.lang.RuntimeException: Could not read
> signature secret file: /Users/sjlee/hadoop-http-auth-signature-secret
> at
> org.apache.hadoop.security.authentication.server.AuthenticationFilter.initializeSecretProvider(AuthenticationFilter.java:266)
> at
> org.apache.hadoop.security.authentication.server.AuthenticationFilter.init(AuthenticationFilter.java:225)
> at
> org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.init(DelegationTokenAuthenticationFilter.java:161)
> at
> org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter.init(RMAuthenticationFilter.java:53)
> at org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:97)
> at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
> at
> org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:713)
> at org.mortbay.jetty.servlet.Context.startContext(Context.java:140)
> at
> org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1282)
> at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518)
> at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
> at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
> at
> org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
> at
> org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:156)
> at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
> at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
> at org.mortbay.jetty.Server.doStart(Server.java:224)
> at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
> at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:773)
> at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:274)
> at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startWepApp(ResourceManager.java:974)
> at
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceStart(ResourceManager.java:1074)
> at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.yarn.server.MiniYARNCluster$2.run(MiniYARNCluster.java:312)
> Caused by: java.lang.RuntimeException: Could not read signature secret
> file: /Users/sjlee/hadoop-http-auth-signature-secret
> at
> org.apache.hadoop.security.authentication.util.FileSignerSecretProvider.init(FileSignerSecretProvider.java:59)
> at
> org.apache.hadoop.security.authentication.server.AuthenticationFilter.initializeSecretProvider(AuthenticationFilter.java:264)
> ... 23 more
>
> Is this a known issue? Could this be related to HADOOP-10670
> <https://issues.apache.org/jira/browse/HADOOP-10670>?
>
> Thanks,
> Sangjin