You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by James F Walton <jf...@us.ibm.com> on 2012/08/03 17:37:27 UTC
Upgrade nutch 1.4 to 1.5.1 getting 'failed to login'
I took my existing, functional configurations from my 1.4 installation and
brought everything over to run on 1.5.1. Now when I attempt to run a
crawl, I'm getting these errors.
2012-08-02 20:03:21,271 ERROR crawl.Injector - Injector:
java.lang.RuntimeException: java.io.IOException: failure to login
at
org.apache.hadoop.mapred.JobConf.getWorkingDirectory(JobConf.java:546)
at
org.apache.hadoop.mapred.FileInputFormat.addInputPath(FileInputFormat.java:336)
at org.apache.nutch.crawl.Injector.inject(Injector.java:209)
at org.apache.nutch.crawl.Injector.run(Injector.java:248)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.nutch.crawl.Injector.main(Injector.java:238)
Caused by: java.io.IOException: failure to login
at
org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:490)
at
org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:452)
at
org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1494)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1395)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:123)
at
org.apache.hadoop.mapred.JobConf.getWorkingDirectory(JobConf.java:542)
... 5 more
Caused by: javax.security.auth.login.LoginException: unable to find
LoginModule class: com.ibm.security.auth.module.LinuxLoginModule
at
javax.security.auth.login.LoginContext.invoke(LoginContext.java:834)
at
javax.security.auth.login.LoginContext.access$000(LoginContext.java:209)
at
javax.security.auth.login.LoginContext$5.run(LoginContext.java:732)
at
java.security.AccessController.doPrivileged(AccessController.java:284)
at
javax.security.auth.login.LoginContext.invokeCreatorPriv(LoginContext.java:729)
at
javax.security.auth.login.LoginContext.login(LoginContext.java:599)
at
org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:471)
... 11 more
It looks like there is some Hadoop security thing that is failing based on
a missing module, or the wrong module.
This is on AIX 6.1 with 64-bit IBM JRE 1.6.0 SR9 FP2 (aka Java6)
Is there a higher Java level requirement that I missed? Missing
configuration change that needs to be in place for 1.5.1 that wasn't in
1.4?
Any help is appreciated.
James
Re: Upgrade nutch 1.4 to 1.5.1 getting 'failed to login'
Posted by James F Walton <jf...@us.ibm.com>.
I'm running the Nutch crawler remotely, a server that is physically
disparate from the Solr servers and from the website that is being
crawled.
It appears that Nutch 1.5.1 prefers to run on Linux. We're attempting to
run it on AIX. I don't recall having this issue with 1.4, unless I need
to find a different package.
From: Lewis John Mcgibbney <le...@gmail.com>
To: user@nutch.apache.org
Date: 08/04/2012 10:00 AM
Subject: Re: Upgrade nutch 1.4 to 1.5.1 getting 'failed to login'
Hi,
do you run Nutch locally, pseudo distrib...?
Lewis
On Fri, Aug 3, 2012 at 4:37 PM, James F Walton <jf...@us.ibm.com>
wrote:
> I took my existing, functional configurations from my 1.4 installation
and
> brought everything over to run on 1.5.1. Now when I attempt to run a
> crawl, I'm getting these errors.
>
> 2012-08-02 20:03:21,271 ERROR crawl.Injector - Injector:
> java.lang.RuntimeException: java.io.IOException: failure to login
> at
> org.apache.hadoop.mapred.JobConf.getWorkingDirectory(JobConf.java:546)
> at
>
org.apache.hadoop.mapred.FileInputFormat.addInputPath(FileInputFormat.java:336)
> at org.apache.nutch.crawl.Injector.inject(Injector.java:209)
> at org.apache.nutch.crawl.Injector.run(Injector.java:248)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.nutch.crawl.Injector.main(Injector.java:238)
> Caused by: java.io.IOException: failure to login
> at
>
org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:490)
> at
>
org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:452)
> at
> org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1494)
> at
org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1395)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:123)
> at
> org.apache.hadoop.mapred.JobConf.getWorkingDirectory(JobConf.java:542)
> ... 5 more
> Caused by: javax.security.auth.login.LoginException: unable to find
> LoginModule class: com.ibm.security.auth.module.LinuxLoginModule
> at
> javax.security.auth.login.LoginContext.invoke(LoginContext.java:834)
> at
> javax.security.auth.login.LoginContext.access$000(LoginContext.java:209)
> at
> javax.security.auth.login.LoginContext$5.run(LoginContext.java:732)
> at
> java.security.AccessController.doPrivileged(AccessController.java:284)
> at
>
javax.security.auth.login.LoginContext.invokeCreatorPriv(LoginContext.java:729)
> at
> javax.security.auth.login.LoginContext.login(LoginContext.java:599)
> at
>
org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:471)
> ... 11 more
>
>
> It looks like there is some Hadoop security thing that is failing based
on
> a missing module, or the wrong module.
> This is on AIX 6.1 with 64-bit IBM JRE 1.6.0 SR9 FP2 (aka Java6)
>
> Is there a higher Java level requirement that I missed? Missing
> configuration change that needs to be in place for 1.5.1 that wasn't in
> 1.4?
> Any help is appreciated.
>
> James
--
Lewis
Re: Upgrade nutch 1.4 to 1.5.1 getting 'failed to login'
Posted by Lewis John Mcgibbney <le...@gmail.com>.
Hi,
do you run Nutch locally, pseudo distrib...?
Lewis
On Fri, Aug 3, 2012 at 4:37 PM, James F Walton <jf...@us.ibm.com> wrote:
> I took my existing, functional configurations from my 1.4 installation and
> brought everything over to run on 1.5.1. Now when I attempt to run a
> crawl, I'm getting these errors.
>
> 2012-08-02 20:03:21,271 ERROR crawl.Injector - Injector:
> java.lang.RuntimeException: java.io.IOException: failure to login
> at
> org.apache.hadoop.mapred.JobConf.getWorkingDirectory(JobConf.java:546)
> at
> org.apache.hadoop.mapred.FileInputFormat.addInputPath(FileInputFormat.java:336)
> at org.apache.nutch.crawl.Injector.inject(Injector.java:209)
> at org.apache.nutch.crawl.Injector.run(Injector.java:248)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.nutch.crawl.Injector.main(Injector.java:238)
> Caused by: java.io.IOException: failure to login
> at
> org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:490)
> at
> org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:452)
> at
> org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1494)
> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1395)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:123)
> at
> org.apache.hadoop.mapred.JobConf.getWorkingDirectory(JobConf.java:542)
> ... 5 more
> Caused by: javax.security.auth.login.LoginException: unable to find
> LoginModule class: com.ibm.security.auth.module.LinuxLoginModule
> at
> javax.security.auth.login.LoginContext.invoke(LoginContext.java:834)
> at
> javax.security.auth.login.LoginContext.access$000(LoginContext.java:209)
> at
> javax.security.auth.login.LoginContext$5.run(LoginContext.java:732)
> at
> java.security.AccessController.doPrivileged(AccessController.java:284)
> at
> javax.security.auth.login.LoginContext.invokeCreatorPriv(LoginContext.java:729)
> at
> javax.security.auth.login.LoginContext.login(LoginContext.java:599)
> at
> org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:471)
> ... 11 more
>
>
> It looks like there is some Hadoop security thing that is failing based on
> a missing module, or the wrong module.
> This is on AIX 6.1 with 64-bit IBM JRE 1.6.0 SR9 FP2 (aka Java6)
>
> Is there a higher Java level requirement that I missed? Missing
> configuration change that needs to be in place for 1.5.1 that wasn't in
> 1.4?
> Any help is appreciated.
>
> James
--
Lewis