You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Gouri Deshpande <go...@gmail.com> on 2012/02/17 12:27:20 UTC
Failure authenticating with NTLM
Hi,
I am getting the error: Failure authenticating with NTLM in the
hadoop.logs.
1) Nutch version is 1.4
2) conf/httpclient-auth.xml contains the following:
<auth-configuration>
<credentials username="xyz" password="abc">
<default/>
</credentials>
</auth-configuration>
3) hadoop.log shows the following:
2012-02-17 16:40:25,678 INFO httpclient.Http - http.proxy.host = null
2012-02-17 16:40:25,678 INFO httpclient.Http - http.proxy.port = 8080
2012-02-17 16:40:25,678 INFO httpclient.Http - http.timeout = 10000
2012-02-17 16:40:25,678 INFO httpclient.Http - http.content.limit = 2097152
2012-02-17 16:40:25,678 INFO httpclient.Http - http.agent =
Spider/Nutch-1.4
2012-02-17 16:40:25,678 INFO httpclient.Http - http.accept.language =
en-us,en-gb,en;q=0.7,*;q=0.3
2012-02-17 16:40:26,552 DEBUG auth.AuthChallengeProcessor - Supported
authentication schemes in the order of preference: [ntlm, digest, basic]
2012-02-17 16:40:26,552 INFO auth.AuthChallengeProcessor - ntlm
authentication scheme selected
2012-02-17 16:40:26,552 DEBUG auth.AuthChallengeProcessor - Using
authentication scheme: ntlm
2012-02-17 16:40:26,552 DEBUG auth.AuthChallengeProcessor - Authorization
challenge processed
2012-02-17 16:40:27,098 DEBUG auth.AuthChallengeProcessor - Using
authentication scheme: ntlm
2012-02-17 16:40:27,098 DEBUG auth.AuthChallengeProcessor - Authorization
challenge processed
2012-02-17 16:40:27,692 DEBUG auth.AuthChallengeProcessor - Using
authentication scheme: ntlm
2012-02-17 16:40:27,692 DEBUG auth.AuthChallengeProcessor - Authorization
challenge processed
2012-02-17 16:40:27,692 INFO httpclient.HttpMethodDirector - Failure
authenticating with NTLM <any realm>@xyz.com:80
2012-02-17 16:40:27,832 INFO parse.ParserChecker - parsing:
http://xyz.com/Default.aspx
2012-02-17 16:40:27,832 INFO parse.ParserChecker - contentType: text/html
I have reffered the
http://wiki.apache.org/nutch/HttpAuthenticationSchemes section
NeedHelp and
seems like I do not have answers for question number 4, 5, 6
Please help me fix this problem.
Thanks
Gouri
Re: Failure authenticating with NTLM
Posted by remi tassing <ta...@gmail.com>.
Hi Gouri,
Did you see any HTTP error code in the stdout?
I'm not sure if this will work but you can try this:
http://hc.apache.org/httpcomponents-client-ga/ntlm.html
Remi
On Fri, Feb 17, 2012 at 1:27 PM, Gouri Deshpande <go...@gmail.com>wrote:
> Hi,
>
> I am getting the error: Failure authenticating with NTLM in the
> hadoop.logs.
>
> 1) Nutch version is 1.4
>
> 2) conf/httpclient-auth.xml contains the following:
>
> <auth-configuration>
> <credentials username="xyz" password="abc">
> <default/>
> </credentials>
> </auth-configuration>
>
> 3) hadoop.log shows the following:
>
> 2012-02-17 16:40:25,678 INFO httpclient.Http - http.proxy.host = null
> 2012-02-17 16:40:25,678 INFO httpclient.Http - http.proxy.port = 8080
> 2012-02-17 16:40:25,678 INFO httpclient.Http - http.timeout = 10000
> 2012-02-17 16:40:25,678 INFO httpclient.Http - http.content.limit =
> 2097152
> 2012-02-17 16:40:25,678 INFO httpclient.Http - http.agent =
> Spider/Nutch-1.4
> 2012-02-17 16:40:25,678 INFO httpclient.Http - http.accept.language =
> en-us,en-gb,en;q=0.7,*;q=0.3
> 2012-02-17 16:40:26,552 DEBUG auth.AuthChallengeProcessor - Supported
> authentication schemes in the order of preference: [ntlm, digest, basic]
> 2012-02-17 16:40:26,552 INFO auth.AuthChallengeProcessor - ntlm
> authentication scheme selected
> 2012-02-17 16:40:26,552 DEBUG auth.AuthChallengeProcessor - Using
> authentication scheme: ntlm
> 2012-02-17 16:40:26,552 DEBUG auth.AuthChallengeProcessor - Authorization
> challenge processed
> 2012-02-17 16:40:27,098 DEBUG auth.AuthChallengeProcessor - Using
> authentication scheme: ntlm
> 2012-02-17 16:40:27,098 DEBUG auth.AuthChallengeProcessor - Authorization
> challenge processed
> 2012-02-17 16:40:27,692 DEBUG auth.AuthChallengeProcessor - Using
> authentication scheme: ntlm
> 2012-02-17 16:40:27,692 DEBUG auth.AuthChallengeProcessor - Authorization
> challenge processed
> 2012-02-17 16:40:27,692 INFO httpclient.HttpMethodDirector - Failure
> authenticating with NTLM <any realm>@xyz.com:80 <http://xyz.com/>
> 2012-02-17 16:40:27,832 INFO parse.ParserChecker - parsing:
> http://xyz.com/Default.aspx
> 2012-02-17 16:40:27,832 INFO parse.ParserChecker - contentType: text/html
>
> I have reffered the
> http://wiki.apache.org/nutch/HttpAuthenticationSchemes section
> NeedHelp and
> seems like I do not have answers for question number 4, 5, 6
>
> Please help me fix this problem.
>
> Thanks
> Gouri
>