You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@nutch.apache.org by sujithq <su...@gmail.com> on 2007/10/22 17:07:21 UTC

Crawling sites (authentication required)

Hi,

Recently I was able to crawl a few sites. But now I have to crawl a site
that requires Authentication. Is there anyone who can provide me some
information how I should do that?

Regards,
Sujith
-- 
View this message in context: http://www.nabble.com/Crawling-sites-%28authentication-required%29-tf4670570.html#a13342369
Sent from the Nutch - User mailing list archive at Nabble.com.

Re: Crawling sites (authentication required)

Posted by Susam Pal <su...@gmail.com>.

What kind of of authentication is required? Do you have to submit the
credentials by POST method or does it require Basic/Digest/NTLM
authentication?

Regards,
Susam Pal

On 10/22/07, sujithq <su...@gmail.com> wrote:
>
> Hi,
>
> Recently I was able to crawl a few sites. But now I have to crawl a site
> that requires Authentication. Is there anyone who can provide me some
> information how I should do that?
>
> Regards,
> Sujith
> --