You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@nutch.apache.org by Mohini Padhye <mp...@internap.com> on 2005/11/02 21:50:21 UTC

Crawling SSL enabled site

 
How does Nutch crawl SSL enabled sites? I am using nutch-0.6
I tried changing following line in crawl-urlfilter and removed https.
# skip file:, ftp:, & mailto: urls
-^(file|ftp|mailto|https):
Still it doesn't crawl anything.
-Mohini