You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Trent DiBacco <tr...@gmail.com> on 2014/01/07 07:50:06 UTC

Crawl HTTPS site that uses self signed certificate?

How do you enable Nutch to crawl over HTTPS where the target site is using an a self signed certificate? 

Using the protocol-httpclient plugin works on sites with valid certificates. 

However, to be able to crawl sites with a self signed certificate required a simple code modification the protocol-httpclient plugin.

org.apache.nutch.protocol.httpclient.Http

Replaced:

ProtocolSocketFactory factory = new SSLProtocolSocketFactory();

With:

ProtocolSocketFactory factory = new DummySSLProtocolSocketFactory();

Is their dependency injection that can be used?