You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Trent DiBacco <tr...@gmail.com> on 2014/01/07 07:50:06 UTC
Crawl HTTPS site that uses self signed certificate?
How do you enable Nutch to crawl over HTTPS where the target site is using an a self signed certificate?
Using the protocol-httpclient plugin works on sites with valid certificates.
However, to be able to crawl sites with a self signed certificate required a simple code modification the protocol-httpclient plugin.
org.apache.nutch.protocol.httpclient.Http
Replaced:
ProtocolSocketFactory factory = new SSLProtocolSocketFactory();
With:
ProtocolSocketFactory factory = new DummySSLProtocolSocketFactory();
Is their dependency injection that can be used?