[jira] [Commented] (NUTCH-2648) Make configurable whether TLS/SSL certificates are checked by protocol plugins

["ASF GitHub Bot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/NUTCH-2648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642045#comment-16642045 ] 

ASF GitHub Bot commented on NUTCH-2648:
---------------------------------------

sebastian-nagel opened a new pull request #388:  NUTCH-2648 Make configurable whether TLS/SSL certificates are checked by protocol plugins
URL: https://github.com/apache/nutch/pull/388
 
 
   - enable/disable validation of certs by property `http.tls.certificates.check` (default: false/disabled)
   - add support to skip certificate validation in protocol-okhttp

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Make configurable whether TLS/SSL certificates are checked by protocol plugins
> ------------------------------------------------------------------------------
>
>                 Key: NUTCH-2648
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2648
>             Project: Nutch
>          Issue Type: Improvement
>            Reporter: Sebastian Nagel
>            Priority: Minor
>
> (see discussion in NUTCH-2647)
> It should be possible to enable/disable TLS/SSL certificate validation centrally for all http/https protocol plugins by a single configuration property.
> Some use cases (eg. crawl a site to detect insecure pages) may require that TLS/SSL certificates are checked. Also a broader, unrestricted web crawl may skip sites with invalid certificates as this is can be an indicator for the quality of a site.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)