You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Markus Jelsma (JIRA)" <ji...@apache.org> on 2018/11/07 11:26:00 UTC

[jira] [Created] (NUTCH-2673) EOFException protocol-http

Markus Jelsma created NUTCH-2673:
------------------------------------

             Summary: EOFException protocol-http
                 Key: NUTCH-2673
                 URL: https://issues.apache.org/jira/browse/NUTCH-2673
             Project: Nutch
          Issue Type: Bug
    Affects Versions: 1.14
            Reporter: Markus Jelsma
             Fix For: 1.16


Got an EOFException for some URL:

{code}
2018-11-07 12:23:18,463 INFO  indexer.IndexingFiltersChecker - fetching: https://www.misdaadjournalist.nl/2018/11/politie-kraakt-server-van-blackbox-265-000-criminele-berichten-onderschept/
2018-11-07 12:23:18,704 INFO  protocol.RobotRulesParser - robots.txt whitelist not configured.
2018-11-07 12:23:18,704 INFO  http.Http - http.proxy.host = null
2018-11-07 12:23:18,704 INFO  http.Http - http.proxy.port = 8080
2018-11-07 12:23:18,704 INFO  http.Http - http.proxy.exception.list = false
2018-11-07 12:23:18,704 INFO  http.Http - http.timeout = 30000
2018-11-07 12:23:18,704 INFO  http.Http - http.content.limit = 32554432
2018-11-07 12:23:18,704 INFO  http.Http - http.agent = Mozilla/5.0 (compatible; OpenindexSpider; +https://www.openindex.io/saas/about-our-spider/)
2018-11-07 12:23:18,704 INFO  http.Http - http.accept.language = en-us,en-gb,en;q=0.7,*;q=0.3
2018-11-07 12:23:18,704 INFO  http.Http - http.accept = text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
2018-11-07 12:23:18,704 INFO  http.Http - http.enable.cookie.header = false
2018-11-07 12:23:18,911 ERROR http.Http - Failed to get protocol output
java.io.EOFException
        at org.apache.nutch.protocol.http.HttpResponse.readLine(HttpResponse.java:591)
        at org.apache.nutch.protocol.http.HttpResponse.parseStatusLine(HttpResponse.java:482)
        at org.apache.nutch.protocol.http.HttpResponse.<init>(HttpResponse.java:249)
        at org.apache.nutch.protocol.http.Http.getResponse(Http.java:72)
        at org.apache.nutch.protocol.http.api.HttpBase.getProtocolOutput(HttpBase.java:276)
        at org.apache.nutch.indexer.IndexingFiltersChecker.getProtocolOutput(IndexingFiltersChecker.java:270)
        at org.apache.nutch.indexer.IndexingFiltersChecker.process(IndexingFiltersChecker.java:141)
        at org.apache.nutch.util.AbstractChecker.processSingle(AbstractChecker.java:86)
        at org.apache.nutch.indexer.IndexingFiltersChecker.run(IndexingFiltersChecker.java:111)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.apache.nutch.indexer.IndexingFiltersChecker.main(IndexingFiltersChecker.java:275)
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)