You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Hudson (JIRA)" <ji...@apache.org> on 2018/06/12 16:55:00 UTC

[jira] [Commented] (NUTCH-2564) protocol-http throws an error when the content-length header is not a number

    [ https://issues.apache.org/jira/browse/NUTCH-2564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16509867#comment-16509867 ] 

Hudson commented on NUTCH-2564:
-------------------------------

SUCCESS: Integrated in Jenkins build Nutch-trunk #3534 (See [https://builds.apache.org/job/Nutch-trunk/3534/])
NUTCH-2564 protocol-http throws an error when the content-length header (snagel: [https://github.com/apache/nutch/commit/957306ae0399442de655fc897ae82f4cb60a8883])
* (edit) src/plugin/protocol-http/src/java/org/apache/nutch/protocol/http/HttpResponse.java
* (edit) src/plugin/protocol-http/src/test/org/apache/nutch/protocol/http/TestBadServerResponses.java


> protocol-http throws an error when the content-length header is not a number
> ----------------------------------------------------------------------------
>
>                 Key: NUTCH-2564
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2564
>             Project: Nutch
>          Issue Type: Sub-task
>            Reporter: Gerard Bouchar
>            Priority: Major
>
> When a server sends an invalid Content-Length header (one that is not a valid number) with a plain-text http body, browsers simply ignore it, but protocol-http has a strange approach: if the header is composed only of white spaces, it ignores it, but if it contains other characters, it throws an error, preventing us from doing anything with the page.
> It should simply ignore invalid Content-Length headers.
>  
> Relevant code: [https://github.com/apache/nutch/blob/master/src/plugin/protocol-http/src/java/org/apache/nutch/protocol/http/HttpResponse.java#L354-L359]
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)