You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Gabriele Kahlout (JIRA)" <ji...@apache.org> on 2011/04/27 20:46:03 UTC
[jira] [Updated] (NUTCH-990) protocol-httpclient fails with short
pages
[ https://issues.apache.org/jira/browse/NUTCH-990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gabriele Kahlout updated NUTCH-990:
-----------------------------------
Description:
Using protocol-http with a few words html pages works fine. But with protocol-httpclient the same pages disappear from the index, although they are still fetched.
Those small files are useful for quick testing.
was:
Using protocol-http html pages without <html> tag are correctly fetched, parsed and indexed. All it takes (I now discover) is to use protocol-httpclient for the page to disappear from the index. But the page is fetched.
$ cat page.html
abc
Those small files are useful for quick testing.
Summary: protocol-httpclient fails with short pages (was: protocol-httpclient fails with actually plain/text pages)
A test page:
<!DOCTYPE html>
<html>
<head>
<title></title>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
artificial rucksack
</body>
</html>
> protocol-httpclient fails with short pages
> ------------------------------------------
>
> Key: NUTCH-990
> URL: https://issues.apache.org/jira/browse/NUTCH-990
> Project: Nutch
> Issue Type: Bug
> Components: fetcher
> Reporter: Gabriele Kahlout
> Priority: Minor
> Fix For: 1.3
>
> Attachments: hadoop.log
>
>
> Using protocol-http with a few words html pages works fine. But with protocol-httpclient the same pages disappear from the index, although they are still fetched.
> Those small files are useful for quick testing.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira