You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Chris A. Mattmann (JIRA)" <ji...@apache.org> on 2014/09/21 07:53:34 UTC
[jira] [Updated] (NUTCH-1844) testresources/testcrawl not
referenced anywhere in code.
[ https://issues.apache.org/jira/browse/NUTCH-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris A. Mattmann updated NUTCH-1844:
-------------------------------------
Description:
While working on NUTCH-1526 in Review Board http://reviews.apache.org/r9119/ [~lewismc] tried to test out the ./bin/nutch dump tool on src/testresources/testcrawl and found that it failed due to an old o.a.h.io.UTF8 key type (instead of the o.a.h.io.Text) type.
I looked into this - how were Nutch tests passing using this old code? I found that Andrzej a long time ago wrote a tool to update the index from the old UFT8 key format to Text - I also found that *no where in the Nutch code* is the testcrawl referenced.
My suggestion:
* we remove the testcrawl (it's not used)
* if we don't remove it, we at least run Andrzej's tool on it and then upgrade it to use o.a.h.io.Text keys.
I'll take care of this.
was:
While working on NUTCH-1526 in Review Board http:/reviews.apache.org/r9119/ [~lewismc] tried to test out the ./bin/nutch dump tool on src/testresources/testcrawl and found that it failed due to an old o.a.h.io.UTF8 key type (instead of the o.a.h.io.Text) type.
I looked into this - how were Nutch tests passing using this old code? I found that Andrzej a long time ago wrote a tool to update the index from the old UFT8 key format to Text - I also found that *no where in the Nutch code* is the testcrawl referenced.
My suggestion:
* we remove the testcrawl (it's not used)
* if we don't remove it, we at least run Andrzej's tool on it and then upgrade it to use o.a.h.io.Text keys.
I'll take care of this.
> testresources/testcrawl not referenced anywhere in code.
> --------------------------------------------------------
>
> Key: NUTCH-1844
> URL: https://issues.apache.org/jira/browse/NUTCH-1844
> Project: Nutch
> Issue Type: Bug
> Components: test
> Reporter: Chris A. Mattmann
> Assignee: Chris A. Mattmann
> Fix For: 1.10
>
>
> While working on NUTCH-1526 in Review Board http://reviews.apache.org/r9119/ [~lewismc] tried to test out the ./bin/nutch dump tool on src/testresources/testcrawl and found that it failed due to an old o.a.h.io.UTF8 key type (instead of the o.a.h.io.Text) type.
> I looked into this - how were Nutch tests passing using this old code? I found that Andrzej a long time ago wrote a tool to update the index from the old UFT8 key format to Text - I also found that *no where in the Nutch code* is the testcrawl referenced.
> My suggestion:
> * we remove the testcrawl (it's not used)
> * if we don't remove it, we at least run Andrzej's tool on it and then upgrade it to use o.a.h.io.Text keys.
> I'll take care of this.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)