You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Ferdy Galema (JIRA)" <ji...@apache.org> on 2012/04/26 13:35:18 UTC
[jira] [Closed] (NUTCH-1290) crawlId not supported by all Tools
[ https://issues.apache.org/jira/browse/NUTCH-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ferdy Galema closed NUTCH-1290.
-------------------------------
Resolution: Fixed
> crawlId not supported by all Tools
> ----------------------------------
>
> Key: NUTCH-1290
> URL: https://issues.apache.org/jira/browse/NUTCH-1290
> Project: Nutch
> Issue Type: Bug
> Components: indexer
> Affects Versions: nutchgora
> Reporter: Mathijs Homminga
> Priority: Minor
> Fix For: nutchgora
>
> Attachments: NUTCH-1290.patch
>
>
> See also: https://issues.apache.org/jira/browse/NUTCH-907
> The StorageUtils class exposes a createDataStore method which uses the default schema for a persistent class specified in the Gora configuration.
> This method ignores Nutch' storage.schema property and the notion of a crawlId.
> Two tools use this method instead of the createWebStore method (which does support the storage.schema property and a crawlId):
> o.a.n.indexer.IndexerReducer (IndexerJob)
> o.a.n.util.domain.DomainStatistics
>
> I propose that these two start using the createWebStore method and that we make remove the createDataStore method from the StorageUtils.
> Also, these two tools should support the crawlId command line parameter.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira