You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Christian Johnsson (JIRA)" <ji...@apache.org> on 2012/09/01 08:19:07 UTC

[jira] [Commented] (NUTCH-1411) nutchgora fetcher.store.content does not work

    [ https://issues.apache.org/jira/browse/NUTCH-1411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446620#comment-13446620 ] 

Christian Johnsson commented on NUTCH-1411:
-------------------------------------------

I applied the patch and did a test run with nutch 2 against hbase but it still stores the
f:cnt field with the entire source document. I have only done the fetch with the parse set to true and store to false.

Snippet:
------------
f:bas timestamp=1346459170179, value=http://www.wwwww.www/
f:cnt timestamp=1346459170179, value=<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"\x0A"http://www.w3.org/TR/xhtml1/DTD/xhtml1
-transitional.dtd">\x0A<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">\x0A <head>\x0A
----------------
This shouldn't be there if i undertood it correct, right?

                
> nutchgora fetcher.store.content does not work
> ---------------------------------------------
>
>                 Key: NUTCH-1411
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1411
>             Project: Nutch
>          Issue Type: Bug
>    Affects Versions: nutchgora
>            Reporter: Ferdy Galema
>            Priority: Minor
>         Attachments: storeContent.patch
>
>
> http://lucene.472066.n3.nabble.com/parse-and-solrindex-in-nutch-2-0-td3991247.html
> The property fetcher.store.content doesn't do anything. Content is always stored. Fix or remove property, what do you think?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira