You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Tamer Yousef (JIRA)" <ji...@apache.org> on 2014/12/17 19:56:14 UTC

[jira] [Commented] (NUTCH-1863) Add JSON format dump output to readdb command

    [ https://issues.apache.org/jira/browse/NUTCH-1863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14250306#comment-14250306 ] 

Tamer Yousef commented on NUTCH-1863:
-------------------------------------

Seconded! the existing readdb is tough to parse when the html content can break some regex expressions to split contents from different sites. We need a more uniform data structure such as json / xml formats.

thanks!

> Add JSON format dump output to readdb command
> ---------------------------------------------
>
>                 Key: NUTCH-1863
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1863
>             Project: Nutch
>          Issue Type: New Feature
>          Components: crawldb
>    Affects Versions: 2.3, 1.10
>            Reporter: Lewis John McGibbney
>             Fix For: 2.4, 1.10
>
>
> Opening up the ability for third parties to consume Nutch crawldb data as JSON would be a poisitive thing IMHO.
> This issue should improve the readdb functionality of both 1.X and 2.X to enable JSON dumps of crawldb data.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)