You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Tamer Yousef (JIRA)" <ji...@apache.org> on 2014/12/17 19:56:14 UTC
[jira] [Commented] (NUTCH-1863) Add JSON format dump output to
readdb command
[ https://issues.apache.org/jira/browse/NUTCH-1863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14250306#comment-14250306 ]
Tamer Yousef commented on NUTCH-1863:
-------------------------------------
Seconded! the existing readdb is tough to parse when the html content can break some regex expressions to split contents from different sites. We need a more uniform data structure such as json / xml formats.
thanks!
> Add JSON format dump output to readdb command
> ---------------------------------------------
>
> Key: NUTCH-1863
> URL: https://issues.apache.org/jira/browse/NUTCH-1863
> Project: Nutch
> Issue Type: New Feature
> Components: crawldb
> Affects Versions: 2.3, 1.10
> Reporter: Lewis John McGibbney
> Fix For: 2.4, 1.10
>
>
> Opening up the ability for third parties to consume Nutch crawldb data as JSON would be a poisitive thing IMHO.
> This issue should improve the readdb functionality of both 1.X and 2.X to enable JSON dumps of crawldb data.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)