You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@nutch.apache.org by Apache Wiki <wi...@apache.org> on 2005/10/07 10:31:20 UTC
[Nutch Wiki] Update of "bin/nutch parse" by AdrianoPalombo
Dear Wiki user,
You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification.
The following page has been changed by AdrianoPalombo:
http://wiki.apache.org/nutch/bin/nutch_parse
------------------------------------------------------------------------------
It assumes, under given segment, existence of ./fetcher_output/, which is typically generated after a non-parsing fetcher run (i.e., fetcher is started with option -noParsing).
- Contents in one segemnt are parsed and saved in these steps:
+ Contents in one segment are parsed and saved in these steps:
1. ./fetcher_output/ and ./content/ are looped together (possibly by multiple ParserThreads), and content is parsed for each entry. The entry number and resultant ParserOutput are saved in ./parser.unsorted.