You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by Apache Wiki <wi...@apache.org> on 2013/03/20 19:09:54 UTC
[Nutch Wiki] Update of "bin/nutch readseg" by kiranchitturi
Dear Wiki user,
You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification.
The "bin/nutch readseg" page has been changed by kiranchitturi:
http://wiki.apache.org/nutch/bin/nutch%20readseg
New page:
Readseg is an alias for org.apache.nutch.segment.SegmentReader
This class is similar to readdb in that it dumps the contents of a segment. There are three ways we can use this class:
{{{
1st Usage: bin/nutch readseg -dump <segment_dir> <output> [general options]
}}}
'''-dump''': Dumps content of a <segment_dir> as a text file to <output>.
'''[general options]''': General options are provided below.
{{{
2nd Usage: bin/nutch readseg -list (<segment_dir1> ... | -dir <segments>) [general options]
}}}
'''-list''': This arguement lists a synopsis of segments in specified directories, or all segments in a directory <segments>, and prints details of them to System.out.
'''<segment_dir1> ...''': This should be a list of the paths for individual segment directories to process.
'''-dir <segments>''': Should be a path to a directory that contains multiple segments.
'''[general options]''': General options are provided below.
{{{
3rd Usage: bin/nutch readseg -get <segment_dir> <keyValue> [general options]
}}}
'''-get''': This arguement gets a specified record from a segment, and prints it on System.out.
'''<segment_dir>''': Path to the segment directory.
'''<keyValue>''': This should be the value of the key (url) we wish to retreive specific information about. N.B. It is essential to put "double-quotes" around strings with spaces.
'''[general options]''': General options are provided below.
* '''-nocontent''': Pass this to ignore the content directory.
* '''-nofetch''': To ignore the crawl_fetch directory.
* '''-nogenerate''': To ignore the crawl_generate directory.
* '''-noparse''': To ignore the crawl_parse directory.
* '''-noparsedata''': To ignore the parse_data directory.
* '''-noparsetext''': To ignore the parse_text directory.
CommandLineOptions