[jira] [Created] (NUTCH-1905) Nutch index tool should be resilient to segments that don't have crawl_* data

["Chris A. Mattmann (JIRA)" <ji...@apache.org>]

Chris A. Mattmann created NUTCH-1905:
----------------------------------------

             Summary: Nutch index tool should be resilient to segments that don't have crawl_* data
                 Key: NUTCH-1905
                 URL: https://issues.apache.org/jira/browse/NUTCH-1905
             Project: Nutch
          Issue Type: Bug
          Components: indexer
            Reporter: Chris A. Mattmann
            Assignee: Chris A. Mattmann
             Fix For: 1.10


When running the ./bin/nutch index command with the -dir <path/to/segment/dir> I noticed that if you have a segment directory that doesn't include crawl_* or parse_* data, that the indexer fails (correctly). However, the indexer should be more resilient in those cases - we can add a simple check to see if those dirs are present in the segment, and proceed if they are, otherwise, ignore that segment and print a message (and go to the other segments).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)