[jira] [Updated] (CRUNCH-371) AvroPathPerKeyTarget doesn't work with empty input

["Gabriel Reid (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/CRUNCH-371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gabriel Reid updated CRUNCH-371:
--------------------------------

    Attachment: CRUNCH-371.patch

Patch to resolve the issue, by just jumping out if there is nothing to output.

> AvroPathPerKeyTarget doesn't work with empty input
> --------------------------------------------------
>
>                 Key: CRUNCH-371
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-371
>             Project: Crunch
>          Issue Type: Bug
>            Reporter: Gabriel Reid
>         Attachments: CRUNCH-371.patch
>
>
> The AvroPathPerKeyTarget doesn't work properly when there is nothing to be output (for example, if all records have been filtered out somehow). This situation results in an exception like the following on HDFS on hadoop-1 
> {code}
> java.io.IOException: java.lang.IllegalArgumentException: Reducer output
> name 'out0' cannot be parsed
> {code}
> and an FileNotFoundException on hadoop-2.
> In both cases, there should be no exception, and no output should be written. More background on this in the following mailing list discussion:
> http://mail-archives.apache.org/mod_mbox/crunch-user/201403.mbox/%3cCACijwiagOJsKVsDq1_x6tbyFhWEZeCyNMV-jpmwjzhQ8CCSF-g@mail.gmail.com%3e



--
This message was sent by Atlassian JIRA
(v6.2#6252)