You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@crunch.apache.org by "Gabriel Reid (JIRA)" <ji...@apache.org> on 2014/03/29 13:07:14 UTC
[jira] [Created] (CRUNCH-371) AvroPathPerKeyTarget doesn't work
with empty input
Gabriel Reid created CRUNCH-371:
-----------------------------------
Summary: AvroPathPerKeyTarget doesn't work with empty input
Key: CRUNCH-371
URL: https://issues.apache.org/jira/browse/CRUNCH-371
Project: Crunch
Issue Type: Bug
Reporter: Gabriel Reid
The AvroPathPerKeyTarget doesn't work properly when there is nothing to be output (for example, if all records have been filtered out somehow). This situation results in an exception like the following on HDFS on hadoop-1
{code}
java.io.IOException: java.lang.IllegalArgumentException: Reducer output
name 'out0' cannot be parsed
{code}
and an FileNotFoundException on hadoop-2.
In both cases, there should be no exception, and no output should be written. More background on this in the following mailing list discussion:
http://mail-archives.apache.org/mod_mbox/crunch-user/201403.mbox/%3cCACijwiagOJsKVsDq1_x6tbyFhWEZeCyNMV-jpmwjzhQ8CCSF-g@mail.gmail.com%3e
--
This message was sent by Atlassian JIRA
(v6.2#6252)