You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Brock Noland (JIRA)" <ji...@apache.org> on 2014/06/30 22:32:25 UTC
[jira] [Resolved] (AVRO-1530) Java DataFileStream does not allow
distinguishing between empty files and corrupt files
[ https://issues.apache.org/jira/browse/AVRO-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brock Noland resolved AVRO-1530.
--------------------------------
Resolution: Won't Fix
Let's take this forward in HIVE-7316. We'll re-open this if needed.
> Java DataFileStream does not allow distinguishing between empty files and corrupt files
> ---------------------------------------------------------------------------------------
>
> Key: AVRO-1530
> URL: https://issues.apache.org/jira/browse/AVRO-1530
> Project: Avro
> Issue Type: Bug
> Reporter: Brock Noland
>
> When writing data to HDFS, especially with Flume, it's possible to write empty files. When you run Hive queries over this data, the job fails with "Not a data file." from here https://github.com/apache/avro/blob/trunk/lang/java/avro/src/main/java/org/apache/avro/file/DataFileStream.java#L102
--
This message was sent by Atlassian JIRA
(v6.2#6252)