You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@orc.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/12/27 17:18:00 UTC
[jira] [Commented] (ORC-285) Empty vector batches of floats or
doubles get java.io.EOFException
[ https://issues.apache.org/jira/browse/ORC-285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16304680#comment-16304680 ]
ASF GitHub Bot commented on ORC-285:
------------------------------------
GitHub user omalley opened a pull request:
https://github.com/apache/orc/pull/205
ORC-285. Empty vector batches of floats or doubles get java.io.EOFExc…
Fix to handle empty vector column batches in the float and double reader.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/omalley/orc orc-285
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/orc/pull/205.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #205
----
commit 03c338720be8b64515372236b97010b229b5e39d
Author: Owen O'Malley <om...@...>
Date: 2017-12-27T17:13:50Z
ORC-285. Empty vector batches of floats or doubles get java.io.EOFException
Signed-off-by: Owen O'Malley <om...@apache.org>
----
> Empty vector batches of floats or doubles get java.io.EOFException
> -------------------------------------------------------------------
>
> Key: ORC-285
> URL: https://issues.apache.org/jira/browse/ORC-285
> Project: ORC
> Issue Type: Bug
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
>
> The FloatTreeReader and DoubleTreeReader both fail if given a set of empty values. This often happens when the float or double data is inside a list where all of the values are empty.
> The stack trace looks like:
> {code}
> java.io.IOException: Error reading file: /Users/piyush.mukati/tmp/11-task_1511779500016_298243_r_000031-r-00031.orc
> at org.apache.orc.impl.RecordReaderImpl.nextBatch(RecordReaderImpl.java:1191)
> at org.apache.orc.tools.ScanData.main(ScanData.java:67)
> at org.apache.orc.tools.Driver.main(Driver.java:109)
> Caused by: java.io.EOFException: Read past EOF for compressed stream Stream for column 36 kind DATA position: 0 length: 0 range: 0 offset: 0 limit: 0
> at org.apache.orc.impl.SerializationUtils.readFully(SerializationUtils.java:119)
> at org.apache.orc.impl.SerializationUtils.readLongLE(SerializationUtils.java:102)
> at org.apache.orc.impl.SerializationUtils.readDouble(SerializationUtils.java:98)
> at org.apache.orc.impl.TreeReaderFactory$DoubleTreeReader.nextVector(TreeReaderFactory.java:763)
> at org.apache.orc.impl.TreeReaderFactory$StructTreeReader.nextVector(TreeReaderFactory.java:1835)
> at org.apache.orc.impl.TreeReaderFactory$StructTreeReader.nextVector(TreeReaderFactory.java:1835)
> at org.apache.orc.impl.TreeReaderFactory$StructTreeReader.nextVector(TreeReaderFactory.java:1835)
> at org.apache.orc.impl.TreeReaderFactory$ListTreeReader.nextVector(TreeReaderFactory.java:2003)
> at org.apache.orc.impl.TreeReaderFactory$StructTreeReader.nextVector(TreeReaderFactory.java:1835)
> at org.apache.orc.impl.TreeReaderFactory$ListTreeReader.nextVector(TreeReaderFactory.java:2003)
> at org.apache.orc.impl.TreeReaderFactory$StructTreeReader.nextVector(TreeReaderFactory.java:1835)
> at org.apache.orc.impl.TreeReaderFactory$StructTreeReader.nextBatch(TreeReaderFactory.java:1817)
> at org.apache.orc.impl.RecordReaderImpl.nextBatch(RecordReaderImpl.java:1184)
> ... 2 more
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)