[jira] [Created] (TEZ-1050) EOFException is thrown by ShuffledUnorderedKVReader

["Cheolsoo Park (JIRA)" <ji...@apache.org>]

Cheolsoo Park created TEZ-1050:
----------------------------------

             Summary: EOFException is thrown by ShuffledUnorderedKVReader
                 Key: TEZ-1050
                 URL: https://issues.apache.org/jira/browse/TEZ-1050
             Project: Apache Tez
          Issue Type: Bug
    Affects Versions: 0.4.0
            Reporter: Cheolsoo Park


Not sure whether this is expected or not, but I am seeing an EOFException while doing ShuffledUnorderedKVReader.next() in Pig. See [here|https://github.com/apache/pig/blob/tez/src/org/apache/pig/backend/hadoop/executionengine/tez/POValueInputTez.java#L100] for the source code.

{code}
: Caused by: java.io.EOFException: Completed reading 31       
: at org.apache.tez.runtime.library.common.sort.impl.IFile$Reader.positionToNextRecord(IFile.java:480)
: at org.apache.tez.runtime.library.common.shuffle.impl.InMemoryReader.readRawKey(InMemoryReader.java:94)
: at org.apache.tez.runtime.library.common.sort.impl.IFile$Reader.nextRawKey(IFile.java:510)       
: at org.apache.tez.runtime.library.common.readers.ShuffledUnorderedKVReader.readNextFromCurrentReader(ShuffledUnorderedKVReader.java:147)
: at org.apache.tez.runtime.library.common.readers.ShuffledUnorderedKVReader.next(ShuffledUnorderedKVReader.java:108)
: at org.apache.pig.backend.hadoop.executionengine.tez.POValueInputTez.getNextTuple(POValueInputTez.java:100)
: ... 12 more
{code}
Shouldn't next() return false when it's EOF instead of throwing a runtime exception? Is this exception supposed to be handled on Pig side?

This makes a Pig e2e test (CastScalar_11) fail.



--
This message was sent by Atlassian JIRA
(v6.2#6252)