[jira] [Resolved] (SPARK-4222) FixedLengthBinaryRecordReader should readFully

["Matei Zaharia (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-4222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matei Zaharia resolved SPARK-4222.
----------------------------------
       Resolution: Fixed
    Fix Version/s: 1.2.0

> FixedLengthBinaryRecordReader should readFully
> ----------------------------------------------
>
>                 Key: SPARK-4222
>                 URL: https://issues.apache.org/jira/browse/SPARK-4222
>             Project: Spark
>          Issue Type: Bug
>            Reporter: Jascha Swisher
>            Assignee: Jascha Swisher
>            Priority: Minor
>             Fix For: 1.2.0
>
>
> The new FixedLengthBinaryRecordReader currently uses a read() call to read from the FSDataInputStream, without checking the number of bytes actually returned. The currentPosition variable is updated assuming that the full number of requested bytes are returned, which could lead to data corruption or other problems if fewer bytes come back than requested.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org