You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Owen O'Malley (JIRA)" <ji...@apache.org> on 2014/04/08 20:41:15 UTC

[jira] [Updated] (HIVE-6759) Fix reading partial ORC files while they are being written

     [ https://issues.apache.org/jira/browse/HIVE-6759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley updated HIVE-6759:
--------------------------------

    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

Thanks for the review, Sergey and Harish. Thejas ran the unit tests internally and they passed.

I just committed this.

> Fix reading partial ORC files while they are being written
> ----------------------------------------------------------
>
>                 Key: HIVE-6759
>                 URL: https://issues.apache.org/jira/browse/HIVE-6759
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>            Priority: Critical
>             Fix For: 0.13.0
>
>         Attachments: HIVE-6759.patch
>
>
> HDFS with the hflush ensures the bytes are visible, but doesn't update the file length on the NameNode. Currently the Orc reader will only read up to the length on the NameNode. If the user specified a length from a flush_length file, the Orc reader should trust it to be right.



--
This message was sent by Atlassian JIRA
(v6.2#6252)