You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@orc.apache.org by "Owen O'Malley (JIRA)" <ji...@apache.org> on 2019/05/07 03:10:00 UTC

[jira] [Commented] (ORC-498) ReaderImpl and RecordReaderImpl open separate file handles

    [ https://issues.apache.org/jira/browse/ORC-498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16834340#comment-16834340 ] 

Owen O'Malley commented on ORC-498:
-----------------------------------

In forward porting the patch, I had to change the test to an ORC file with a stripe, because otherwise the new lazy open behavior was defeating the test.

> ReaderImpl and RecordReaderImpl open separate file handles
> ----------------------------------------------------------
>
>                 Key: ORC-498
>                 URL: https://issues.apache.org/jira/browse/ORC-498
>             Project: ORC
>          Issue Type: Bug
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>            Priority: Major
>             Fix For: 1.5.6, 1.6.0, 1.4.5
>
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> The older versions of ORC used the same file handle to read the file footer and the data. The current code opens a file handle to read the footer and a separate file handle to read data, which doubles the number of opens on the Name Node.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)