You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@orc.apache.org by "Yang Jie (Jira)" <ji...@apache.org> on 2021/08/16 05:14:00 UTC

[jira] [Updated] (ORC-746) OrcMapreduceRecordReader support building ReaderImpl using incoming OrcTail

     [ https://issues.apache.org/jira/browse/ORC-746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yang Jie updated ORC-746:
-------------------------
    Description: 
SPARK-36516 discusses adding file meta cache mechanism for Spark SQL to reduce data reading and speed up query.

For the scenarios that need to use OrcMapreduceRecordReader, we hope to add an interface to support passing an existing OrcTail or FileMetadata to OrcFile and use this instance to build ReaderImpl.

  was:
SPARK-33449 discusses adding file meta cache mechanism for Spark SQL to reduce data reading and speed up query.

For the scenarios that need to use OrcMapreduceRecordReader, we hope to add an interface to support passing an existing OrcTail or FileMetadata to OrcFile and use this instance to build ReaderImpl.


> OrcMapreduceRecordReader support building ReaderImpl using incoming OrcTail
> ---------------------------------------------------------------------------
>
>                 Key: ORC-746
>                 URL: https://issues.apache.org/jira/browse/ORC-746
>             Project: ORC
>          Issue Type: Improvement
>            Reporter: Yang Jie
>            Priority: Major
>
> SPARK-36516 discusses adding file meta cache mechanism for Spark SQL to reduce data reading and speed up query.
> For the scenarios that need to use OrcMapreduceRecordReader, we hope to add an interface to support passing an existing OrcTail or FileMetadata to OrcFile and use this instance to build ReaderImpl.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)