You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@orc.apache.org by "Pavan Lanka (Jira)" <ji...@apache.org> on 2020/04/22 20:41:00 UTC

[jira] [Created] (ORC-622) Refactoring of TreeReader into TypeReader and BatchReader

Pavan Lanka created ORC-622:
-------------------------------

             Summary: Refactoring of TreeReader into TypeReader and BatchReader
                 Key: ORC-622
                 URL: https://issues.apache.org/jira/browse/ORC-622
             Project: ORC
          Issue Type: Improvement
          Components: Java, Reader
            Reporter: Pavan Lanka


The org.apache.orc.impl.TreeReaderFactory.TreeReader class is playing two functions:
 # *Type Read*: Activities that deal with the read of a particular type that finally results in the population of the vector.
 # *Batch Read*: This is invoked on the Type Reader where the Type Reader is as determined by the Root Type. In this case the activities are about the population of the vectors into the VectorizedRowBatch e.g. Ignoring the columns that are the partition fields, setting the batch size, etc

This request proposes that these functions be separated into distinct interfaces. Separating the more generic Batch functions away from the Type specific functions allows enhancements to TypeReaders to focus purely on type functions without having to deal with the Batch related functions.

In addition the request also proposes that certain methods and classes within impl package be made public with the understanding that classes within the impl package are internal.
* TreeReader.checkEncoding
* TreeReader.startStripe
* TreeReader.skipRows
* StreamInformation
This enables the use of these classes and methods without having to clobber the impl package.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)