You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@orc.apache.org by "Sudarshan Vasudevan (Jira)" <ji...@apache.org> on 2021/03/29 15:54:00 UTC

[jira] [Created] (ORC-777) Make the vectorized row batch size configurable in MR record readers and writers

Sudarshan Vasudevan created ORC-777:
---------------------------------------

             Summary: Make the vectorized row batch size configurable in MR record readers and writers
                 Key: ORC-777
                 URL: https://issues.apache.org/jira/browse/ORC-777
             Project: ORC
          Issue Type: Improvement
          Components: MapReduce
    Affects Versions: 1.6.7
            Reporter: Sudarshan Vasudevan
             Fix For: 1.6.8


Current behavior of OrcInput(Output)Format is to create an ORC reader/writer with the default row batch size of 1024. This may need to be overridden in certain scenarios to prevent OOMs.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)