You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@impala.apache.org by "Riza Suminto (Jira)" <ji...@apache.org> on 2022/02/01 00:24:00 UTC

[jira] [Created] (IMPALA-11099) Use orc::Reader::getMemoryUseByTypeId to compute ideal memory reservation

Riza Suminto created IMPALA-11099:
-------------------------------------

             Summary: Use orc::Reader::getMemoryUseByTypeId to compute ideal memory reservation
                 Key: IMPALA-11099
                 URL: https://issues.apache.org/jira/browse/IMPALA-11099
             Project: IMPALA
          Issue Type: Improvement
          Components: Backend
            Reporter: Riza Suminto


The design of IMPALA-6636 currently follow existing algorithm in hdfs-parquet-scanner for computing ideal memory reservation for each column (see ).

We can refine this computation for ORC by checking orc::Reader::getMemoryUseByTypeId once the file reader has read the metadata in footer.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)