You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Riza Suminto (Jira)" <ji...@apache.org> on 2022/02/02 22:11:00 UTC
[jira] [Created] (IMPALA-11104) Revisit computeMinScalarColumnMemReservation for ORC async IO
Riza Suminto created IMPALA-11104:
-------------------------------------
Summary: Revisit computeMinScalarColumnMemReservation for ORC async IO
Key: IMPALA-11104
URL: https://issues.apache.org/jira/browse/IMPALA-11104
Project: IMPALA
Issue Type: Improvement
Components: Frontend
Reporter: Riza Suminto
HdfsScanNode.computeMinScalarColumnMemReservation has estimate to reduce memory reservation for a column lower than DEFAULT_COLUMN_SCAN_RANGE_RESERVATION (4MB).
[https://github.com/apache/impala/blob/df528fe/fe/src/main/java/org/apache/impala/planner/HdfsScanNode.java#L2226-L2235]
This estimate is based on Parquet table. We need to revisit this estimate for ORC table.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)