You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Stamatis Zampetakis (Jira)" <ji...@apache.org> on 2024/10/29 14:41:00 UTC
[jira] [Created] (HIVE-28596) Skip ColumnAccessInfo collection when not needed to speed-up compilation
Stamatis Zampetakis created HIVE-28596:
------------------------------------------
Summary: Skip ColumnAccessInfo collection when not needed to speed-up compilation
Key: HIVE-28596
URL: https://issues.apache.org/jira/browse/HIVE-28596
Project: Hive
Issue Type: Improvement
Security Level: Public (Viewable by anyone)
Reporter: Stamatis Zampetakis
Assignee: Stamatis Zampetakis
Avoid paying the perf-overhead of collecting {{ColumnAccessInfo}} via the {{HiveRelFieldTrimmer}} when it is not necessary.
Currently, we only use the {{ColumnAccessInfo}} when we need to perform column based authorization or when it is requested explicitly by the user via the hive.stats.collect.scancols property.
The field trimmer is an expensive operation and can become pretty slow for certain use-cases/queries so skipping some calls when it is not necessary is in general beneficial and can notably improve the compilation time for some queries.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)