You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Stamatis Zampetakis (Jira)" <ji...@apache.org> on 2024/10/29 14:41:00 UTC

[jira] [Created] (HIVE-28596) Skip ColumnAccessInfo collection when not needed to speed-up compilation

Stamatis Zampetakis created HIVE-28596:
------------------------------------------

             Summary: Skip ColumnAccessInfo collection when not needed to speed-up compilation
                 Key: HIVE-28596
                 URL: https://issues.apache.org/jira/browse/HIVE-28596
             Project: Hive
          Issue Type: Improvement
      Security Level: Public (Viewable by anyone)
            Reporter: Stamatis Zampetakis
            Assignee: Stamatis Zampetakis


Avoid paying the perf-overhead of collecting {{ColumnAccessInfo}} via the {{HiveRelFieldTrimmer}} when it is not necessary. 

Currently, we only use the {{ColumnAccessInfo}} when we need to perform column based authorization or when it is requested explicitly by the user via the hive.stats.collect.scancols property.

The field trimmer is an expensive operation and can become pretty slow for certain use-cases/queries so skipping some calls when it is not necessary is in general beneficial and can notably improve  the compilation time for some queries.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)