You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@drill.apache.org by "Vova Vysotskyi (Jira)" <ji...@apache.org> on 2019/11/18 11:04:00 UTC

[jira] [Created] (DRILL-7450) Improve performance for ANALYZE command

Vova Vysotskyi created DRILL-7450:
-------------------------------------

             Summary: Improve performance for ANALYZE command
                 Key: DRILL-7450
                 URL: https://issues.apache.org/jira/browse/DRILL-7450
             Project: Apache Drill
          Issue Type: Bug
    Affects Versions: 1.17.0
            Reporter: Vova Vysotskyi
             Fix For: 1.17.0


In the scope of DRILL-7273 was introduced ANALYZE command for collecting metadata and storing it to the metastore.
But current implementation uses too much memory and is low-performant. It uses stream aggregate for collecting metadata, but all incoming data should be sorted before producing the aggregation. Memory usage may be reduced by using hash aggregate, so sort may not be produced and it should increase performance.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)