You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hive.apache.org by "Attila Magyar (Jira)" <ji...@apache.org> on 2020/02/25 14:57:00 UTC

[jira] [Updated] (HIVE-22925) Implement TopNKeyFilter efficiency check

     [ https://issues.apache.org/jira/browse/HIVE-22925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Attila Magyar updated HIVE-22925:
---------------------------------
    Attachment: HIVE-22925.1.patch

> Implement TopNKeyFilter efficiency check
> ----------------------------------------
>
>                 Key: HIVE-22925
>                 URL: https://issues.apache.org/jira/browse/HIVE-22925
>             Project: Hive
>          Issue Type: Bug
>          Components: Hive
>            Reporter: Attila Magyar
>            Assignee: Attila Magyar
>            Priority: Major
>             Fix For: 4.0.0
>
>         Attachments: HIVE-22925.1.patch
>
>
> In certain cases the TopNKey filter might work in an inefficient way and adds extra CPU overhead. For example if the rows are coming in an ascending order but the filter wants the top N smallest elements the filter will forward everything.
> Inefficient should be detected in runtime so that the filter can be disabled of the ration between forwarder_rows/total_rows is too high.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)