You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Illya Yalovyy (JIRA)" <ji...@apache.org> on 2014/12/30 04:06:13 UTC

[jira] [Created] (HIVE-9225) Windowing functions are not executing efficiently when the window is identical

Illya Yalovyy created HIVE-9225:
-----------------------------------

             Summary: Windowing functions are not executing efficiently when the window is identical
                 Key: HIVE-9225
                 URL: https://issues.apache.org/jira/browse/HIVE-9225
             Project: Hive
          Issue Type: Improvement
          Components: PTF-Windowing
    Affects Versions: 0.13.0
         Environment: Linux
            Reporter: Illya Yalovyy


Hive optimizer and the runtime are not smart enough to recognize if the windowing is the same. Even when the window is identical, the windowing is re-executed again and cause the runtime increase proportionally to # of windows. 

Example:
{code:sql}
select code,min(emp) over (partition by code order by emp  range between current row and 300000000 following)from sample_big limit 10;
{code}
*Time taken: 1h:36m:12s*

{code:sql}
select code,
min(emp) over (partition by code order by emp  range between current row and 300000000 following),
max(emp) over (partition by code order by emp  range between current row and 300000000 following),
min(salary) over (partition by code order by emp  range between current row and 300000000 following),
max(salary) over (partition by code order by emp  range between current row and 300000000 following)
from sample_big limit 10;
{code}
*Time taken: 4h:0m:37s*



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)