You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Ashutosh Chauhan (JIRA)" <ji...@apache.org> on 2014/05/24 03:26:02 UTC

[jira] [Updated] (HIVE-5381) OOM when using many lead/lag funtions against large partition

     [ https://issues.apache.org/jira/browse/HIVE-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ashutosh Chauhan updated HIVE-5381:
-----------------------------------

    Status: Open  (was: Patch Available)

This should be done post HIVE-7062 since than lead / lag function can utilize new streaming partitions. [~navis] you may want to review that patch. 

> OOM when using many lead/lag funtions against large partition
> -------------------------------------------------------------
>
>                 Key: HIVE-5381
>                 URL: https://issues.apache.org/jira/browse/HIVE-5381
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Navis
>            Assignee: Navis
>            Priority: Minor
>         Attachments: D13161.1.patch
>
>
> Currently, columns containing window function are evaluated for all rows in a partition, which possibly make OOM if the partition is big (400MB in my case). For lead/lag functions, the value can be evaluated per row.



--
This message was sent by Atlassian JIRA
(v6.2#6252)