You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Harish Butani (JIRA)" <ji...@apache.org> on 2014/05/01 20:27:15 UTC

[jira] [Created] (HIVE-6999) Add streaming mode to PTFs

Harish Butani created HIVE-6999:
-----------------------------------

             Summary: Add streaming mode to PTFs
                 Key: HIVE-6999
                 URL: https://issues.apache.org/jira/browse/HIVE-6999
             Project: Hive
          Issue Type: Improvement
            Reporter: Harish Butani


There are a set of use cases where the Table Function can operate on a Partition row by row or on a subset(window) of rows as it is being streamed to it.
- Windowing has couple of use cases of this:processing of Rank functions, processing of Window Aggregations.
- But this is a generic concept: any analysis that operates on an Ordered partition maybe able to operate in Streaming mode.

This patch introduces streaming mode in PTFs and provides the mechanics to handle PTF chains that contain both modes of PTFs.
Subsequent patches will introduce Streaming mode for Windowing.




--
This message was sent by Atlassian JIRA
(v6.2#6252)