You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@phoenix.apache.org by "James Taylor (JIRA)" <ji...@apache.org> on 2016/04/22 02:43:12 UTC

[jira] [Commented] (PHOENIX-2851) Support multi level aggregation through partial aggregation feature in Pig

    [ https://issues.apache.org/jira/browse/PHOENIX-2851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15253094#comment-15253094 ] 

James Taylor commented on PHOENIX-2851:
---------------------------------------

FYI, for some other interesting Pig work (that was unfortunately never committed), see PHOENIX-1561. This seems similar in functionality to our recent Hive support (PHOENIX-2743).

> Support multi level aggregation through partial aggregation feature in Pig
> --------------------------------------------------------------------------
>
>                 Key: PHOENIX-2851
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-2851
>             Project: Phoenix
>          Issue Type: New Feature
>            Reporter: James Taylor
>            Assignee: Prashant Kommireddi
>
> Explore the option of pushing partial aggregation in Pig to Phoenix engine. Phoenix is good at doing the first level aggregation optimally in coprocessors, but lacks the ability to do a multi-level aggregation since it's single client node. We could leverage our Pig integration to fill that gap. 
> Here is the Pig class that does it within the Map phase right now.
> https://pig.apache.org/docs/r0.11.0/api/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPartialAgg.html
> This could be built into Pig and might require some patches on Phoenix, or might just be a simple delegation.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)