You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@phoenix.apache.org by "James Taylor (JIRA)" <ji...@apache.org> on 2016/04/22 02:43:12 UTC
[jira] [Commented] (PHOENIX-2851) Support multi level aggregation
through partial aggregation feature in Pig
[ https://issues.apache.org/jira/browse/PHOENIX-2851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15253094#comment-15253094 ]
James Taylor commented on PHOENIX-2851:
---------------------------------------
FYI, for some other interesting Pig work (that was unfortunately never committed), see PHOENIX-1561. This seems similar in functionality to our recent Hive support (PHOENIX-2743).
> Support multi level aggregation through partial aggregation feature in Pig
> --------------------------------------------------------------------------
>
> Key: PHOENIX-2851
> URL: https://issues.apache.org/jira/browse/PHOENIX-2851
> Project: Phoenix
> Issue Type: New Feature
> Reporter: James Taylor
> Assignee: Prashant Kommireddi
>
> Explore the option of pushing partial aggregation in Pig to Phoenix engine. Phoenix is good at doing the first level aggregation optimally in coprocessors, but lacks the ability to do a multi-level aggregation since it's single client node. We could leverage our Pig integration to fill that gap.
> Here is the Pig class that does it within the Map phase right now.
> https://pig.apache.org/docs/r0.11.0/api/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPartialAgg.html
> This could be built into Pig and might require some patches on Phoenix, or might just be a simple delegation.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)