You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "zhchbin (JIRA)" <ji...@apache.org> on 2013/12/25 10:05:57 UTC
[jira] [Commented] (PIG-2167) CUBE operation in Pig
[ https://issues.apache.org/jira/browse/PIG-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13856553#comment-13856553 ]
zhchbin commented on PIG-2167:
------------------------------
Hi Prasanth,
I'm interesting in data cube and map reduce. So I am reading the source code of CUBE operation and the associated paper.
In the paper <Distributed Cube Materialization on Holistic Measures>, it mentions "batch areas", have you implement it here?
If "batch areas" has been implemented, could you please tell me where is it? I can't find it. Thank you so much.
> CUBE operation in Pig
> ---------------------
>
> Key: PIG-2167
> URL: https://issues.apache.org/jira/browse/PIG-2167
> Project: Pig
> Issue Type: New Feature
> Reporter: Dmitriy V. Ryaboy
> Assignee: Prasanth J
> Labels: gsoc2012, mentor
> Attachments: PIG-2167.1.patch, PIG-2167.2.patch, PIG-2167.3.patch, PIG-2167.4.patch, Pig-Cubing-Performance.png
>
>
> Computing aggregates over a cube of several dimensions is a common operation in data warehousing.
> The standard SQL syntax is "GROUP relation BY dim1, dim2, dim3 WITH CUBE" -- which in addition to all dim1-2-3, produces aggregations for just dim1, just dim1 and dim2, etc. NULL is generally used to represent "all".
> A presentation by Arnab Nandi describes how one might implement efficient cubing in Map-Reduce here: http://pdf.cx/44wrk
> We can start with the naive solution which only works for algebraic measures, and work up from there.
> This is a candidate project for Google summer of code 2012. More information about the program can be found at https://cwiki.apache.org/confluence/display/PIG/GSoc2012
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)