You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "zhchbin (JIRA)" <ji...@apache.org> on 2013/12/25 10:05:57 UTC

[jira] [Commented] (PIG-2167) CUBE operation in Pig

    [ https://issues.apache.org/jira/browse/PIG-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13856553#comment-13856553 ] 

zhchbin commented on PIG-2167:
------------------------------

Hi Prasanth,
I'm interesting in data cube and map reduce. So I am reading the source code of CUBE operation and the associated paper.
In the paper <Distributed Cube Materialization on Holistic Measures>, it mentions "batch areas", have you implement it here?
If "batch areas" has been implemented, could you please tell me where is it? I can't find it. Thank you so much.

> CUBE operation in Pig
> ---------------------
>
>                 Key: PIG-2167
>                 URL: https://issues.apache.org/jira/browse/PIG-2167
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Dmitriy V. Ryaboy
>            Assignee: Prasanth J
>              Labels: gsoc2012, mentor
>         Attachments: PIG-2167.1.patch, PIG-2167.2.patch, PIG-2167.3.patch, PIG-2167.4.patch, Pig-Cubing-Performance.png
>
>
> Computing aggregates over a cube of several dimensions is a common operation in data warehousing.
> The standard SQL syntax is "GROUP relation BY dim1, dim2, dim3 WITH CUBE" -- which in addition to all dim1-2-3, produces aggregations for just dim1, just dim1 and dim2, etc. NULL is generally used to represent "all".
> A presentation by Arnab Nandi describes how one might implement efficient cubing in Map-Reduce here: http://pdf.cx/44wrk
> We can start with the naive solution which only works for algebraic measures, and work up from there.
> This is a candidate project for Google summer of code 2012. More information about the program can be found at https://cwiki.apache.org/confluence/display/PIG/GSoc2012



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)