You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "holdenk (JIRA)" <ji...@apache.org> on 2014/08/29 21:05:53 UTC

[jira] [Created] (SPARK-3312) Add a groupByKey which returns a special GroupBy object like in pandas

holdenk created SPARK-3312:
------------------------------

             Summary: Add a groupByKey which returns a special GroupBy object like in pandas
                 Key: SPARK-3312
                 URL: https://issues.apache.org/jira/browse/SPARK-3312
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core
            Reporter: holdenk
            Priority: Minor


A common pattern which causes problems for new Spark users is using groupByKey followed by a reduce. I'd like to make a special version of groupByKey which returns a groupBy object (like the Panda's groupby object). The resulting class would have a number of functions (min,max, stats, reduce) which could all be implemented efficiently.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org