You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Reynold Xin (JIRA)" <ji...@apache.org> on 2014/04/04 03:55:15 UTC

[jira] [Created] (SPARK-1412) Disable partial aggregation automatically when reduction factor is low

Reynold Xin created SPARK-1412:
----------------------------------

             Summary: Disable partial aggregation automatically when reduction factor is low
                 Key: SPARK-1412
                 URL: https://issues.apache.org/jira/browse/SPARK-1412
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 1.0.0
            Reporter: Reynold Xin
            Assignee: Michael Armbrust
             Fix For: 1.1.0


Once we see enough number of rows in partial aggregation and don't observe any reduction, the aggregate operator should just turn off partial aggregation. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)