You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/05/21 04:23:21 UTC

[jira] [Updated] (SPARK-11168) Explore precise behavior of treeAggregate

     [ https://issues.apache.org/jira/browse/SPARK-11168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon updated SPARK-11168:
---------------------------------
    Labels: bulk-closed  (was: )

> Explore precise behavior of treeAggregate
> -----------------------------------------
>
>                 Key: SPARK-11168
>                 URL: https://issues.apache.org/jira/browse/SPARK-11168
>             Project: Spark
>          Issue Type: Improvement
>          Components: MLlib, Spark Core
>            Reporter: Joseph K. Bradley
>            Priority: Major
>              Labels: bulk-closed
>
> It would be worthwhile to make sure treeAggregate is efficient for small numbers of partitions.  We should examine its exact behavior in terms of the structure of the tree aggregation on small problems sizes (maybe # partitions from 1 to 20) and for different suggested depths.
> A lot of use cases will be in this range, and if we can speed it up a bit, it would be very worthwhile.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org