You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Souri (JIRA)" <ji...@apache.org> on 2016/02/01 23:16:40 UTC

[jira] [Closed] (SPARK-12958) Map accumulator in spark

     [ https://issues.apache.org/jira/browse/SPARK-12958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Souri closed SPARK-12958.
-------------------------

It was decided that its not something in very high demand right now and users who want it can manage it themselves, so need not be added to spark core.

> Map accumulator in spark
> ------------------------
>
>                 Key: SPARK-12958
>                 URL: https://issues.apache.org/jira/browse/SPARK-12958
>             Project: Spark
>          Issue Type: Wish
>          Components: Spark Core
>            Reporter: Souri
>            Priority: Minor
>
> Spark by default supports accumulators of Int,Long,Double,Float.
> It would be good if we can have a Map accumulator where each executor can just add key->value pairs and driver can have access to the aggregated value for each key in the map.
> In this way, it would also be easier to use accumulators for various metrics. We can define metrics at runtime as the map can take any string key.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org