You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Souri (JIRA)" <ji...@apache.org> on 2016/01/21 20:09:40 UTC

[jira] [Created] (SPARK-12958) Map accumulator in spark

Souri created SPARK-12958:
-----------------------------

             Summary: Map accumulator in spark
                 Key: SPARK-12958
                 URL: https://issues.apache.org/jira/browse/SPARK-12958
             Project: Spark
          Issue Type: Wish
          Components: Spark Core
            Reporter: Souri
            Priority: Minor


Spark by default supports accumulators of Int,Long,Double,Float.

It would be good if we can have a Map accumulator where each executor can just add key->value pairs and driver can have access to the aggregated value for each key in the map.
In this way, it would also be easier to use accumulators for various metrics. We can define metrics at runtime as the map can take any string key.






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org