You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "holdenk (JIRA)" <ji...@apache.org> on 2016/10/07 23:24:20 UTC

[jira] [Commented] (SPARK-2868) Support named accumulators in Python

    [ https://issues.apache.org/jira/browse/SPARK-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15556582#comment-15556582 ] 

holdenk commented on SPARK-2868:
--------------------------------

Is this something we are still interested in pursuing (cc [~rxin] who did the Scala accumulator API update). I'd be happy to take on this issue, once we've decide what to do around data property accumulators, since I've already been working with accumulators a bunch.

> Support named accumulators in Python
> ------------------------------------
>
>                 Key: SPARK-2868
>                 URL: https://issues.apache.org/jira/browse/SPARK-2868
>             Project: Spark
>          Issue Type: New Feature
>          Components: PySpark
>            Reporter: Patrick Wendell
>
> SPARK-2380 added this for Java/Scala. To allow this in Python we'll need to make some additional changes. One potential path is to have a 1:1 correspondence with Scala accumulators (instead of a one-to-many). A challenge is exposing the stringified values of the accumulators to the Scala code.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org