You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2016/09/23 08:45:21 UTC
[jira] [Updated] (SPARK-16861) Refactor PySpark accumulator API to
be on top of AccumulatorV2 API
[ https://issues.apache.org/jira/browse/SPARK-16861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen updated SPARK-16861:
------------------------------
Assignee: holdenk
Priority: Minor (was: Major)
> Refactor PySpark accumulator API to be on top of AccumulatorV2 API
> ------------------------------------------------------------------
>
> Key: SPARK-16861
> URL: https://issues.apache.org/jira/browse/SPARK-16861
> Project: Spark
> Issue Type: Improvement
> Components: PySpark, Spark Core
> Reporter: holdenk
> Assignee: holdenk
> Priority: Minor
> Fix For: 2.1.0
>
>
> The PySpark accumulator API is implemented on top of the legacy accumulator API which is now deprecated. To allow this deprecated API to be removed eventually we will need to rewrite the PySpark accumulators on top of the new API. An open question for a possible follow up is if we want to make the Python accumulator API look more like the new accumulator API.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org