You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Andrew Or (JIRA)" <ji...@apache.org> on 2016/01/19 02:17:39 UTC
[jira] [Updated] (SPARK-12896) Send only accumulator updates, not
TaskMetrics, to the driver
[ https://issues.apache.org/jira/browse/SPARK-12896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Or updated SPARK-12896:
------------------------------
Description:
Currently in Spark there are two different things that the executors send to the driver, accumulators and TaskMetrics. It would allow us to clean up a lot of things if we send ONLY accumulator updates instead of both that and TaskMetrics. Eventually we will be able to make TaskMetrics private and maybe even remove it.
This blocks on SPARK-12895.
was:This blocks on
> Send only accumulator updates, not TaskMetrics, to the driver
> -------------------------------------------------------------
>
> Key: SPARK-12896
> URL: https://issues.apache.org/jira/browse/SPARK-12896
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core
> Reporter: Andrew Or
> Assignee: Andrew Or
>
> Currently in Spark there are two different things that the executors send to the driver, accumulators and TaskMetrics. It would allow us to clean up a lot of things if we send ONLY accumulator updates instead of both that and TaskMetrics. Eventually we will be able to make TaskMetrics private and maybe even remove it.
> This blocks on SPARK-12895.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org