You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Reynold Xin (JIRA)" <ji...@apache.org> on 2016/04/14 10:01:25 UTC
[jira] [Updated] (SPARK-14626) Simplify accumulators and task
metrics
[ https://issues.apache.org/jira/browse/SPARK-14626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Reynold Xin updated SPARK-14626:
--------------------------------
Description:
The goal of the ticket is to simplify both the external interface and the internal implementation for accumulators and metrics. They are unnecessarily convoluted and we should be able to simplify them quite a bit.
This is an umbrella ticket and I will iteratively create new tasks as my investigation goes on. At a high level, I'd would like to create better abstractions for internal implementations, as well as creating a simplified accumulator v2 external interface that doesn't involve a complex type hierarchy.
was:
The goal of the ticket is to simplify both the external interface and the internal implementation for accumulators and metrics. They are unnecessarily convoluted and we should be able to simplify them quite a bit.
This is an umbrella ticket and I will iteratively create new tasks as my investigation goes on. However, at a high level, I'd would like to create better abstractions for internal implementations, as well as creating a simplified accumulator v2 external interface that doesn't involve a complex type hierarchy.
> Simplify accumulators and task metrics
> --------------------------------------
>
> Key: SPARK-14626
> URL: https://issues.apache.org/jira/browse/SPARK-14626
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Reporter: Reynold Xin
> Assignee: Reynold Xin
>
> The goal of the ticket is to simplify both the external interface and the internal implementation for accumulators and metrics. They are unnecessarily convoluted and we should be able to simplify them quite a bit.
> This is an umbrella ticket and I will iteratively create new tasks as my investigation goes on. At a high level, I'd would like to create better abstractions for internal implementations, as well as creating a simplified accumulator v2 external interface that doesn't involve a complex type hierarchy.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org