You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@giraph.apache.org by "Maja Kabiljo (JIRA)" <ji...@apache.org> on 2014/10/10 21:59:34 UTC

[jira] [Resolved] (GIRAPH-939) Reduce/broadcast API

     [ https://issues.apache.org/jira/browse/GIRAPH-939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Maja Kabiljo resolved GIRAPH-939.
---------------------------------
    Resolution: Fixed

> Reduce/broadcast API
> --------------------
>
>                 Key: GIRAPH-939
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-939
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Igor Kabiljo
>
> Add reduce and broadcast API.
> Current aggregator API has multiple issues:
> - no matter whether aggregated values are needed on workers, they are distributed to them
> - there is no way to register aggregator for a single superstep
> - in order for master to send data to workers, it needs to go through an aggregator - even though it can only be Writable
> - value to be aggregated and result of aggregation need to be of the same type
> - logic of how to do aggregation is combined with how Aggregator is kept (i.e. aggregate(valueToAggregate), instead of aggregate(currentAggregatedValue, valueToAggregate)), and so every aggregator needs to extend BasicAggregator, but that still limits what can be done.
> reduce/broadcast is the simplest comprehensive API for what it does, and Aggregator API can be built on top of it



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)