[jira] [Created] (GIRAPH-939) Reduce/broadcast API

["Igor Kabiljo (JIRA)" <ji...@apache.org>]

Igor Kabiljo created GIRAPH-939:
-----------------------------------

             Summary: Reduce/broadcast API
                 Key: GIRAPH-939
                 URL: https://issues.apache.org/jira/browse/GIRAPH-939
             Project: Giraph
          Issue Type: Improvement
            Reporter: Igor Kabiljo


Add reduce and broadcast API.

Current aggregator API has multiple issues:

- no matter whether aggregated values are needed on workers, they are distributed to them
- there is no way to register aggregator for a single superstep
- in order for master to send data to workers, it needs to go through an aggregator - even though it can only be Writable
- value to be aggregated and result of aggregation need to be of the same type
- logic of how to do aggregation is combined with how Aggregator is kept (i.e. aggregate(valueToAggregate), instead of aggregate(currentAggregatedValue, valueToAggregate)), and so every aggregator needs to extend BasicAggregator, but that still limits what can be done.

reduce/broadcast is the simplest comprehensive API for what it does, and Aggregator API can be built on top of it



--
This message was sent by Atlassian JIRA
(v6.2#6252)