You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by markus-h <gi...@git.apache.org> on 2014/06/23 13:04:23 UTC
[GitHub] incubator-flink pull request: Reworking of Iteration Synchronizati...
GitHub user markus-h opened a pull request:
https://github.com/apache/incubator-flink/pull/36
Reworking of Iteration Synchronization, Accumulators and Aggregators
This pullrequest includes:
Iteration superstep synchronization through RPC and JobManager
Unification of Accumulators and Aggregators (removal of former Aggregators)
Adjusted Testcases accordingly
A detailed description can also be found on Jira: https://issues.apache.org/jira/browse/FLINK-951
Currently the testcase "KMeansIterativeNepheleITCase" sometimes fails. I think this is connected to this issue: https://issues.apache.org/jira/browse/FLINK-909 and needs to be resolved in a following pull request.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/markus-h/incubator-flink aggregatorsReworkToAccumulatorsRebase4
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-flink/pull/36.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #36
----
commit 9da8aa6442861be17c7658c1dd2c2d9a6943d507
Author: Markus Holzemer <ma...@gmx.de>
Date: 2014-06-16T12:56:36Z
Iteration superstep synchronization through RPC and JobManager
Unification of Accumulators and Aggregators (removal of former Aggregators)
Adjusted Testcases accordingly
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-flink pull request: Reworking of Iteration Synchronizati...
Posted by StephanEwen <gi...@git.apache.org>.
Github user StephanEwen commented on the pull request:
https://github.com/apache/incubator-flink/pull/36#issuecomment-54074682
Sorry for the long delay. This looks like cool work, especially unifying the Accumulators and Aggregators :-)
This is interacting quite a bit with the RPC, ExecutionGraph, and JobManager/TaskManager communication (see https://issues.apache.org/jira/browse/FLINK-1030). I am currently reworking that and would like to merge it with that part once it is done.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-flink pull request: Reworking of Iteration Synchronizati...
Posted by uce <gi...@git.apache.org>.
Github user uce commented on the pull request:
https://github.com/apache/incubator-flink/pull/36#issuecomment-63622454
I think this one is very outdated. @markus-h, can you give a heads-up whether you will have time to rebase this after #147 is merged? The execution graph changes are already in.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---