You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/09/06 20:04:20 UTC
[jira] [Commented] (FLINK-4571) Configurable little parallelism in
Gelly drivers
[ https://issues.apache.org/jira/browse/FLINK-4571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468406#comment-15468406 ]
ASF GitHub Bot commented on FLINK-4571:
---------------------------------------
GitHub user greghogan opened a pull request:
https://github.com/apache/flink/pull/2475
[FLINK-4571] [gelly] Configurable little parallelism in Gelly drivers
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/greghogan/flink 4571_configurable_little_parallelism_in_gelly_drivers
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/2475.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2475
----
commit 4e42a617d79e0400fc55dba0d46dc6c9012b0c59
Author: Greg Hogan <co...@greghogan.com>
Date: 2016-09-02T15:53:08Z
[FLINK-4571] [gelly] Configurable little parallelism in Gelly drivers
----
> Configurable little parallelism in Gelly drivers
> ------------------------------------------------
>
> Key: FLINK-4571
> URL: https://issues.apache.org/jira/browse/FLINK-4571
> Project: Flink
> Issue Type: Improvement
> Components: Gelly
> Affects Versions: 1.2.0
> Reporter: Greg Hogan
> Assignee: Greg Hogan
> Priority: Minor
>
> Several Gelly library implementations support a configurable "little parallelism" which is important when scaling to large data sets. These algorithms include operators at the beginning and end which process data on the order of the original DataSet, as well as middle operators that exchange 100s or 1000s more data. The "little parallelism" should be configurable in the appropriate Gelly drivers in the flink-gelly-examples module.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)