You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Stephan Ewen (JIRA)" <ji...@apache.org> on 2014/09/21 04:17:33 UTC
[jira] [Resolved] (FLINK-1094) Simplify input split assignments
[ https://issues.apache.org/jira/browse/FLINK-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Stephan Ewen resolved FLINK-1094.
---------------------------------
Resolution: Fixed
Fix Version/s: 0.7-incubating
Fixed n c32569aed12ffa968e2c2289c2d56db262c0eba4
> Simplify input split assignments
> --------------------------------
>
> Key: FLINK-1094
> URL: https://issues.apache.org/jira/browse/FLINK-1094
> Project: Flink
> Issue Type: Improvement
> Components: JobManager
> Reporter: Stephan Ewen
> Assignee: Stephan Ewen
> Priority: Minor
> Fix For: 0.7-incubating
>
>
> The input split assigner is currently one shared instances across jobs and inputs. The mapping between splits, split type, and assigner is very inflexible, as it requires changing an internal class in the runtime project.
> The following changes will make it simpler and more efficient:
> - Attach the split assigner to the job vertex (the ExecutionJobVertex) for the task that consumes the input splits.
> - Move the input split assigner interfaces into the core project, as well as the simple base implementations of the assigners (default and locality aware)
> - Let input split producers (such as input formats) create their own assigners.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)