[jira] [Resolved] (FLINK-1149) Operators cannot adapt DOP for NonParallelInputs

["Fabian Hueske (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/FLINK-1149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Fabian Hueske resolved FLINK-1149.
----------------------------------
    Resolution: Fixed

Fixed with 986f25f6b51e3672865439e9a6581aab121b45ee

> Operators cannot adapt DOP for NonParallelInputs
> ------------------------------------------------
>
>                 Key: FLINK-1149
>                 URL: https://issues.apache.org/jira/browse/FLINK-1149
>             Project: Flink
>          Issue Type: Bug
>          Components: Java API
>    Affects Versions: 0.6.1-incubating, 0.7-incubating
>            Reporter: Fabian Hueske
>            Assignee: Fabian Hueske
>            Priority: Minor
>
> InputFormats that cannot be processed in parallel implement the NonParallelInput interface.
> During optimization, the optimizer checks for this interface and sets the DOP of an operator to 1 if it is found. Other operators such as Mappers set their DOP during program construction to the DOP of their preceding task (if not specified otherwise). Since non-splittable data sources are only considered later by the optimizer, a Map operator will not have the same DOP as an preceding non-splittable data source.
> The simple solution is to set the DOP of a non-splittable data source during program construction.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)