[jira] [Closed] (FLINK-2834) Global round-robin for temporary directories

["Fabian Hueske (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/FLINK-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Fabian Hueske closed FLINK-2834.
--------------------------------
       Resolution: Fixed
    Fix Version/s: 0.10
                   0.9.2

Fixed for 0.10 with dd3264e6360130c935267a13ff23db9ec3128d18
Fixed for 0.9 with 96099951e031adf37a5dba6d1c46c9eb6d43a52a

> Global round-robin for temporary directories
> --------------------------------------------
>
>                 Key: FLINK-2834
>                 URL: https://issues.apache.org/jira/browse/FLINK-2834
>             Project: Flink
>          Issue Type: Improvement
>          Components: Distributed Runtime
>    Affects Versions: 0.10
>            Reporter: Greg Hogan
>            Assignee: Greg Hogan
>            Priority: Minor
>             Fix For: 0.9.2, 0.10
>
>
> Currently each {{FileIOChannel}} performs a local round-robin among temporary directories. Initially every writer will be concurrently spilling to the same first directory, then the same second directory, etc. Even when evenly dispersed this effect will naturally occur due to the bunching effect.
> One solution is to use a global counter when selecting the temporary path.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)