You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2014/11/06 20:39:36 UTC
[jira] [Commented] (FLINK-1215) FileSystem.initOutPathLocalFS can
lead to race condition
[ https://issues.apache.org/jira/browse/FLINK-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200755#comment-14200755 ]
ASF GitHub Bot commented on FLINK-1215:
---------------------------------------
GitHub user StephanEwen opened a pull request:
https://github.com/apache/incubator-flink/pull/186
[FLINK-1215] Fix spurious failures when creating output directories due to I/O races
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/StephanEwen/incubator-flink FLINK1215
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-flink/pull/186.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #186
----
commit ef406916dbeabaef79b4ffd38fe5916cdd34bd2f
Author: Stephan Ewen <se...@apache.org>
Date: 2014-11-06T14:14:12Z
[FLINK-1222] Tasks send close acknowledgements early.
commit ef9a37390dfbd325b3bf2422334f99d22fca2a1a
Author: Stephan Ewen <se...@apache.org>
Date: 2014-11-06T18:14:13Z
[runtime] In local mode, make sure taskmanagers have completed registration before starting a job.
commit e58049711e4275d86197223b7efcb47d2f801244
Author: Stephan Ewen <se...@apache.org>
Date: 2014-11-06T19:33:38Z
[FLINK-1215] Fix spurious failures when creating output directories due to I/O races
----
> FileSystem.initOutPathLocalFS can lead to race condition
> --------------------------------------------------------
>
> Key: FLINK-1215
> URL: https://issues.apache.org/jira/browse/FLINK-1215
> Project: Flink
> Issue Type: Bug
> Components: Local Runtime
> Reporter: Aljoscha Krettek
> Priority: Minor
> Fix For: 0.8-incubating
>
>
> This can fail when concurrent tasks notice about deleting/creating the output directory.
> Seen in a travis log:
> Failed tests:
> LocalExecutorITCase.testLocalExecutorWithWordCount:61 java.io.IOException: Output directory 'file:/tmp/wctext7874076083387578604.out' could not be created. Canceling task...
> at org.apache.flink.api.common.io.FileOutputFormat.open(FileOutputFormat.java:232)
> at org.apache.flink.api.java.record.io.CsvOutputFormat.open(CsvOutputFormat.java:261)
> at org.apache.flink.runtime.operators.DataSinkTask.invoke(DataSinkTask.java:172)
> at org.apache.flink.runtime.execution.RuntimeEnvironment.run(RuntimeEnvironment.java:245)
> at java.lang.Thread.run(Thread.java:745)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)