[jira] [Commented] (REEF-692) Make Open and Create function in REEF.IO.FileSystem.Hadoop.HadoopFileSystem return valid stream

["Markus Weimer (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/REEF-692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14721263#comment-14721263 ] 

Markus Weimer commented on REEF-692:
------------------------------------

{{Create}} will be tricky to get right: When you create the file locally, you will also have to create a dummy file on HDFS to make sure noone else creates the same file while it is still in flight locally. Then, during upload, that temp file needs to be deleted right before the upload. 

There are still race conditions in this approach, but at least it is better than nothing...

> Make Open and Create function in REEF.IO.FileSystem.Hadoop.HadoopFileSystem return valid stream
> -----------------------------------------------------------------------------------------------
>
>                 Key: REEF-692
>                 URL: https://issues.apache.org/jira/browse/REEF-692
>             Project: REEF
>          Issue Type: New Feature
>          Components: REEF.NET
>    Affects Versions: 0.13
>         Environment: C#
>            Reporter: Dhruv Mahajan
>            Assignee: Dhruv Mahajan
>
> The aim of the JIRA is to make Open and Create function in REEF.IO.FileSystem.Hadoop.HadoopFileSystem return valid stream.
> Basically we will do copytolocal followed by opening the local file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)