You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@reef.apache.org by "Markus Weimer (JIRA)" <ji...@apache.org> on 2015/07/23 19:41:04 UTC

[jira] [Created] (REEF-492) Implement FileSystem using (HDFS) commands

Markus Weimer created REEF-492:
----------------------------------

             Summary: Implement FileSystem using (HDFS) commands
                 Key: REEF-492
                 URL: https://issues.apache.org/jira/browse/REEF-492
             Project: REEF
          Issue Type: Sub-task
          Components: REEF.NET
            Reporter: Markus Weimer


With {{IFileSystem}} defined and implemented for local file access, the next step is to support distributed file systems like HDFS. As there is no native HDFS support in .NET, a simple approach is to implement {{IFileSystem}} using external commands, e.g. {{hadoop fs -ls}} and friends. Ideally, the set of commands used should be configurable to allow for different / future file systems to be supported.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)