You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Weiwei Yang (JIRA)" <ji...@apache.org> on 2017/06/01 07:46:04 UTC
[jira] [Comment Edited] (HDFS-11909) Ozone: KSM : Support for
simulated file system operations
[ https://issues.apache.org/jira/browse/HDFS-11909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16032591#comment-16032591 ]
Weiwei Yang edited comment on HDFS-11909 at 6/1/17 7:45 AM:
------------------------------------------------------------
Hi [~anu]
Thanks for initiating this, some general questions
# I am not sure how useful is that to differentiate file with dir in API, {{getSimulatedFiles}} and {{getSimulatedDirectories}}. In file system they are all FileStatus. When we want to implement listStatus, the most convenient API wanted would be a call simply returns all paths under a path, along with an attribute to indicate itself a dir or a file. Otherwise we will end up with calling 2 APIs here, less favored.
# I looks like we need a module to do offer path <-> key convert, given a object key, it returns a path and vice versa.
# How to deal with paths with extra slashes? E.g photos/2006/January/mike//, and photos/2006/January/mike/, we don't want to list them as 2 different directories.
# How to handle FileSystem FsPermission in ozone? Maybe this is not the scope of this jira, just curious to ask if this will be covered in the file system implementation.
Let me know if I am missing anything, thanks!
was (Author: cheersyang):
Hi [~anu]
Thanks for initiating this, some general questions
# I am not sure how useful is that to differentiate file with dir in API, {{getSimulatedFiles}} and {{getSimulatedDirectories}}. In file system they are all FileStatus. When we want to implement listStatus, the most convenient API wanted would be a call simply returns all paths under a path, along with an attribute to indicate itself a dir or a file. Otherwise we will end up with calling 2 APIs here, less favored.
# I looks like we need a module to offer path <-> key convert, given a object key, it would return a path and vice versa.
# How to deal with paths with extra slashes? E.g photos/2006/January/mike//, and photos/2006/January/mike/, we don't want to list them as 2 different directories.
# How to handle FileSystem FsPermission in ozone? Maybe this is not the scope of this jira, just curious to ask if this will be covered in the file system implementation.
Let me know if I am missing anything, thanks!
> Ozone: KSM : Support for simulated file system operations
> ----------------------------------------------------------
>
> Key: HDFS-11909
> URL: https://issues.apache.org/jira/browse/HDFS-11909
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ozone
> Affects Versions: HDFS-7240
> Reporter: Anu Engineer
> Assignee: Anu Engineer
> Attachments: simulation-file-system.pdf
>
>
> This JIRA adds a proposal that makes it easy to implement OzoneFileSystem. This allows the directory and file list operations simpler.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org