You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2015/06/16 11:47:01 UTC
[jira] [Commented] (HADOOP-12092) Issues with sub-directories in
Swift
[ https://issues.apache.org/jira/browse/HADOOP-12092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587768#comment-14587768 ]
Steve Loughran commented on HADOOP-12092:
-----------------------------------------
There is already a JIRA for this, with a patch, its not something anyone has sat down to work with yet. I did see that it didn't make the feature optional, which is critical to maintain backwards compatibility.
> Issues with sub-directories in Swift
> ------------------------------------
>
> Key: HADOOP-12092
> URL: https://issues.apache.org/jira/browse/HADOOP-12092
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs/swift
> Reporter: Gil Vernik
> Assignee: Gil Vernik
>
> OpenStack swift doesn't have notion of directories or sub-directories. In Swift everything is object, stored in container, that belongs to account.
> Openstack Swift allows objects to have delimiters and than users can access and filter those objects using delimiter.
> Very good explanation appear here http://docs.rackspace.com/files/api/v1/cf-devguide/content/Pseudo-Hierarchical_Folders_Directories-d1e1580.html
> Current driver has many code that create nested directories as zero length objects. While it might be needed for some cases, in general this
> is wrong when working with Swift and highly affects performance of the driver.
> The goal of this Jira is too make "sub-directories" generation as a configurable option. There will be option that will allow to disable sub-directories generation and this will highly improve the performance.
> Example: client perform PUT account/container/a/b/c/d/e/f/g.txt and driver is configured not to use sub-directories in Swift, than only one object "a/b/c/d/e/f/g.txt" will be generated in the container.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)