[jira] [Created] (HADOOP-12092) Issues with sub-directories in Swift

["Gil Vernik (JIRA)" <ji...@apache.org>]

Gil Vernik created HADOOP-12092:
-----------------------------------

             Summary: Issues with sub-directories in Swift
                 Key: HADOOP-12092
                 URL: https://issues.apache.org/jira/browse/HADOOP-12092
             Project: Hadoop Common
          Issue Type: Improvement
          Components: fs/swift
            Reporter: Gil Vernik
            Assignee: Gil Vernik


OpenStack swift doesn't have notion of directories or sub-directories. In Swift everything is object, stored in container, that belongs to account.
Openstack Swift allows objects to have delimiters and than users can access and filter those objects using delimiter.

Very good explanation appear here http://docs.rackspace.com/files/api/v1/cf-devguide/content/Pseudo-Hierarchical_Folders_Directories-d1e1580.html

Current driver has many code that create nested directories as zero length objects. While it might be needed for some cases, in general this
is wrong when working with Swift and highly affects performance of the driver.

The goal of this Jira is too make "sub-directories" generation as a configurable option. There will be option that will allow to disable sub-directories  generation and this will highly improve the performance.

Example: client perform PUT account/container/a/b/c/d/e/f/g.txt and driver is configured not to use sub-directories in Swift, than only one object "a/b/c/d/e/f/g.txt" will be generated in the container.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)