You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by "David Dobbins (JIRA)" <ji...@apache.org> on 2015/06/03 02:54:49 UTC

[jira] [Created] (HADOOP-12057) swiftfs rename on partitioned file attempts to consolidate partitions

David Dobbins created HADOOP-12057:
--------------------------------------

             Summary: swiftfs rename on partitioned file attempts to consolidate partitions
                 Key: HADOOP-12057
                 URL: https://issues.apache.org/jira/browse/HADOOP-12057
             Project: Hadoop Common
          Issue Type: Bug
          Components: fs/swift
            Reporter: David Dobbins
            Assignee: David Dobbins


In the swift filesystem for openstack, a rename operation on a partitioned file uses the swift COPY operation, which attempts to consolidate all of the partitions into a single object.  This causes the rename to fail when the total size of all the partitions exceeds the maximum object size for swift.  Since partitioned files are primarily created to allow a file to exceed the maximum object size, this bug makes writing to swift extremely unreliable.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)