You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Hadoop QA (JIRA)" <ji...@apache.org> on 2015/06/03 03:37:49 UTC

[jira] [Commented] (HADOOP-12057) swiftfs rename on partitioned file attempts to consolidate partitions

    [ https://issues.apache.org/jira/browse/HADOOP-12057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14570114#comment-14570114 ] 

Hadoop QA commented on HADOOP-12057:
------------------------------------

\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch |  15m 22s | Pre-patch trunk compilation is healthy. |
| {color:green}+1{color} | @author |   0m  0s | The patch does not contain any @author tags. |
| {color:green}+1{color} | tests included |   0m  0s | The patch appears to include 1 new or modified test files. |
| {color:green}+1{color} | javac |   7m 34s | There were no new javac warning messages. |
| {color:green}+1{color} | javadoc |   9m 37s | There were no new javadoc warning messages. |
| {color:green}+1{color} | release audit |   0m 22s | The applied patch does not increase the total number of release audit warnings. |
| {color:red}-1{color} | checkstyle |   0m 19s | The applied patch generated  4 new checkstyle issues (total was 43, now 46). |
| {color:green}+1{color} | whitespace |   0m  0s | The patch has no lines that end in whitespace. |
| {color:green}+1{color} | install |   1m 35s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse |   0m 34s | The patch built with eclipse:eclipse. |
| {color:green}+1{color} | findbugs |   0m 46s | The patch does not introduce any new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | tools/hadoop tests |   0m 14s | Tests passed in hadoop-openstack. |
| | |  36m 26s | |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL | http://issues.apache.org/jira/secure/attachment/12737057/HADOOP-12057.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / c1d50a9 |
| checkstyle |  https://builds.apache.org/job/PreCommit-HADOOP-Build/6898/artifact/patchprocess/diffcheckstylehadoop-openstack.txt |
| hadoop-openstack test log | https://builds.apache.org/job/PreCommit-HADOOP-Build/6898/artifact/patchprocess/testrun_hadoop-openstack.txt |
| Test Results | https://builds.apache.org/job/PreCommit-HADOOP-Build/6898/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf902.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output | https://builds.apache.org/job/PreCommit-HADOOP-Build/6898/console |


This message was automatically generated.

> swiftfs rename on partitioned file attempts to consolidate partitions
> ---------------------------------------------------------------------
>
>                 Key: HADOOP-12057
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12057
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs/swift
>            Reporter: David Dobbins
>            Assignee: David Dobbins
>         Attachments: HADOOP-12057.patch
>
>
> In the swift filesystem for openstack, a rename operation on a partitioned file uses the swift COPY operation, which attempts to consolidate all of the partitions into a single object.  This causes the rename to fail when the total size of all the partitions exceeds the maximum object size for swift.  Since partitioned files are primarily created to allow a file to exceed the maximum object size, this bug makes writing to swift extremely unreliable.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)