You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Eli Collins (JIRA)" <ji...@apache.org> on 2010/11/19 04:42:14 UTC

[jira] Updated: (HADOOP-7045) TestDU fails on systems with local file systems with extended attributes

     [ https://issues.apache.org/jira/browse/HADOOP-7045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eli Collins updated HADOOP-7045:
--------------------------------

    Status: Patch Available  (was: Open)

> TestDU fails on systems with local file systems with extended attributes
> ------------------------------------------------------------------------
>
>                 Key: HADOOP-7045
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7045
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>            Reporter: Eli Collins
>            Assignee: Eli Collins
>            Priority: Minor
>             Fix For: 0.23.0
>
>         Attachments: hadoop-7045-1.patch
>
>
> The test reports that the file takes an extra 4k on disk:
> {noformat}
> Testcase: testDU took 5.74 sec
>         FAILED
> expected:<32768> but was:<36864>
> junit.framework.AssertionFailedError: expected:<32768> but was:<36864>
>         at org.apache.hadoop.fs.TestDU.testDU(TestDU.java:79)
> {noformat}
> This is because du reports 32k for the file and 4k because the file system it lives on uses extended attributes.
> {noformat}
> common-branch-0.20 $ dd if=/dev/zero of=data bs=4096 count=8
> 8+0 records in
> 8+0 records out
> 32768 bytes (33 kB) copied, 9.6e-05 seconds, 341 MB/s
> common-branch-0.20 $ du data
> 36	data
> common-branch-0.20 $ du --apparent-size data
> 32	data
> {noformat}
> We should modify the test to allow for some extra on-disk slack. The on-disk usage could also be smaller if the file data is all zeros or compression is enabled. The test currently handles the former by writing random data, we're punting on the latter.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.