You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Eli Collins (JIRA)" <ji...@apache.org> on 2010/11/19 04:26:14 UTC

[jira] Created: (HADOOP-7045) TestDU fails on systems with local file systems with extended attributes

TestDU fails on systems with local file systems with extended attributes
------------------------------------------------------------------------

                 Key: HADOOP-7045
                 URL: https://issues.apache.org/jira/browse/HADOOP-7045
             Project: Hadoop Common
          Issue Type: Bug
          Components: fs
            Reporter: Eli Collins
            Assignee: Eli Collins
            Priority: Minor
             Fix For: 0.23.0


The test reports that the file takes an extra 4k on disk:

{noformat}
Testcase: testDU took 5.74 sec
        FAILED
expected:<32768> but was:<36864>
junit.framework.AssertionFailedError: expected:<32768> but was:<36864>
        at org.apache.hadoop.fs.TestDU.testDU(TestDU.java:79)
{noformat}

This is because du reports 32k for the file and 4k because the file system it lives on uses extended attributes.

{noformat}
common-branch-0.20 $ dd if=/dev/zero of=data bs=4096 count=8
8+0 records in
8+0 records out
32768 bytes (33 kB) copied, 9.6e-05 seconds, 341 MB/s
common-branch-0.20 $ du data
36	data
common-branch-0.20 $ du --apparent-size data
32	data
{noformat}

We should modify the test to allow for some extra on-disk slack. The on-disk usage could also be smaller if the file data is all zeros or compression is enabled. The test currently handles the former by writing random data, we're punting on the latter.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.