You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Alex Newman (JIRA)" <ji...@apache.org> on 2013/08/19 21:13:48 UTC

[jira] [Created] (HADOOP-9884) Hadoop calling du -sk can cause huge load

Alex Newman created HADOOP-9884:
-----------------------------------

             Summary: Hadoop calling du -sk can cause huge load 
                 Key: HADOOP-9884
                 URL: https://issues.apache.org/jira/browse/HADOOP-9884
             Project: Hadoop Common
          Issue Type: Bug
            Reporter: Alex Newman


On numerous occasions we've had customers worry about slowness while hadoop calls du -sk underneath the hood. For most of these users getting the information from df would be sufficient and much faster. In fact there is a hack going around, that is quiet common that replaces df with du. Sometimes people have to tune the vcache. What if we just allowed users to use the df information instead of the du information with a patch and config setting. I'd be glad to code it up

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira