You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-dev@hadoop.apache.org by "Ramkumar Vadali (JIRA)" <ji...@apache.org> on 2010/05/26 08:04:33 UTC

[jira] Created: (MAPREDUCE-1816) HAR files used for RAID parity need to have configurable partfile size

HAR files used for RAID parity need to have configurable partfile size
----------------------------------------------------------------------

                 Key: MAPREDUCE-1816
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1816
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: contrib/raid
    Affects Versions: 0.20.1
            Reporter: Ramkumar Vadali
            Priority: Minor


RAID parity files are merged into HAR archives periodically. This is required to reduce the number of files that the NameNode has to track. The number of files present in a HAR archive depends on the size of HAR part files - higher the size, lower the number of files.
The size of HAR part files is configurable through the setting har.partfile.size, but that is a global setting. This task introduces a new setting specific to raid.har.partfile.size, that is used in-turn to set har.partfile.size

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.