You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by "Ramkumar Vadali (JIRA)" <ji...@apache.org> on 2011/04/13 21:16:05 UTC
[jira] [Created] (MAPREDUCE-2436) RAID block fixer should
prioritize block fix operations
RAID block fixer should prioritize block fix operations
-------------------------------------------------------
Key: MAPREDUCE-2436
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2436
Project: Hadoop Map/Reduce
Issue Type: Improvement
Components: contrib/raid
Affects Versions: 0.20.2, 0.20.3
Reporter: Ramkumar Vadali
Assignee: Ramkumar Vadali
The RAID block fixer submits mapreduce jobs to fix corrupt files. This is OK for XOR RAID, but with Reed-Solomon RAID, there can be large number of corrupt files when even a single datanode goes dead. With Reed-SOlomon RAID, it is better to categorize corrupt files based on urgency. Files with only one corrupt block can be treated as lower priority than those with more number of corrupt blocks.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira