You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Karam Singh (JIRA)" <ji...@apache.org> on 2008/10/08 11:53:44 UTC
[jira] Commented: (HADOOP-4373) Guaranteed Capacity calculation is
not calculated correctly
[ https://issues.apache.org/jira/browse/HADOOP-4373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12637840#action_12637840 ]
Karam Singh commented on HADOOP-4373:
-------------------------------------
Settings:
Cluster is of 107 nodes out which 106 runs tasktrackers
Configured 4 qeueues -:
default gc_percent=10
test_q1 gc_percent=20
test_q2 gc_precent=30
test_q3 gc_percent=40
After starting mapred cluster.
JobTracker UI shows -:
Nodes=106, Map Task Capacity=212, Reduce Task Capacity=212 Avg. Tasks/Node=4.00
Queue Information shows -:
Queue Name Scheduling Information
default Guaranteed Capacity Maps (%) :10.0, Guaranteed Capacity Reduces (%) :10.0, Current Capacity Maps : 0, Current Capacity Reduces : 0
test_q1 Guaranteed Capacity Maps (%) :20.0, Guaranteed Capacity Reduces (%) :20.0, Current Capacity Maps : 0, Current Capacity Reduces : 0
test_q2 Guaranteed Capacity Maps (%) :30.0, Guaranteed Capacity Reduces (%) :30.0, Current Capacity Maps : 0, Current Capacity Reduces : 0
test_q3 Guaranteed Capacity Maps (%) :40.0, Guaranteed Capacity Reduces (%) :40.0, Current Capacity Maps : 0, Current Capacity Reduces : 0
And Job track log shows -:
2008-10-08 09:46:48,053 DEBUG org.apache.hadoop.mapred.CapacityTaskScheduler: After updating QSI objects:
2008-10-08 09:46:48,053 DEBUG org.apache.hadoop.mapred.CapacityTaskScheduler: Queue 'default'(map): run=0, gc=0, wait=0, run jobs=0, wait jobs=0*** Queue 'test_q1'(map): run=0, gc=0, wait=0, run jobs=0, wait jobs=0*** Queue 'test_q2'(map): run=0, gc=0, wait=0, run jobs=0, wait jobs=0*** Queue 'test_q3'(map): run=0, gc=0, wait=0, run jobs=0, wait jobs=0***
2008-10-08 09:46:48,053 DEBUG org.apache.hadoop.mapred.CapacityTaskScheduler: After updating QSI objects:
2008-10-08 09:46:48,053 DEBUG org.apache.hadoop.mapred.CapacityTaskScheduler: Queue 'default'(reduce): run=0, gc=0, wait=0, run jobs=0, wait jobs=0*** Queue 'test_q1'(reduce): run=0, gc=0, wait=0, run jobs=0, wait jobs=0*** Queue 'test_q2'(reduce): run=0, gc=0, wait=0, run jobs=0, wait jobs=0*** Queue 'test_q3'(reduce): run=0, gc=0, wait=0, run jobs=0, wait jobs=0***
Ran running about 15 jobs.
gc for all 4 queues remained 0 all the time.
> Guaranteed Capacity calculation is not calculated correctly
> -----------------------------------------------------------
>
> Key: HADOOP-4373
> URL: https://issues.apache.org/jira/browse/HADOOP-4373
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.19.0
> Reporter: Karam Singh
> Priority: Blocker
>
> Guaranteed Capacity calculation is not calculated correctly.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.