You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Thomas Graves (Created) (JIRA)" <ji...@apache.org> on 2011/11/01 21:37:34 UTC
[jira] [Created] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
mapred queue -list output inconsistent and missing child queues
---------------------------------------------------------------
Key: MAPREDUCE-3328
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0
Reporter: Thomas Graves
Priority: Critical
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Ravi Prakash (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147184#comment-13147184 ]
Ravi Prakash commented on MAPREDUCE-3328:
-----------------------------------------
Sorry! JIRA ate up the indentation I had put in.
I am wondering what is the best way to display the list of queues. I am leaning towards an output like this (I'll fix the capacity numbers after this)
{noformat}
======================
Queue Name : default
Queue State : running
Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
======================
Queue Name : test
Queue State : running
Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
======================
Queue Name : a1
Queue State : running
Scheduling Info : queueName: "a1", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
======================
Queue Name : a2
Queue State : running
Scheduling Info : queueName: "a2", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
======================
Queue Name : test2
Queue State : running
Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
======================
Queue Name : a3
Queue State : running
Scheduling Info : queueName: "a3", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
======================
Queue Name : a4
Queue State : running
Scheduling Info : queueName: "a4", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
{noformat}
What do you think?
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13148533#comment-13148533 ]
jiraposter@reviews.apache.org commented on MAPREDUCE-3328:
----------------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2804/
-----------------------------------------------------------
(Updated 2011-11-11 15:25:47.466764)
Review request for Tom Graves, Robert Evans, Eric Payne, Jonathan Eagles, and Mark Holderbaugh.
Changes
-------
Reduced lines greater than 80 chars
Summary
-------
Output is like this now:
======================
Queue Name : boston
Queue State : running
Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
======================
Queue Name : default
Queue State : running
Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
======================
Queue Name : kansas
Queue State : running
Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
======================
Queue Name : styx
Queue State : running
Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
======================
Queue Name : boston
Queue State : running
Scheduling Info : Capacity: 50.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
======================
Queue Name : kansas
Queue State : running
Scheduling Info : Capacity: 50.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
(MaximumCapacity was undefined in my setup)
This addresses bug MAPREDUCE-3328.
https://issues.apache.org/jira/browse/MAPREDUCE-3328
Diffs (updated)
-----
branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java 1200893
branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/TestTypeConverter.java 1200893
branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueClient.java 1200893
branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueInfo.java 1200893
branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobQueueClient.java PRE-CREATION
branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java 1200893
branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestResourceMgrDelegate.java PRE-CREATION
Diff: https://reviews.apache.org/r/2804/diff
Testing
-------
- Unit tests ran.
- test-patch ran with +1.
- command executed.
Thanks,
Ravi
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Ravi Prakash (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravi Prakash updated MAPREDUCE-3328:
------------------------------------
Status: Patch Available (was: Open)
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149952#comment-13149952 ]
jiraposter@reviews.apache.org commented on MAPREDUCE-3328:
----------------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2804/#review3230
-----------------------------------------------------------
branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java
<https://reviews.apache.org/r/2804/#comment7191>
Line 461: Is queueInfo.getChildQueues() recursive? Will this get children of children? It does, right?
- Eric
On 2011-11-11 15:53:53, Ravi Prakash wrote:
bq.
bq. -----------------------------------------------------------
bq. This is an automatically generated e-mail. To reply, visit:
bq. https://reviews.apache.org/r/2804/
bq. -----------------------------------------------------------
bq.
bq. (Updated 2011-11-11 15:53:53)
bq.
bq.
bq. Review request for Tom Graves, Robert Evans, Eric Payne, Jonathan Eagles, Mark Holderbaugh, and johnvijoe.
bq.
bq.
bq. Summary
bq. -------
bq.
bq. Output is like this now:
bq.
bq. ======================
bq. Queue Name : boston
bq. Queue State : running
bq. Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq. ======================
bq. Queue Name : default
bq. Queue State : running
bq. Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq. ======================
bq. Queue Name : kansas
bq. Queue State : running
bq. Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq. ======================
bq. Queue Name : styx
bq. Queue State : running
bq. Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq. ======================
bq. Queue Name : boston
bq. Queue State : running
bq. Scheduling Info : Capacity: 50.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq. ======================
bq. Queue Name : kansas
bq. Queue State : running
bq. Scheduling Info : Capacity: 50.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq.
bq. (MaximumCapacity was undefined in my setup)
bq.
bq.
bq. This addresses bug MAPREDUCE-3328.
bq. https://issues.apache.org/jira/browse/MAPREDUCE-3328
bq.
bq.
bq. Diffs
bq. -----
bq.
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java 1200893
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/TestTypeConverter.java 1200893
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueClient.java 1200893
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueInfo.java 1200893
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobQueueClient.java PRE-CREATION
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java 1200893
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestResourceMgrDelegate.java PRE-CREATION
bq.
bq. Diff: https://reviews.apache.org/r/2804/diff
bq.
bq.
bq. Testing
bq. -------
bq.
bq. - Unit tests ran.
bq. - test-patch ran with +1.
bq. - command executed.
bq.
bq.
bq. Thanks,
bq.
bq. Ravi
bq.
bq.
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168041#comment-13168041 ]
Hudson commented on MAPREDUCE-3328:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #1404 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1404/])
MAPREDUCE-3328. mapred queue -list output inconsistent and missing child queues. (Ravi Prakash via mahadev)
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213504
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/TestTypeConverter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueClient.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueInfo.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobQueueClient.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestResourceMgrDelegate.java
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13167995#comment-13167995 ]
Hudson commented on MAPREDUCE-3328:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Commit #284 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/284/])
MAPREDUCE-3328. mapred queue -list output inconsistent and missing child queues. (Ravi Prakash via mahadev) - Merging r1213504 from trunk
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213505
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/TestTypeConverter.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueClient.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueInfo.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobQueueClient.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestResourceMgrDelegate.java
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168029#comment-13168029 ]
Hudson commented on MAPREDUCE-3328:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Commit #263 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/263/])
MAPREDUCE-3328. mapred queue -list output inconsistent and missing child queues. (Ravi Prakash via mahadev) - Merging r1213504 from trunk
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213505
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/TestTypeConverter.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueClient.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueInfo.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobQueueClient.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestResourceMgrDelegate.java
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Ravi Prakash (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147181#comment-13147181 ]
Ravi Prakash commented on MAPREDUCE-3328:
-----------------------------------------
I am wondering what is the best way to display the list of queues. I am leaning towards an output like this (I'll fix the capacity numbers after this)
======================
Queue Name : default
Queue State : running
Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
======================
Queue Name : test
Queue State : running
Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
======================
Queue Name : a1
Queue State : running
Scheduling Info : queueName: "a1", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
======================
Queue Name : a2
Queue State : running
Scheduling Info : queueName: "a2", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
======================
Queue Name : test2
Queue State : running
Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
======================
Queue Name : a3
Queue State : running
Scheduling Info : queueName: "a3", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
======================
Queue Name : a4
Queue State : running
Scheduling Info : queueName: "a4", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
What do you think?
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Ravi Prakash (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravi Prakash updated MAPREDUCE-3328:
------------------------------------
Status: Patch Available (was: Open)
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Ravi Prakash (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravi Prakash updated MAPREDUCE-3328:
------------------------------------
Attachment: MAPREDUCE-3328.trunk.patch
Sorry again! This is the real trunk patch!
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Ravi Prakash (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13158555#comment-13158555 ]
Ravi Prakash commented on MAPREDUCE-3328:
-----------------------------------------
Mahadev,
TestMRCLI is failing without the patch too. There are JIRAs filed MAPREDUCE-2565 and MAPREDUCE-3207.
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168451#comment-13168451 ]
Hudson commented on MAPREDUCE-3328:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #926 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/926/])
MAPREDUCE-3328. mapred queue -list output inconsistent and missing child queues. (Ravi Prakash via mahadev)
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213504
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/TestTypeConverter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueClient.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueInfo.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobQueueClient.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestResourceMgrDelegate.java
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149951#comment-13149951 ]
jiraposter@reviews.apache.org commented on MAPREDUCE-3328:
----------------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2804/#review3237
-----------------------------------------------------------
Ship it!
- Eric
On 2011-11-11 15:53:53, Ravi Prakash wrote:
bq.
bq. -----------------------------------------------------------
bq. This is an automatically generated e-mail. To reply, visit:
bq. https://reviews.apache.org/r/2804/
bq. -----------------------------------------------------------
bq.
bq. (Updated 2011-11-11 15:53:53)
bq.
bq.
bq. Review request for Tom Graves, Robert Evans, Eric Payne, Jonathan Eagles, Mark Holderbaugh, and johnvijoe.
bq.
bq.
bq. Summary
bq. -------
bq.
bq. Output is like this now:
bq.
bq. ======================
bq. Queue Name : boston
bq. Queue State : running
bq. Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq. ======================
bq. Queue Name : default
bq. Queue State : running
bq. Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq. ======================
bq. Queue Name : kansas
bq. Queue State : running
bq. Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq. ======================
bq. Queue Name : styx
bq. Queue State : running
bq. Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq. ======================
bq. Queue Name : boston
bq. Queue State : running
bq. Scheduling Info : Capacity: 50.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq. ======================
bq. Queue Name : kansas
bq. Queue State : running
bq. Scheduling Info : Capacity: 50.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq.
bq. (MaximumCapacity was undefined in my setup)
bq.
bq.
bq. This addresses bug MAPREDUCE-3328.
bq. https://issues.apache.org/jira/browse/MAPREDUCE-3328
bq.
bq.
bq. Diffs
bq. -----
bq.
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java 1200893
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/TestTypeConverter.java 1200893
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueClient.java 1200893
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueInfo.java 1200893
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobQueueClient.java PRE-CREATION
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java 1200893
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestResourceMgrDelegate.java PRE-CREATION
bq.
bq. Diff: https://reviews.apache.org/r/2804/diff
bq.
bq.
bq. Testing
bq. -------
bq.
bq. - Unit tests ran.
bq. - test-patch ran with +1.
bq. - command executed.
bq.
bq.
bq. Thanks,
bq.
bq. Ravi
bq.
bq.
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149719#comment-13149719 ]
jiraposter@reviews.apache.org commented on MAPREDUCE-3328:
----------------------------------------------------------
bq. On 2011-11-11 20:44:17, Jonathan Eagles wrote:
bq. > looks good to me. i prefer parentqueue.childqueue notation instead of indentation format which i think will look better with deep queue hierarchies.
Thanks Jon! :) I'm leaning towards fixing the notation (parentqueue.childqueue) in MAPREDUCE-3147.
- Ravi
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2804/#review3180
-----------------------------------------------------------
On 2011-11-11 15:53:53, Ravi Prakash wrote:
bq.
bq. -----------------------------------------------------------
bq. This is an automatically generated e-mail. To reply, visit:
bq. https://reviews.apache.org/r/2804/
bq. -----------------------------------------------------------
bq.
bq. (Updated 2011-11-11 15:53:53)
bq.
bq.
bq. Review request for Tom Graves, Robert Evans, Eric Payne, Jonathan Eagles, Mark Holderbaugh, and johnvijoe.
bq.
bq.
bq. Summary
bq. -------
bq.
bq. Output is like this now:
bq.
bq. ======================
bq. Queue Name : boston
bq. Queue State : running
bq. Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq. ======================
bq. Queue Name : default
bq. Queue State : running
bq. Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq. ======================
bq. Queue Name : kansas
bq. Queue State : running
bq. Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq. ======================
bq. Queue Name : styx
bq. Queue State : running
bq. Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq. ======================
bq. Queue Name : boston
bq. Queue State : running
bq. Scheduling Info : Capacity: 50.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq. ======================
bq. Queue Name : kansas
bq. Queue State : running
bq. Scheduling Info : Capacity: 50.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq.
bq. (MaximumCapacity was undefined in my setup)
bq.
bq.
bq. This addresses bug MAPREDUCE-3328.
bq. https://issues.apache.org/jira/browse/MAPREDUCE-3328
bq.
bq.
bq. Diffs
bq. -----
bq.
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java 1200893
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/TestTypeConverter.java 1200893
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueClient.java 1200893
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueInfo.java 1200893
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobQueueClient.java PRE-CREATION
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java 1200893
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestResourceMgrDelegate.java PRE-CREATION
bq.
bq. Diff: https://reviews.apache.org/r/2804/diff
bq.
bq.
bq. Testing
bq. -------
bq.
bq. - Unit tests ran.
bq. - test-patch ran with +1.
bq. - command executed.
bq.
bq.
bq. Thanks,
bq.
bq. Ravi
bq.
bq.
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Thomas Graves (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves updated MAPREDUCE-3328:
-------------------------------------
Description:
When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
- the child queues do not show up
- The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
Queue Name : default
Queue State : running
Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
======================
Queue Name : test
Queue State : running
Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
======================
Queue Name : test2
Queue State : running
Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
======================
here default is configured to have capacity=70% and maximum capacity = 90%
Release Note: (was: When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
- the child queues do not show up
- The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
Queue Name : default
Queue State : running
Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
======================
Queue Name : test
Queue State : running
Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
======================
Queue Name : test2
Queue State : running
Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
======================
here default is configured to have capacity=70% and maximum capacity = 90%)
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Priority: Critical
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13148532#comment-13148532 ]
jiraposter@reviews.apache.org commented on MAPREDUCE-3328:
----------------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2804/
-----------------------------------------------------------
Review request for Tom Graves, Robert Evans, Eric Payne, Jonathan Eagles, and Mark Holderbaugh.
Summary
-------
Output is like this now:
======================
Queue Name : boston
Queue State : running
Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
======================
Queue Name : default
Queue State : running
Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
======================
Queue Name : kansas
Queue State : running
Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
======================
Queue Name : styx
Queue State : running
Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
======================
Queue Name : boston
Queue State : running
Scheduling Info : Capacity: 50.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
======================
Queue Name : kansas
Queue State : running
Scheduling Info : Capacity: 50.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
(MaximumCapacity was undefined in my setup)
This addresses bug MAPREDUCE-3328.
https://issues.apache.org/jira/browse/MAPREDUCE-3328
Diffs
-----
branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java 1200893
branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/TestTypeConverter.java 1200893
branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueClient.java 1200893
branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueInfo.java 1200893
branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobQueueClient.java PRE-CREATION
branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java 1200893
branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestResourceMgrDelegate.java PRE-CREATION
Diff: https://reviews.apache.org/r/2804/diff
Testing
-------
- Unit tests ran.
- test-patch ran with +1.
- command executed.
Thanks,
Ravi
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168364#comment-13168364 ]
Hudson commented on MAPREDUCE-3328:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Build #124 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/124/])
MAPREDUCE-3328. mapred queue -list output inconsistent and missing child queues. (Ravi Prakash via mahadev) - Merging r1213504 from trunk
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213505
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/TestTypeConverter.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueClient.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueInfo.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobQueueClient.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestResourceMgrDelegate.java
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13148545#comment-13148545 ]
jiraposter@reviews.apache.org commented on MAPREDUCE-3328:
----------------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2804/
-----------------------------------------------------------
(Updated 2011-11-11 15:53:53.968771)
Review request for Tom Graves, Robert Evans, Eric Payne, Jonathan Eagles, Mark Holderbaugh, and johnvijoe.
Summary
-------
Output is like this now:
======================
Queue Name : boston
Queue State : running
Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
======================
Queue Name : default
Queue State : running
Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
======================
Queue Name : kansas
Queue State : running
Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
======================
Queue Name : styx
Queue State : running
Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
======================
Queue Name : boston
Queue State : running
Scheduling Info : Capacity: 50.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
======================
Queue Name : kansas
Queue State : running
Scheduling Info : Capacity: 50.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
(MaximumCapacity was undefined in my setup)
This addresses bug MAPREDUCE-3328.
https://issues.apache.org/jira/browse/MAPREDUCE-3328
Diffs
-----
branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java 1200893
branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/TestTypeConverter.java 1200893
branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueClient.java 1200893
branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueInfo.java 1200893
branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobQueueClient.java PRE-CREATION
branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java 1200893
branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestResourceMgrDelegate.java PRE-CREATION
Diff: https://reviews.apache.org/r/2804/diff
Testing
-------
- Unit tests ran.
- test-patch ran with +1.
- command executed.
Thanks,
Ravi
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Ravi Prakash (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravi Prakash updated MAPREDUCE-3328:
------------------------------------
Attachment: MAPREDUCE-3328.branch-0.23.patch
Attaching patch to fix the problem.
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168345#comment-13168345 ]
Hudson commented on MAPREDUCE-3328:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #106 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/106/])
MAPREDUCE-3328. mapred queue -list output inconsistent and missing child queues. (Ravi Prakash via mahadev) - Merging r1213504 from trunk
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213505
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/TestTypeConverter.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueClient.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueInfo.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobQueueClient.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestResourceMgrDelegate.java
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Mahadev konar (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated MAPREDUCE-3328:
-------------------------------------
Status: Open (was: Patch Available)
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Ravi Prakash (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravi Prakash updated MAPREDUCE-3328:
------------------------------------
Attachment: MAPREDUCE-3328.trunk.patch
Attaching a patch for trunk
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch, MAPREDUCE-3328.trunk.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168037#comment-13168037 ]
Hudson commented on MAPREDUCE-3328:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #1478 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1478/])
MAPREDUCE-3328. mapred queue -list output inconsistent and missing child queues. (Ravi Prakash via mahadev)
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213504
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/TestTypeConverter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueClient.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueInfo.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobQueueClient.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestResourceMgrDelegate.java
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Mahadev konar (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated MAPREDUCE-3328:
-------------------------------------
Resolution: Fixed
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
I just committed this. Thanks Ravi!
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Ravi Prakash (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravi Prakash updated MAPREDUCE-3328:
------------------------------------
Attachment: MAPREDUCE-3328.trunk.patch
Sorry! Forgot to include new Test files
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Eli Collins (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins updated MAPREDUCE-3328:
-----------------------------------
Target Version/s: (was: 0.23.1)
Fix Version/s: 0.23.1
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3328.branch-0.23.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13167769#comment-13167769 ]
Hadoop QA commented on MAPREDUCE-3328:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12505380/MAPREDUCE-3328.trunk.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 9 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1423//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1423//console
This message is automatically generated.
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13167993#comment-13167993 ]
Hudson commented on MAPREDUCE-3328:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #1426 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1426/])
MAPREDUCE-3328. mapred queue -list output inconsistent and missing child queues. (Ravi Prakash via mahadev)
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213504
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/TestTypeConverter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueClient.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueInfo.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobQueueClient.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestResourceMgrDelegate.java
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168435#comment-13168435 ]
Hudson commented on MAPREDUCE-3328:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #893 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/893/])
MAPREDUCE-3328. mapred queue -list output inconsistent and missing child queues. (Ravi Prakash via mahadev)
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213504
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/TestTypeConverter.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueClient.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueInfo.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobQueueClient.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestResourceMgrDelegate.java
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168033#comment-13168033 ]
Hudson commented on MAPREDUCE-3328:
-----------------------------------
Integrated in Hadoop-Common-0.23-Commit #273 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/273/])
MAPREDUCE-3328. mapred queue -list output inconsistent and missing child queues. (Ravi Prakash via mahadev) - Merging r1213504 from trunk
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213505
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/TestTypeConverter.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueClient.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueInfo.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobQueueClient.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestResourceMgrDelegate.java
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch, MAPREDUCE-3328.trunk.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Ravi Prakash (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravi Prakash reassigned MAPREDUCE-3328:
---------------------------------------
Assignee: Ravi Prakash
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13148722#comment-13148722 ]
jiraposter@reviews.apache.org commented on MAPREDUCE-3328:
----------------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2804/#review3180
-----------------------------------------------------------
Ship it!
looks good to me. i prefer parentqueue.childqueue notation instead of indentation format which i think will look better with deep queue hierarchies.
- Jonathan
On 2011-11-11 15:53:53, Ravi Prakash wrote:
bq.
bq. -----------------------------------------------------------
bq. This is an automatically generated e-mail. To reply, visit:
bq. https://reviews.apache.org/r/2804/
bq. -----------------------------------------------------------
bq.
bq. (Updated 2011-11-11 15:53:53)
bq.
bq.
bq. Review request for Tom Graves, Robert Evans, Eric Payne, Jonathan Eagles, Mark Holderbaugh, and johnvijoe.
bq.
bq.
bq. Summary
bq. -------
bq.
bq. Output is like this now:
bq.
bq. ======================
bq. Queue Name : boston
bq. Queue State : running
bq. Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq. ======================
bq. Queue Name : default
bq. Queue State : running
bq. Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq. ======================
bq. Queue Name : kansas
bq. Queue State : running
bq. Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq. ======================
bq. Queue Name : styx
bq. Queue State : running
bq. Scheduling Info : Capacity: 25.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq. ======================
bq. Queue Name : boston
bq. Queue State : running
bq. Scheduling Info : Capacity: 50.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq. ======================
bq. Queue Name : kansas
bq. Queue State : running
bq. Scheduling Info : Capacity: 50.0, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0
bq.
bq. (MaximumCapacity was undefined in my setup)
bq.
bq.
bq. This addresses bug MAPREDUCE-3328.
bq. https://issues.apache.org/jira/browse/MAPREDUCE-3328
bq.
bq.
bq. Diffs
bq. -----
bq.
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/TypeConverter.java 1200893
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/TestTypeConverter.java 1200893
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueClient.java 1200893
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobQueueInfo.java 1200893
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobQueueClient.java PRE-CREATION
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java 1200893
bq. branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestResourceMgrDelegate.java PRE-CREATION
bq.
bq. Diff: https://reviews.apache.org/r/2804/diff
bq.
bq.
bq. Testing
bq. -------
bq.
bq. - Unit tests ran.
bq. - test-patch ran with +1.
bq. - command executed.
bq.
bq.
bq. Thanks,
bq.
bq. Ravi
bq.
bq.
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149754#comment-13149754 ]
Hadoop QA commented on MAPREDUCE-3328:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12503635/MAPREDUCE-3328.branch-0.23.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 9 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1302//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1302//console
This message is automatically generated.
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3328) mapred queue -list output
inconsistent and missing child queues
Posted by "Mahadev konar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13158031#comment-13158031 ]
Mahadev konar commented on MAPREDUCE-3328:
------------------------------------------
Ravi,
The patch looks good. Can you please confirm that TestMRCLI (an old test that checks the CLI format) in MR1, is passing? The test is an ant test as of now.
> mapred queue -list output inconsistent and missing child queues
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-3328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Thomas Graves
> Assignee: Ravi Prakash
> Priority: Critical
> Attachments: MAPREDUCE-3328.branch-0.23.patch
>
>
> When running mapred queue -list on a 0.23.0 cluster with capacity scheduler configured with child queues. In my case I have queues default, test1, and test2. test1 has subqueues of a1, a2. test2 has subqueues of a3 and a4.
> - the child queues do not show up
> - The output of maximum capacity doesn't match the format of the current capacity and capacity. the latter two use float while the maximum is specified as int:
> Queue Name : default
> Queue State : running
> Scheduling Info : queueName: "default", capacity: 0.7, maximumCapacity: 90.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test
> Queue State : running
> Scheduling Info : queueName: "test", capacity: 0.2, maximumCapacity: -1.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> Queue Name : test2
> Queue State : running
> Scheduling Info : queueName: "test2", capacity: 0.1, maximumCapacity: 5.0, currentCapacity: 0.0, state: Q_RUNNING,
> ======================
> here default is configured to have capacity=70% and maximum capacity = 90%
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira