You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Ramya Sunil (Created) (JIRA)" <ji...@apache.org> on 2012/02/01 23:47:53 UTC
[jira] [Created] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
maxActiveApplications(|PerUser) per queue is too low for small clusters
-----------------------------------------------------------------------
Key: MAPREDUCE-3784
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.1
Reporter: Ramya Sunil
We ran into this issue while testing on small clusters.
On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3784:
-------------------------------------
Status: Open (was: Patch Available)
Grr... forgot to change the log again. :)
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199464#comment-13199464 ]
Hudson commented on MAPREDUCE-3784:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #1650 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1650/])
MAPREDUCE-3784. Fixed CapacityScheduler so that maxActiveApplications and maxActiveApplicationsPerUser per queue are not too low for small clusters. Contributed by Arun C Murthy.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239971
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CSQueueUtils.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/LeafQueue.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestApplicationLimits.java
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3784:
-------------------------------------
Target Version/s: 0.23.1
Affects Version/s: (was: 0.23.1)
0.23.0
Fix Version/s: 0.23.1
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3784:
-------------------------------------
Attachment: MAPREDUCE-3784.patch
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199732#comment-13199732 ]
Hudson commented on MAPREDUCE-3784:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #978 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/978/])
MAPREDUCE-3784. Fixed CapacityScheduler so that maxActiveApplications and maxActiveApplicationsPerUser per queue are not too low for small clusters. Contributed by Arun C Murthy.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239971
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CSQueueUtils.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/LeafQueue.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestApplicationLimits.java
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199465#comment-13199465 ]
Hudson commented on MAPREDUCE-3784:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #1721 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1721/])
MAPREDUCE-3784. Fixed CapacityScheduler so that maxActiveApplications and maxActiveApplicationsPerUser per queue are not too low for small clusters. Contributed by Arun C Murthy.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239971
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CSQueueUtils.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/LeafQueue.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestApplicationLimits.java
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3784:
-------------------------------------
Attachment: MAPREDUCE-3784.patch
Made it a little more aggressive: Math.ceil instead of Math.round... :)
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3784:
-------------------------------------
Attachment: MAPREDUCE-3784.patch
Fixed log statements too.
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199468#comment-13199468 ]
Hudson commented on MAPREDUCE-3784:
-----------------------------------
Integrated in Hadoop-Common-0.23-Commit #477 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/477/])
MAPREDUCE-3784. Fixed CapacityScheduler so that maxActiveApplications and maxActiveApplicationsPerUser per queue are not too low for small clusters. Contributed by Arun C Murthy.
svn merge --ignore-ancestry -c 1239971 ../../trunk/
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239972
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CSQueueUtils.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/LeafQueue.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestApplicationLimits.java
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3784:
-------------------------------------
Status: Open (was: Patch Available)
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199671#comment-13199671 ]
Hudson commented on MAPREDUCE-3784:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #945 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/945/])
MAPREDUCE-3784. Fixed CapacityScheduler so that maxActiveApplications and maxActiveApplicationsPerUser per queue are not too low for small clusters. Contributed by Arun C Murthy.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239971
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CSQueueUtils.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/LeafQueue.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestApplicationLimits.java
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199236#comment-13199236 ]
Hadoop QA commented on MAPREDUCE-3784:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12513026/MAPREDUCE-3784.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
-1 javadoc. The javadoc tool appears to have generated 1 warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1751//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1751//console
This message is automatically generated.
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3784:
-------------------------------------
Attachment: MAPREDUCE-3784.patch
Changed to use queue max-cap in calculation of maxActiveApps.
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3784:
-------------------------------------
Status: Patch Available (was: Open)
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.1
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Attachments: MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3784:
-------------------------------------
Status: Patch Available (was: Open)
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Arun C Murthy (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy reassigned MAPREDUCE-3784:
----------------------------------------
Assignee: Arun C Murthy
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.1
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199472#comment-13199472 ]
Hudson commented on MAPREDUCE-3784:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Commit #467 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/467/])
MAPREDUCE-3784. Fixed CapacityScheduler so that maxActiveApplications and maxActiveApplicationsPerUser per queue are not too low for small clusters. Contributed by Arun C Murthy.
svn merge --ignore-ancestry -c 1239971 ../../trunk/
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239972
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CSQueueUtils.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/LeafQueue.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestApplicationLimits.java
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Arun C Murthy (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198688#comment-13198688 ]
Arun C Murthy commented on MAPREDUCE-3784:
------------------------------------------
I verified that the javadoc warnings are unrelated...
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198623#comment-13198623 ]
Hadoop QA commented on MAPREDUCE-3784:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12512920/MAPREDUCE-3784.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
-1 javadoc. The javadoc tool appears to have generated 1 warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1742//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1742//console
This message is automatically generated.
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198632#comment-13198632 ]
Hadoop QA commented on MAPREDUCE-3784:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12512923/MAPREDUCE-3784.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
-1 javadoc. The javadoc tool appears to have generated 3 warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1743//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1743//console
This message is automatically generated.
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3784:
-------------------------------------
Status: Open (was: Patch Available)
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Ramya Sunil (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199407#comment-13199407 ]
Ramya Sunil commented on MAPREDUCE-3784:
----------------------------------------
+1. Looks good. Tested the patch with various combination of maxCap, userlimit and queue capacity.
The problem of apps queuing up for small queues is alleviated after applying the patch. Also verified that the maxActiveApplications/maxActiveApplicationsPerUser is computed dynamically based on cluster resources.
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199476#comment-13199476 ]
Hudson commented on MAPREDUCE-3784:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Commit #491 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/491/])
MAPREDUCE-3784. Fixed CapacityScheduler so that maxActiveApplications and maxActiveApplicationsPerUser per queue are not too low for small clusters. Contributed by Arun C Murthy.
svn merge --ignore-ancestry -c 1239971 ../../trunk/
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239972
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CSQueueUtils.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/LeafQueue.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestApplicationLimits.java
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Vinod Kumar Vavilapalli (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199433#comment-13199433 ]
Vinod Kumar Vavilapalli commented on MAPREDUCE-3784:
----------------------------------------------------
Looking for final review/commit.
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Vinod Kumar Vavilapalli (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod Kumar Vavilapalli updated MAPREDUCE-3784:
-----------------------------------------------
Resolution: Fixed
Release Note: Fixed CapacityScheduler so that maxActiveApplication and maxActiveApplicationsPerUser per queue are not too low for small clusters.
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
I just committed this to trunk and branch-0.23. Thanks Arun!
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3784:
-------------------------------------
Status: Patch Available (was: Open)
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3784:
-------------------------------------
Status: Patch Available (was: Open)
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199478#comment-13199478 ]
Hudson commented on MAPREDUCE-3784:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #1665 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1665/])
MAPREDUCE-3784. Fixed CapacityScheduler so that maxActiveApplications and maxActiveApplicationsPerUser per queue are not too low for small clusters. Contributed by Arun C Murthy.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239971
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CSQueueUtils.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/LeafQueue.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestApplicationLimits.java
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199682#comment-13199682 ]
Hudson commented on MAPREDUCE-3784:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #158 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/158/])
MAPREDUCE-3784. Fixed CapacityScheduler so that maxActiveApplications and maxActiveApplicationsPerUser per queue are not too low for small clusters. Contributed by Arun C Murthy.
svn merge --ignore-ancestry -c 1239971 ../../trunk/
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239972
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CSQueueUtils.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/LeafQueue.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestApplicationLimits.java
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199721#comment-13199721 ]
Hudson commented on MAPREDUCE-3784:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Build #180 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/180/])
MAPREDUCE-3784. Fixed CapacityScheduler so that maxActiveApplications and maxActiveApplicationsPerUser per queue are not too low for small clusters. Contributed by Arun C Murthy.
svn merge --ignore-ancestry -c 1239971 ../../trunk/
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239972
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CSQueueUtils.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/LeafQueue.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestApplicationLimits.java
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Vinod Kumar Vavilapalli (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199445#comment-13199445 ]
Vinod Kumar Vavilapalli commented on MAPREDUCE-3784:
----------------------------------------------------
Looks good, +1. I am pushing this in.
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch, MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3784) maxActiveApplications(|PerUser)
per queue is too low for small clusters
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3784:
-------------------------------------
Attachment: MAPREDUCE-3784.patch
Straight-fwd fix, removed the hardcoded 2G for AM and used min. container size.
> maxActiveApplications(|PerUser) per queue is too low for small clusters
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-3784
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3784
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Arun C Murthy
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3784.patch
>
>
> We ran into this issue while testing on small clusters.
> On a 7node cluster with 8G per node, for a queue with absolute capacity 30%, user limit 100%, maxActiveApplications and maxActiveApplicationsPerUser is calculated to be 1.
> This means that even though the queue has 17GB(0.3*8*7), only 1 user can run 1 app at a given time queuing up rest of the apps/users. This hurts performance on small clusters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira