You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Amar Kamat (Created) (JIRA)" <ji...@apache.org> on 2011/11/29 09:59:40 UTC
[jira] [Created] (MAPREDUCE-3481) [Gridmix] Improve STRESS mode
locking
[Gridmix] Improve STRESS mode locking
-------------------------------------
Key: MAPREDUCE-3481
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3481
Project: Hadoop Map/Reduce
Issue Type: Improvement
Components: contrib/gridmix
Affects Versions: 0.24.0
Reporter: Amar Kamat
Assignee: Amar Kamat
Fix For: 0.24.0
Gridmix STREES mode code doesnt sufficiently load the cluster due to improper locking.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3481) [Gridmix] Improve STRESS mode
locking
Posted by "Amar Kamat (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat updated MAPREDUCE-3481:
----------------------------------
Attachment: MAPREDUCE-3481-v1.7.patch
Attaching a patch incorporating Ravi's review comments. test-patch and ant-test passed.
> [Gridmix] Improve STRESS mode locking
> -------------------------------------
>
> Key: MAPREDUCE-3481
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3481
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/gridmix
> Affects Versions: 0.24.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Labels: gridmix, locking, stress-mode
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3481-v1.6.patch, MAPREDUCE-3481-v1.7.patch
>
>
> Gridmix STREES mode code doesnt sufficiently load the cluster due to improper locking.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3481) [Gridmix] Improve STRESS mode
locking
Posted by "Vinod Kumar Vavilapalli (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13195870#comment-13195870 ]
Vinod Kumar Vavilapalli commented on MAPREDUCE-3481:
----------------------------------------------------
Amar/Ravi, can you please coordinate to finish this? This will help us with running gridmix with YARN+MR. Thanks!
> [Gridmix] Improve STRESS mode locking
> -------------------------------------
>
> Key: MAPREDUCE-3481
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3481
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/gridmix
> Affects Versions: 0.24.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Labels: gridmix, locking, stress-mode
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3481-v1.6.patch
>
>
> Gridmix STREES mode code doesnt sufficiently load the cluster due to improper locking.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3481) [Gridmix] Improve STRESS mode
locking
Posted by "Vinod Kumar Vavilapalli (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod Kumar Vavilapalli updated MAPREDUCE-3481:
-----------------------------------------------
Target Version/s: 0.23.1, 0.24.0 (was: 0.24.0, 0.23.1)
Affects Version/s: 0.23.0
Fix Version/s: 0.23.1
> [Gridmix] Improve STRESS mode locking
> -------------------------------------
>
> Key: MAPREDUCE-3481
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3481
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/gridmix
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Labels: gridmix, locking, stress-mode
> Fix For: 0.23.1, 0.24.0
>
> Attachments: MAPREDUCE-3481-v1.6.patch, MAPREDUCE-3481-v1.7.patch
>
>
> Gridmix STREES mode code doesnt sufficiently load the cluster due to improper locking.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3481) [Gridmix] Improve STRESS mode
locking
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13195959#comment-13195959 ]
Hudson commented on MAPREDUCE-3481:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #1687 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1687/])
MAPREDUCE-3481. [Gridmix] Improve Gridmix STRESS mode. (amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237543
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/java/org/apache/hadoop/mapred/gridmix/Statistics.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/java/org/apache/hadoop/mapred/gridmix/StressJobFactory.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSubmission.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSummary.java
> [Gridmix] Improve STRESS mode locking
> -------------------------------------
>
> Key: MAPREDUCE-3481
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3481
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/gridmix
> Affects Versions: 0.24.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Labels: gridmix, locking, stress-mode
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3481-v1.6.patch, MAPREDUCE-3481-v1.7.patch
>
>
> Gridmix STREES mode code doesnt sufficiently load the cluster due to improper locking.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3481) [Gridmix] Improve STRESS mode
locking
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13196099#comment-13196099 ]
Hudson commented on MAPREDUCE-3481:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Build #176 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/176/])
MAPREDUCE-3481. [Gridmix] Improve Gridmix STRESS mode. (amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237578
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/java/org/apache/hadoop/mapred/gridmix/Statistics.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/java/org/apache/hadoop/mapred/gridmix/StressJobFactory.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSubmission.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSummary.java
> [Gridmix] Improve STRESS mode locking
> -------------------------------------
>
> Key: MAPREDUCE-3481
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3481
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/gridmix
> Affects Versions: 0.24.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Labels: gridmix, locking, stress-mode
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3481-v1.6.patch, MAPREDUCE-3481-v1.7.patch
>
>
> Gridmix STREES mode code doesnt sufficiently load the cluster due to improper locking.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-3481) [Gridmix] Improve STRESS mode
locking
Posted by "Amar Kamat (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat resolved MAPREDUCE-3481.
-----------------------------------
Resolution: Fixed
Target Version/s: 0.23.1, 0.24.0 (was: 0.24.0, 0.23.1)
Release Note: Modified Gridmix STRESS mode locking structure. The submitted thread and the polling thread now run simultaneously without blocking each other.
Hadoop Flags: Reviewed
I just committed the v1.7 patch to trunk. Thanks Ravi for the review.
> [Gridmix] Improve STRESS mode locking
> -------------------------------------
>
> Key: MAPREDUCE-3481
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3481
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/gridmix
> Affects Versions: 0.24.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Labels: gridmix, locking, stress-mode
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3481-v1.6.patch, MAPREDUCE-3481-v1.7.patch
>
>
> Gridmix STREES mode code doesnt sufficiently load the cluster due to improper locking.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3481) [Gridmix] Improve STRESS mode
locking
Posted by "Amar Kamat (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13196005#comment-13196005 ]
Amar Kamat commented on MAPREDUCE-3481:
---------------------------------------
Committed this to branch-0.23 too.
> [Gridmix] Improve STRESS mode locking
> -------------------------------------
>
> Key: MAPREDUCE-3481
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3481
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/gridmix
> Affects Versions: 0.24.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Labels: gridmix, locking, stress-mode
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3481-v1.6.patch, MAPREDUCE-3481-v1.7.patch
>
>
> Gridmix STREES mode code doesnt sufficiently load the cluster due to improper locking.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3481) [Gridmix] Improve STRESS mode
locking
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13196089#comment-13196089 ]
Hudson commented on MAPREDUCE-3481:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #154 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/154/])
MAPREDUCE-3481. [Gridmix] Improve Gridmix STRESS mode. (amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237578
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/java/org/apache/hadoop/mapred/gridmix/Statistics.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/java/org/apache/hadoop/mapred/gridmix/StressJobFactory.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSubmission.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSummary.java
> [Gridmix] Improve STRESS mode locking
> -------------------------------------
>
> Key: MAPREDUCE-3481
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3481
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/gridmix
> Affects Versions: 0.24.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Labels: gridmix, locking, stress-mode
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3481-v1.6.patch, MAPREDUCE-3481-v1.7.patch
>
>
> Gridmix STREES mode code doesnt sufficiently load the cluster due to improper locking.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3481) [Gridmix] Improve STRESS mode
locking
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13196030#comment-13196030 ]
Hudson commented on MAPREDUCE-3481:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Commit #459 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/459/])
MAPREDUCE-3481. [Gridmix] Improve Gridmix STRESS mode. (amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237578
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/java/org/apache/hadoop/mapred/gridmix/Statistics.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/java/org/apache/hadoop/mapred/gridmix/StressJobFactory.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSubmission.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSummary.java
> [Gridmix] Improve STRESS mode locking
> -------------------------------------
>
> Key: MAPREDUCE-3481
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3481
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/gridmix
> Affects Versions: 0.24.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Labels: gridmix, locking, stress-mode
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3481-v1.6.patch, MAPREDUCE-3481-v1.7.patch
>
>
> Gridmix STREES mode code doesnt sufficiently load the cluster due to improper locking.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3481) [Gridmix] Improve STRESS mode
locking
Posted by "Siddharth Seth (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Siddharth Seth updated MAPREDUCE-3481:
--------------------------------------
Target Version/s: 0.23.1, 0.24.0 (was: 0.24.0)
> [Gridmix] Improve STRESS mode locking
> -------------------------------------
>
> Key: MAPREDUCE-3481
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3481
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/gridmix
> Affects Versions: 0.24.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Labels: gridmix, locking, stress-mode
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3481-v1.6.patch
>
>
> Gridmix STREES mode code doesnt sufficiently load the cluster due to improper locking.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3481) [Gridmix] Improve STRESS mode
locking
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13196131#comment-13196131 ]
Hudson commented on MAPREDUCE-3481:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #974 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/974/])
MAPREDUCE-3481. [Gridmix] Improve Gridmix STRESS mode. (amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237543
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/java/org/apache/hadoop/mapred/gridmix/Statistics.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/java/org/apache/hadoop/mapred/gridmix/StressJobFactory.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSubmission.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSummary.java
> [Gridmix] Improve STRESS mode locking
> -------------------------------------
>
> Key: MAPREDUCE-3481
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3481
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/gridmix
> Affects Versions: 0.24.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Labels: gridmix, locking, stress-mode
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3481-v1.6.patch, MAPREDUCE-3481-v1.7.patch
>
>
> Gridmix STREES mode code doesnt sufficiently load the cluster due to improper locking.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3481) [Gridmix] Improve STRESS mode
locking
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13196009#comment-13196009 ]
Hudson commented on MAPREDUCE-3481:
-----------------------------------
Integrated in Hadoop-Common-0.23-Commit #444 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/444/])
MAPREDUCE-3481. [Gridmix] Improve Gridmix STRESS mode. (amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237578
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/java/org/apache/hadoop/mapred/gridmix/Statistics.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/java/org/apache/hadoop/mapred/gridmix/StressJobFactory.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSubmission.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSummary.java
> [Gridmix] Improve STRESS mode locking
> -------------------------------------
>
> Key: MAPREDUCE-3481
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3481
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/gridmix
> Affects Versions: 0.24.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Labels: gridmix, locking, stress-mode
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3481-v1.6.patch, MAPREDUCE-3481-v1.7.patch
>
>
> Gridmix STREES mode code doesnt sufficiently load the cluster due to improper locking.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3481) [Gridmix] Improve STRESS mode
locking
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13196008#comment-13196008 ]
Hudson commented on MAPREDUCE-3481:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Commit #435 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/435/])
MAPREDUCE-3481. [Gridmix] Improve Gridmix STRESS mode. (amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237578
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/java/org/apache/hadoop/mapred/gridmix/Statistics.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/java/org/apache/hadoop/mapred/gridmix/StressJobFactory.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSubmission.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSummary.java
> [Gridmix] Improve STRESS mode locking
> -------------------------------------
>
> Key: MAPREDUCE-3481
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3481
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/gridmix
> Affects Versions: 0.24.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Labels: gridmix, locking, stress-mode
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3481-v1.6.patch, MAPREDUCE-3481-v1.7.patch
>
>
> Gridmix STREES mode code doesnt sufficiently load the cluster due to improper locking.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3481) [Gridmix] Improve STRESS mode
locking
Posted by "Amar Kamat (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat updated MAPREDUCE-3481:
----------------------------------
Attachment: MAPREDUCE-3481-v1.6.patch
Attaching a patch.
> [Gridmix] Improve STRESS mode locking
> -------------------------------------
>
> Key: MAPREDUCE-3481
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3481
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/gridmix
> Affects Versions: 0.24.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Labels: gridmix, locking, stress-mode
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3481-v1.6.patch
>
>
> Gridmix STREES mode code doesnt sufficiently load the cluster due to improper locking.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3481) [Gridmix] Improve STRESS mode
locking
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13195954#comment-13195954 ]
Hudson commented on MAPREDUCE-3481:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #1615 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1615/])
MAPREDUCE-3481. [Gridmix] Improve Gridmix STRESS mode. (amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237543
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/java/org/apache/hadoop/mapred/gridmix/Statistics.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/java/org/apache/hadoop/mapred/gridmix/StressJobFactory.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSubmission.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSummary.java
> [Gridmix] Improve STRESS mode locking
> -------------------------------------
>
> Key: MAPREDUCE-3481
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3481
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/gridmix
> Affects Versions: 0.24.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Labels: gridmix, locking, stress-mode
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3481-v1.6.patch, MAPREDUCE-3481-v1.7.patch
>
>
> Gridmix STREES mode code doesnt sufficiently load the cluster due to improper locking.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3481) [Gridmix] Improve STRESS mode
locking
Posted by "Ravi Gummadi (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13195950#comment-13195950 ]
Ravi Gummadi commented on MAPREDUCE-3481:
-----------------------------------------
Latest patch looks good to me.
+1
> [Gridmix] Improve STRESS mode locking
> -------------------------------------
>
> Key: MAPREDUCE-3481
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3481
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/gridmix
> Affects Versions: 0.24.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Labels: gridmix, locking, stress-mode
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3481-v1.6.patch, MAPREDUCE-3481-v1.7.patch
>
>
> Gridmix STREES mode code doesnt sufficiently load the cluster due to improper locking.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3481) [Gridmix] Improve STRESS mode
locking
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13196087#comment-13196087 ]
Hudson commented on MAPREDUCE-3481:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #941 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/941/])
MAPREDUCE-3481. [Gridmix] Improve Gridmix STRESS mode. (amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1237543
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/java/org/apache/hadoop/mapred/gridmix/Statistics.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/java/org/apache/hadoop/mapred/gridmix/StressJobFactory.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSubmission.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSummary.java
> [Gridmix] Improve STRESS mode locking
> -------------------------------------
>
> Key: MAPREDUCE-3481
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3481
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/gridmix
> Affects Versions: 0.24.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Labels: gridmix, locking, stress-mode
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3481-v1.6.patch, MAPREDUCE-3481-v1.7.patch
>
>
> Gridmix STREES mode code doesnt sufficiently load the cluster due to improper locking.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3481) [Gridmix] Improve STRESS mode
locking
Posted by "Ravi Gummadi (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13192927#comment-13192927 ]
Ravi Gummadi commented on MAPREDUCE-3481:
-----------------------------------------
Patch looks good overall.
Some minor comments:
(1) You changed "return" to "break" in the while loop in StressReaderThread.run() when an InterruptedException is seen. "return" seems to be better.
(2) The return value from calcEffectiveIncompleteMapTasks() is taken in to a variable called "mapSlotsBackFill", which is misleading. Please change it to mapLoad or similar name.
> [Gridmix] Improve STRESS mode locking
> -------------------------------------
>
> Key: MAPREDUCE-3481
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3481
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/gridmix
> Affects Versions: 0.24.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Labels: gridmix, locking, stress-mode
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3481-v1.6.patch
>
>
> Gridmix STREES mode code doesnt sufficiently load the cluster due to improper locking.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira