You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by "Amar Kamat (Created) (JIRA)" <ji...@apache.org> on 2012/02/02 07:23:53 UTC

[jira] [Created] (MAPREDUCE-3787) [Gridmix] Improve STRESS mode

[Gridmix] Improve STRESS mode
-----------------------------

                 Key: MAPREDUCE-3787
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3787
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: contrib/gridmix
    Affects Versions: 0.24.0
            Reporter: Amar Kamat
            Assignee: Amar Kamat
             Fix For: 0.23.1, 0.24.0


Gridmix STRESS mode can be improved as follows:
1. The sleep time in JobMonitor can be reduced and/or made configurable
2. Map and reduce load calculation in StressJobFactory can be done in one loop
3. Updating the overload status from the job submitter thread (inline)
4. Optimizations to avoid un-necessary progress check (which inturn would result into delay)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (MAPREDUCE-3787) [Gridmix] Improve STRESS mode

Posted by "Amar Kamat (Resolved) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Amar Kamat resolved MAPREDUCE-3787.
-----------------------------------

      Resolution: Fixed
    Release Note: JobMonitor can now deploy multiple threads for faster job-status polling. Use 'gridmix.job-monitor.thread-count' to set the number of threads. Stress mode now relies on the updates from the job monitor instead of polling for job status. Failures in job submission now get reported to the statistics module and ultimately reported to the user via summary.
    Hadoop Flags: Reviewed

I just committed this to trunk! Thanks Ravi for the review.
                
> [Gridmix] Improve STRESS mode
> -----------------------------
>
>                 Key: MAPREDUCE-3787
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3787
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: contrib/gridmix
>    Affects Versions: 0.24.0
>            Reporter: Amar Kamat
>            Assignee: Amar Kamat
>              Labels: gridmix, stress
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3787-v1.12.patch, MAPREDUCE-3787-v1.9.patch
>
>
> Gridmix STRESS mode can be improved as follows:
> 1. The sleep time in JobMonitor can be reduced and/or made configurable
> 2. Map and reduce load calculation in StressJobFactory can be done in one loop
> 3. Updating the overload status from the job submitter thread (inline)
> 4. Optimizations to avoid un-necessary progress check (which inturn would result into delay)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira