You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Arun C Murthy (JIRA)" <ji...@apache.org> on 2011/05/06 08:24:03 UTC

[jira] [Created] (HADOOP-7262) Update CS docs with better example configs

Update CS docs with better example configs
------------------------------------------

                 Key: HADOOP-7262
                 URL: https://issues.apache.org/jira/browse/HADOOP-7262
             Project: Hadoop Common
          Issue Type: Improvement
            Reporter: Arun C Murthy
            Assignee: Arun C Murthy
            Priority: Minor
             Fix For: 0.20.204.0


It will be nice to enhance CS docs with real-world example configs.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HADOOP-7262) Update CS docs with better example configs

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley updated HADOOP-7262:
----------------------------------

    Fix Version/s:     (was: 0.20.204.0)

> Update CS docs with better example configs
> ------------------------------------------
>
>                 Key: HADOOP-7262
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7262
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>            Priority: Minor
>         Attachments: HADOOP-7262.patch, capacity_scheduler.pdf
>
>
> It will be nice to enhance CS docs with real-world example configs.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7262) Update CS docs with better example configs

Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy updated HADOOP-7262:
----------------------------------

    Attachment: capacity_scheduler.pdf
                HADOOP-7262.patch

Patch with a real-world example config and also the generated capacity-scheduler.pdf for review.

> Update CS docs with better example configs
> ------------------------------------------
>
>                 Key: HADOOP-7262
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7262
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>            Priority: Minor
>             Fix For: 0.20.204.0
>
>         Attachments: HADOOP-7262.patch, capacity_scheduler.pdf
>
>
> It will be nice to enhance CS docs with real-world example configs.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-7262) Update CS docs with better example configs

Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13030901#comment-13030901 ] 

Koji Noguchi commented on HADOOP-7262:
--------------------------------------

Arun, "mapred.capacity-scheduler.queue.<queue-name>" is repeated many times on the tables in your pdf doc.  We should fill in the right conf names.

> Update CS docs with better example configs
> ------------------------------------------
>
>                 Key: HADOOP-7262
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7262
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>            Priority: Minor
>             Fix For: 0.20.204.0
>
>         Attachments: HADOOP-7262.patch, capacity_scheduler.pdf
>
>
> It will be nice to enhance CS docs with real-world example configs.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-7262) Update CS docs with better example configs

Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13030912#comment-13030912 ] 

Koji Noguchi commented on HADOOP-7262:
--------------------------------------

bq. Capacity Guarantees
bq.
Isn't 'guarantee' a strong word to use for the current capacity scheduler?
This is only possible when all of the queues have max-limit equal to queue capacity (since we don't have preemption).

bq. If true, priorities of jobs will be taken into account in scheduling decisions. 
bq.
On our internal cluster, we've never tried this.  It was once pointed out that we still have  priority inversion problems(MAPREDUCE:314) and should not enable this conf.  Was this fixed ?  If not, should we mention that it is not being used/tested yet?



> Update CS docs with better example configs
> ------------------------------------------
>
>                 Key: HADOOP-7262
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7262
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>            Priority: Minor
>             Fix For: 0.20.204.0
>
>         Attachments: HADOOP-7262.patch, capacity_scheduler.pdf
>
>
> It will be nice to enhance CS docs with real-world example configs.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira