You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Arun Suresh (JIRA)" <ji...@apache.org> on 2017/12/06 06:39:00 UTC
[jira] [Comment Edited] (YARN-7610) Extend Distributed Shell to
support launching job with opportunistic containers
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16279724#comment-16279724 ]
Arun Suresh edited comment on YARN-7610 at 12/6/17 6:38 AM:
------------------------------------------------------------
Thanks for the update [~cheersyang]..
Since you are updating the documentation, can you also include the following [changes|https://github.com/apache/hadoop/commit/4e1fd7b022362ec7954b23d0ba6420dbc72a031b]. I had put them in when we released 2.9.0, but forgot to cherry-pick to branch-2.9 and above.
Since we are modifying the md to an md.vm, Can you also run mvn site and post a png of the updated section of the generated html page here. so we can verify if it looks good ?
was (Author: asuresh):
Thanks for the update [~cheersyang]..
Since you are updating the OpportunisticContainers.md.vm file, can you also include the following [changes|https://github.com/apache/hadoop/commit/4e1fd7b022362ec7954b23d0ba6420dbc72a031b]. I had put them in when we released 2.9.0, but forgot to cherry-pick to branch-2.9 and above.
Since we are modifying the md to an md.vm, Can you also run mvn site and post a png of the updated section of the generated html page here. so we can verify if it looks good ?
> Extend Distributed Shell to support launching job with opportunistic containers
> -------------------------------------------------------------------------------
>
> Key: YARN-7610
> URL: https://issues.apache.org/jira/browse/YARN-7610
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: applications/distributed-shell
> Reporter: Weiwei Yang
> Assignee: Weiwei Yang
> Attachments: YARN-7610.001.patch, YARN-7610.002.patch
>
>
> Per doc in [https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/OpportunisticContainers.html#Running_a_Sample_Job], user can run some of PI job mappers as O containers. Similarly, propose to extend distributed shell to support specifying the container type, it will be very helpful for testing. Propose to add following argument
> {code}
> $./bin/yarn org.apache.hadoop.yarn.applications.distributedshell.Client
> -container_type <arg> Container execution type,
> GUARANTEED or
> OPPORTUNISTIC
> {code}
> Implication: all containers in a distributed shell job will be launching as user-specified container type (except for AM), if not given, default type is {{GUARANTEED}}. AM is always launched as {{GUARANTEED}} container.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org