You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Weiwei Yang (JIRA)" <ji...@apache.org> on 2018/01/23 07:31:00 UTC
[jira] [Comment Edited] (YARN-7791) Support submit intra-app
placement constraint in Distributed Shell to AppPlacementAllocator
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16335434#comment-16335434 ]
Weiwei Yang edited comment on YARN-7791 at 1/23/18 7:30 AM:
------------------------------------------------------------
+ [~leftnoteasy], [~sunilg].
[~sunilg], if you are working on a patch, feel free to take over. Thanks
was (Author: cheersyang):
+ [~leftnoteasy], [~sunilg]
> Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator
> -------------------------------------------------------------------------------------------
>
> Key: YARN-7791
> URL: https://issues.apache.org/jira/browse/YARN-7791
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: client
> Environment: Set {{yarn.resourcemanager.placement-constraints.enabled}} to {{false}}
> Submit a job with placement constraint spec, e.g
> {code}
> in/yarn org.apache.hadoop.yarn.applications.distributedshell.Client -jar share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.1.0-SNAPSHOT.jar -shell_command sleep -shell_args 30 -num_containers 2 -master_memory 500 -container_memory 200 -placement_spec foo=4,NOTIN,NODE,foo
> {code}
> got following errors in RM log
> {noformat}
> Exception message:As of now, the only accepted target key for targetKey of allocation_tag target expression is: [yarn_application_label/%intra_app%]. Please make changes to placement constraints accordingly.
> {noformat}
> Looks like DS needs some modification to support submitting proper scheduling requests to app placement allocators.
> Reporter: Weiwei Yang
> Priority: Major
> Labels: distributedshell
>
> Set {{yarn.resourcemanager.placement-constraints.enabled}} to {{false}}
> Submit a job with placement constraint spec, e.g
> {code}
> in/yarn org.apache.hadoop.yarn.applications.distributedshell.Client -jar share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.1.0-SNAPSHOT.jar -shell_command sleep -shell_args 30 -num_containers 2 -master_memory 500 -container_memory 200 -placement_spec foo=4,NOTIN,NODE,foo
> {code}
> got following errors in RM log
> {noformat}
> Exception message:As of now, the only accepted target key for targetKey of allocation_tag target expression is: [yarn_application_label/%intra_app%]. Please make changes to placement constraints accordingly.
> {noformat}
> Looks like DS needs some modification to support submitting proper scheduling requests to app placement allocators.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org