You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Jiandan Yang (JIRA)" <ji...@apache.org> on 2017/12/12 07:40:02 UTC
[jira] [Commented] (YARN-5636) Support reserving resources on
certain nodes for certain applications
[ https://issues.apache.org/jira/browse/YARN-5636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16287229#comment-16287229 ]
Jiandan Yang commented on YARN-5636:
-------------------------------------
[~Tao Jie] I think you solution is good. You can provide a patch to review.
> Support reserving resources on certain nodes for certain applications
> ---------------------------------------------------------------------
>
> Key: YARN-5636
> URL: https://issues.apache.org/jira/browse/YARN-5636
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: scheduler
> Reporter: Tao Jie
>
> We have met such circumstance:
> We are trying to run storm&kafka on yarn by Slider, and Storm&Kafka writes data to local disk on node. If some containers or the application fails, we expect that those containers would restart on the same node as they run before, otherwise data written on local would lost.
> For slider, it will trying to ensure restarted container on same nodes as before. However for yarn, resource may be assigned to other applications when former long-running application is down.
> As a result we'd better to have a mechanism that reserve some resource for certain long-running applications on certain nodes for a period of time. Does it make sense?
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org