You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@storm.apache.org by "Boyang Jerry Peng (JIRA)" <ji...@apache.org> on 2016/01/19 20:50:39 UTC

[jira] [Comment Edited] (STORM-1336) Evalute/Port JStorm cgroup support

    [ https://issues.apache.org/jira/browse/STORM-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107291#comment-15107291 ] 

Boyang Jerry Peng edited comment on STORM-1336 at 1/19/16 7:50 PM:
-------------------------------------------------------------------

Hello Everyone,

Currently at Yahoo, we want to enable the Resource Aware Scheduler we built to have cgroup support.  The CGroup code that is part of JStorm looks good and perhaps we can modify it slightly so that the Resource Aware Scheduler can interact with it. What I would like to do is modify the CGroup code that already exists in JStorm to be able to start jvm workers that is limited to the amount of resources that the resource aware scheduler has allocated for that worker and move it to Storm.  I would like to have a discussion (especially with people that worked on JStorm) about how we can integrate support for the resource aware scheduler into the existing CGroups code. I know the folks at Alibaba is working on converting the supervisor.clj to java.  What is the status of that?  


was (Author: jerrypeng):
Hello Everyone,

Currently at Yahoo, we want to enable the Resource Aware Scheduler we built to have cgroup support.  The CGroup code that is part of JStorm looks good and perhaps we can modify it slightly so that the Resource Aware Scheduler can interact with it. What I would like to do is modify the CGroup code that already exists in JStorm to be able to start jvm workers that is limited to the amount of resources that the resource aware scheduler has allocated for that worker.  I would like to have a discussion (especially with people that worked on JStorm) about how we can integrate support for the resource aware scheduler into the existing CGroups code. I know the folks at Alibaba is working on converting the supervisor.clj to java.  What is the status of that?  

> Evalute/Port JStorm cgroup support
> ----------------------------------
>
>                 Key: STORM-1336
>                 URL: https://issues.apache.org/jira/browse/STORM-1336
>             Project: Apache Storm
>          Issue Type: New Feature
>          Components: storm-core
>            Reporter: Robert Joseph Evans
>            Assignee: 冯健
>              Labels: jstorm-merger
>
> Supports controlling the upper limit of CPU core usage for a worker using cgroups
> Sounds like a good start, will be nice to integrate it with RAS requests too.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)