[jira] [Commented] (MESOS-204) enable Frameworks level disk IO bandwidth support

["Charles Reiss (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/MESOS-204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289108#comment-13289108 ] 

Charles Reiss commented on MESOS-204:
-------------------------------------

It would probably make more sense to use the cgroups blkio controller (http://www.kernel.org/doc/Documentation/cgroups/blkio-controller.txt), assuming you'll have a recent enough kernel. Network prioritization can probably be done similarly. This probably just hasn't been a big priority for people because there are nastier issues with isolation, e.g. MESOS-47.

For I/O isolation, one issue is that HDFS (or other DFS) will probably create priority inversion issues in most real installations. It's not clear how to deal with this problem.
                
> enable Frameworks level disk IO bandwidth support
> -------------------------------------------------
>
>                 Key: MESOS-204
>                 URL: https://issues.apache.org/jira/browse/MESOS-204
>             Project: Mesos
>          Issue Type: Brainstorming
>            Reporter: Qinghe Jin
>
> I am considering to add Frameworks level disk IO bandwidth support to mesos，which behaves like ionice on the single node，but this time it‘s in multi-nodes。I believe this kind of disk QoS support will be more user friendly。My initial idea is to allow user to use an ioprio_set like api to set the io priority when they commit their job. At the same time, here may need some tools to display the disk IO usage per node/container on the webui.
> I have read the mesos paper carefully and I found that in the comment，it mentioned that in the future it will support disk and network bandwidth control。But，in my opinion，disk IO bandwidth is more feasible for it has more locality，and network bandwidth control may be more difficult for the complexity of the network environment。But I don't know why is there nobody going to add this feature。Is it useless？Or not feasible？Or just not interested？
> For this feature may need a lot of work，I‘d like to listen to your opinions before I start to work on it。Anybody who have any questions ,suggestions or ideas, please tell me and I appreciate it very much，Thanks！

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira