You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "Jiandan Yang (JIRA)" <ji...@apache.org> on 2018/05/18 09:18:00 UTC
[jira] [Created] (YARN-8320) Add support CPU isolation for
latency-sensitive (LS) tasks
Jiandan Yang created YARN-8320:
-----------------------------------
Summary: Add support CPU isolation for latency-sensitive (LS) tasks
Key: YARN-8320
URL: https://issues.apache.org/jira/browse/YARN-8320
Project: Hadoop YARN
Issue Type: New Feature
Components: nodemanager
Reporter: Jiandan Yang
Currently NodeManager uses “cpu.cfs_period_us”, “cpu.cfs_quota_us” and “cpu.shares” to isolate cpu resource. However,
* Linux Completely Fair Scheduling (CFS) is a throughput-oriented scheduler; no support for differentiated latency
* Request latency of services running on container may be frequent shake when all containers share cpus, and latency-sensitive services can not afford in our production environment.
So we need more finer cpu isolation.
My co-workers and I propose a solution using cgroup cpuset to binds containers to different processors according to a [Google’s PPT|http://schd.ws/hosted_files/lcccna2016/a7/CAT%20@%20Scale.pdf].
Later I will upload a detailed design doc.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org