You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@mesos.apache.org by "Qian Zhang (Jira)" <ji...@apache.org> on 2020/04/22 08:30:00 UTC

[jira] [Assigned] (MESOS-8877) Docker container's resources will be wrongly enlarged in cgroups after agent recovery

     [ https://issues.apache.org/jira/browse/MESOS-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Qian Zhang reassigned MESOS-8877:
---------------------------------

    Story Points: 3  (was: 5)
        Assignee: Qian Zhang

RR: [https://reviews.apache.org/r/72401/]

> Docker container's resources will be wrongly enlarged in cgroups after agent recovery
> -------------------------------------------------------------------------------------
>
>                 Key: MESOS-8877
>                 URL: https://issues.apache.org/jira/browse/MESOS-8877
>             Project: Mesos
>          Issue Type: Bug
>          Components: docker
>    Affects Versions: 1.6.1, 1.6.0, 1.5.1, 1.5.0, 1.4.2, 1.4.1, 1.4.0
>            Reporter: Qian Zhang
>            Assignee: Qian Zhang
>            Priority: Critical
>              Labels: containerization
>
> Reproduce steps:
> 1. Run `mesos-execute --master=10.0.49.2:5050 --task=[file:///home/qzhang/workspace/config/task_docker.json] --checkpoint=true` to launch a Docker container.
> {code:java}
> # cat task_docker.json 
> {
>   "name": "test",
>   "task_id": {"value" : "test"},
>   "agent_id": {"value" : ""},
>   "resources": [
>     {"name": "cpus", "type": "SCALAR", "scalar": {"value": 0.1}},
>     {"name": "mem", "type": "SCALAR", "scalar": {"value": 32}}
>   ],
>   "command": {
>     "value": "sleep 55555"
>   },
>   "container": {
>     "type": "DOCKER",
>     "docker": {
>       "image": "alpine"
>     }
>   }
> }
> {code}
> 2. When the Docker container is running, we can see its resources in cgroups are correctly set, so far so good.
> {code:java}
> # cat /sys/fs/cgroup/cpu,cpuacct/docker/a711b3c7b0d91cd6d1c7d8daf45a90ff78d2fd66973e615faca55a717ec6b106/cpu.cfs_quota_us 
> 10000
> # cat /sys/fs/cgroup/memory/docker/a711b3c7b0d91cd6d1c7d8daf45a90ff78d2fd66973e615faca55a717ec6b106/memory.limit_in_bytes 
> 33554432
> {code}
> 3. Restart Mesos agent, and then we will see the resources of the Docker container will be wrongly enlarged.
> {code}
> I0503 02:06:17.268340 29512 docker.cpp:1855] Updated 'cpu.shares' to 204 at /sys/fs/cgroup/cpu,cpuacct/docker/a711b3c7b0d91cd6d1c7d8daf45a90ff78d2fd66973e615faca55a717ec6b106 for container 1b21295b-2f49-4d08-84c7-43b9ae15ad88
> I0503 02:06:17.271390 29512 docker.cpp:1882] Updated 'cpu.cfs_period_us' to 100ms and 'cpu.cfs_quota_us' to 20ms (cpus 0.2) for container 1b21295b-2f49-4d08-84c7-43b9ae15ad88
> I0503 02:06:17.273082 29512 docker.cpp:1924] Updated 'memory.soft_limit_in_bytes' to 64MB for container 1b21295b-2f49-4d08-84c7-43b9ae15ad88
> I0503 02:06:17.275908 29512 docker.cpp:1950] Updated 'memory.limit_in_bytes' to 64MB at /sys/fs/cgroup/memory/docker/a711b3c7b0d91cd6d1c7d8daf45a90ff78d2fd66973e615faca55a717ec6b106 for container 1b21295b-2f49-4d08-84c7-43b9ae15ad88
> # cat /sys/fs/cgroup/cpu,cpuacct/docker/a711b3c7b0d91cd6d1c7d8daf45a90ff78d2fd66973e615faca55a717ec6b106/cpu.cfs_quota_us
> 20000
> # cat /sys/fs/cgroup/memory/docker/a711b3c7b0d91cd6d1c7d8daf45a90ff78d2fd66973e615faca55a717ec6b106/memory.limit_in_bytes
> 67108864
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)