[jira] [Created] (MESOS-5441) Tests fail to use mounted cgroups on Ubuntu 16.04

["Jan Schlicht (JIRA)" <ji...@apache.org>]

Jan Schlicht created MESOS-5441:
-----------------------------------

             Summary: Tests fail to use mounted cgroups on Ubuntu 16.04
                 Key: MESOS-5441
                 URL: https://issues.apache.org/jira/browse/MESOS-5441
             Project: Mesos
          Issue Type: Bug
          Components: cgroups, tests
         Environment: Ubuntu 16.04
            Reporter: Jan Schlicht


Test fixtures inheriting from {{mesos::internal::tests::ContainerizerTest}} fail if {{sudo ./bin/mesos-tests.sh}} is run. Here's an example from our internal CI:
{noformat}

[23:49:18] :	 [Step 10/10] [ RUN      ] SlaveRecoveryTest/0.RecoverSlaveState
[23:49:18] :	 [Step 10/10] ../../src/tests/mesos.cpp:864: Failure
[23:49:18] :	 [Step 10/10] cgroups::mount(hierarchy, subsystem): 'cpu' is already attached to another hierarchy
[23:49:18] :	 [Step 10/10] -------------------------------------------------------------
[23:49:18] :	 [Step 10/10] We cannot run any cgroups tests that require
[23:49:18] :	 [Step 10/10] a hierarchy with subsystem 'cpu'
[23:49:18] :	 [Step 10/10] because we failed to find an existing hierarchy
[23:49:18] :	 [Step 10/10] or create a new one (tried '/run/lxcfs/controllers/cpu').
[23:49:18] :	 [Step 10/10] You can either remove all existing
[23:49:18] :	 [Step 10/10] hierarchies, or disable this test case
[23:49:18] :	 [Step 10/10] (i.e., --gtest_filter=-SlaveRecoveryTest/0.*).
[23:49:18] :	 [Step 10/10] -------------------------------------------------------------
[23:49:18] :	 [Step 10/10] ../../src/tests/mesos.cpp:918: Failure
[23:49:18] :	 [Step 10/10] cgroups: '/run/lxcfs/controllers/cpu' is not a valid hierarchy
[23:49:18] :	 [Step 10/10] [  FAILED  ] SlaveRecoveryTest/0.RecoverSlaveState, where TypeParam = mesos::internal::slave::MesosContainerizer (11 ms)
{noformat}
It seems that {{lxcfs}} of Ubuntu 16.04 might be causing this, {{/proc/mounts}} looks like this:
{noformat}
sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0
udev /dev devtmpfs rw,nosuid,relatime,size=3809788k,nr_inodes=952447,mode=755 0 0
devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
tmpfs /run tmpfs rw,nosuid,noexec,relatime,size=765776k,nr_inodes=957217,mode=755 0 0
/dev/xvda1 / ext4 rw,relatime,discard,data=ordered 0 0
securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0
tmpfs /dev/shm tmpfs rw,nosuid,nodev,size=3828868k,nr_inodes=957217 0 0
tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,nr_inodes=957217 0 0
tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,size=3828868k,nr_inodes=957217,mode=755 0 0
cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/lib/systemd/systemd-cgroups-agent,name=systemd,nsroot=/ 0 0
pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0
cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio,nsroot=/ 0 0
cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct,nsroot=/ 0 0
cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio,nsroot=/ 0 0
cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer,nsroot=/ 0 0
cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset,nsroot=/ 0 0
cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory,nsroot=/ 0 0
cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb,nsroot=/ 0 0
cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event,nsroot=/ 0 0
cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids,nsroot=/ 0 0
cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices,nsroot=/ 0 0
systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=25,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0
mqueue /dev/mqueue mqueue rw,relatime 0 0
debugfs /sys/kernel/debug debugfs rw,relatime 0 0
hugetlbfs /dev/hugepages hugetlbfs rw,relatime 0 0
fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0
/dev/xvdb /mnt ext3 rw,relatime,data=ordered 0 0
tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=765780k,mode=700,uid=1000,gid=1000 0 0
tmpfs /run/lxcfs/controllers tmpfs rw,relatime,size=100k,mode=700 0 0
devices /run/lxcfs/controllers/devices cgroup rw,relatime,devices,nsroot=/ 0 0
pids /run/lxcfs/controllers/pids cgroup rw,relatime,pids,nsroot=/ 0 0
perf_event /run/lxcfs/controllers/perf_event cgroup rw,relatime,perf_event,nsroot=/ 0 0
hugetlb /run/lxcfs/controllers/hugetlb cgroup rw,relatime,hugetlb,nsroot=/ 0 0
memory /run/lxcfs/controllers/memory cgroup rw,relatime,memory,nsroot=/ 0 0
cpuset /run/lxcfs/controllers/cpuset cgroup rw,relatime,cpuset,nsroot=/ 0 0
freezer /run/lxcfs/controllers/freezer cgroup rw,relatime,freezer,nsroot=/ 0 0
net_cls,net_prio /run/lxcfs/controllers/net_cls,net_prio cgroup rw,relatime,net_cls,net_prio,nsroot=/ 0 0
cpu,cpuacct /run/lxcfs/controllers/cpu,cpuacct cgroup rw,relatime,cpu,cpuacct,nsroot=/ 0 0
blkio /run/lxcfs/controllers/blkio cgroup rw,relatime,blkio,nsroot=/ 0 0
name=systemd /run/lxcfs/controllers/name=systemd cgroup rw,relatime,xattr,release_agent=/lib/systemd/systemd-cgroups-agent,name=systemd,nsroot=/ 0 0
lxcfs /var/lib/lxcfs fuse.lxcfs rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)