You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@mesos.apache.org by "Till Toenshoff (JIRA)" <ji...@apache.org> on 2015/11/22 16:24:11 UTC

[jira] [Comment Edited] (MESOS-3272) CgroupsAnyHierarchyWithCpuMemoryTest.ROOT_CGROUPS_FreezeNonFreezer is flaky.

    [ https://issues.apache.org/jira/browse/MESOS-3272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15018253#comment-15018253 ] 

Till Toenshoff edited comment on MESOS-3272 at 11/22/15 3:24 PM:
-----------------------------------------------------------------

I am seeing this flaky test (~ 10%) on CentOS 6.7 as well.

{noformat}
GLOG_v=2 sudo ./bin/mesos-tests.sh --gtest_filter="CgroupsAnyHierarchyWithCpuMemoryTest.ROOT_CGROUPS_FreezeNonFreezer" --gtest_repeat=100 --gtest_break_on_failure --verbose
{noformat}

{noformat}
[ ... ]

Repeating all tests (iteration 7) . . .

Note: Google Test filter = CgroupsAnyHierarchyWithCpuMemoryTest.ROOT_CGROUPS_FreezeNonFreezer-MesosContainerizerSlaveRecoveryTest.CGROUPS_ROOT_PerfRollForward:DockerContainerizerTest.ROOT_DOCKER_NC_PortMapping:PerfEventIsolatorTest.ROOT_CGROUPS_Sample:UserCgroupIsolatorTest/2.ROOT_CGROUPS_UserCgroup:CgroupsNoHierarchyTest.ROOT_CGROUPS_NOHIERARCHY_MountUnmountHierarchy:CgroupsAnyHierarchyWithPerfEventTest.ROOT_CGROUPS_Perf:PerfTest.ROOT_Events:PerfTest.ROOT_Sample:PerfTest.Parse:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/0:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/1:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/2:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/3:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/4:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/5:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/6:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/7:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/8:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/9:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/10:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/11:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/12:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/13:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/14:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/15:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/16:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/17:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/18:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/19:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/20:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/21:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/22:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/23:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/24:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/25:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/26:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/27:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/28:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/29:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/30:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/31:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/32:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/33:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/34:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/35:SlaveCount/Registrar_BENCHMARK_Test.Performance/0:SlaveCount/Registrar_BENCHMARK_Test.Performance/1:SlaveCount/Registrar_BENCHMARK_Test.Performance/2:SlaveCount/Registrar_BENCHMARK_Test.Performance/3
[==========] Running 1 test from 1 test case.
[----------] Global test environment set-up.
[----------] 1 test from CgroupsAnyHierarchyWithCpuMemoryTest
I1120 16:22:04.135941 27505 process.cpp:2426] Spawned process __latch__(33)@127.0.0.1:33586
[ RUN      ] CgroupsAnyHierarchyWithCpuMemoryTest.ROOT_CGROUPS_FreezeNonFreezer
I1120 16:22:04.135995 27521 process.cpp:2436] Resuming __gc__@127.0.0.1:33586 at 2015-11-20 16:22:04.135983104+00:00
I1120 16:22:04.136077 27521 process.cpp:2436] Resuming __latch__(33)@127.0.0.1:33586 at 2015-11-20 16:22:04.136075008+00:00
I1120 16:22:04.136106 27521 process.cpp:2541] Cleaning up __latch__(33)@127.0.0.1:33586
I1120 16:22:04.136154 27521 process.cpp:2436] Resuming __gc__@127.0.0.1:33586 at 2015-11-20 16:22:04.136152064+00:00
I1120 16:22:04.138380 27505 cgroups.cpp:2429] Freezing cgroup /cgroup/cpu/mesos_test
I1120 16:22:04.138452 27505 process.cpp:2426] Spawned process (13)@127.0.0.1:33586
I1120 16:22:04.138505 27505 process.cpp:2426] Spawned process __latch__(34)@127.0.0.1:33586
I1120 16:22:04.138532 27505 process.cpp:2426] Spawned process __waiter__(12)@127.0.0.1:33586
I1120 16:22:04.138566 27505 process.cpp:2734] Donating thread to __waiter__(12)@127.0.0.1:33586 while waiting
I1120 16:22:04.138576 27505 process.cpp:2436] Resuming __waiter__(12)@127.0.0.1:33586 at 2015-11-20 16:22:04.138573056+00:00
I1120 16:22:04.138677 27521 process.cpp:2436] Resuming __gc__@127.0.0.1:33586 at 2015-11-20 16:22:04.138673152+00:00
I1120 16:22:04.138731 27524 process.cpp:2436] Resuming (13)@127.0.0.1:33586 at 2015-11-20 16:22:04.138720000+00:00
I1120 16:22:04.138737 27521 process.cpp:2436] Resuming __latch__(34)@127.0.0.1:33586 at 2015-11-20 16:22:04.138735104+00:00
I1120 16:22:04.139137 27524 process.cpp:2541] Cleaning up (13)@127.0.0.1:33586
I1120 16:22:04.139174 27523 process.cpp:2436] Resuming __latch__(34)@127.0.0.1:33586 at 2015-11-20 16:22:04.139164928+00:00
I1120 16:22:04.139197 27523 process.cpp:2541] Cleaning up __latch__(34)@127.0.0.1:33586
I1120 16:22:04.139204 27524 process.cpp:2436] Resuming __gc__@127.0.0.1:33586 at 2015-11-20 16:22:04.139195904+00:00
I1120 16:22:04.139236 27524 process.cpp:2436] Resuming __waiter__(12)@127.0.0.1:33586 at 2015-11-20 16:22:04.139234048+00:00
I1120 16:22:04.139252 27524 process.cpp:2541] Cleaning up __waiter__(12)@127.0.0.1:33586
I1120 16:22:04.139358 27505 cgroups.cpp:2446] Thawing cgroup /cgroup/cpu/mesos_test
I1120 16:22:04.139415 27520 process.cpp:2436] Resuming __gc__@127.0.0.1:33586 at 2015-11-20 16:22:04.139411968+00:00
I1120 16:22:04.139582 27525 process.cpp:2436] Resuming (14)@127.0.0.1:33586 at 2015-11-20 16:22:04.139576064+00:00
I1120 16:22:04.139967 27525 process.cpp:2541] Cleaning up (14)@127.0.0.1:33586
I1120 16:22:04.140014 27525 process.cpp:2436] Resuming __gc__@127.0.0.1:33586 at 2015-11-20 16:22:04.140012032+00:00
I1120 16:22:04.140066 27505 process.cpp:2426] Spawned process (14)@127.0.0.1:33586
*** Aborted at 1448036524 (unix time) try "date -d @1448036524" if you are using GNU date ***
PC: @     0x7f5cccd543b9 (unknown)
*** SIGSEGV (@0x0) received by PID 27505 (TID 0x7f5cd2993840) from PID 0; stack trace: ***
    @     0x7f5ccd1b6790 (unknown)
    @     0x7f5cccd543b9 (unknown)
    @     0x7f5cd11bc6cd process::Process<>::self()
    @     0x7f5cd11c0441 process::dispatch<>()
    @     0x7f5cd11b4a2f cgroups::freezer::thaw()
    @          0x13b4abe mesos::internal::tests::CgroupsAnyHierarchyWithCpuMemoryTest_ROOT_CGROUPS_FreezeNonFreezer_Test::TestBody()
    @          0x1473e3a testing::internal::HandleSehExceptionsInMethodIfSupported<>()
    @          0x146ebe8 testing::internal::HandleExceptionsInMethodIfSupported<>()
    @          0x144feb7 testing::Test::Run()
    @          0x145063c testing::TestInfo::Run()
    @          0x1450c8c testing::TestCase::Run()
    @          0x14575f6 testing::internal::UnitTestImpl::RunAllTests()
    @          0x1474a5f testing::internal::HandleSehExceptionsInMethodIfSupported<>()
    @          0x146f788 testing::internal::HandleExceptionsInMethodIfSupported<>()
    @          0x145631c testing::UnitTest::Run()
    @           0xd183e5 RUN_ALL_TESTS()
    @           0xd17fbe main
    @     0x7f5ccc489d5d __libc_start_main
I1120 16:22:04.188093 27525 process.cpp:2436] Resuming reaper(1)@127.0.0.1:33586 at 2015-11-20 16:22:04.188075008+00:00
    @           0x90e8c9 (unknown)
/var/tmp/sclhILXQL: line 8: 27505 Segmentation fault      './bin/mesos-tests.sh' '--gtest_filter=CgroupsAnyHierarchyWithCpuMemoryTest.ROOT_CGROUPS_FreezeNonFreezer' '--gtest_repeat=100' '--gtest_break_on_failure' '--verbose'
{noformat}

My Vagrant generator script:
{noformat}
cat << EOF > Vagrantfile
# -*- mode: ruby -*-" >
# vi: set ft=ruby :
Vagrant.configure(2) do |config|
  # Disable shared folder to prevent certain kernel module dependencies.
  config.vm.synced_folder ".", "/vagrant", disabled: true

  config.vm.hostname = "centos67"

  config.vm.box = "bento/centos-6.7"

  config.vm.provider "virtualbox" do |vb|
    vb.memory = 16384
    vb.cpus = 8
  end

  config.vm.provider "vmware_fusion" do |vb|
    vb.memory = 9216
    vb.cpus = 4
  end

  config.vm.provision "shell", inline: <<-SHELL
    # Kernel 3.10 (required by Docker):
    sudo rpm --import https://www.elrepo.org/RPM-GPG-KEY-elrepo.org
    sudo rpm -Uvh http://www.elrepo.org/elrepo-release-6-6.el6.elrepo.noarch.rpm
    sudo yum --enablerepo=elrepo-kernel install -y kernel-lt
    sudo sed -i "s/default=1/default=0/g" /etc/grub.conf
    sudo sed -i "s/default=1/default=0/g" /boot/grub/grub.conf
    echo "SELINUX=disabled" > config
    echo "SELINUXTYPE=targeted" >> config
    sudo mv config /etc/selinux
    sudo yum install -y http://ftp.riken.jp/Linux/fedora/epel/6/i386/epel-release-6-8.noarch.rpm
    (cd /etc/yum.repos.d; sudo wget http://www.hop5.in/yum/el6/hop5.repo)

    # gcc 4.8 (required by Mesos):
    sudo wget http://people.centos.org/tru/devtools-2/devtools-2.repo -O /etc/yum.repos.d/devtools-2.repo
    sudo yum install devtoolset-2-gcc devtoolset-2-binutils devtoolset-2-gcc-c++

    # Docker:
    sudo wget -qO- https://get.docker.com/ | sh

    cp /etc/fstab .
    echo "none                    /sys/fs/cgroup          cgroup  defaults        0 0" >> fstab
    sudo mv fstab /etc/


    sudo yum install -y tar wget
    sudo wget http://repos.fedorapeople.org/repos/dchen/apache-maven/epel-apache-maven.repo -O /etc/yum.repos.d/epel-apache-maven.repo

    sudo yum groupinstall -y "Development Tools"
    sudo yum install -y apache-maven python-devel java-1.7.0-openjdk-devel zlib-devel libcurl-devel openssl-devel cyrus-sasl-devel cyrus-sasl-md5 apr-devel subversion-devel apr-util-devel

    sudo yum install -y git

    sudo wget -qO- https://get.docker.com/ | sh
    sudo docker info

  SHELL
end
EOF

vagrant up
vagrant reload

vagrant ssh -c "
scl enable devtoolset-2 bash

git clone  https://github.com/apache/mesos.git mesos
cd mesos
git checkout -b 0.26.0-rc1 0.26.0-rc1

./bootstrap
mkdir build
cd build

../configure
make -j4 check
#make -j4 distcheck
sudo ./bin/mesos-tests.sh

#make clean

#../configure --enable-libevent --enable-ssl
#GTEST_FILTER="" make check
#sudo ./bin/mesos-tests.sh
"
{noformat}


was (Author: tillt):
I am seeing this flaky test (~ 10%) on CentOS 6.7 as well.

{noformat}
GLOG_v=2 sudo ./bin/mesos-tests.sh --gtest_filter="CgroupsAnyHierarchyWithCpuMemoryTest.ROOT_CGROUPS_FreezeNonFreezer" --gtest_repeat=100 --gtest_break_on_failure --verbose
{noformat}

{noformat}
[ ... ]

Repeating all tests (iteration 7) . . .

Note: Google Test filter = CgroupsAnyHierarchyWithCpuMemoryTest.ROOT_CGROUPS_FreezeNonFreezer-MesosContainerizerSlaveRecoveryTest.CGROUPS_ROOT_PerfRollForward:DockerContainerizerTest.ROOT_DOCKER_NC_PortMapping:PerfEventIsolatorTest.ROOT_CGROUPS_Sample:UserCgroupIsolatorTest/2.ROOT_CGROUPS_UserCgroup:CgroupsNoHierarchyTest.ROOT_CGROUPS_NOHIERARCHY_MountUnmountHierarchy:CgroupsAnyHierarchyWithPerfEventTest.ROOT_CGROUPS_Perf:PerfTest.ROOT_Events:PerfTest.ROOT_Sample:PerfTest.Parse:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/0:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/1:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/2:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/3:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/4:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/5:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/6:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/7:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/8:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/9:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/10:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/11:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/12:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/13:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/14:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/15:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/16:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/17:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/18:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/19:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/20:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/21:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/22:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/23:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/24:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/25:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/26:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/27:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/28:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/29:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/30:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/31:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/32:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/33:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/34:SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.AddAndUpdateSlave/35:SlaveCount/Registrar_BENCHMARK_Test.Performance/0:SlaveCount/Registrar_BENCHMARK_Test.Performance/1:SlaveCount/Registrar_BENCHMARK_Test.Performance/2:SlaveCount/Registrar_BENCHMARK_Test.Performance/3
[==========] Running 1 test from 1 test case.
[----------] Global test environment set-up.
[----------] 1 test from CgroupsAnyHierarchyWithCpuMemoryTest
I1120 16:22:04.135941 27505 process.cpp:2426] Spawned process __latch__(33)@127.0.0.1:33586
[ RUN      ] CgroupsAnyHierarchyWithCpuMemoryTest.ROOT_CGROUPS_FreezeNonFreezer
I1120 16:22:04.135995 27521 process.cpp:2436] Resuming __gc__@127.0.0.1:33586 at 2015-11-20 16:22:04.135983104+00:00
I1120 16:22:04.136077 27521 process.cpp:2436] Resuming __latch__(33)@127.0.0.1:33586 at 2015-11-20 16:22:04.136075008+00:00
I1120 16:22:04.136106 27521 process.cpp:2541] Cleaning up __latch__(33)@127.0.0.1:33586
I1120 16:22:04.136154 27521 process.cpp:2436] Resuming __gc__@127.0.0.1:33586 at 2015-11-20 16:22:04.136152064+00:00
I1120 16:22:04.138380 27505 cgroups.cpp:2429] Freezing cgroup /cgroup/cpu/mesos_test
I1120 16:22:04.138452 27505 process.cpp:2426] Spawned process (13)@127.0.0.1:33586
I1120 16:22:04.138505 27505 process.cpp:2426] Spawned process __latch__(34)@127.0.0.1:33586
I1120 16:22:04.138532 27505 process.cpp:2426] Spawned process __waiter__(12)@127.0.0.1:33586
I1120 16:22:04.138566 27505 process.cpp:2734] Donating thread to __waiter__(12)@127.0.0.1:33586 while waiting
I1120 16:22:04.138576 27505 process.cpp:2436] Resuming __waiter__(12)@127.0.0.1:33586 at 2015-11-20 16:22:04.138573056+00:00
I1120 16:22:04.138677 27521 process.cpp:2436] Resuming __gc__@127.0.0.1:33586 at 2015-11-20 16:22:04.138673152+00:00
I1120 16:22:04.138731 27524 process.cpp:2436] Resuming (13)@127.0.0.1:33586 at 2015-11-20 16:22:04.138720000+00:00
I1120 16:22:04.138737 27521 process.cpp:2436] Resuming __latch__(34)@127.0.0.1:33586 at 2015-11-20 16:22:04.138735104+00:00
I1120 16:22:04.139137 27524 process.cpp:2541] Cleaning up (13)@127.0.0.1:33586
I1120 16:22:04.139174 27523 process.cpp:2436] Resuming __latch__(34)@127.0.0.1:33586 at 2015-11-20 16:22:04.139164928+00:00
I1120 16:22:04.139197 27523 process.cpp:2541] Cleaning up __latch__(34)@127.0.0.1:33586
I1120 16:22:04.139204 27524 process.cpp:2436] Resuming __gc__@127.0.0.1:33586 at 2015-11-20 16:22:04.139195904+00:00
I1120 16:22:04.139236 27524 process.cpp:2436] Resuming __waiter__(12)@127.0.0.1:33586 at 2015-11-20 16:22:04.139234048+00:00
I1120 16:22:04.139252 27524 process.cpp:2541] Cleaning up __waiter__(12)@127.0.0.1:33586
I1120 16:22:04.139358 27505 cgroups.cpp:2446] Thawing cgroup /cgroup/cpu/mesos_test
I1120 16:22:04.139415 27520 process.cpp:2436] Resuming __gc__@127.0.0.1:33586 at 2015-11-20 16:22:04.139411968+00:00
I1120 16:22:04.139582 27525 process.cpp:2436] Resuming (14)@127.0.0.1:33586 at 2015-11-20 16:22:04.139576064+00:00
I1120 16:22:04.139967 27525 process.cpp:2541] Cleaning up (14)@127.0.0.1:33586
I1120 16:22:04.140014 27525 process.cpp:2436] Resuming __gc__@127.0.0.1:33586 at 2015-11-20 16:22:04.140012032+00:00
I1120 16:22:04.140066 27505 process.cpp:2426] Spawned process (14)@127.0.0.1:33586
*** Aborted at 1448036524 (unix time) try "date -d @1448036524" if you are using GNU date ***
PC: @     0x7f5cccd543b9 (unknown)
*** SIGSEGV (@0x0) received by PID 27505 (TID 0x7f5cd2993840) from PID 0; stack trace: ***
    @     0x7f5ccd1b6790 (unknown)
    @     0x7f5cccd543b9 (unknown)
    @     0x7f5cd11bc6cd process::Process<>::self()
    @     0x7f5cd11c0441 process::dispatch<>()
    @     0x7f5cd11b4a2f cgroups::freezer::thaw()
    @          0x13b4abe mesos::internal::tests::CgroupsAnyHierarchyWithCpuMemoryTest_ROOT_CGROUPS_FreezeNonFreezer_Test::TestBody()
    @          0x1473e3a testing::internal::HandleSehExceptionsInMethodIfSupported<>()
    @          0x146ebe8 testing::internal::HandleExceptionsInMethodIfSupported<>()
    @          0x144feb7 testing::Test::Run()
    @          0x145063c testing::TestInfo::Run()
    @          0x1450c8c testing::TestCase::Run()
    @          0x14575f6 testing::internal::UnitTestImpl::RunAllTests()
    @          0x1474a5f testing::internal::HandleSehExceptionsInMethodIfSupported<>()
    @          0x146f788 testing::internal::HandleExceptionsInMethodIfSupported<>()
    @          0x145631c testing::UnitTest::Run()
    @           0xd183e5 RUN_ALL_TESTS()
    @           0xd17fbe main
    @     0x7f5ccc489d5d __libc_start_main
I1120 16:22:04.188093 27525 process.cpp:2436] Resuming reaper(1)@127.0.0.1:33586 at 2015-11-20 16:22:04.188075008+00:00
    @           0x90e8c9 (unknown)
/var/tmp/sclhILXQL: line 8: 27505 Segmentation fault      './bin/mesos-tests.sh' '--gtest_filter=CgroupsAnyHierarchyWithCpuMemoryTest.ROOT_CGROUPS_FreezeNonFreezer' '--gtest_repeat=100' '--gtest_break_on_failure' '--verbose'
{noformat}

My Vagrant generator script:
{noformat}
cat << EOF > Vagrantfile
# -*- mode: ruby -*-" >
# vi: set ft=ruby :
Vagrant.configure(2) do |config|
  # Disable shared folder to prevent certain kernel module dependencies.
  config.vm.synced_folder ".", "/vagrant", disabled: true

  config.vm.hostname = "centos67"

  config.vm.box = "bento/centos-6.7"

  config.vm.provider "virtualbox" do |vb|
    vb.memory = 16384
    vb.cpus = 8
  end

  config.vm.provider "vmware_fusion" do |vb|
    vb.memory = 9216
    vb.cpus = 4
  end

  config.vm.provision "shell", inline: <<-SHELL
    # Kernel 3.10 (required by Docker):
    sudo rpm --import https://www.elrepo.org/RPM-GPG-KEY-elrepo.org
    sudo rpm -Uvh http://www.elrepo.org/elrepo-release-6-6.el6.elrepo.noarch.rpm
    sudo yum --enablerepo=elrepo-kernel install -y kernel-lt
    sudo sed -i "s/default=1/default=0/g" /etc/grub.conf
    sudo sed -i "s/default=1/default=0/g" /boot/grub/grub.conf
    echo "SELINUX=disabled" > config
    echo "SELINUXTYPE=targeted" >> config
    sudo mv config /etc/selinux
    sudo yum install -y http://ftp.riken.jp/Linux/fedora/epel/6/i386/epel-release-6-8.noarch.rpm
    (cd /etc/yum.repos.d; sudo wget http://www.hop5.in/yum/el6/hop5.repo)

    # gcc 4.8 (required by Mesos):
    sudo wget http://people.centos.org/tru/devtools-2/devtools-2.repo -O /etc/yum.repos.d/devtools-2.repo
    sudo yum install devtoolset-2-gcc devtoolset-2-binutils devtoolset-2-gcc-c++

    # Docker:
    sudo wget -qO- https://get.docker.com/ | sh

    cp /etc/fstab .
    echo "none                    /sys/fs/cgroup          cgroup  defaults        0 0" >> fstab
    sudo mv fstab /etc/


    sudo yum install -y tar wget
    sudo wget http://repos.fedorapeople.org/repos/dchen/apache-maven/epel-apache-maven.repo -O /etc/yum.repos.d/epel-apache-maven.repo

    sudo yum groupinstall -y "Development Tools"
    sudo yum install -y apache-maven python-devel java-1.7.0-openjdk-devel zlib-devel libcurl-devel openssl-devel cyrus-sasl-devel cyrus-sasl-md5 apr-devel subversion-devel apr-util-devel

    sudo yum install -y git

    sudo docker info

    #sudo wget -qO- https://get.docker.com/ | sh
  SHELL
end
EOF

vagrant up
vagrant reload

vagrant ssh -c "
scl enable devtoolset-2 bash

git clone  https://github.com/apache/mesos.git mesos
cd mesos
git checkout -b 0.26.0-rc1 0.26.0-rc1

./bootstrap
mkdir build
cd build

../configure
make -j4 check
#make -j4 distcheck
sudo ./bin/mesos-tests.sh

#make clean

#../configure --enable-libevent --enable-ssl
#GTEST_FILTER="" make check
#sudo ./bin/mesos-tests.sh
"
{noformat}

> CgroupsAnyHierarchyWithCpuMemoryTest.ROOT_CGROUPS_FreezeNonFreezer is flaky.
> ----------------------------------------------------------------------------
>
>                 Key: MESOS-3272
>                 URL: https://issues.apache.org/jira/browse/MESOS-3272
>             Project: Mesos
>          Issue Type: Bug
>          Components: isolation
>            Reporter: Paul Brett
>            Assignee: Jian Qiu
>         Attachments: build.log
>
>
> Test aborts when configured with python, libevent and SSL on Ubuntu12.
> [ RUN      ] CgroupsAnyHierarchyWithCpuMemoryTest.ROOT_CGROUPS_FreezeNonFreezer
> *** Aborted at 1439667937 (unix time) try "date -d @1439667937" if you are using GNU date ***
> PC: @     0x7feba972a753 (unknown)
> *** SIGSEGV (@0x0) received by PID 4359 (TID 0x7febabf897c0) from PID 0; stack trace: ***
>     @     0x7feba8f7dcb0 (unknown)
>     @     0x7feba972a753 (unknown)
>     @     0x7febaaa69328 process::dispatch<>()
>     @     0x7febaaa5e9a7 cgroups::freezer::thaw()
>     @           0xba64ff mesos::internal::tests::CgroupsAnyHierarchyWithCpuMemoryTest_ROOT_CGROUPS_FreezeNonFreezer_Test::TestBody()
>     @           0xc199a3 testing::internal::HandleExceptionsInMethodIfSupported<>()
>     @           0xc0f947 testing::Test::Run()
>     @           0xc0f9ee testing::TestInfo::Run()
>     @           0xc0faf5 testing::TestCase::Run()
>     @           0xc0fda8 testing::internal::UnitTestImpl::RunAllTests()
>     @           0xc10064 testing::UnitTest::Run()
>     @           0x4b3273 main
>     @     0x7feba8bd176d (unknown)
>     @           0x4bf1f1 (unknown)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)