You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@mesos.apache.org by "Bernd Mathiske (JIRA)" <ji...@apache.org> on 2015/11/27 12:41:10 UTC

[jira] [Commented] (MESOS-4023) Test DockerContainerizerTest.ROOT_DOCKER_Default_CMD is flaky.

    [ https://issues.apache.org/jira/browse/MESOS-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029793#comment-15029793 ] 

Bernd Mathiske commented on MESOS-4023:
---------------------------------------

This might be a VM issue, I/O being slow. Filed a ticket anyhow in case someone has advice how to tune this Vagrantfile:

{noformat}
# -*- mode: ruby -*-" >
# vi: set ft=ruby :
Vagrant.configure(2) do |config|
  config.vm.box = "box-cutter/ubuntu1204-docker"
  config.vm.provider "virtualbox" do |vb|
    vb.memory = 16384
    vb.cpus = 8
    vb.customize ["modifyvm", :id, "--nictype1", "virtioā€¯]
    vb.customize ["modifyvm", :id, "--natdnshostresolver1", "on"]
    vb.customize ["modifyvm", :id, "--natdnsproxy1", "on"]
  end
  config.vm.provision "shell", inline: <<-SHELL
    sudo add-apt-repository ppa:ubuntu-toolchain-r/ppa
    sudo apt-get update

    sudo apt-get install -y python-software-properties
    sudo add-apt-repository -y ppa:ubuntu-toolchain-r/test
    sudo apt-get update

    sudo apt-get install -y openjdk-7-jdk
    sudo update-alternatives --set java /usr/lib/jvm/java-7-openjdk-amd64/jre/bin/java

    sudo apt-get install -y autoconf libtool
    sudo apt-get -y install build-essential python-dev python-boto libcurl4-nss-dev libsasl2-dev maven libapr1-dev libsvn-dev

    sudo apt-get install -y git

    # Docker:
    sudo apt-key adv --keyserver hkp://p80.pool.sks-keyservers.net:80 --recv-keys 58118E89F3A912897C070ADBF76221572C52609D
    sudo echo "deb https://apt.dockerproject.org/repo ubuntu-precise main" > docker.list
    sudo mv docker.list /etc/apt/sources.list.d/
    sudo apt-get update
    sudo apt-get purge lxc-docker*
    sudo apt-get -y install docker.engine
    sudo docker run hello-world

    sudo apt-get remove -y gcc
    sudo apt-get remove -y g++ g++-4.6 libstdc++6-4.6-dev
    sudo apt-get install -y gcc-4.8
    sudo apt-get install -y g++-4.8
    sudo update-alternatives --install /usr/bin/gcc gcc /usr/bin/gcc-4.8 50
    sudo update-alternatives --install /usr/bin/g++ g++ /usr/bin/g++-4.8 50
  SHELL
end
{noformat}

> Test DockerContainerizerTest.ROOT_DOCKER_Default_CMD is flaky.
> --------------------------------------------------------------
>
>                 Key: MESOS-4023
>                 URL: https://issues.apache.org/jira/browse/MESOS-4023
>             Project: Mesos
>          Issue Type: Bug
>          Components: docker
>    Affects Versions: 0.26.0
>         Environment: Ubuntu 12.04, docker 1.9.1, gcc 4.8.1
>            Reporter: Bernd Mathiske
>              Labels: flaky-test, mesosphere
>
> This happens when running  `sudo ./bin/mesos-tests.sh` on Ubuntu12.04, 
> but when run individually the test passes all the time.
> {noformat}
> [ RUN      ] DockerContainerizerTest.ROOT_DOCKER_Default_CMD
> 2015-11-27 11:22:20,981:3466(0x7f2b85ee4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:38787] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
> 2015-11-27 11:22:24,317:3466(0x7f2b85ee4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:38787] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
> 2015-11-27 11:22:27,655:3466(0x7f2b85ee4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:38787] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
> 2015-11-27 11:22:30,993:3466(0x7f2b85ee4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:38787] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
> 2015-11-27 11:22:34,331:3466(0x7f2b85ee4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:38787] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
> 2015-11-27 11:22:37,681:3466(0x7f2b85ee4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:38787] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
> 2015-11-27 11:22:41,019:3466(0x7f2b85ee4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:38787] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
> 2015-11-27 11:22:44,357:3466(0x7f2b85ee4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:38787] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
> 2015-11-27 11:22:47,695:3466(0x7f2b85ee4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:38787] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
> 2015-11-27 11:22:51,033:3466(0x7f2b85ee4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:38787] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
> 2015-11-27 11:22:54,372:3466(0x7f2b85ee4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:38787] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
> 2015-11-27 11:22:57,708:3466(0x7f2b85ee4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:38787] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
> 2015-11-27 11:23:01,045:3466(0x7f2b85ee4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:38787] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
> 2015-11-27 11:23:04,380:3466(0x7f2b85ee4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:38787] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
> 2015-11-27 11:23:07,720:3466(0x7f2b85ee4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:38787] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
> 2015-11-27 11:23:11,059:3466(0x7f2b85ee4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:38787] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
> 2015-11-27 11:23:14,395:3466(0x7f2b85ee4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:38787] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
> 2015-11-27 11:23:17,729:3466(0x7f2b85ee4700):ZOO_ERROR@handle_socket_error_msg@1697: Socket [127.0.0.1:38787] zk retcode=-4, errno=111(Connection refused): server refused to accept the client
> ../../src/tests/containerizer/docker_containerizer_tests.cpp:1289: Failure
> Failed to wait 1mins for statusRunning
> ../../src/tests/containerizer/docker_containerizer_tests.cpp:1280: Failure
> Actual function call count doesn't match EXPECT_CALL(sched, statusUpdate(&driver, _))...
>          Expected: to be called at least twice
>            Actual: never called - unsatisfied and active
> F1127 11:23:20.535930  3486 logging.cpp:55] RAW: Pure virtual method called
> F1127 11:23:20.535930  3466 logging.cpp:55] RAW: Pure virtual method called
>     @     0x7f2c0e41f832  google::LogMessage::Fail()
>     @     0x7f2c0e41f832  google::LogMessage::Fail()
>     @     0x7f2c0e424f5b  google::RawLog__()
>     @     0x7f2c0e424f5b  google::RawLog__()
>     @     0x7f2c0d654fb0  __cxa_pure_virtual
>     @     0x7f2c0d654fb0  __cxa_pure_virtual
>     @     0x7f2c0d9b9a63  mesos::internal::slave::Slave::executorLaunched()
>     @           0x9d189f  mesos::internal::tests::Cluster::Slaves::shutdown()
>     @     0x7f2c0da1fd44  _ZZN7process8dispatchIN5mesos8internal5slave5SlaveERKNS1_11FrameworkIDERKNS1_10ExecutorIDERKNS1_11ContainerIDERKNS_6FutureIbEES5_S8_SB_SF_EEvRKNS_3PIDIT_EEMSJ_FvT0_T1_T2_T3_ET4_T5_T6_T7_ENKUlPNS_11ProcessBaseEE_clESY_
>     @           0x9d16ea  mesos::internal::tests::Cluster::Slaves::~Slaves()
>     @           0x92a5d8  mesos::internal::tests::Cluster::~Cluster()
>     @           0x92a65b  mesos::internal::tests::MesosTest::~MesosTest()
>     @          0x1348583  mesos::internal::tests::DockerContainerizerTest::~DockerContainerizerTest()
>     @     0x7f2c0da4727c  _ZNSt17_Function_handlerIFvPN7process11ProcessBaseEEZNS0_8dispatchIN5mesos8internal5slave5SlaveERKNS5_11FrameworkIDERKNS5_10ExecutorIDERKNS5_11ContainerIDERKNS0_6FutureIbEES9_SC_SF_SJ_EEvRKNS0_3PIDIT_EEMSN_FvT0_T1_T2_T3_ET4_T5_T6_T7_EUlS2_E_E9_M_invokeERKSt9_Any_dataS2_
>     @          0x13554b7  mesos::internal::tests::DockerContainerizerTest_ROOT_DOCKER_Default_CMD_Test::~DockerContainerizerTest_ROOT_DOCKER_Default_CMD_Test()
>     @          0x13554e6  mesos::internal::tests::DockerContainerizerTest_ROOT_DOCKER_Default_CMD_Test::~DockerContainerizerTest_ROOT_DOCKER_Default_CMD_Test()
>     @     0x7f2c0e3a53a5  std::function<>::operator()()
>     @          0x14cb194  testing::Test::DeleteSelf_()
>     @     0x7f2c0e38d2f9  process::ProcessBase::visit()
>     @          0x14d5428  testing::internal::HandleSehExceptionsInMethodIfSupported<>()
>     @          0x14d023a  testing::internal::HandleExceptionsInMethodIfSupported<>()
>     @     0x7f2c0e390f60  process::DispatchEvent::visit()
>     @          0x14b1b8f  testing::TestInfo::Run()
>     @           0x9d4b8e  process::ProcessBase::serve()
>     @          0x14b2192  testing::TestCase::Run()
>     @          0x14b89da  testing::internal::UnitTestImpl::RunAllTests()
>     @     0x7f2c0e389510  process::ProcessManager::resume()
>     @     0x7f2c0e386576  _ZZN7process14ProcessManager12init_threadsEvENKUlRKSt11atomic_boolE_clES3_
>     @     0x7f2c0e390734  _ZNSt5_BindIFZN7process14ProcessManager12init_threadsEvEUlRKSt11atomic_boolE_St17reference_wrapperIS3_EEE6__callIvIEILm0EEEET_OSt5tupleIIDpT0_EESt12_Index_tupleIIXspT1_EEE
>     @          0x14d604d  testing::internal::HandleSehExceptionsInMethodIfSupported<>()
>     @     0x7f2c0e3906da  _ZNSt5_BindIFZN7process14ProcessManager12init_threadsEvEUlRKSt11atomic_boolE_St17reference_wrapperIS3_EEEclIIEvEET0_DpOT_
>     @     0x7f2c0e39066c  _ZNSt12_Bind_simpleIFSt5_BindIFZN7process14ProcessManager12init_threadsEvEUlRKSt11atomic_boolE_St17reference_wrapperIS4_EEEvEE9_M_invokeIIEEEvSt12_Index_tupleIIXspT_EEE
>     @          0x14d0dda  testing::internal::HandleExceptionsInMethodIfSupported<>()
>     @     0x7f2c0e3905b9  _ZNSt12_Bind_simpleIFSt5_BindIFZN7process14ProcessManager12init_threadsEvEUlRKSt11atomic_boolE_St17reference_wrapperIS4_EEEvEEclEv
>     @     0x7f2c0e390552  _ZNSt6thread5_ImplISt12_Bind_simpleIFSt5_BindIFZN7process14ProcessManager12init_threadsEvEUlRKSt11atomic_boolE_St17reference_wrapperIS6_EEEvEEE6_M_runEv
>     @     0x7f2c09b14a30  (unknown)
>     @     0x7f2c0935ee9a  start_thread
>     @          0x14b7710  testing::UnitTest::Run()
>     @     0x7f2c0908c38d  (unknown)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)