You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@mesos.apache.org by "Benno Evers (JIRA)" <ji...@apache.org> on 2018/09/27 11:58:00 UTC

[jira] [Created] (MESOS-9273) DockerVolumeIsolatorTest.ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume is flaky

Benno Evers created MESOS-9273:
----------------------------------

             Summary: DockerVolumeIsolatorTest.ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume is flaky
                 Key: MESOS-9273
                 URL: https://issues.apache.org/jira/browse/MESOS-9273
             Project: Mesos
          Issue Type: Bug
            Reporter: Benno Evers


Observed in an internal CI run (4499):
{noformat}
../../src/tests/containerizer/docker_volume_isolator_tests.cpp:1361
Failed to wait 15secs for statusStarting
{noformat}

Full log:
{noformat}
[ RUN      ] DockerVolumeIsolatorTest.ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume
I0927 01:52:53.770812 13860 cluster.cpp:173] Creating default 'local' authorizer
I0927 01:52:53.771752  3593 master.cpp:413] Master 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec (ip-172-16-10-139.ec2.internal) started on 172.16.10.139:46305
I0927 01:52:53.771773  3593 master.cpp:416] Flags at startup: --acls="" --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins" --allocation_interval="1secs" --allocator="hierarchical" --authenticate_agents="true" --authenticate_frameworks="true" --authenticate_http_frameworks="true" --authenticate_http_readonly="true" --authenticate_http_readwrite="true" --authentication_v0_timeout="15secs" --authenticators="crammd5" --authorizers="local" --credentials="/tmp/X4P8mF/credentials" --filter_gpu_resources="true" --framework_sorter="drf" --help="false" --hostname_lookup="true" --http_authenticators="basic" --http_framework_authenticators="basic" --initialize_driver_logging="true" --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5" --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000" --max_unreachable_tasks_per_framework="1000" --memory_profiling="false" --min_allocatable_resources="cpus:0.01|mem:32" --port="5050" --quiet="false" --recovery_agent_removal_limit="100%" --registry="in_memory" --registry_fetch_timeout="1mins" --registry_gc_interval="15mins" --registry_max_agent_age="2weeks" --registry_max_agent_count="102400" --registry_store_timeout="100secs" --registry_strict="false" --require_agent_domain="false" --role_sorter="drf" --root_submissions="true" --version="false" --webui_dir="/usr/local/share/mesos/webui" --work_dir="/tmp/X4P8mF/master" --zk_session_timeout="10secs"
I0927 01:52:53.771903  3593 master.cpp:465] Master only allowing authenticated frameworks to register
I0927 01:52:53.771914  3593 master.cpp:471] Master only allowing authenticated agents to register
I0927 01:52:53.771920  3593 master.cpp:477] Master only allowing authenticated HTTP frameworks to register
I0927 01:52:53.771926  3593 credentials.hpp:37] Loading credentials for authentication from '/tmp/X4P8mF/credentials'
I0927 01:52:53.771996  3593 master.cpp:521] Using default 'crammd5' authenticator
I0927 01:52:53.772053  3593 http.cpp:1037] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readonly'
I0927 01:52:53.772120  3593 http.cpp:1037] Creating default 'basic' HTTP authenticator for realm 'mesos-master-readwrite'
I0927 01:52:53.772158  3593 http.cpp:1037] Creating default 'basic' HTTP authenticator for realm 'mesos-master-scheduler'
I0927 01:52:53.772189  3593 master.cpp:602] Authorization enabled
I0927 01:52:53.772347  3597 hierarchical.cpp:182] Initialized hierarchical allocator process
I0927 01:52:53.772367  3594 whitelist_watcher.cpp:77] No whitelist given
I0927 01:52:53.773003  3594 master.cpp:2083] Elected as the leading master!
I0927 01:52:53.773023  3594 master.cpp:1638] Recovering from registrar
I0927 01:52:53.773063  3594 registrar.cpp:339] Recovering registrar
I0927 01:52:53.773201  3596 registrar.cpp:383] Successfully fetched the registry (0B) in 117760ns
I0927 01:52:53.773241  3596 registrar.cpp:487] Applied 1 operations in 8146ns; attempting to update the registry
I0927 01:52:53.773360  3596 registrar.cpp:544] Successfully updated the registry in 102912ns
I0927 01:52:53.773396  3596 registrar.cpp:416] Successfully recovered registrar
I0927 01:52:53.773474  3596 master.cpp:1752] Recovered 0 agents from the registry (176B); allowing 10mins for agents to reregister
I0927 01:52:53.773562  3597 hierarchical.cpp:220] Skipping recovery of hierarchical allocator: nothing to recover
I0927 01:52:53.774943 13860 isolator.cpp:144] Initialized the docker volume information root directory at '/run/mesos/isolators/docker/volume'
I0927 01:52:53.776796 13860 linux_launcher.cpp:144] Using /sys/fs/cgroup/freezer as the freezer hierarchy for the Linux launcher
sh: 1: hadoop: not found
I0927 01:52:53.859550 13860 fetcher.cpp:66] Skipping URI fetcher plugin 'hadoop' as it could not be created: Failed to create HDFS client: Hadoop client is not available, exit status: 32512
I0927 01:52:53.859833 13860 registry_puller.cpp:128] Creating registry puller with docker registry 'https://registry-1.docker.io'
I0927 01:52:53.860913 13860 provisioner.cpp:298] Using default backend 'overlay'
W0927 01:52:53.862563 13860 process.cpp:2810] Attempted to spawn already running process files@172.16.10.139:46305
I0927 01:52:53.862756 13860 cluster.cpp:485] Creating default 'local' authorizer
I0927 01:52:53.863294  3597 slave.cpp:267] Mesos agent started on (807)@172.16.10.139:46305
I0927 01:52:53.863319  3597 slave.cpp:268] Flags at startup: --acls="" --appc_simple_discovery_uri_prefix="http://" --appc_store_dir="/tmp/DockerVolumeIsolatorTest_ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume_HCiJvu/store/appc" --authenticate_http_readonly="true" --authenticate_http_readwrite="false" --authenticatee="crammd5" --authentication_backoff_factor="1secs" --authentication_timeout_max="1mins" --authentication_timeout_min="5secs" --authorizer="local" --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_destroy_timeout="1mins" --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false" --cgroups_root="mesos" --container_disk_watch_interval="15secs" --containerizers="mesos" --credential="/tmp/DockerVolumeIsolatorTest_ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume_HCiJvu/credential" --default_role="*" --disallow_sharing_agent_pid_namespace="false" --disk_watch_interval="1mins" --docker="docker" --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io" --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns" --docker_store_dir="/tmp/DockerVolumeIsolatorTest_ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume_HCiJvu/store/docker" --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume" --enforce_container_disk_quota="false" --executor_registration_timeout="1mins" --executor_reregistration_timeout="2secs" --executor_shutdown_grace_period="5secs" --fetcher_cache_dir="/tmp/DockerVolumeIsolatorTest_ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume_HCiJvu/fetch" --fetcher_cache_size="2GB" --fetcher_stall_timeout="1mins" --frameworks_home="" --gc_delay="1weeks" --gc_disk_headroom="0.1" --gc_non_executor_container_sandboxes="false" --help="false" --hostname_lookup="true" --http_command_executor="false" --http_credentials="/tmp/DockerVolumeIsolatorTest_ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume_HCiJvu/http_credentials" --http_heartbeat_interval="30secs" --image_providers="docker" --initialize_driver_logging="true" --isolation="docker/volume,docker/runtime,filesystem/linux" --launcher="linux" --launcher_dir="/home/ubuntu/workspace/mesos/Mesos_CI-build/FLAG/Plain/label/mesos-ec2-ubuntu-16.04/mesos/build/src" --logbufsecs="0" --logging_level="INFO" --max_completed_executors_per_framework="150" --memory_profiling="false" --network_cni_metrics="true" --oversubscribed_resources_interval="15secs" --perf_duration="10secs" --perf_interval="1mins" --port="5051" --qos_correction_interval_min="0ns" --quiet="false" --reconfiguration_policy="equal" --recover="reconnect" --recovery_timeout="15mins" --registration_backoff_factor="10ms" --resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]" --revocable_cpu_low_priority="true" --runtime_dir="/tmp/DockerVolumeIsolatorTest_ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume_HCiJvu" --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true" --systemd_enable_support="true" --systemd_runtime_directory="/run/systemd/system" --version="false" --work_dir="/tmp/DockerVolumeIsolatorTest_ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume_ANTqWz" --zk_session_timeout="10secs"
I0927 01:52:53.863602  3597 credentials.hpp:86] Loading credential for authentication from '/tmp/DockerVolumeIsolatorTest_ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume_HCiJvu/credential'
I0927 01:52:53.863665  3597 slave.cpp:300] Agent using credential for: test-principal
I0927 01:52:53.863687  3597 credentials.hpp:37] Loading credentials for authentication from '/tmp/DockerVolumeIsolatorTest_ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume_HCiJvu/http_credentials'
I0927 01:52:53.863770  3597 http.cpp:1037] Creating default 'basic' HTTP authenticator for realm 'mesos-agent-readonly'
I0927 01:52:53.863914  3597 disk_profile_adaptor.cpp:80] Creating default disk profile adaptor module
W0927 01:52:53.864408 13860 process.cpp:2810] Attempted to spawn already running process version@172.16.10.139:46305
I0927 01:52:53.864408  3597 slave.cpp:615] Agent resources: [{"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}]
I0927 01:52:53.864588  3597 slave.cpp:623] Agent attributes: [  ]
I0927 01:52:53.864599  3597 slave.cpp:632] Agent hostname: ip-172-16-10-139.ec2.internal
I0927 01:52:53.865008  3594 task_status_update_manager.cpp:181] Pausing sending task status updates
I0927 01:52:53.865067  3597 state.cpp:66] Recovering state from '/tmp/DockerVolumeIsolatorTest_ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume_ANTqWz/meta'
I0927 01:52:53.865281  3592 slave.cpp:6909] Finished recovering checkpointed state from '/tmp/DockerVolumeIsolatorTest_ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume_ANTqWz/meta', beginning agent recovery
I0927 01:52:53.865414  3590 task_status_update_manager.cpp:207] Recovering task status update manager
I0927 01:52:53.865581  3590 containerizer.cpp:727] Recovering Mesos containers
I0927 01:52:53.865667 13860 sched.cpp:232] Version: 1.8.0
I0927 01:52:53.865903  3590 linux_launcher.cpp:286] Recovering Linux launcher
I0927 01:52:53.865988  3592 sched.cpp:336] New master detected at master@172.16.10.139:46305
I0927 01:52:53.866147  3592 sched.cpp:401] Authenticating with master master@172.16.10.139:46305
I0927 01:52:53.866233  3592 sched.cpp:408] Using default CRAM-MD5 authenticatee
I0927 01:52:53.866269  3590 containerizer.cpp:1053] Recovering isolators
I0927 01:52:53.866546  3592 authenticatee.cpp:121] Creating new client SASL connection
I0927 01:52:53.867075  3592 master.cpp:9653] Authenticating scheduler-3eb85818-2958-4dc6-80fe-e90114429c0d@172.16.10.139:46305
I0927 01:52:53.867236  3592 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(1544)@172.16.10.139:46305
I0927 01:52:53.867466  3594 authenticator.cpp:98] Creating new server SASL connection
I0927 01:52:53.867583  3596 containerizer.cpp:1092] Recovering provisioner
I0927 01:52:53.867890  3593 metadata_manager.cpp:254] No images to load from disk. Docker provisioner image storage path '/tmp/DockerVolumeIsolatorTest_ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume_HCiJvu/store/docker/storedImages' does not exist
I0927 01:52:53.867970  3593 provisioner.cpp:494] Provisioner recovery complete
I0927 01:52:53.868108  3594 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5
I0927 01:52:53.868129  3594 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5'
I0927 01:52:53.868161  3594 authenticator.cpp:204] Received SASL authentication start
I0927 01:52:53.868207  3594 authenticator.cpp:326] Authentication requires more steps
I0927 01:52:53.868248  3594 authenticatee.cpp:259] Received SASL authentication step
I0927 01:52:53.868295  3594 authenticator.cpp:232] Received SASL authentication step
I0927 01:52:53.868319  3594 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'ip-172-16-10-139.ec2.internal' server FQDN: 'ip-172-16-10-139.ec2.internal' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false 
I0927 01:52:53.868329  3594 auxprop.cpp:181] Looking up auxiliary property '*userPassword'
I0927 01:52:53.868340  3594 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5'
I0927 01:52:53.868350  3594 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'ip-172-16-10-139.ec2.internal' server FQDN: 'ip-172-16-10-139.ec2.internal' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true 
I0927 01:52:53.868358  3594 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true
I0927 01:52:53.868366  3594 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true
I0927 01:52:53.868377  3594 authenticator.cpp:318] Authentication success
I0927 01:52:53.868415  3594 authenticatee.cpp:299] Authentication success
I0927 01:52:53.868463  3594 master.cpp:9685] Successfully authenticated principal 'test-principal' at scheduler-3eb85818-2958-4dc6-80fe-e90114429c0d@172.16.10.139:46305
I0927 01:52:53.868496  3594 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(1544)@172.16.10.139:46305
I0927 01:52:53.868566  3594 sched.cpp:513] Successfully authenticated with master master@172.16.10.139:46305
I0927 01:52:53.868584  3594 sched.cpp:817] Sending SUBSCRIBE call to master@172.16.10.139:46305
I0927 01:52:53.868624  3594 sched.cpp:850] Will retry registration in 1.512455404secs if necessary
I0927 01:52:53.868782  3594 master.cpp:2854] Received SUBSCRIBE call for framework 'default' at scheduler-3eb85818-2958-4dc6-80fe-e90114429c0d@172.16.10.139:46305
I0927 01:52:53.868809  3594 master.cpp:2155] Authorizing framework principal 'test-principal' to receive offers for roles '{ * }'
I0927 01:52:53.868916  3594 master.cpp:2935] Subscribing framework default with checkpointing disabled and capabilities [ MULTI_ROLE, RESERVATION_REFINEMENT ]
I0927 01:52:53.869374  3594 master.cpp:9883] Adding framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000 (default) at scheduler-3eb85818-2958-4dc6-80fe-e90114429c0d@172.16.10.139:46305 with roles {  } suppressed
I0927 01:52:53.869781  3593 composing.cpp:339] Finished recovering all containerizers
I0927 01:52:53.869853  3593 slave.cpp:7138] Recovering executors
I0927 01:52:53.869885  3593 slave.cpp:7291] Finished recovery
I0927 01:52:53.870012  3590 hierarchical.cpp:306] Added framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000
I0927 01:52:53.870175  3593 slave.cpp:1254] New master detected at master@172.16.10.139:46305
I0927 01:52:53.870265  3593 slave.cpp:1319] Detecting new master
I0927 01:52:53.870203  3596 task_status_update_manager.cpp:181] Pausing sending task status updates
I0927 01:52:53.870430  3590 hierarchical.cpp:1568] Performed allocation for 0 agents in 12338ns
I0927 01:52:53.870501  3594 sched.cpp:744] Framework registered with 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000
I0927 01:52:53.870542  3594 sched.cpp:758] Scheduler::registered took 19414ns
I0927 01:52:53.874657  3597 slave.cpp:1346] Authenticating with master master@172.16.10.139:46305
I0927 01:52:53.874683  3597 slave.cpp:1355] Using default CRAM-MD5 authenticatee
I0927 01:52:53.874748  3597 authenticatee.cpp:121] Creating new client SASL connection
I0927 01:52:53.875123  3597 master.cpp:9653] Authenticating slave(807)@172.16.10.139:46305
I0927 01:52:53.875169  3597 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(1545)@172.16.10.139:46305
I0927 01:52:53.875231  3597 authenticator.cpp:98] Creating new server SASL connection
I0927 01:52:53.875579  3597 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5
I0927 01:52:53.875598  3597 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5'
I0927 01:52:53.875627  3597 authenticator.cpp:204] Received SASL authentication start
I0927 01:52:53.875661  3597 authenticator.cpp:326] Authentication requires more steps
I0927 01:52:53.875697  3597 authenticatee.cpp:259] Received SASL authentication step
I0927 01:52:53.875739  3597 authenticator.cpp:232] Received SASL authentication step
I0927 01:52:53.875761  3597 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'ip-172-16-10-139.ec2.internal' server FQDN: 'ip-172-16-10-139.ec2.internal' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false 
I0927 01:52:53.875771  3597 auxprop.cpp:181] Looking up auxiliary property '*userPassword'
I0927 01:52:53.875780  3597 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5'
I0927 01:52:53.875789  3597 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'ip-172-16-10-139.ec2.internal' server FQDN: 'ip-172-16-10-139.ec2.internal' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true 
I0927 01:52:53.875797  3597 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true
I0927 01:52:53.875803  3597 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true
I0927 01:52:53.875814  3597 authenticator.cpp:318] Authentication success
I0927 01:52:53.875854  3597 authenticatee.cpp:299] Authentication success
I0927 01:52:53.875898  3597 master.cpp:9685] Successfully authenticated principal 'test-principal' at slave(807)@172.16.10.139:46305
I0927 01:52:53.875931  3597 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(1545)@172.16.10.139:46305
I0927 01:52:53.875983  3597 slave.cpp:1446] Successfully authenticated with master master@172.16.10.139:46305
I0927 01:52:53.876085  3597 slave.cpp:1877] Will retry registration in 6.854263ms if necessary
I0927 01:52:53.876240  3595 master.cpp:6605] Received register agent message from slave(807)@172.16.10.139:46305 (ip-172-16-10-139.ec2.internal)
I0927 01:52:53.876320  3595 master.cpp:3964] Authorizing agent providing resources 'cpus:2; mem:1024; disk:1024; ports:[31000-32000]' with principal 'test-principal'
I0927 01:52:53.876463  3596 master.cpp:6672] Authorized registration of agent at slave(807)@172.16.10.139:46305 (ip-172-16-10-139.ec2.internal)
I0927 01:52:53.876518  3596 master.cpp:6787] Registering agent at slave(807)@172.16.10.139:46305 (ip-172-16-10-139.ec2.internal) with id 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0
I0927 01:52:53.876664  3596 registrar.cpp:487] Applied 1 operations in 35891ns; attempting to update the registry
I0927 01:52:53.876829  3592 registrar.cpp:544] Successfully updated the registry in 134912ns
I0927 01:52:53.876889  3592 master.cpp:6835] Admitted agent 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0 at slave(807)@172.16.10.139:46305 (ip-172-16-10-139.ec2.internal)
I0927 01:52:53.877033  3592 master.cpp:6880] Registered agent 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0 at slave(807)@172.16.10.139:46305 (ip-172-16-10-139.ec2.internal) with cpus:2; mem:1024; disk:1024; ports:[31000-32000]
I0927 01:52:53.877130  3596 slave.cpp:1479] Registered with master master@172.16.10.139:46305; given agent ID 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0
I0927 01:52:53.877210  3592 hierarchical.cpp:605] Added agent 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0 (ip-172-16-10-139.ec2.internal) with cpus:2; mem:1024; disk:1024; ports:[31000-32000] (allocated: {})
I0927 01:52:53.877424  3592 hierarchical.cpp:1568] Performed allocation for 1 agents in 118355ns
I0927 01:52:53.877461  3592 task_status_update_manager.cpp:188] Resuming sending task status updates
I0927 01:52:53.877547  3596 slave.cpp:1499] Checkpointing SlaveInfo to '/tmp/DockerVolumeIsolatorTest_ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume_ANTqWz/meta/slaves/1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0/slave.info'
I0927 01:52:53.877568  3592 master.cpp:9468] Sending offers [ 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-O0 ] to framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000 (default) at scheduler-3eb85818-2958-4dc6-80fe-e90114429c0d@172.16.10.139:46305
I0927 01:52:53.877923  3596 slave.cpp:1548] Forwarding agent update {"operations":{},"resource_version_uuid":{"value":"rcW/3E6RRyawQWKEypqKsg=="},"slave_id":{"value":"1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0"},"update_oversubscribed_resources":false}
I0927 01:52:53.878172  3593 master.cpp:7939] Ignoring update on agent 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0 at slave(807)@172.16.10.139:46305 (ip-172-16-10-139.ec2.internal) as it reports no changes
I0927 01:52:53.878315  3592 sched.cpp:914] Scheduler::resourceOffers took 391557ns
I0927 01:52:53.878906  3591 master.cpp:11462] Removing offer 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-O0
I0927 01:52:53.879014  3591 master.cpp:4467] Processing ACCEPT call for offers: [ 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-O0 ] on agent 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0 at slave(807)@172.16.10.139:46305 (ip-172-16-10-139.ec2.internal) for framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000 (default) at scheduler-3eb85818-2958-4dc6-80fe-e90114429c0d@172.16.10.139:46305
I0927 01:52:53.879067  3591 master.cpp:3541] Authorizing framework principal 'test-principal' to launch task 22311eff-7d9a-4bf2-87ad-2d237d665d90
I0927 01:52:53.879521  3593 master.cpp:12209] Adding task 22311eff-7d9a-4bf2-87ad-2d237d665d90 with resources cpus(allocated: *):2; mem(allocated: *):1024; disk(allocated: *):1024; ports(allocated: *):[31000-32000] on agent 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0 at slave(807)@172.16.10.139:46305 (ip-172-16-10-139.ec2.internal)
I0927 01:52:53.879621  3593 master.cpp:5439] Launching task 22311eff-7d9a-4bf2-87ad-2d237d665d90 of framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000 (default) at scheduler-3eb85818-2958-4dc6-80fe-e90114429c0d@172.16.10.139:46305 with resources [{"allocation_info":{"role":"*"},"name":"cpus","scalar":{"value":2.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"mem","scalar":{"value":1024.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"disk","scalar":{"value":1024.0},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"ports","ranges":{"range":[{"begin":31000,"end":32000}]},"type":"RANGES"}] on agent 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0 at slave(807)@172.16.10.139:46305 (ip-172-16-10-139.ec2.internal) on  new executor
I0927 01:52:53.879915  3593 slave.cpp:2014] Got assigned task '22311eff-7d9a-4bf2-87ad-2d237d665d90' for framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000
I0927 01:52:53.880247  3593 slave.cpp:2388] Authorizing task '22311eff-7d9a-4bf2-87ad-2d237d665d90' for framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000
I0927 01:52:53.880290  3593 slave.cpp:8466] Authorizing framework principal 'test-principal' to launch task 22311eff-7d9a-4bf2-87ad-2d237d665d90
I0927 01:52:53.880764  3595 slave.cpp:2831] Launching task '22311eff-7d9a-4bf2-87ad-2d237d665d90' for framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000
I0927 01:52:53.880843  3595 paths.cpp:752] Creating sandbox '/tmp/DockerVolumeIsolatorTest_ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume_ANTqWz/slaves/1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0/frameworks/1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000/executors/22311eff-7d9a-4bf2-87ad-2d237d665d90/runs/29a4b7df-2e87-4317-a8be-95743b98f8d3' for user 'root'
I0927 01:52:53.882277  3595 slave.cpp:8994] Launching executor '22311eff-7d9a-4bf2-87ad-2d237d665d90' of framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000 with resources [{"allocation_info":{"role":"*"},"name":"cpus","scalar":{"value":0.1},"type":"SCALAR"},{"allocation_info":{"role":"*"},"name":"mem","scalar":{"value":32.0},"type":"SCALAR"}] in work directory '/tmp/DockerVolumeIsolatorTest_ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume_ANTqWz/slaves/1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0/frameworks/1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000/executors/22311eff-7d9a-4bf2-87ad-2d237d665d90/runs/29a4b7df-2e87-4317-a8be-95743b98f8d3'
I0927 01:52:53.882508  3595 slave.cpp:3509] Launching container 29a4b7df-2e87-4317-a8be-95743b98f8d3 for executor '22311eff-7d9a-4bf2-87ad-2d237d665d90' of framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000
I0927 01:52:53.882668  3595 slave.cpp:3028] Queued task '22311eff-7d9a-4bf2-87ad-2d237d665d90' for executor '22311eff-7d9a-4bf2-87ad-2d237d665d90' of framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000
I0927 01:52:53.882733  3595 slave.cpp:988] Successfully attached '/tmp/DockerVolumeIsolatorTest_ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume_ANTqWz/slaves/1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0/frameworks/1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000/executors/22311eff-7d9a-4bf2-87ad-2d237d665d90/runs/29a4b7df-2e87-4317-a8be-95743b98f8d3' to virtual path '/tmp/DockerVolumeIsolatorTest_ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume_ANTqWz/slaves/1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0/frameworks/1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000/executors/22311eff-7d9a-4bf2-87ad-2d237d665d90/runs/latest'
I0927 01:52:53.882763  3595 slave.cpp:988] Successfully attached '/tmp/DockerVolumeIsolatorTest_ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume_ANTqWz/slaves/1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0/frameworks/1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000/executors/22311eff-7d9a-4bf2-87ad-2d237d665d90/runs/29a4b7df-2e87-4317-a8be-95743b98f8d3' to virtual path '/frameworks/1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000/executors/22311eff-7d9a-4bf2-87ad-2d237d665d90/runs/latest'
I0927 01:52:53.882778  3595 slave.cpp:988] Successfully attached '/tmp/DockerVolumeIsolatorTest_ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume_ANTqWz/slaves/1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0/frameworks/1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000/executors/22311eff-7d9a-4bf2-87ad-2d237d665d90/runs/29a4b7df-2e87-4317-a8be-95743b98f8d3' to virtual path '/tmp/DockerVolumeIsolatorTest_ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume_ANTqWz/slaves/1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0/frameworks/1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000/executors/22311eff-7d9a-4bf2-87ad-2d237d665d90/runs/29a4b7df-2e87-4317-a8be-95743b98f8d3'
I0927 01:52:53.882962  3592 containerizer.cpp:1280] Starting container 29a4b7df-2e87-4317-a8be-95743b98f8d3
I0927 01:52:53.883229  3591 metadata_manager.cpp:179] Looking for image 'alpine'
I0927 01:52:53.883383  3591 registry_puller.cpp:286] Pulling image 'library/alpine' from 'docker-manifest://registry-1.docker.io:443library/alpine?latest#https' to '/tmp/DockerVolumeIsolatorTest_ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume_HCiJvu/store/docker/staging/fykCZe'
I0927 01:52:54.565984  3596 registry_puller.cpp:314] The manifest for image 'library/alpine' is '{
   "schemaVersion": 1,
   "name": "library/alpine",
   "tag": "latest",
   "architecture": "amd64",
   "fsLayers": [
      {
         "blobSum": "sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4"
      },
      {
         "blobSum": "sha256:4fe2ade4980c2dda4fc95858ebb981489baec8c1e4bd282ab1c3560be8ff9bde"
      }
   ],
   "history": [
      {
         "v1Compatibility": "{\"architecture\":\"amd64\",\"config\":{\"Hostname\":\"\",\"Domainname\":\"\",\"User\":\"\",\"AttachStdin\":false,\"AttachStdout\":false,\"AttachStderr\":false,\"Tty\":false,\"OpenStdin\":false,\"StdinOnce\":false,\"Env\":[\"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin\"],\"Cmd\":[\"/bin/sh\"],\"ArgsEscaped\":true,\"Image\":\"sha256:836dc9b148a584f3f42ac645c7d2bfa11423c1a07a054446314e11259f0e59b7\",\"Volumes\":null,\"WorkingDir\":\"\",\"Entrypoint\":null,\"OnBuild\":null,\"Labels\":null},\"container\":\"cdce86c23e71b41aab0cdb15c010945deadaf59b296f216b0f9f43c331730049\",\"container_config\":{\"Hostname\":\"cdce86c23e71\",\"Domainname\":\"\",\"User\":\"\",\"AttachStdin\":false,\"AttachStdout\":false,\"AttachStderr\":false,\"Tty\":false,\"OpenStdin\":false,\"StdinOnce\":false,\"Env\":[\"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin\"],\"Cmd\":[\"/bin/sh\",\"-c\",\"#(nop) \",\"CMD [\\\"/bin/sh\\\"]\"],\"ArgsEscaped\":true,\"Image\":\"sha256:836dc9b148a584f3f42ac645c7d2bfa11423c1a07a054446314e11259f0e59b7\",\"Volumes\":null,\"WorkingDir\":\"\",\"Entrypoint\":null,\"OnBuild\":null,\"Labels\":{}},\"created\":\"2018-09-11T22:19:50.322783064Z\",\"docker_version\":\"17.06.2-ce\",\"id\":\"f33084b4b6032f9c77744a165174368fa4aed696ac301bfe504fa5533121690f\",\"os\":\"linux\",\"parent\":\"70034ea7817b10a77d60705f61423abcc61b8bb299571494ddbfd4f1f83f46ee\",\"throwaway\":true}"
      },
      {
         "v1Compatibility": "{\"id\":\"70034ea7817b10a77d60705f61423abcc61b8bb299571494ddbfd4f1f83f46ee\",\"created\":\"2018-09-11T22:19:50.165674013Z\",\"container_config\":{\"Cmd\":[\"/bin/sh -c #(nop) ADD file:25c10b1d1b41d46a1827ad0b0d2389c24df6d31430005ff4e9a2d84ea23ebd42 in / \"]}}"
      }
   ],
   "signatures": [
      {
         "header": {
            "jwk": {
               "crv": "P-256",
               "kid": "UIBF:YTZM:EPTX:AOVA:4DZW:XEZS:6T5P:RDLK:JPEO:PKHC:TUAA:FVYG",
               "kty": "EC",
               "x": "RxEVf8J8asVoUVVze-3tx-IXbNY-xxZRk4m5LABp8oA",
               "y": "_MKqmw59-GdyzP2jLeQrM2_6RlqlYrbAht4nrcGT6EQ"
            },
            "alg": "ES256"
         },
         "signature": "h6uzIQ6-1UjCXgNwfyDsOY8c_In7qm-pmvt4IU5raJF9Sg77a0x6uCINlojPR3VNM_0kQOh3h8FOalqPYR92Vw",
         "protected": "eyJmb3JtYXRMZW5ndGgiOjIxNDEsImZvcm1hdFRhaWwiOiJDbjAiLCJ0aW1lIjoiMjAxOC0wOS0yN1QwMTo1Mjo1NFoifQ"
      }
   ]
}'
I0927 01:52:54.566064  3596 registry_puller.cpp:460] Fetching blob 'sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4' for layer 'f33084b4b6032f9c77744a165174368fa4aed696ac301bfe504fa5533121690f' of image 'library/alpine'
I0927 01:52:54.566087  3596 registry_puller.cpp:460] Fetching blob 'sha256:4fe2ade4980c2dda4fc95858ebb981489baec8c1e4bd282ab1c3560be8ff9bde' for layer '70034ea7817b10a77d60705f61423abcc61b8bb299571494ddbfd4f1f83f46ee' of image 'library/alpine'
I0927 01:52:54.774668  3592 hierarchical.cpp:1568] Performed allocation for 1 agents in 105192ns
I0927 01:52:55.776119  3592 hierarchical.cpp:1568] Performed allocation for 1 agents in 54184ns
I0927 01:52:56.776422  3591 hierarchical.cpp:1568] Performed allocation for 1 agents in 46015ns
I0927 01:52:57.776826  3590 hierarchical.cpp:1568] Performed allocation for 1 agents in 48634ns
I0927 01:52:58.777995  3596 hierarchical.cpp:1568] Performed allocation for 1 agents in 46974ns
I0927 01:52:59.779162  3592 hierarchical.cpp:1568] Performed allocation for 1 agents in 47464ns
I0927 01:53:00.780297  3595 hierarchical.cpp:1568] Performed allocation for 1 agents in 47626ns
I0927 01:53:01.780908  3594 hierarchical.cpp:1568] Performed allocation for 1 agents in 48755ns
I0927 01:53:02.781811  3595 hierarchical.cpp:1568] Performed allocation for 1 agents in 48509ns
I0927 01:53:03.782745  3592 hierarchical.cpp:1568] Performed allocation for 1 agents in 48160ns
I0927 01:53:04.783749  3595 hierarchical.cpp:1568] Performed allocation for 1 agents in 49275ns
I0927 01:53:05.784260  3592 hierarchical.cpp:1568] Performed allocation for 1 agents in 47778ns
I0927 01:53:06.784873  3593 hierarchical.cpp:1568] Performed allocation for 1 agents in 47790ns
I0927 01:53:07.785811  3592 hierarchical.cpp:1568] Performed allocation for 1 agents in 47328ns
I0927 01:53:08.786969  3593 hierarchical.cpp:1568] Performed allocation for 1 agents in 48523ns
../../src/tests/containerizer/docker_volume_isolator_tests.cpp:1361: Failure
Failed to wait 15secs for statusStarting
../../src/tests/containerizer/docker_volume_isolator_tests.cpp:1354: Failure
Actual function call count doesn't match EXPECT_CALL(sched, statusUpdate(&driver, _))...
         Expected: to be called 3 times
           Actual: never called - unsatisfied and active
I0927 01:53:08.879714  3592 master.cpp:1366] Framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000 (default) at scheduler-3eb85818-2958-4dc6-80fe-e90114429c0d@172.16.10.139:46305 disconnected
I0927 01:53:08.879751  3592 master.cpp:3230] Deactivating framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000 (default) at scheduler-3eb85818-2958-4dc6-80fe-e90114429c0d@172.16.10.139:46305
I0927 01:53:08.879776  3592 master.cpp:3207] Disconnecting framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000 (default) at scheduler-3eb85818-2958-4dc6-80fe-e90114429c0d@172.16.10.139:46305
I0927 01:53:08.879791  3592 master.cpp:1381] Giving framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000 (default) at scheduler-3eb85818-2958-4dc6-80fe-e90114429c0d@172.16.10.139:46305 0ns to failover
I0927 01:53:08.879876 13860 slave.cpp:909] Agent terminating
I0927 01:53:08.879899 13860 slave.cpp:3896] Asked to shut down framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000 by @0.0.0.0:0
I0927 01:53:08.879912 13860 slave.cpp:3921] Shutting down framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000
I0927 01:53:08.879923 13860 slave.cpp:6640] Shutting down executor '22311eff-7d9a-4bf2-87ad-2d237d665d90' of framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000
W0927 01:53:08.879933 13860 slave.hpp:959] Unable to send event to executor '22311eff-7d9a-4bf2-87ad-2d237d665d90' of framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000: unknown connection type
I0927 01:53:08.879969  3592 hierarchical.cpp:420] Deactivated framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000
I0927 01:53:08.880178  3593 master.cpp:1251] Agent 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0 at slave(807)@172.16.10.139:46305 (ip-172-16-10-139.ec2.internal) disconnected
I0927 01:53:08.880208  3593 master.cpp:3267] Disconnecting agent 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0 at slave(807)@172.16.10.139:46305 (ip-172-16-10-139.ec2.internal)
I0927 01:53:08.880220  3593 master.cpp:3286] Deactivating agent 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0 at slave(807)@172.16.10.139:46305 (ip-172-16-10-139.ec2.internal)
I0927 01:53:08.880241  3593 master.cpp:1275] Removing framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000 (default) at scheduler-3eb85818-2958-4dc6-80fe-e90114429c0d@172.16.10.139:46305 from disconnected agent 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0 at slave(807)@172.16.10.139:46305 (ip-172-16-10-139.ec2.internal) because the framework is not checkpointing
I0927 01:53:08.880254  3593 master.cpp:10373] Removing framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000 (default) at scheduler-3eb85818-2958-4dc6-80fe-e90114429c0d@172.16.10.139:46305 from agent 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0 at slave(807)@172.16.10.139:46305 (ip-172-16-10-139.ec2.internal)
I0927 01:53:08.880295  3597 hierarchical.cpp:803] Agent 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0 deactivated
I0927 01:53:08.880420  3596 containerizer.cpp:2455] Destroying container 29a4b7df-2e87-4317-a8be-95743b98f8d3 in PROVISIONING state
I0927 01:53:08.880441  3596 containerizer.cpp:3118] Transitioning the state of container 29a4b7df-2e87-4317-a8be-95743b98f8d3 from PROVISIONING to DESTROYING
I0927 01:53:08.880486  3596 containerizer.cpp:2517] Waiting for the provisioner to complete provisioning before destroying container 29a4b7df-2e87-4317-a8be-95743b98f8d3
I0927 01:53:08.880295  3593 master.cpp:10932] Updating the state of task 22311eff-7d9a-4bf2-87ad-2d237d665d90 of framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000 (latest state: TASK_LOST, status update state: TASK_LOST)
I0927 01:53:08.880672  3593 master.cpp:11030] Removing task 22311eff-7d9a-4bf2-87ad-2d237d665d90 with resources cpus(allocated: *):2; mem(allocated: *):1024; disk(allocated: *):1024; ports(allocated: *):[31000-32000] of framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000 on agent 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0 at slave(807)@172.16.10.139:46305 (ip-172-16-10-139.ec2.internal)
I0927 01:53:08.880687  3592 hierarchical.cpp:1240] Recovered cpus(allocated: *):2; mem(allocated: *):1024; disk(allocated: *):1024; ports(allocated: *):[31000-32000] (total: cpus:2; mem:1024; disk:1024; ports:[31000-32000], allocated: {}) on agent 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0 from framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000
I0927 01:53:08.881211  3591 master.cpp:9261] Framework failover timeout, removing framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000 (default) at scheduler-3eb85818-2958-4dc6-80fe-e90114429c0d@172.16.10.139:46305
I0927 01:53:08.881234  3591 master.cpp:10197] Removing framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000 (default) at scheduler-3eb85818-2958-4dc6-80fe-e90114429c0d@172.16.10.139:46305
I0927 01:53:08.881389  3597 hierarchical.cpp:359] Removed framework 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-0000
I0927 01:53:09.787252  3592 hierarchical.cpp:1568] Performed allocation for 1 agents in 17214ns
I0927 01:53:10.788175  3591 hierarchical.cpp:1568] Performed allocation for 1 agents in 16239ns
I0927 01:53:11.788573  3597 hierarchical.cpp:1568] Performed allocation for 1 agents in 16448ns
I0927 01:53:12.789023  3593 hierarchical.cpp:1568] Performed allocation for 1 agents in 16249ns
I0927 01:53:13.789229  3590 hierarchical.cpp:1568] Performed allocation for 1 agents in 15883ns
I0927 01:53:14.789963  3595 hierarchical.cpp:1568] Performed allocation for 1 agents in 16928ns
I0927 01:53:15.790400  3596 hierarchical.cpp:1568] Performed allocation for 1 agents in 17415ns
I0927 01:53:16.790920  3594 hierarchical.cpp:1568] Performed allocation for 1 agents in 17360ns
I0927 01:53:17.791153  3592 hierarchical.cpp:1568] Performed allocation for 1 agents in 17510ns
I0927 01:53:18.791674  3591 hierarchical.cpp:1568] Performed allocation for 1 agents in 17340ns
I0927 01:53:19.792531  3594 hierarchical.cpp:1568] Performed allocation for 1 agents in 17180ns
I0927 01:53:20.793000  3592 hierarchical.cpp:1568] Performed allocation for 1 agents in 17611ns
I0927 01:53:21.793212  3591 hierarchical.cpp:1568] Performed allocation for 1 agents in 16937ns
I0927 01:53:22.793951  3597 hierarchical.cpp:1568] Performed allocation for 1 agents in 17633ns
I0927 01:53:23.794147  3593 hierarchical.cpp:1568] Performed allocation for 1 agents in 16896ns
../../src/tests/cluster.cpp:680: Failure
Failed to wait 15secs for termination
../../src/tests/containerizer/docker_volume_isolator_tests.cpp:1346: Failure
Actual function call count doesn't match EXPECT_CALL(*mockClient, unmount(_driver, _))...
         Expected: to be called once
           Actual: never called - unsatisfied and active
../../src/tests/containerizer/docker_volume_isolator_tests.cpp:1339: Failure
Actual function call count doesn't match EXPECT_CALL(*mockClient, mount(_driver, _, _))...
         Expected: to be called once
           Actual: never called - unsatisfied and active
I0927 01:53:23.883563 13860 master.cpp:1093] Master terminating
I0927 01:53:23.883810  3595 hierarchical.cpp:645] Removed agent 1c890578-e87d-41a2-bb4c-5ed9b7e0d8ec-S0
[  FAILED  ] DockerVolumeIsolatorTest.ROOT_INTERNET_CURL_CommandTaskRootfsWithReadOnlyVolume (30116 ms)
{noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)