You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@mesos.apache.org by "Alexander Rukletsov (JIRA)" <ji...@apache.org> on 2017/10/04 16:14:00 UTC

[jira] [Updated] (MESOS-7082) ROOT_DOCKER_DockerAndMesosContainerizers/DefaultExecutorTest.KillTask/0 is flaky.

     [ https://issues.apache.org/jira/browse/MESOS-7082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alexander Rukletsov updated MESOS-7082:
---------------------------------------
    Summary: ROOT_DOCKER_DockerAndMesosContainerizers/DefaultExecutorTest.KillTask/0 is flaky.  (was: ROOT_DOCKER_DockerAndMesosContainerizers/DefaultExecutorTest.KillTask/0 is flaky)

> ROOT_DOCKER_DockerAndMesosContainerizers/DefaultExecutorTest.KillTask/0 is flaky.
> ---------------------------------------------------------------------------------
>
>                 Key: MESOS-7082
>                 URL: https://issues.apache.org/jira/browse/MESOS-7082
>             Project: Mesos
>          Issue Type: Bug
>    Affects Versions: 1.2.0
>         Environment: ubuntu 16.04 with/without SSL
> Fedora 23
>            Reporter: Anand Mazumdar
>            Priority: Critical
>              Labels: flaky, flaky-test, mesosphere
>
> Showed up on our internal CI
> {noformat}
> 07:00:17 [ RUN      ] ROOT_DOCKER_DockerAndMesosContainerizers/DefaultExecutorTest.KillTask/0
> 07:00:17 I0207 07:00:17.775459  2952 cluster.cpp:160] Creating default 'local' authorizer
> 07:00:17 I0207 07:00:17.776511  2970 master.cpp:383] Master fa1554c4-572a-4b89-8994-a89460f588d3 (ip-10-153-254-29.ec2.internal) started on 10.153.254.29:38570
> 07:00:17 I0207 07:00:17.776538  2970 master.cpp:385] Flags at startup: --acls="" --agent_ping_timeout="15secs" --agent_reregister_timeout="10mins" --allocation_interval="1secs" --allocator="HierarchicalDRF" --authenticate_agents="true" --authenticate_frameworks="true" --authenticate_http_frameworks="true" --authenticate_http_readonly="true" --authenticate_http_readwrite="true" --authenticators="crammd5" --authorizers="local" --credentials="/tmp/ZROfJk/credentials" --framework_sorter="drf" --help="false" --hostname_lookup="true" --http_authenticators="basic" --http_framework_authenticators="basic" --initialize_driver_logging="true" --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5" --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000" --max_unreachable_tasks_per_framework="1000" --quiet="false" --recovery_agent_removal_limit="100%" --registry="in_memory" --registry_fetch_timeout="1mins" --registry_gc_interval="15mins" --registry_max_agent_age="2weeks" --registry_max_agent_count="102400" --registry_store_timeout="100secs" --registry_strict="false" --root_submissions="true" --user_sorter="drf" --version="false" --webui_dir="/usr/local/share/mesos/webui" --work_dir="/tmp/ZROfJk/master" --zk_session_timeout="10secs"
> 07:00:17 I0207 07:00:17.776674  2970 master.cpp:435] Master only allowing authenticated frameworks to register
> 07:00:17 I0207 07:00:17.776687  2970 master.cpp:449] Master only allowing authenticated agents to register
> 07:00:17 I0207 07:00:17.776695  2970 master.cpp:462] Master only allowing authenticated HTTP frameworks to register
> 07:00:17 I0207 07:00:17.776703  2970 credentials.hpp:37] Loading credentials for authentication from '/tmp/ZROfJk/credentials'
> 07:00:17 I0207 07:00:17.776779  2970 master.cpp:507] Using default 'crammd5' authenticator
> 07:00:17 I0207 07:00:17.776841  2970 http.cpp:919] Using default 'basic' HTTP authenticator for realm 'mesos-master-readonly'
> 07:00:17 I0207 07:00:17.776919  2970 http.cpp:919] Using default 'basic' HTTP authenticator for realm 'mesos-master-readwrite'
> 07:00:17 I0207 07:00:17.776970  2970 http.cpp:919] Using default 'basic' HTTP authenticator for realm 'mesos-master-scheduler'
> 07:00:17 I0207 07:00:17.777009  2970 master.cpp:587] Authorization enabled
> 07:00:17 I0207 07:00:17.777122  2975 hierarchical.cpp:161] Initialized hierarchical allocator process
> 07:00:17 I0207 07:00:17.777138  2974 whitelist_watcher.cpp:77] No whitelist given
> 07:00:17 I0207 07:00:17.777704  2976 master.cpp:2123] Elected as the leading master!
> 07:00:17 I0207 07:00:17.777726  2976 master.cpp:1645] Recovering from registrar
> 07:00:17 I0207 07:00:17.777784  2975 registrar.cpp:329] Recovering registrar
> 07:00:17 I0207 07:00:17.777989  2973 registrar.cpp:362] Successfully fetched the registry (0B) in 176384ns
> 07:00:17 I0207 07:00:17.778023  2973 registrar.cpp:461] Applied 1 operations in 7573ns; attempting to update the registry
> 07:00:17 I0207 07:00:17.778249  2976 registrar.cpp:506] Successfully updated the registry in 210944ns
> 07:00:17 I0207 07:00:17.778290  2976 registrar.cpp:392] Successfully recovered registrar
> 07:00:17 I0207 07:00:17.778373  2976 master.cpp:1761] Recovered 0 agents from the registry (172B); allowing 10mins for agents to re-register
> 07:00:17 I0207 07:00:17.778394  2974 hierarchical.cpp:188] Skipping recovery of hierarchical allocator: nothing to recover
> 07:00:17 I0207 07:00:17.869381  2952 containerizer.cpp:220] Using isolation: posix/cpu,posix/mem,filesystem/posix,network/cni
> 07:00:17 I0207 07:00:17.872557  2952 linux_launcher.cpp:150] Using /sys/fs/cgroup/freezer as the freezer hierarchy for the Linux launcher
> 07:00:17 I0207 07:00:17.872915  2952 provisioner.cpp:249] Using default backend 'overlay'
> 07:00:17 I0207 07:00:17.873425  2952 cluster.cpp:446] Creating default 'local' authorizer
> 07:00:17 I0207 07:00:17.873791  2974 slave.cpp:211] Mesos agent started on (716)@10.153.254.29:38570
> 07:00:17 I0207 07:00:17.874034  2952 scheduler.cpp:184] Version: 1.2.0
> 07:00:17 I0207 07:00:17.873829  2974 slave.cpp:212] Flags at startup: --acls="" --appc_simple_discovery_uri_prefix="http://" --appc_store_dir="/tmp/mesos/store/appc" --authenticate_http_readonly="true" --authenticate_http_readwrite="false" --authenticatee="crammd5" --authentication_backoff_factor="1secs" --authorizer="local" --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false" --cgroups_root="mesos" --container_disk_watch_interval="15secs" --containerizers="docker,mesos" --credential="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/credential" --default_role="*" --disk_watch_interval="1mins" --docker="docker" --docker_kill_orphans="true" --docker_registry="https://registry-1.docker.io" --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns" --docker_store_dir="/tmp/mesos/store/docker" --docker_volume_checkpoint_dir="/var/run/mesos/isolators/docker/volume" --enforce_container_disk_quota="false" --executor_registration_timeout="1mins" --executor_shutdown_grace_period="5secs" --fetcher_cache_dir="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/fetch" --fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks" --gc_disk_headroom="0.1" --hadoop_home="" --help="false" --hostname_lookup="true" --http_authenticators="basic" --http_command_executor="false" --http_credentials="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/http_credentials" --http_heartbeat_interval="30secs" --initialize_driver_logging="true" --isolation="posix/cpu,posix/mem" --launcher="linux" --launcher_dir="/home/ubuntu/workspace/mesos/Mesos_CI-build/FLAG/Clang/label/mesos-ec2-ubuntu-16.04/mesos/build/src" --logbufsecs="0" --logging_level="INFO" --max_completed_executors_per_framework="150" --oversubscribed_resources_interval="15secs" --perf_duration="10secs" --perf_interval="1mins" --qos_correction_interval_min="0ns" --quiet="false" --recover="reconnect" --recovery_timeout="15mins" --registration_backoff_factor="10ms" --resources="cpus:2;gpus:0;mem:1024;disk:1024;ports:[31000-32000]" --revocable_cpu_low_priority="true" --runtime_dir="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO" --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true" --systemd_enable_support="true" --systemd_runtime_directory="/run/systemd/system" --version="false" --work_dir="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4"
> 07:00:17 I0207 07:00:17.874168  2974 credentials.hpp:86] Loading credential for authentication from '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/credential'
> 07:00:17 I0207 07:00:17.874236  2974 slave.cpp:354] Agent using credential for: test-principal
> 07:00:17 I0207 07:00:17.874258  2974 credentials.hpp:37] Loading credentials for authentication from '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/http_credentials'
> 07:00:17 I0207 07:00:17.874331  2974 http.cpp:919] Using default 'basic' HTTP authenticator for realm 'mesos-agent-readonly'
> 07:00:17 I0207 07:00:17.874583  2976 scheduler.cpp:470] New master detected at master@10.153.254.29:38570
> 07:00:17 I0207 07:00:17.874610  2976 scheduler.cpp:479] Waiting for 0ns before initiating a re-(connection) attempt with the master
> 07:00:17 I0207 07:00:17.874836  2974 slave.cpp:541] Agent resources: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000]
> 07:00:17 I0207 07:00:17.874873  2974 slave.cpp:549] Agent attributes: [  ]
> 07:00:17 I0207 07:00:17.874881  2974 slave.cpp:554] Agent hostname: ip-10-153-254-29.ec2.internal
> 07:00:17 I0207 07:00:17.874991  2970 status_update_manager.cpp:177] Pausing sending status updates
> 07:00:17 I0207 07:00:17.875248  2972 state.cpp:62] Recovering state from '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/meta'
> 07:00:17 I0207 07:00:17.875445  2971 status_update_manager.cpp:203] Recovering status update manager
> 07:00:17 I0207 07:00:17.875591  2972 containerizer.cpp:599] Recovering containerizer
> 07:00:17 I0207 07:00:17.875604  2977 docker.cpp:868] Recovering Docker containers
> 07:00:17 I0207 07:00:17.875658  2977 docker.cpp:1139] Running docker -H unix:///var/run/docker.sock ps -a
> 07:00:17 I0207 07:00:17.879174  2973 scheduler.cpp:361] Connected with the master at http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:17 I0207 07:00:17.879809  2976 provisioner.cpp:410] Provisioner recovery complete
> 07:00:17 I0207 07:00:17.879889  2971 scheduler.cpp:243] Sending SUBSCRIBE call to http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:17 I0207 07:00:17.880321  2976 process.cpp:3704] Handling HTTP event for process 'master' with path: '/master/api/v1/scheduler'
> 07:00:17 I0207 07:00:17.880755  2972 http.cpp:420] HTTP POST for /master/api/v1/scheduler from 10.153.254.29:44396
> 07:00:17 I0207 07:00:17.880834  2972 master.cpp:2422] Received subscription request for HTTP framework 'default'
> 07:00:17 I0207 07:00:17.880857  2972 master.cpp:2159] Authorizing framework principal 'test-principal' to receive offers for role '*'
> 07:00:17 I0207 07:00:17.881100  2977 master.cpp:2536] Subscribing framework 'default' with checkpointing disabled and capabilities [  ]
> 07:00:17 I0207 07:00:17.881320  2976 master.hpp:2114] Sending heartbeat to fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:17 I0207 07:00:17.881291  2973 hierarchical.cpp:286] Added framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:17 I0207 07:00:17.881448  2973 hierarchical.cpp:1817] No allocations performed
> 07:00:17 I0207 07:00:17.881471  2973 hierarchical.cpp:1907] No inverse offers to send out!
> 07:00:17 I0207 07:00:17.881480  2973 hierarchical.cpp:1401] Performed allocation for 0 agents in 47645ns
> 07:00:17 I0207 07:00:17.881830  2972 scheduler.cpp:676] Enqueuing event SUBSCRIBED received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:17 I0207 07:00:17.882037  2972 scheduler.cpp:676] Enqueuing event HEARTBEAT received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:17.970202  2975 slave.cpp:5499] Finished recovery
> 07:00:18 I0207 07:00:17.970434  2975 slave.cpp:5673] Querying resource estimator for oversubscribable resources
> 07:00:18 I0207 07:00:17.970556  2975 slave.cpp:931] New master detected at master@10.153.254.29:38570
> 07:00:18 I0207 07:00:17.970564  2973 status_update_manager.cpp:177] Pausing sending status updates
> 07:00:18 I0207 07:00:17.970598  2975 slave.cpp:966] Detecting new master
> 07:00:18 I0207 07:00:17.970636  2975 slave.cpp:5687] Received oversubscribable resources {} from the resource estimator
> 07:00:18 I0207 07:00:17.976898  2970 slave.cpp:993] Authenticating with master master@10.153.254.29:38570
> 07:00:18 I0207 07:00:17.976929  2970 slave.cpp:1004] Using default CRAM-MD5 authenticatee
> 07:00:18 I0207 07:00:17.977015  2974 authenticatee.cpp:121] Creating new client SASL connection
> 07:00:18 I0207 07:00:17.977448  2974 master.cpp:7103] Authenticating slave(716)@10.153.254.29:38570
> 07:00:18 I0207 07:00:17.977509  2975 authenticator.cpp:414] Starting authentication session for crammd5-authenticatee(1366)@10.153.254.29:38570
> 07:00:18 I0207 07:00:17.977602  2976 authenticator.cpp:98] Creating new server SASL connection
> 07:00:18 I0207 07:00:17.977922  2976 authenticatee.cpp:213] Received SASL authentication mechanisms: CRAM-MD5
> 07:00:18 I0207 07:00:17.977954  2976 authenticatee.cpp:239] Attempting to authenticate with mechanism 'CRAM-MD5'
> 07:00:18 I0207 07:00:17.977998  2976 authenticator.cpp:204] Received SASL authentication start
> 07:00:18 I0207 07:00:17.978061  2976 authenticator.cpp:326] Authentication requires more steps
> 07:00:18 I0207 07:00:17.978106  2976 authenticatee.cpp:259] Received SASL authentication step
> 07:00:18 I0207 07:00:17.978184  2974 authenticator.cpp:232] Received SASL authentication step
> 07:00:18 I0207 07:00:17.978210  2974 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'ip-10-153-254-29.ec2.internal' server FQDN: 'ip-10-153-254-29.ec2.internal' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: false 
> 07:00:18 I0207 07:00:17.978219  2974 auxprop.cpp:181] Looking up auxiliary property '*userPassword'
> 07:00:18 I0207 07:00:17.978227  2974 auxprop.cpp:181] Looking up auxiliary property '*cmusaslsecretCRAM-MD5'
> 07:00:18 I0207 07:00:17.978235  2974 auxprop.cpp:109] Request to lookup properties for user: 'test-principal' realm: 'ip-10-153-254-29.ec2.internal' server FQDN: 'ip-10-153-254-29.ec2.internal' SASL_AUXPROP_VERIFY_AGAINST_HASH: false SASL_AUXPROP_OVERRIDE: false SASL_AUXPROP_AUTHZID: true 
> 07:00:18 I0207 07:00:17.978238  2974 auxprop.cpp:131] Skipping auxiliary property '*userPassword' since SASL_AUXPROP_AUTHZID == true
> 07:00:18 I0207 07:00:17.978243  2974 auxprop.cpp:131] Skipping auxiliary property '*cmusaslsecretCRAM-MD5' since SASL_AUXPROP_AUTHZID == true
> 07:00:18 I0207 07:00:17.978252  2974 authenticator.cpp:318] Authentication success
> 07:00:18 I0207 07:00:17.978297  2973 authenticatee.cpp:299] Authentication success
> 07:00:18 I0207 07:00:17.978324  2974 master.cpp:7133] Successfully authenticated principal 'test-principal' at slave(716)@10.153.254.29:38570
> 07:00:18 I0207 07:00:17.978356  2972 authenticator.cpp:432] Authentication session cleanup for crammd5-authenticatee(1366)@10.153.254.29:38570
> 07:00:18 I0207 07:00:17.978426  2975 slave.cpp:1088] Successfully authenticated with master master@10.153.254.29:38570
> 07:00:18 I0207 07:00:17.978520  2975 slave.cpp:1515] Will retry registration in 19.358366ms if necessary
> 07:00:18 I0207 07:00:17.978575  2973 master.cpp:5318] Registering agent at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) with id fa1554c4-572a-4b89-8994-a89460f588d3-S0
> 07:00:18 I0207 07:00:17.978699  2976 registrar.cpp:461] Applied 1 operations in 24121ns; attempting to update the registry
> 07:00:18 I0207 07:00:17.979012  2974 registrar.cpp:506] Successfully updated the registry in 280832ns
> 07:00:18 I0207 07:00:17.979252  2973 slave.cpp:4301] Received ping from slave-observer(652)@10.153.254.29:38570
> 07:00:18 I0207 07:00:17.979238  2976 master.cpp:5392] Registered agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) with cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000]
> 07:00:18 I0207 07:00:17.979311  2973 slave.cpp:1134] Registered with master master@10.153.254.29:38570; given agent ID fa1554c4-572a-4b89-8994-a89460f588d3-S0
> 07:00:18 I0207 07:00:17.979312  2974 hierarchical.cpp:515] Added agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 (ip-10-153-254-29.ec2.internal) with cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] (allocated: {})
> 07:00:18 I0207 07:00:17.979336  2973 fetcher.cpp:90] Clearing fetcher cache
> 07:00:18 I0207 07:00:17.979425  2977 status_update_manager.cpp:184] Resuming sending status updates
> 07:00:18 I0207 07:00:17.979490  2973 slave.cpp:1162] Checkpointing SlaveInfo to '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/meta/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/slave.info'
> 07:00:18 I0207 07:00:17.979542  2974 hierarchical.cpp:1907] No inverse offers to send out!
> 07:00:18 I0207 07:00:17.979562  2974 hierarchical.cpp:1401] Performed allocation for 1 agents in 198598ns
> 07:00:18 I0207 07:00:17.979625  2973 slave.cpp:1200] Forwarding total oversubscribed resources {}
> 07:00:18 I0207 07:00:17.979665  2970 master.cpp:6932] Sending 1 offers to framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:18 I0207 07:00:17.979815  2970 master.cpp:5949] Received update of agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) with total oversubscribed resources {}
> 07:00:18 I0207 07:00:17.979897  2970 hierarchical.cpp:588] Agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 (ip-10-153-254-29.ec2.internal) updated with oversubscribed resources {} (total: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000], allocated: cpus(*)(allocated: *):2; mem(*)(allocated: *):1024; disk(*)(allocated: *):1024; ports(*)(allocated: *):[31000-32000])
> 07:00:18 I0207 07:00:17.979951  2970 hierarchical.cpp:1817] No allocations performed
> 07:00:18 I0207 07:00:17.980002  2970 hierarchical.cpp:1907] No inverse offers to send out!
> 07:00:18 I0207 07:00:17.980016  2970 hierarchical.cpp:1401] Performed allocation for 1 agents in 83177ns
> 07:00:18 I0207 07:00:17.980195  2974 scheduler.cpp:676] Enqueuing event OFFERS received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:17.980867  2970 scheduler.cpp:243] Sending ACCEPT call to http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:17.981184  2973 process.cpp:3704] Handling HTTP event for process 'master' with path: '/master/api/v1/scheduler'
> 07:00:18 I0207 07:00:17.981575  2976 http.cpp:420] HTTP POST for /master/api/v1/scheduler from 10.153.254.29:44398
> 07:00:18 I0207 07:00:17.981762  2976 master.cpp:3745] Processing ACCEPT call for offers: [ fa1554c4-572a-4b89-8994-a89460f588d3-O0 ] on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) for framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:18 I0207 07:00:17.981812  2976 master.cpp:3318] Authorizing framework principal 'test-principal' to launch task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb
> 07:00:18 I0207 07:00:17.981945  2976 master.cpp:3318] Authorizing framework principal 'test-principal' to launch task c24a618d-ce08-4784-b8c7-0eeda79d121b
> 07:00:18 I0207 07:00:17.982826  2976 master.cpp:8993] Adding task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb with resources cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal)
> 07:00:18 I0207 07:00:17.982899  2976 master.cpp:8993] Adding task c24a618d-ce08-4784-b8c7-0eeda79d121b with resources cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal)
> 07:00:18 I0207 07:00:17.982950  2976 master.cpp:4600] Launching task group { 16b247b5-e1dd-4395-a2d7-71c9c393e5bb, c24a618d-ce08-4784-b8c7-0eeda79d121b } of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) with resources cpus(*)(allocated: *):0.2; mem(*)(allocated: *):64; disk(*)(allocated: *):64 on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal)
> 07:00:18 I0207 07:00:17.983122  2977 slave.cpp:1583] Got assigned task group containing tasks [ 16b247b5-e1dd-4395-a2d7-71c9c393e5bb, c24a618d-ce08-4784-b8c7-0eeda79d121b ] for framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:17.983191  2973 hierarchical.cpp:1079] Recovered cpus(*)(allocated: *):1.7; mem(*)(allocated: *):928; disk(*)(allocated: *):928; ports(*)(allocated: *):[31000-32000] (total: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000], allocated: cpus(*)(allocated: *):0.3; mem(*)(allocated: *):96; disk(*)(allocated: *):96) on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 from framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:17.983423  2977 slave.cpp:1743] Launching task group containing tasks [ 16b247b5-e1dd-4395-a2d7-71c9c393e5bb, c24a618d-ce08-4784-b8c7-0eeda79d121b ] for framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:17.983650  2977 paths.cpp:547] Trying to chown '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974' to user 'root'
> 07:00:18 I0207 07:00:17.983779  2977 slave.cpp:6414] Launching executor 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 with resources cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 in work directory '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974'
> 07:00:18 I0207 07:00:17.983988  2977 slave.cpp:2073] Queued task group containing tasks [ 16b247b5-e1dd-4395-a2d7-71c9c393e5bb, c24a618d-ce08-4784-b8c7-0eeda79d121b ] for executor 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:17.984022  2974 docker.cpp:1099] No container info found, skipping launch
> 07:00:18 I0207 07:00:17.984032  2977 slave.cpp:884] Successfully attached file '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974'
> 07:00:18 I0207 07:00:17.984192  2975 containerizer.cpp:992] Starting container 4cfc866d-9fef-442b-8682-58dabb305974 for executor 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:17.985002  2976 containerizer.cpp:1538] Launching 'mesos-containerizer' with flags '--help="false" --launch_info="{"command":{"arguments":["mesos-default-executor","--launcher_dir=\/home\/ubuntu\/workspace\/mesos\/Mesos_CI-build\/FLAG\/Clang\/label\/mesos-ec2-ubuntu-16.04\/mesos\/build\/src"],"shell":false,"value":"\/home\/ubuntu\/workspace\/mesos\/Mesos_CI-build\/FLAG\/Clang\/label\/mesos-ec2-ubuntu-16.04\/mesos\/build\/src\/mesos-default-executor"},"environment":{"variables":[{"name":"LIBPROCESS_PORT","value":"0"},{"name":"MESOS_AGENT_ENDPOINT","value":"10.153.254.29:38570"},{"name":"MESOS_CHECKPOINT","value":"0"},{"name":"MESOS_DIRECTORY","value":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974"},{"name":"MESOS_EXECUTOR_ID","value":"default"},{"name":"MESOS_EXECUTOR_SHUTDOWN_GRACE_PERIOD","value":"5secs"},{"name":"MESOS_FRAMEWORK_ID","value":"fa1554c4-572a-4b89-8994-a89460f588d3-0000"},{"name":"MESOS_HTTP_COMMAND_EXECUTOR","value":"0"},{"name":"MESOS_SLAVE_ID","value":"fa1554c4-572a-4b89-8994-a89460f588d3-S0"},{"name":"MESOS_SLAVE_PID","value":"slave(716)@10.153.254.29:38570"},{"name":"MESOS_SANDBOX","value":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974"}]},"user":"root","working_directory":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974"}" --pipe_read="30" --pipe_write="31" --runtime_directory="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/containers/4cfc866d-9fef-442b-8682-58dabb305974" --unshare_namespace_mnt="false"'
> 07:00:18 I0207 07:00:17.985275  2970 linux_launcher.cpp:429] Launching container 4cfc866d-9fef-442b-8682-58dabb305974 and cloning with namespaces 
> 07:00:18 I0207 07:00:18.011076  2973 fetcher.cpp:349] Starting to fetch URIs for container: 4cfc866d-9fef-442b-8682-58dabb305974, directory: /tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974
> 07:00:18 I0207 07:00:18.076251 29005 executor.cpp:192] Version: 1.2.0
> 07:00:18 I0207 07:00:18.078815  2974 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1/executor'
> 07:00:18 I0207 07:00:18.079205  2975 http.cpp:303] HTTP POST for /slave(716)/api/v1/executor from 10.153.254.29:44400
> 07:00:18 I0207 07:00:18.079286  2975 slave.cpp:3124] Received Subscribe request for HTTP executor 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.080021  2970 slave.cpp:2315] Sending queued task group task group containing tasks [ 16b247b5-e1dd-4395-a2d7-71c9c393e5bb, c24a618d-ce08-4784-b8c7-0eeda79d121b ] to executor 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (via HTTP)
> 07:00:18 I0207 07:00:18.080541 29024 default_executor.cpp:153] Received SUBSCRIBED event
> 07:00:18 I0207 07:00:18.082542 29024 default_executor.cpp:157] Subscribed executor on ip-10-153-254-29.ec2.internal
> 07:00:18 I0207 07:00:18.082628 29024 default_executor.cpp:153] Received LAUNCH_GROUP event
> 07:00:18 I0207 07:00:18.083161  2975 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1'
> 07:00:18 I0207 07:00:18.083336  2975 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1'
> 07:00:18 I0207 07:00:18.083618  2976 http.cpp:303] HTTP POST for /slave(716)/api/v1 from 10.153.254.29:44404
> 07:00:18 I0207 07:00:18.083688  2976 http.cpp:303] HTTP POST for /slave(716)/api/v1 from 10.153.254.29:44404
> 07:00:18 I0207 07:00:18.083775  2976 http.cpp:517] Processing call LAUNCH_NESTED_CONTAINER
> 07:00:18 I0207 07:00:18.083876  2976 http.cpp:517] Processing call LAUNCH_NESTED_CONTAINER
> 07:00:18 I0207 07:00:18.084066  2972 containerizer.cpp:1805] Starting nested container 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338
> 07:00:18 I0207 07:00:18.084185  2972 containerizer.cpp:1829] Trying to chown '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974/containers/966d71b2-cbc7-40a6-accf-bef80d3d8338' to user 'root'
> 07:00:18 I0207 07:00:18.084568  2972 containerizer.cpp:1805] Starting nested container 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e
> 07:00:18 I0207 07:00:18.084655  2972 containerizer.cpp:1829] Trying to chown '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974/containers/486b0abc-966d-49b7-b2e0-58cd1d4b462e' to user 'root'
> 07:00:18 I0207 07:00:18.085088  2972 containerizer.cpp:1538] Launching 'mesos-containerizer' with flags '--help="false" --launch_info="{"command":{"shell":true,"value":"sleep 1000"},"environment":{"variables":[{"name":"MESOS_SANDBOX","value":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974\/containers\/966d71b2-cbc7-40a6-accf-bef80d3d8338"}]},"user":"root","working_directory":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974\/containers\/966d71b2-cbc7-40a6-accf-bef80d3d8338"}" --pipe_read="57" --pipe_write="76" --runtime_directory="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/containers/4cfc866d-9fef-442b-8682-58dabb305974/containers/966d71b2-cbc7-40a6-accf-bef80d3d8338" --unshare_namespace_mnt="false"'
> 07:00:18 I0207 07:00:18.085297  2976 linux_launcher.cpp:429] Launching nested container 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338 and cloning with namespaces 
> 07:00:18 I0207 07:00:18.114851  2972 containerizer.cpp:1538] Launching 'mesos-containerizer' with flags '--help="false" --launch_info="{"command":{"shell":true,"value":"sleep 1000"},"environment":{"variables":[{"name":"MESOS_SANDBOX","value":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974\/containers\/486b0abc-966d-49b7-b2e0-58cd1d4b462e"}]},"user":"root","working_directory":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974\/containers\/486b0abc-966d-49b7-b2e0-58cd1d4b462e"}" --pipe_read="77" --pipe_write="78" --runtime_directory="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/containers/4cfc866d-9fef-442b-8682-58dabb305974/containers/486b0abc-966d-49b7-b2e0-58cd1d4b462e" --unshare_namespace_mnt="false"'
> 07:00:18 I0207 07:00:18.115092  2974 linux_launcher.cpp:429] Launching nested container 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e and cloning with namespaces 
> 07:00:18 I0207 07:00:18.124974  2970 fetcher.cpp:349] Starting to fetch URIs for container: 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338, directory: /tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974/containers/966d71b2-cbc7-40a6-accf-bef80d3d8338
> 07:00:18 I0207 07:00:18.126298  2970 fetcher.cpp:349] Starting to fetch URIs for container: 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e, directory: /tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974/containers/486b0abc-966d-49b7-b2e0-58cd1d4b462e
> 07:00:18 I0207 07:00:18.129250 29022 default_executor.cpp:469] Successfully launched tasks [ 16b247b5-e1dd-4395-a2d7-71c9c393e5bb, c24a618d-ce08-4784-b8c7-0eeda79d121b ] in child containers [ 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338, 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e ]
> 07:00:18 I0207 07:00:18.130044 29019 default_executor.cpp:542] Waiting for child container 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338 of task '16b247b5-e1dd-4395-a2d7-71c9c393e5bb'
> 07:00:18 I0207 07:00:18.130199 29019 default_executor.cpp:542] Waiting for child container 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e of task 'c24a618d-ce08-4784-b8c7-0eeda79d121b'
> 07:00:18 I0207 07:00:18.130437  2975 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1/executor'
> 07:00:18 I0207 07:00:18.130678  2975 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1/executor'
> 07:00:18 I0207 07:00:18.130791  2975 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1'
> 07:00:18 I0207 07:00:18.130939  2975 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1'
> 07:00:18 I0207 07:00:18.131260  2973 http.cpp:303] HTTP POST for /slave(716)/api/v1 from 10.153.254.29:44408
> 07:00:18 I0207 07:00:18.131341  2973 http.cpp:303] HTTP POST for /slave(716)/api/v1/executor from 10.153.254.29:44402
> 07:00:18 I0207 07:00:18.131402  2973 slave.cpp:3771] Handling status update TASK_RUNNING (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.131579  2973 http.cpp:303] HTTP POST for /slave(716)/api/v1 from 10.153.254.29:44406
> 07:00:18 I0207 07:00:18.131680  2973 http.cpp:303] HTTP POST for /slave(716)/api/v1/executor from 10.153.254.29:44402
> 07:00:18 I0207 07:00:18.131752  2973 slave.cpp:3771] Handling status update TASK_RUNNING (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.132120  2973 http.cpp:517] Processing call WAIT_NESTED_CONTAINER
> 07:00:18 I0207 07:00:18.132252  2973 http.cpp:517] Processing call WAIT_NESTED_CONTAINER
> 07:00:18 I0207 07:00:18.132444  2976 status_update_manager.cpp:323] Received status update TASK_RUNNING (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.132472  2976 status_update_manager.cpp:500] Creating StatusUpdate stream for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.132637  2976 status_update_manager.cpp:377] Forwarding update TASK_RUNNING (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to the agent
> 07:00:18 I0207 07:00:18.132741  2973 slave.cpp:4211] Forwarding the update TASK_RUNNING (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to master@10.153.254.29:38570
> 07:00:18 I0207 07:00:18.132776  2976 status_update_manager.cpp:323] Received status update TASK_RUNNING (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.132791  2976 status_update_manager.cpp:500] Creating StatusUpdate stream for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.132839  2973 slave.cpp:4105] Status update manager successfully handled status update TASK_RUNNING (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.132913  2976 status_update_manager.cpp:377] Forwarding update TASK_RUNNING (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to the agent
> 07:00:18 I0207 07:00:18.132949  2972 master.cpp:6094] Status update TASK_RUNNING (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 from agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal)
> 07:00:18 I0207 07:00:18.133024  2974 slave.cpp:4211] Forwarding the update TASK_RUNNING (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to master@10.153.254.29:38570
> 07:00:18 I0207 07:00:18.133051  2972 master.cpp:6162] Forwarding status update TASK_RUNNING (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.133170  2974 slave.cpp:4105] Status update manager successfully handled status update TASK_RUNNING (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.133327 29025 default_executor.cpp:153] Received ACKNOWLEDGED event
> 07:00:18 I0207 07:00:18.133405  2972 master.cpp:8242] Updating the state of task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_RUNNING, status update state: TASK_RUNNING)
> 07:00:18 I0207 07:00:18.133518  2972 master.cpp:6094] Status update TASK_RUNNING (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 from agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal)
> 07:00:18 I0207 07:00:18.133553  2972 master.cpp:6162] Forwarding status update TASK_RUNNING (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.133646  2972 master.cpp:8242] Updating the state of task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_RUNNING, status update state: TASK_RUNNING)
> 07:00:18 I0207 07:00:18.133905 29019 default_executor.cpp:153] Received ACKNOWLEDGED event
> 07:00:18 I0207 07:00:18.134141  2973 scheduler.cpp:676] Enqueuing event UPDATE received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:18.134351  2973 scheduler.cpp:676] Enqueuing event UPDATE received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:18.778179  2976 hierarchical.cpp:1907] No inverse offers to send out!
> 07:00:18 I0207 07:00:18.778226  2976 hierarchical.cpp:1401] Performed allocation for 1 agents in 258865ns
> 07:00:18 I0207 07:00:18.778333  2972 master.cpp:6932] Sending 1 offers to framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:18 I0207 07:00:18.778885  2972 scheduler.cpp:676] Enqueuing event OFFERS received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:18.779575  2976 scheduler.cpp:243] Sending ACCEPT call to http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:18.779938  2976 process.cpp:3704] Handling HTTP event for process 'master' with path: '/master/api/v1/scheduler'
> 07:00:18 I0207 07:00:18.817811  2974 http.cpp:420] HTTP POST for /master/api/v1/scheduler from 10.153.254.29:44398
> 07:00:18 I0207 07:00:18.817988  2974 master.cpp:3745] Processing ACCEPT call for offers: [ fa1554c4-572a-4b89-8994-a89460f588d3-O1 ] on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) for framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:18 I0207 07:00:18.818032  2974 master.cpp:3318] Authorizing framework principal 'test-principal' to launch task 8cd47a02-ff21-4585-ab72-0ce803a4be78
> 07:00:18 I0207 07:00:18.818761  2970 master.cpp:8993] Adding task 8cd47a02-ff21-4585-ab72-0ce803a4be78 with resources cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal)
> 07:00:18 I0207 07:00:18.818826  2970 master.cpp:4600] Launching task group { 8cd47a02-ff21-4585-ab72-0ce803a4be78 } of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) with resources cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal)
> 07:00:18 I0207 07:00:18.818967  2976 slave.cpp:1583] Got assigned task group containing tasks [ 8cd47a02-ff21-4585-ab72-0ce803a4be78 ] for framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.819067  2971 hierarchical.cpp:1079] Recovered cpus(*)(allocated: *):1.6; mem(*)(allocated: *):896; disk(*)(allocated: *):896; ports(*)(allocated: *):[31000-32000] (total: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000], allocated: cpus(*)(allocated: *):0.4; mem(*)(allocated: *):128; disk(*)(allocated: *):128) on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 from framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.819103  2971 hierarchical.cpp:1116] Framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 filtered agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 for 5secs
> 07:00:18 I0207 07:00:18.819105  2976 slave.cpp:1743] Launching task group containing tasks [ 8cd47a02-ff21-4585-ab72-0ce803a4be78 ] for framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.819150  2976 slave.cpp:2095] Queued task group containing tasks [ 8cd47a02-ff21-4585-ab72-0ce803a4be78 ] for executor 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (via HTTP)
> 07:00:18 I0207 07:00:18.819540  2974 slave.cpp:2315] Sending queued task group task group containing tasks [ 8cd47a02-ff21-4585-ab72-0ce803a4be78 ] to executor 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (via HTTP)
> 07:00:18 I0207 07:00:18.820272 29019 default_executor.cpp:153] Received LAUNCH_GROUP event
> 07:00:18 I0207 07:00:18.821336  2970 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1'
> 07:00:18 I0207 07:00:18.821585  2972 http.cpp:303] HTTP POST for /slave(716)/api/v1 from 10.153.254.29:44410
> 07:00:18 I0207 07:00:18.821693  2972 http.cpp:517] Processing call LAUNCH_NESTED_CONTAINER
> 07:00:18 I0207 07:00:18.821916  2976 containerizer.cpp:1805] Starting nested container 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8
> 07:00:18 I0207 07:00:18.822005  2976 containerizer.cpp:1829] Trying to chown '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974/containers/5e04c992-3a62-4187-86b2-2ad4abb2f5e8' to user 'root'
> 07:00:18 I0207 07:00:18.822497  2975 containerizer.cpp:1538] Launching 'mesos-containerizer' with flags '--help="false" --launch_info="{"command":{"shell":true,"value":"sleep 1000"},"environment":{"variables":[{"name":"MESOS_SANDBOX","value":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974\/containers\/5e04c992-3a62-4187-86b2-2ad4abb2f5e8"}]},"user":"root","working_directory":"\/tmp\/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4\/slaves\/fa1554c4-572a-4b89-8994-a89460f588d3-S0\/frameworks\/fa1554c4-572a-4b89-8994-a89460f588d3-0000\/executors\/default\/runs\/4cfc866d-9fef-442b-8682-58dabb305974\/containers\/5e04c992-3a62-4187-86b2-2ad4abb2f5e8"}" --pipe_read="77" --pipe_write="78" --runtime_directory="/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/containers/4cfc866d-9fef-442b-8682-58dabb305974/containers/5e04c992-3a62-4187-86b2-2ad4abb2f5e8" --unshare_namespace_mnt="false"'
> 07:00:18 I0207 07:00:18.822722  2977 linux_launcher.cpp:429] Launching nested container 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8 and cloning with namespaces 
> 07:00:18 I0207 07:00:18.851102  2976 fetcher.cpp:349] Starting to fetch URIs for container: 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8, directory: /tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974/containers/5e04c992-3a62-4187-86b2-2ad4abb2f5e8
> 07:00:18 I0207 07:00:18.853680 29021 default_executor.cpp:469] Successfully launched tasks [ 8cd47a02-ff21-4585-ab72-0ce803a4be78 ] in child containers [ 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8 ]
> 07:00:18 I0207 07:00:18.854037 29026 default_executor.cpp:542] Waiting for child container 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8 of task '8cd47a02-ff21-4585-ab72-0ce803a4be78'
> 07:00:18 I0207 07:00:18.854059  2973 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1/executor'
> 07:00:18 I0207 07:00:18.854372  2976 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1'
> 07:00:18 I0207 07:00:18.854599  2974 http.cpp:303] HTTP POST for /slave(716)/api/v1 from 10.153.254.29:44412
> 07:00:18 I0207 07:00:18.854703  2974 http.cpp:517] Processing call WAIT_NESTED_CONTAINER
> 07:00:18 I0207 07:00:18.893777  2973 http.cpp:303] HTTP POST for /slave(716)/api/v1/executor from 10.153.254.29:44402
> 07:00:18 I0207 07:00:18.893868  2973 slave.cpp:3771] Handling status update TASK_RUNNING (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.894559  2970 status_update_manager.cpp:323] Received status update TASK_RUNNING (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.894589  2970 status_update_manager.cpp:500] Creating StatusUpdate stream for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.894749  2970 status_update_manager.cpp:377] Forwarding update TASK_RUNNING (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to the agent
> 07:00:18 I0207 07:00:18.894865  2977 slave.cpp:4211] Forwarding the update TASK_RUNNING (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to master@10.153.254.29:38570
> 07:00:18 I0207 07:00:18.894951  2977 slave.cpp:4105] Status update manager successfully handled status update TASK_RUNNING (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.895066  2975 master.cpp:6094] Status update TASK_RUNNING (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 from agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal)
> 07:00:18 I0207 07:00:18.895097  2975 master.cpp:6162] Forwarding status update TASK_RUNNING (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.895196  2975 master.cpp:8242] Updating the state of task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_RUNNING, status update state: TASK_RUNNING)
> 07:00:18 I0207 07:00:18.895474 29025 default_executor.cpp:153] Received ACKNOWLEDGED event
> 07:00:18 I0207 07:00:18.895576  2971 scheduler.cpp:676] Enqueuing event UPDATE received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:18.896118  2972 scheduler.cpp:243] Sending ACKNOWLEDGE call to http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:18.896244  2972 scheduler.cpp:243] Sending ACKNOWLEDGE call to http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:18.896327  2972 scheduler.cpp:243] Sending ACKNOWLEDGE call to http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:18.896453  2972 scheduler.cpp:243] Sending KILL call to http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:18 I0207 07:00:18.896493  2975 process.cpp:3704] Handling HTTP event for process 'master' with path: '/master/api/v1/scheduler'
> 07:00:18 I0207 07:00:18.933679  2976 process.cpp:3704] Handling HTTP event for process 'master' with path: '/master/api/v1/scheduler'
> 07:00:18 I0207 07:00:18.933753  2976 process.cpp:3704] Handling HTTP event for process 'master' with path: '/master/api/v1/scheduler'
> 07:00:18 I0207 07:00:18.933818  2976 process.cpp:3704] Handling HTTP event for process 'master' with path: '/master/api/v1/scheduler'
> 07:00:18 I0207 07:00:18.934253  2976 http.cpp:420] HTTP POST for /master/api/v1/scheduler from 10.153.254.29:44398
> 07:00:18 I0207 07:00:18.934309  2976 master.cpp:5032] Processing ACKNOWLEDGE call d54c9399-1a59-426c-80f2-c5fa491b9215 for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0
> 07:00:18 I0207 07:00:18.934440  2974 status_update_manager.cpp:395] Received status update acknowledgement (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.934512  2976 http.cpp:420] HTTP POST for /master/api/v1/scheduler from 10.153.254.29:44398
> 07:00:18 I0207 07:00:18.934556  2976 master.cpp:5032] Processing ACKNOWLEDGE call 10681538-b4e6-4eb8-b8ae-0e7af9b4e009 for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0
> 07:00:18 I0207 07:00:18.934666  2973 slave.cpp:3060] Status update manager successfully handled status update acknowledgement (UUID: d54c9399-1a59-426c-80f2-c5fa491b9215) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.934710  2976 http.cpp:420] HTTP POST for /master/api/v1/scheduler from 10.153.254.29:44398
> 07:00:18 I0207 07:00:18.934746  2973 status_update_manager.cpp:395] Received status update acknowledgement (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.934763  2976 master.cpp:5032] Processing ACKNOWLEDGE call 128da3e5-7a2c-4351-a36c-5dd43d7977ea for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0
> 07:00:18 I0207 07:00:18.934803  2973 slave.cpp:3060] Status update manager successfully handled status update acknowledgement (UUID: 10681538-b4e6-4eb8-b8ae-0e7af9b4e009) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.934844  2976 http.cpp:420] HTTP POST for /master/api/v1/scheduler from 10.153.254.29:44398
> 07:00:18 I0207 07:00:18.934875  2976 master.cpp:4851] Processing KILL call for task '16b247b5-e1dd-4395-a2d7-71c9c393e5bb' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:18 I0207 07:00:18.934918  2973 status_update_manager.cpp:395] Received status update acknowledgement (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.934916  2976 master.cpp:4924] Telling agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) to kill task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:18 I0207 07:00:18.935019  2975 slave.cpp:2383] Asked to kill task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.935169  2975 slave.cpp:3060] Status update manager successfully handled status update acknowledgement (UUID: 128da3e5-7a2c-4351-a36c-5dd43d7977ea) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:18 I0207 07:00:18.935544 29020 default_executor.cpp:153] Received KILL event
> 07:00:18 I0207 07:00:18.935567 29020 default_executor.cpp:841] Received kill for task '16b247b5-e1dd-4395-a2d7-71c9c393e5bb'
> 07:00:18 I0207 07:00:18.935581 29020 default_executor.cpp:813] Killing child container 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338
> 07:00:18 I0207 07:00:18.936013  2975 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1'
> 07:00:18 I0207 07:00:18.936257  2976 http.cpp:303] HTTP POST for /slave(716)/api/v1 from 10.153.254.29:44414
> 07:00:18 I0207 07:00:18.936349  2976 http.cpp:517] Processing call KILL_NESTED_CONTAINER
> 07:00:18 I0207 07:00:18.936545  2974 containerizer.cpp:2116] Destroying container 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338 in RUNNING state
> 07:00:18 I0207 07:00:18.936640  2975 linux_launcher.cpp:505] Asked to destroy container 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338
> 07:00:18 I0207 07:00:18.937069  2975 linux_launcher.cpp:548] Using freezer to destroy cgroup mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/966d71b2-cbc7-40a6-accf-bef80d3d8338
> 07:00:18 I0207 07:00:18.937824  2971 cgroups.cpp:2726] Freezing cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/966d71b2-cbc7-40a6-accf-bef80d3d8338
> 07:00:18 I0207 07:00:18.938868  2977 cgroups.cpp:1439] Successfully froze cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/966d71b2-cbc7-40a6-accf-bef80d3d8338 after 1.015808ms
> 07:00:18 I0207 07:00:18.939909  2975 cgroups.cpp:2744] Thawing cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/966d71b2-cbc7-40a6-accf-bef80d3d8338
> 07:00:18 I0207 07:00:18.940995  2977 cgroups.cpp:1468] Successfully thawed cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/966d71b2-cbc7-40a6-accf-bef80d3d8338 after 1.072128ms
> 07:00:19 I0207 07:00:18.975450  2973 containerizer.cpp:2479] Container 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338 has exited
> 07:00:19 I0207 07:00:18.976356  2973 provisioner.cpp:484] Ignoring destroy request for unknown container 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338
> 07:00:19 I0207 07:00:18.976426  2973 containerizer.cpp:2395] Checkpointing termination state to nested container's runtime directory '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/containers/4cfc866d-9fef-442b-8682-58dabb305974/containers/966d71b2-cbc7-40a6-accf-bef80d3d8338/termination'
> 07:00:19 I0207 07:00:18.977567 29023 default_executor.cpp:673] Child container 4cfc866d-9fef-442b-8682-58dabb305974.966d71b2-cbc7-40a6-accf-bef80d3d8338 of task '16b247b5-e1dd-4395-a2d7-71c9c393e5bb' in state TASK_KILLED terminated with status terminated with signal Killed
> 07:00:19 I0207 07:00:18.977624 29023 default_executor.cpp:708] Killing task group containing tasks [ 16b247b5-e1dd-4395-a2d7-71c9c393e5bb, c24a618d-ce08-4784-b8c7-0eeda79d121b ]
> 07:00:19 I0207 07:00:18.977648 29023 default_executor.cpp:813] Killing child container 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e
> 07:00:19 I0207 07:00:18.977864  2973 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1/executor'
> 07:00:19 I0207 07:00:18.978206  2977 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1'
> 07:00:19 I0207 07:00:18.978425  2977 http.cpp:303] HTTP POST for /slave(716)/api/v1 from 10.153.254.29:44416
> 07:00:19 I0207 07:00:18.978505  2977 http.cpp:517] Processing call KILL_NESTED_CONTAINER
> 07:00:19 I0207 07:00:18.978755  2972 containerizer.cpp:2116] Destroying container 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e in RUNNING state
> 07:00:19 I0207 07:00:18.978834  2972 linux_launcher.cpp:505] Asked to destroy container 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e
> 07:00:19 I0207 07:00:18.979177  2972 linux_launcher.cpp:548] Using freezer to destroy cgroup mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/486b0abc-966d-49b7-b2e0-58cd1d4b462e
> 07:00:19 I0207 07:00:18.979863  2974 cgroups.cpp:2726] Freezing cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/486b0abc-966d-49b7-b2e0-58cd1d4b462e
> 07:00:19 I0207 07:00:18.980865  2973 cgroups.cpp:1439] Successfully froze cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/486b0abc-966d-49b7-b2e0-58cd1d4b462e after 969984ns
> 07:00:19 I0207 07:00:18.981984  2971 cgroups.cpp:2744] Thawing cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/486b0abc-966d-49b7-b2e0-58cd1d4b462e
> 07:00:19 I0207 07:00:18.982986  2971 cgroups.cpp:1468] Successfully thawed cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/486b0abc-966d-49b7-b2e0-58cd1d4b462e after 984832ns
> 07:00:19 I0207 07:00:19.017686  2977 http.cpp:303] HTTP POST for /slave(716)/api/v1/executor from 10.153.254.29:44402
> 07:00:19 I0207 07:00:19.017765  2977 slave.cpp:3771] Handling status update TASK_KILLED (UUID: 5811c6a9-1fd6-48a2-90a6-65f5e9c9ee84) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.018388  2977 status_update_manager.cpp:323] Received status update TASK_KILLED (UUID: 5811c6a9-1fd6-48a2-90a6-65f5e9c9ee84) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.018442  2977 status_update_manager.cpp:377] Forwarding update TASK_KILLED (UUID: 5811c6a9-1fd6-48a2-90a6-65f5e9c9ee84) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to the agent
> 07:00:19 I0207 07:00:19.018528  2976 slave.cpp:4211] Forwarding the update TASK_KILLED (UUID: 5811c6a9-1fd6-48a2-90a6-65f5e9c9ee84) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to master@10.153.254.29:38570
> 07:00:19 I0207 07:00:19.018610  2976 slave.cpp:4105] Status update manager successfully handled status update TASK_KILLED (UUID: 5811c6a9-1fd6-48a2-90a6-65f5e9c9ee84) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.018651  2977 master.cpp:6094] Status update TASK_KILLED (UUID: 5811c6a9-1fd6-48a2-90a6-65f5e9c9ee84) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 from agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal)
> 07:00:19 I0207 07:00:19.018682  2977 master.cpp:6162] Forwarding status update TASK_KILLED (UUID: 5811c6a9-1fd6-48a2-90a6-65f5e9c9ee84) for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.018759  2977 master.cpp:8242] Updating the state of task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_KILLED, status update state: TASK_KILLED)
> 07:00:19 I0207 07:00:19.018950  2974 hierarchical.cpp:1079] Recovered cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 (total: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000], allocated: cpus(*)(allocated: *):0.3; mem(*)(allocated: *):96; disk(*)(allocated: *):96) on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 from framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.019011 29022 default_executor.cpp:153] Received ACKNOWLEDGED event
> 07:00:19 I0207 07:00:19.019037  2973 scheduler.cpp:676] Enqueuing event UPDATE received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:19 I0207 07:00:19.076431  2977 containerizer.cpp:2479] Container 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e has exited
> 07:00:19 I0207 07:00:19.077306  2974 provisioner.cpp:484] Ignoring destroy request for unknown container 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e
> 07:00:19 I0207 07:00:19.077369  2974 containerizer.cpp:2395] Checkpointing termination state to nested container's runtime directory '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/containers/4cfc866d-9fef-442b-8682-58dabb305974/containers/486b0abc-966d-49b7-b2e0-58cd1d4b462e/termination'
> 07:00:19 I0207 07:00:19.077934 29025 default_executor.cpp:673] Child container 4cfc866d-9fef-442b-8682-58dabb305974.486b0abc-966d-49b7-b2e0-58cd1d4b462e of task 'c24a618d-ce08-4784-b8c7-0eeda79d121b' in state TASK_KILLED terminated with status terminated with signal Killed
> 07:00:19 I0207 07:00:19.078296  2974 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1/executor'
> 07:00:19 I0207 07:00:19.117736  2970 http.cpp:303] HTTP POST for /slave(716)/api/v1/executor from 10.153.254.29:44402
> 07:00:19 I0207 07:00:19.117791  2970 slave.cpp:3771] Handling status update TASK_KILLED (UUID: 9f6f1fc0-5838-4a46-a4c1-4543e28dc1c9) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.118321  2977 status_update_manager.cpp:323] Received status update TASK_KILLED (UUID: 9f6f1fc0-5838-4a46-a4c1-4543e28dc1c9) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.118379  2977 status_update_manager.cpp:377] Forwarding update TASK_KILLED (UUID: 9f6f1fc0-5838-4a46-a4c1-4543e28dc1c9) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to the agent
> 07:00:19 I0207 07:00:19.118453  2971 slave.cpp:4211] Forwarding the update TASK_KILLED (UUID: 9f6f1fc0-5838-4a46-a4c1-4543e28dc1c9) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to master@10.153.254.29:38570
> 07:00:19 I0207 07:00:19.118526  2971 slave.cpp:4105] Status update manager successfully handled status update TASK_KILLED (UUID: 9f6f1fc0-5838-4a46-a4c1-4543e28dc1c9) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.118571  2970 master.cpp:6094] Status update TASK_KILLED (UUID: 9f6f1fc0-5838-4a46-a4c1-4543e28dc1c9) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 from agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal)
> 07:00:19 I0207 07:00:19.118604  2970 master.cpp:6162] Forwarding status update TASK_KILLED (UUID: 9f6f1fc0-5838-4a46-a4c1-4543e28dc1c9) for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.118687  2970 master.cpp:8242] Updating the state of task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_KILLED, status update state: TASK_KILLED)
> 07:00:19 I0207 07:00:19.118865  2976 hierarchical.cpp:1079] Recovered cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 (total: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000], allocated: cpus(*)(allocated: *):0.2; mem(*)(allocated: *):64; disk(*)(allocated: *):64) on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 from framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.118947 29019 default_executor.cpp:153] Received ACKNOWLEDGED event
> 07:00:19 I0207 07:00:19.118973  2973 scheduler.cpp:676] Enqueuing event UPDATE received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:19 I0207 07:00:19.119366  2977 scheduler.cpp:243] Sending KILL call to http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:19 I0207 07:00:19.119678  2972 process.cpp:3704] Handling HTTP event for process 'master' with path: '/master/api/v1/scheduler'
> 07:00:19 I0207 07:00:19.157742  2970 http.cpp:420] HTTP POST for /master/api/v1/scheduler from 10.153.254.29:44398
> 07:00:19 I0207 07:00:19.157784  2970 master.cpp:4851] Processing KILL call for task '8cd47a02-ff21-4585-ab72-0ce803a4be78' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:19 I0207 07:00:19.157804  2970 master.cpp:4924] Telling agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) to kill task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:19 I0207 07:00:19.157855  2976 slave.cpp:2383] Asked to kill task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.158260 29024 default_executor.cpp:153] Received KILL event
> 07:00:19 I0207 07:00:19.158283 29024 default_executor.cpp:841] Received kill for task '8cd47a02-ff21-4585-ab72-0ce803a4be78'
> 07:00:19 I0207 07:00:19.158294 29024 default_executor.cpp:813] Killing child container 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8
> 07:00:19 I0207 07:00:19.158717  2974 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1'
> 07:00:19 I0207 07:00:19.158946  2972 http.cpp:303] HTTP POST for /slave(716)/api/v1 from 10.153.254.29:44418
> 07:00:19 I0207 07:00:19.159024  2972 http.cpp:517] Processing call KILL_NESTED_CONTAINER
> 07:00:19 I0207 07:00:19.159195  2976 containerizer.cpp:2116] Destroying container 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8 in RUNNING state
> 07:00:19 I0207 07:00:19.159293  2972 linux_launcher.cpp:505] Asked to destroy container 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8
> 07:00:19 I0207 07:00:19.159647  2972 linux_launcher.cpp:548] Using freezer to destroy cgroup mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/5e04c992-3a62-4187-86b2-2ad4abb2f5e8
> 07:00:19 I0207 07:00:19.160347  2973 cgroups.cpp:2726] Freezing cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/5e04c992-3a62-4187-86b2-2ad4abb2f5e8
> 07:00:19 I0207 07:00:19.161346  2973 cgroups.cpp:1439] Successfully froze cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/5e04c992-3a62-4187-86b2-2ad4abb2f5e8 after 974080ns
> 07:00:19 I0207 07:00:19.162377  2972 cgroups.cpp:2744] Thawing cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/5e04c992-3a62-4187-86b2-2ad4abb2f5e8
> 07:00:19 I0207 07:00:19.163326  2975 cgroups.cpp:1468] Successfully thawed cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos/5e04c992-3a62-4187-86b2-2ad4abb2f5e8 after 929792ns
> 07:00:19 I0207 07:00:19.177110  2975 containerizer.cpp:2479] Container 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8 has exited
> 07:00:19 I0207 07:00:19.178030  2970 provisioner.cpp:484] Ignoring destroy request for unknown container 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8
> 07:00:19 I0207 07:00:19.178082  2970 containerizer.cpp:2395] Checkpointing termination state to nested container's runtime directory '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_6mgrFO/containers/4cfc866d-9fef-442b-8682-58dabb305974/containers/5e04c992-3a62-4187-86b2-2ad4abb2f5e8/termination'
> 07:00:19 I0207 07:00:19.178556 29020 default_executor.cpp:673] Child container 4cfc866d-9fef-442b-8682-58dabb305974.5e04c992-3a62-4187-86b2-2ad4abb2f5e8 of task '8cd47a02-ff21-4585-ab72-0ce803a4be78' in state TASK_KILLED terminated with status terminated with signal Killed
> 07:00:19 I0207 07:00:19.178586 29020 default_executor.cpp:797] Terminating after 1secs
> 07:00:19 I0207 07:00:19.181659  2975 process.cpp:3704] Handling HTTP event for process 'slave(716)' with path: '/slave(716)/api/v1/executor'
> 07:00:19 I0207 07:00:19.221710  2972 http.cpp:303] HTTP POST for /slave(716)/api/v1/executor from 10.153.254.29:44402
> 07:00:19 I0207 07:00:19.221762  2972 slave.cpp:3771] Handling status update TASK_KILLED (UUID: c62e4ad7-468a-4934-9b77-815d878de732) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.222328  2974 status_update_manager.cpp:323] Received status update TASK_KILLED (UUID: c62e4ad7-468a-4934-9b77-815d878de732) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.222389  2974 status_update_manager.cpp:377] Forwarding update TASK_KILLED (UUID: c62e4ad7-468a-4934-9b77-815d878de732) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to the agent
> 07:00:19 I0207 07:00:19.222486  2977 slave.cpp:4211] Forwarding the update TASK_KILLED (UUID: c62e4ad7-468a-4934-9b77-815d878de732) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 to master@10.153.254.29:38570
> 07:00:19 I0207 07:00:19.222591  2977 slave.cpp:4105] Status update manager successfully handled status update TASK_KILLED (UUID: c62e4ad7-468a-4934-9b77-815d878de732) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.222607  2971 master.cpp:6094] Status update TASK_KILLED (UUID: c62e4ad7-468a-4934-9b77-815d878de732) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 from agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal)
> 07:00:19 I0207 07:00:19.222627  2971 master.cpp:6162] Forwarding status update TASK_KILLED (UUID: c62e4ad7-468a-4934-9b77-815d878de732) for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.222712  2971 master.cpp:8242] Updating the state of task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_KILLED, status update state: TASK_KILLED)
> 07:00:19 I0207 07:00:19.222867  2975 hierarchical.cpp:1079] Recovered cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 (total: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000], allocated: cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32) on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 from framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:19 I0207 07:00:19.223067  2970 scheduler.cpp:676] Enqueuing event UPDATE received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:19 I0207 07:00:19.779280  2973 hierarchical.cpp:1907] No inverse offers to send out!
> 07:00:19 I0207 07:00:19.779335  2973 hierarchical.cpp:1401] Performed allocation for 1 agents in 276292ns
> 07:00:19 I0207 07:00:19.779414  2971 master.cpp:6932] Sending 1 offers to framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:19 I0207 07:00:19.780038  2973 scheduler.cpp:676] Enqueuing event OFFERS received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:20 I0207 07:00:20.178755 29020 default_executor.cpp:708] Killing task group containing tasks [ 8cd47a02-ff21-4585-ab72-0ce803a4be78 ]
> 07:00:20 I0207 07:00:20.284885  2970 containerizer.cpp:2479] Container 4cfc866d-9fef-442b-8682-58dabb305974 has exited
> 07:00:20 I0207 07:00:20.284914  2970 containerizer.cpp:2116] Destroying container 4cfc866d-9fef-442b-8682-58dabb305974 in RUNNING state
> 07:00:20 I0207 07:00:20.285010  2975 linux_launcher.cpp:505] Asked to destroy container 4cfc866d-9fef-442b-8682-58dabb305974
> 07:00:20 I0207 07:00:20.285462  2975 linux_launcher.cpp:548] Using freezer to destroy cgroup mesos/4cfc866d-9fef-442b-8682-58dabb305974
> 07:00:20 I0207 07:00:20.286226  2977 cgroups.cpp:2726] Freezing cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos
> 07:00:20 I0207 07:00:20.286248  2974 cgroups.cpp:2726] Freezing cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974
> 07:00:20 I0207 07:00:20.288529  2975 cgroups.cpp:1439] Successfully froze cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos after 2.279168ms
> 07:00:20 I0207 07:00:20.288636  2970 cgroups.cpp:1439] Successfully froze cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974 after 2.370048ms
> 07:00:20 I0207 07:00:20.289970  2973 cgroups.cpp:2744] Thawing cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos
> 07:00:20 I0207 07:00:20.290127  2975 cgroups.cpp:2744] Thawing cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974
> 07:00:20 I0207 07:00:20.291142  2973 cgroups.cpp:1468] Successfully thawed cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974/mesos after 1.154048ms
> 07:00:20 I0207 07:00:20.291566  2970 cgroups.cpp:1468] Successfully thawed cgroup /sys/fs/cgroup/freezer/mesos/4cfc866d-9fef-442b-8682-58dabb305974 after 1.420032ms
> 07:00:20 I0207 07:00:20.292809  2970 provisioner.cpp:484] Ignoring destroy request for unknown container 4cfc866d-9fef-442b-8682-58dabb305974
> 07:00:20 I0207 07:00:20.293262  2970 slave.cpp:4706] Executor 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 exited with status 0
> 07:00:20 I0207 07:00:20.293408  2970 master.cpp:6224] Executor 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal): exited with status 0
> 07:00:20 I0207 07:00:20.293469  2970 master.cpp:8365] Removing executor 'default' with resources cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal)
> 07:00:20 I0207 07:00:20.293663  2971 hierarchical.cpp:1079] Recovered cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 (total: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000], allocated: cpus(*)(allocated: *):1.9; mem(*)(allocated: *):992; disk(*)(allocated: *):992; ports(*)(allocated: *):[31000-32000]) on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 from framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:20 I0207 07:00:20.293929  2970 scheduler.cpp:676] Enqueuing event FAILURE received from http://10.153.254.29:38570/master/api/v1/scheduler
> 07:00:20 I0207 07:00:20.294646  2973 master.cpp:1380] Framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) disconnected
> 07:00:20 I0207 07:00:20.294739  2973 master.cpp:3080] Deactivating framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:20 W0207 07:00:20.294898  2973 master.hpp:2262] Unable to send event to framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default): connection closed
> 07:00:20 I0207 07:00:20.294934  2973 master.cpp:3057] Disconnecting framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:20 I0207 07:00:20.294951  2973 master.cpp:1395] Giving framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default) 0ns to failover
> 07:00:20 I0207 07:00:20.295022  2974 hierarchical.cpp:415] Deactivated framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:20 I0207 07:00:20.295150  2974 hierarchical.cpp:1079] Recovered cpus(*)(allocated: *):1.9; mem(*)(allocated: *):992; disk(*)(allocated: *):992; ports(*)(allocated: *):[31000-32000] (total: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000], allocated: {}) on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 from framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:20 I0207 07:00:20.296192  2972 master.cpp:6772] Framework failover timeout, removing framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:20 I0207 07:00:20.296218  2972 master.cpp:7657] Removing framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (default)
> 07:00:20 I0207 07:00:20.296278  2972 master.cpp:8242] Updating the state of task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_KILLED, status update state: TASK_KILLED)
> 07:00:20 I0207 07:00:20.296283  2974 slave.cpp:2613] Asked to shut down framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 by master@10.153.254.29:38570
> 07:00:20 I0207 07:00:20.296320  2974 slave.cpp:2638] Shutting down framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:20 I0207 07:00:20.296336  2974 slave.cpp:4806] Cleaning up executor 'default' of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (via HTTP)
> 07:00:20 I0207 07:00:20.296311  2972 master.cpp:8336] Removing task c24a618d-ce08-4784-b8c7-0eeda79d121b with resources cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal)
> 07:00:20 I0207 07:00:20.296442  2972 master.cpp:8242] Updating the state of task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_KILLED, status update state: TASK_KILLED)
> 07:00:20 I0207 07:00:20.296480  2971 gc.cpp:55] Scheduling '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default/runs/4cfc866d-9fef-442b-8682-58dabb305974' for gc 6.99999659133037days in the future
> 07:00:20 I0207 07:00:20.296504  2974 slave.cpp:4894] Cleaning up framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:20 I0207 07:00:20.296465  2972 master.cpp:8336] Removing task 8cd47a02-ff21-4585-ab72-0ce803a4be78 with resources cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal)
> 07:00:20 I0207 07:00:20.296556  2971 gc.cpp:55] Scheduling '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000/executors/default' for gc 6.99999659133037days in the future
> 07:00:20 I0207 07:00:20.296576  2972 master.cpp:8242] Updating the state of task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 (latest state: TASK_KILLED, status update state: TASK_KILLED)
> 07:00:20 I0207 07:00:20.296604  2975 status_update_manager.cpp:285] Closing status update streams for framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:20 I0207 07:00:20.296593  2972 master.cpp:8336] Removing task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb with resources cpus(*)(allocated: *):0.1; mem(*)(allocated: *):32; disk(*)(allocated: *):32 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000 on agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal)
> 07:00:20 I0207 07:00:20.296638  2971 gc.cpp:55] Scheduling '/tmp/ROOT_DOCKER_DockerAndMesosContainerizers_DefaultExecutorTest_KillTask_0_2EklH4/slaves/fa1554c4-572a-4b89-8994-a89460f588d3-S0/frameworks/fa1554c4-572a-4b89-8994-a89460f588d3-0000' for gc 6.99999659133037days in the future
> 07:00:20 I0207 07:00:20.296641  2975 status_update_manager.cpp:531] Cleaning up status update stream for task c24a618d-ce08-4784-b8c7-0eeda79d121b of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:20 I0207 07:00:20.296808  2976 hierarchical.cpp:362] Removed framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:20 I0207 07:00:20.296821  2975 status_update_manager.cpp:531] Cleaning up status update stream for task 8cd47a02-ff21-4585-ab72-0ce803a4be78 of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:20 I0207 07:00:20.296928  2975 status_update_manager.cpp:531] Cleaning up status update stream for task 16b247b5-e1dd-4395-a2d7-71c9c393e5bb of framework fa1554c4-572a-4b89-8994-a89460f588d3-0000
> 07:00:20 W0207 07:00:20.297485  2976 containerizer.cpp:2104] Attempted to destroy unknown container 4cfc866d-9fef-442b-8682-58dabb305974
> 07:00:20 ../../src/tests/cluster.cpp:576: Failure
> 07:00:20 Value of: containers.get().empty()
> 07:00:20   Actual: false
> 07:00:20 Expected: true
> 07:00:20 Failed to destroy containers: { 4cfc866d-9fef-442b-8682-58dabb305974 }
> 07:00:20 I0207 07:00:20.297739  2977 slave.cpp:803] Agent terminating
> 07:00:20 I0207 07:00:20.297816  2973 master.cpp:1263] Agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal) disconnected
> 07:00:20 I0207 07:00:20.297837  2973 master.cpp:3117] Disconnecting agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal)
> 07:00:20 I0207 07:00:20.297860  2973 master.cpp:3136] Deactivating agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 at slave(716)@10.153.254.29:38570 (ip-10-153-254-29.ec2.internal)
> 07:00:20 I0207 07:00:20.297920  2977 hierarchical.cpp:617] Agent fa1554c4-572a-4b89-8994-a89460f588d3-S0 deactivated
> 07:00:20 I0207 07:00:20.300276  2952 master.cpp:1102] Master terminating
> 07:00:20 I0207 07:00:20.300390  2971 hierarchical.cpp:548] Removed agent fa1554c4-572a-4b89-8994-a89460f588d3-S0
> 07:00:20 [  FAILED  ] ROOT_DOCKER_DockerAndMesosContainerizers/DefaultExecutorTest.KillTask/0, where GetParam() = "docker,mesos" (2527 ms)
> {noformat}
> Note that the other parameterized test {{MesosContainerizer/DefaultExecutorTest.KillTask/0}} passes successfully though.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)