You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@mesos.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2016/02/23 05:54:40 UTC

Build failed in Jenkins: Mesos » gcc,--verbose,GLOG_v=1 MESOS_VERBOSE=1,ubuntu:14.04,(docker||Hadoop)&&(!ubuntu-us1) #1704

See <https://builds.apache.org/job/Mesos/COMPILER=gcc,CONFIGURATION=--verbose,ENVIRONMENT=GLOG_v=1%20MESOS_VERBOSE=1,OS=ubuntu%3A14.04,label_exp=(docker%7C%7CHadoop)&&(!ubuntu-us1)/1704/changes>

Changes:

[mpark] Updated the website for 0.27.1 release.

------------------------------------------
[...truncated 120917 lines...]
I0223 04:54:28.935920   808 master.cpp:4240] Registering slave at slave@172.17.0.2:44225 (5847d87ad902) with id 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0
I0223 04:54:28.936285   819 registrar.cpp:439] Applied 1 operations in 53091ns; attempting to update the 'registry'
I0223 04:54:28.936992   818 log.cpp:683] Attempting to append 339 bytes to the log
I0223 04:54:28.937113   805 coordinator.cpp:348] Coordinator attempting to write APPEND action at position 3
I0223 04:54:28.937728   816 replica.cpp:537] Replica received write request for position 3 from (9614)@172.17.0.2:44225
I0223 04:54:28.952417   807 slave.cpp:1321] Will retry registration in 35.446972ms if necessary
I0223 04:54:28.952584   814 master.cpp:4228] Ignoring register slave message from slave@172.17.0.2:44225 (5847d87ad902) as admission is already in progress
I0223 04:54:28.981781   816 leveldb.cpp:341] Persisting action (358 bytes) to leveldb took 43.997431ms
I0223 04:54:28.981883   816 replica.cpp:712] Persisted action at 3
I0223 04:54:28.982956   816 replica.cpp:691] Replica received learned notice for position 3 from @0.0.0.0:0
I0223 04:54:28.989023   818 slave.cpp:1321] Will retry registration in 52.677739ms if necessary
I0223 04:54:28.989296   818 master.cpp:4228] Ignoring register slave message from slave@172.17.0.2:44225 (5847d87ad902) as admission is already in progress
I0223 04:54:29.032562   816 leveldb.cpp:341] Persisting action (360 bytes) to leveldb took 49.562387ms
I0223 04:54:29.032641   816 replica.cpp:712] Persisted action at 3
I0223 04:54:29.032675   816 replica.cpp:697] Replica learned APPEND action at position 3
I0223 04:54:29.034543   807 registrar.cpp:484] Successfully updated the 'registry' in 98.188032ms
I0223 04:54:29.034868   818 log.cpp:702] Attempting to truncate the log to 3
I0223 04:54:29.035054   819 coordinator.cpp:348] Coordinator attempting to write TRUNCATE action at position 4
I0223 04:54:29.035475   806 slave.cpp:3482] Received ping from slave-observer(278)@172.17.0.2:44225
I0223 04:54:29.035616   820 master.cpp:4308] Registered slave 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 at slave@172.17.0.2:44225 (5847d87ad902) with cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000]
I0223 04:54:29.035703   809 slave.cpp:971] Registered with master master@172.17.0.2:44225; given slave ID 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0
I0223 04:54:29.035728   809 fetcher.cpp:81] Clearing fetcher cache
I0223 04:54:29.035836   814 hierarchical.cpp:473] Added slave 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 (5847d87ad902) with cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] (allocated: )
I0223 04:54:29.035892   815 status_update_manager.cpp:181] Resuming sending status updates
I0223 04:54:29.035941   819 replica.cpp:537] Replica received write request for position 4 from (9615)@172.17.0.2:44225
I0223 04:54:29.036110   809 slave.cpp:994] Checkpointing SlaveInfo to '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/slave.info'
I0223 04:54:29.036485   809 slave.cpp:1030] Forwarding total oversubscribed resources 
I0223 04:54:29.036645   813 master.cpp:4649] Received update of slave 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 at slave@172.17.0.2:44225 (5847d87ad902) with total oversubscribed resources 
I0223 04:54:29.036782   814 hierarchical.cpp:1529] No inverse offers to send out!
I0223 04:54:29.036818   814 hierarchical.cpp:1147] Performed allocation for slave 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 in 935779ns
I0223 04:54:29.037040   813 master.cpp:5355] Sending 1 offers to framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (default) at scheduler-3cf586e5-0306-4d44-a767-644193a0b441@172.17.0.2:44225
I0223 04:54:29.037104   814 hierarchical.cpp:531] Slave 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 (5847d87ad902) updated with oversubscribed resources  (total: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000], allocated: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000])
I0223 04:54:29.037240   814 hierarchical.cpp:1434] No resources available to allocate!
I0223 04:54:29.037282   814 hierarchical.cpp:1529] No inverse offers to send out!
I0223 04:54:29.037307   814 hierarchical.cpp:1147] Performed allocation for slave 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 in 160900ns
I0223 04:54:29.037569   809 sched.cpp:873] Scheduler::resourceOffers took 195666ns
I0223 04:54:29.039176   807 master.cpp:3138] Processing ACCEPT call for offers: [ 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-O0 ] on slave 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 at slave@172.17.0.2:44225 (5847d87ad902) for framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (default) at scheduler-3cf586e5-0306-4d44-a767-644193a0b441@172.17.0.2:44225
I0223 04:54:29.039221   807 master.cpp:2825] Authorizing framework principal 'test-principal' to launch task 1 as user 'mesos'
W0223 04:54:29.040493   807 validation.cpp:404] Executor http for task 1 uses less CPUs (None) than the minimum required (0.01). Please update your executor, as this will be mandatory in future releases.
W0223 04:54:29.040529   807 validation.cpp:416] Executor http for task 1 uses less memory (None) than the minimum required (32MB). Please update your executor, as this will be mandatory in future releases.
I0223 04:54:29.040904   807 master.hpp:176] Adding task 1 with resources cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] on slave 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 (5847d87ad902)
I0223 04:54:29.041144   807 master.cpp:3623] Launching task 1 of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (default) at scheduler-3cf586e5-0306-4d44-a767-644193a0b441@172.17.0.2:44225 with resources cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] on slave 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 at slave@172.17.0.2:44225 (5847d87ad902)
I0223 04:54:29.041574   809 slave.cpp:1361] Got assigned task 1 for framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
I0223 04:54:29.041755   809 slave.cpp:5287] Checkpointing FrameworkInfo to '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/framework.info'
I0223 04:54:29.042193   809 slave.cpp:5298] Checkpointing framework pid 'scheduler-3cf586e5-0306-4d44-a767-644193a0b441@172.17.0.2:44225' to '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/framework.pid'
I0223 04:54:29.043066   809 slave.cpp:1480] Launching task 1 for framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
I0223 04:54:29.043884   809 paths.cpp:474] Trying to chown '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc' to user 'mesos'
I0223 04:54:29.055244   809 slave.cpp:5739] Checkpointing ExecutorInfo to '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/executor.info'
I0223 04:54:29.055868   809 slave.cpp:5367] Launching executor http of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 with resources  in work directory '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc'
I0223 04:54:29.056241   820 containerizer.cpp:666] Starting container 'a43cbeed-f390-46aa-b7a1-67770a3dd4fc' for executor 'http' of framework '81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000'
I0223 04:54:29.056298   809 slave.cpp:5762] Checkpointing TaskInfo to '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc/tasks/1/task.info'
I0223 04:54:29.056675   809 slave.cpp:1698] Queuing task '1' for executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
I0223 04:54:29.056779   809 slave.cpp:749] Successfully attached file '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc'
I0223 04:54:29.061602   815 launcher.cpp:147] Forked child with pid '6997' for container 'a43cbeed-f390-46aa-b7a1-67770a3dd4fc'
I0223 04:54:29.061995   815 containerizer.cpp:1104] Checkpointing executor's forked pid 6997 to '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc/pids/forked.pid'
I0223 04:54:29.083487   819 leveldb.cpp:341] Persisting action (16 bytes) to leveldb took 47.478443ms
I0223 04:54:29.083585   819 replica.cpp:712] Persisted action at 4
I0223 04:54:29.084709   810 replica.cpp:691] Replica received learned notice for position 4 from @0.0.0.0:0
I0223 04:54:29.122370   810 leveldb.cpp:341] Persisting action (18 bytes) to leveldb took 37.598534ms
I0223 04:54:29.122570   810 leveldb.cpp:399] Deleting ~2 keys from leveldb took 89419ns
I0223 04:54:29.122599   810 replica.cpp:712] Persisted action at 4
I0223 04:54:29.122635   810 replica.cpp:697] Replica learned TRUNCATE action at position 4
I0223 04:54:29.606348   806 hierarchical.cpp:1434] No resources available to allocate!
I0223 04:54:29.606449   806 hierarchical.cpp:1529] No inverse offers to send out!
I0223 04:54:29.606494   806 hierarchical.cpp:1127] Performed allocation for 1 slaves in 411327ns
I0223 04:54:30.607574   810 hierarchical.cpp:1434] No resources available to allocate!
I0223 04:54:30.607647   810 hierarchical.cpp:1529] No inverse offers to send out!
I0223 04:54:30.607676   810 hierarchical.cpp:1127] Performed allocation for 1 slaves in 309149ns
WARNING: Logging before InitGoogleLogging() is written to STDERR
I0223 04:54:31.163267  7011 process.cpp:991] libprocess is initialized on 172.17.0.2:47892 for 16 cpus
I0223 04:54:31.164299  7036 logging.cpp:193] Logging to STDERR
I0223 04:54:31.164322  7036 executor.cpp:172] Version: 0.28.0
I0223 04:54:31.166379  7045 executor.cpp:316] Connected with the agent
I0223 04:54:31.167551  7035 executor.cpp:247] Sending SUBSCRIBE call to http://172.17.0.2:44225/slave/api/v1/executor
I0223 04:54:31.176286   808 process.cpp:3141] Handling HTTP event for process 'slave' with path: '/slave/api/v1/executor'
I0223 04:54:31.176759   814 http.cpp:190] HTTP POST for /slave/api/v1/executor from 172.17.0.2:42711
I0223 04:54:31.177016   814 slave.cpp:2476] Received Subscribe request for HTTP executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
I0223 04:54:31.177106   814 slave.cpp:2539] Creating a marker file for HTTP based executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP) at path '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc/http.marker'
I0223 04:54:31.179092   813 slave.cpp:1863] Sending queued task '1' to executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP)
I0223 04:54:31.181721  7036 executor.cpp:588] Enqueuing event SUBSCRIBED received from http://172.17.0.2:44225/slave/api/v1/executor
I0223 04:54:31.182701  7035 executor.cpp:588] Enqueuing event LAUNCH received from http://172.17.0.2:44225/slave/api/v1/executor
Received a SUBSCRIBED event
Starting task 1
Finishing task 1
I0223 04:54:31.185159  7040 executor.cpp:247] Sending UPDATE call to http://172.17.0.2:44225/slave/api/v1/executor
I0223 04:54:31.185442  7040 executor.cpp:247] Sending UPDATE call to http://172.17.0.2:44225/slave/api/v1/executor
I0223 04:54:31.187504   811 slave.cpp:668] Slave terminating
I0223 04:54:31.187763   819 master.cpp:1174] Slave 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 at slave@172.17.0.2:44225 (5847d87ad902) disconnected
I0223 04:54:31.187794   819 master.cpp:2635] Disconnecting slave 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 at slave@172.17.0.2:44225 (5847d87ad902)
I0223 04:54:31.187850   819 master.cpp:2654] Deactivating slave 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 at slave@172.17.0.2:44225 (5847d87ad902)
I0223 04:54:31.187969   809 hierarchical.cpp:560] Slave 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 deactivated
I0223 04:54:31.188148  7037 executor.cpp:586] Enqueuing locally injected event ERROR
Received an ERROR event
I0223 04:54:31.189012  7044 executor.cpp:586] Enqueuing locally injected event ERROR
Received an ERROR event
E0223 04:54:31.189673  7044 executor.cpp:553] End-Of-File received from agent. The agent closed the event stream
I0223 04:54:31.189709  7044 executor.cpp:357] Disconnected from agent: End-Of-File received from agent. The agent closed the event stream
I0223 04:54:31.190441  7044 executor.cpp:411] Will retry connecting with the agent again in 1.548772469secs
I0223 04:54:31.191680   786 containerizer.cpp:149] Using isolation: posix/cpu,posix/mem,filesystem/posix
W0223 04:54:31.192128   786 backend.cpp:48] Failed to create 'bind' backend: BindBackend requires root privileges
I0223 04:54:31.192425  7033 executor.cpp:316] Connected with the agent
I0223 04:54:31.193727  7034 executor.cpp:247] Sending SUBSCRIBE call to http://172.17.0.2:44225/slave/api/v1/executor
I0223 04:54:31.194473   821 process.cpp:2409] Returning '404 Not Found' for '/slave/api/v1/executor'
W0223 04:54:31.195523  7041 executor.cpp:509] Received '404 Not Found' () for SUBSCRIBE
I0223 04:54:31.195714   817 slave.cpp:193] Slave started on 172.17.0.2:44225
I0223 04:54:31.195780   817 slave.cpp:194] Flags at startup: --appc_simple_discovery_uri_prefix="http://" --appc_store_dir="/tmp/mesos/store/appc" --authenticatee="crammd5" --cgroups_cpu_enable_pids_and_tids_count="false" --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup" --cgroups_limit_swap="false" --cgroups_root="mesos" --container_disk_watch_interval="15secs" --containerizers="mesos" --credential="/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/credential" --default_role="*" --disk_watch_interval="1mins" --docker="docker" --docker_auth_server="https://auth.docker.io" --docker_kill_orphans="true" --docker_puller_timeout="60" --docker_registry="https://registry-1.docker.io" --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock" --docker_stop_timeout="0ns" --docker_store_dir="/tmp/mesos/store/docker" --enforce_container_disk_quota="false" --executor_registration_timeout="1mins" --executor_shutdown_grace_period="5secs" --fetcher_cache_dir="/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/fetch" --fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks" --gc_disk_headroom="0.1" --hadoop_home="" --help="false" --hostname_lookup="true" --image_provisioner_backend="copy" --initialize_driver_logging="true" --isolation="posix/cpu,posix/mem" --launcher_dir="/mesos/mesos-0.28.0/_build/src" --logbufsecs="0" --logging_level="INFO" --oversubscribed_resources_interval="15secs" --perf_duration="10secs" --perf_interval="1mins" --qos_correction_interval_min="0ns" --quiet="false" --recover="reconnect" --recovery_timeout="15mins" --registration_backoff_factor="10ms" --resources="cpus:2;mem:1024;disk:1024;ports:[31000-32000]" --revocable_cpu_low_priority="true" --sandbox_directory="/mnt/mesos/sandbox" --strict="true" --switch_user="true" --systemd_enable_support="true" --systemd_runtime_directory="/run/systemd/system" --version="false" --work_dir="/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU"
I0223 04:54:31.196280   817 credentials.hpp:83] Loading credential for authentication from '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/credential'
I0223 04:54:31.196491   817 slave.cpp:324] Slave using credential for: test-principal
I0223 04:54:31.196655   817 resources.cpp:576] Parsing resources as JSON failed: cpus:2;mem:1024;disk:1024;ports:[31000-32000]
Trying semicolon-delimited string format instead
I0223 04:54:31.197144   817 slave.cpp:464] Slave resources: cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000]
I0223 04:54:31.197226   817 slave.cpp:472] Slave attributes: [  ]
I0223 04:54:31.197242   817 slave.cpp:477] Slave hostname: 5847d87ad902
I0223 04:54:31.198366   816 state.cpp:58] Recovering state from '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta'
I0223 04:54:31.198439   816 state.cpp:698] No checkpointed resources found at '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/resources/resources.info'
W0223 04:54:31.200115   816 state.cpp:607] Failed to find status updates file '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc/tasks/1/task.updates'
I0223 04:54:31.202293   819 fetcher.cpp:81] Clearing fetcher cache
I0223 04:54:31.202379   819 slave.cpp:4653] Recovering framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
I0223 04:54:31.202507   819 slave.cpp:5476] Recovering executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
I0223 04:54:31.203364   810 status_update_manager.cpp:200] Recovering status update manager
I0223 04:54:31.203483   810 status_update_manager.cpp:208] Recovering executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
W0223 04:54:31.203572   810 status_update_manager.cpp:247] No updates found for task 1 of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
I0223 04:54:31.203832   819 slave.cpp:749] Successfully attached file '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc'
I0223 04:54:31.204326   820 containerizer.cpp:407] Recovering containerizer
I0223 04:54:31.204448   820 containerizer.cpp:462] Recovering container 'a43cbeed-f390-46aa-b7a1-67770a3dd4fc' for executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
I0223 04:54:31.206951   820 provisioner.cpp:245] Provisioner recovery complete
I0223 04:54:31.208343   806 slave.cpp:4512] Waiting for executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP) to subscribe
I0223 04:54:31.608290   815 hierarchical.cpp:1434] No resources available to allocate!
I0223 04:54:31.608355   815 hierarchical.cpp:1529] No inverse offers to send out!
I0223 04:54:31.608387   815 hierarchical.cpp:1127] Performed allocation for 1 slaves in 252147ns
I0223 04:54:32.169790  7044 executor.cpp:247] Sending SUBSCRIBE call to http://172.17.0.2:44225/slave/api/v1/executor
I0223 04:54:32.172236   807 process.cpp:3141] Handling HTTP event for process 'slave' with path: '/slave/api/v1/executor'
I0223 04:54:32.173068   807 http.cpp:190] HTTP POST for /slave/api/v1/executor from 172.17.0.2:42713
I0223 04:54:32.173709   807 slave.cpp:2476] Received Subscribe request for HTTP executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP)
I0223 04:54:32.173815   807 slave.cpp:2539] Creating a marker file for HTTP based executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP) at path '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc/http.marker'
I0223 04:54:32.194341  7044 executor.cpp:247] Sending SUBSCRIBE call to http://172.17.0.2:44225/slave/api/v1/executor
I0223 04:54:32.196682   807 slave.cpp:3002] Handling status update TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1 of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
I0223 04:54:32.196950   807 slave.cpp:3002] Handling status update TASK_FINISHED (UUID: e7010e72-616f-4612-a218-47b26031630c) for task 1 of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
I0223 04:54:32.198343   811 process.cpp:3141] Handling HTTP event for process 'slave' with path: '/slave/api/v1/executor'
I0223 04:54:32.198863   808 status_update_manager.cpp:320] Received status update TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1 of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
I0223 04:54:32.198905   808 status_update_manager.cpp:497] Creating StatusUpdate stream for task 1 of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
I0223 04:54:32.198945   811 http.cpp:190] HTTP POST for /slave/api/v1/executor from 172.17.0.2:42713
I0223 04:54:32.199236   811 slave.cpp:2476] Received Subscribe request for HTTP executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP)
W0223 04:54:32.199256   811 slave.cpp:2518] Closing already existing HTTP connection from executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP)
I0223 04:54:32.199362   811 slave.cpp:2539] Creating a marker file for HTTP based executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP) at path '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc/http.marker'
I0223 04:54:32.199448   808 status_update_manager.cpp:824] Checkpointing UPDATE for status update TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1 of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
I0223 04:54:32.199654   811 slave.cpp:3002] Handling status update TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1 of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
I0223 04:54:32.199822   811 slave.cpp:3002] Handling status update TASK_FINISHED (UUID: e7010e72-616f-4612-a218-47b26031630c) for task 1 of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
I0223 04:54:32.200212  7040 executor.cpp:588] Enqueuing event SUBSCRIBED received from http://172.17.0.2:44225/slave/api/v1/executor
I0223 04:54:32.200510   811 slave.cpp:5677] Terminating task 1
F0223 04:54:32.200620   806 process.cpp:1114] Check failed: items.size() > 0 
E0223 04:54:32.201045  7040 executor.cpp:553] End-Of-File received from agent. The agent closed the event stream
I0223 04:54:32.201124  7040 executor.cpp:357] Disconnected from agent: End-Of-File received from agent. The agent closed the event stream
Received a SUBSCRIBED event
I0223 04:54:32.201858  7040 executor.cpp:411] Will retry connecting with the agent again in 587.356137ms
E0223 04:54:32.203120  7040 executor.cpp:543] Failed to decode the stream of events: Pipe::Reader failure: failed to decode body
I0223 04:54:32.203341  7031 executor.cpp:316] Connected with the agent
I0223 04:54:32.204586  7040 executor.cpp:247] Sending SUBSCRIBE call to http://172.17.0.2:44225/slave/api/v1/executor
*** Check failure stack trace: ***
I0223 04:54:32.205591   820 process.cpp:3141] Handling HTTP event for process 'slave' with path: '/slave/api/v1/executor'
I0223 04:54:32.242341   819 http.cpp:190] HTTP POST for /slave/api/v1/executor from 172.17.0.2:42715
I0223 04:54:32.242702   819 slave.cpp:2476] Received Subscribe request for HTTP executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP)
W0223 04:54:32.242722   819 slave.cpp:2518] Closing already existing HTTP connection from executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP)
I0223 04:54:32.242769   819 slave.cpp:2539] Creating a marker file for HTTP based executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP) at path '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc/http.marker'
    @     0x2b5689fe3a4e  google::LogMessage::Fail()
    @     0x2b5689fe399a  google::LogMessage::SendToLog()
I0223 04:54:32.264030   819 slave.cpp:3002] Handling status update TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1 of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
I0223 04:54:32.264382   819 slave.cpp:3002] Handling status update TASK_FINISHED (UUID: e7010e72-616f-4612-a218-47b26031630c) for task 1 of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
    @     0x2b5689fe339c  google::LogMessage::Flush()
I0223 04:54:32.268173  7045 executor.cpp:588] Enqueuing event SUBSCRIBED received from http://172.17.0.2:44225/slave/api/v1/executor
Received a SUBSCRIBED event
    @     0x2b5689fe62b0  google::LogMessageFatal::~LogMessageFatal()
    @     0x2b5689f3b512  process::HttpProxy::waited()
    @     0x2b5689f68821  _ZZN7process8dispatchINS_9HttpProxyERKNS_6FutureINS_4http8ResponseEEES5_EEvRKNS_3PIDIT_EEMS9_FvT0_ET1_ENKUlPNS_11ProcessBaseEE_clESI_
    @     0x2b5689f84c72  _ZNSt17_Function_handlerIFvPN7process11ProcessBaseEEZNS0_8dispatchINS0_9HttpProxyERKNS0_6FutureINS0_4http8ResponseEEES9_EEvRKNS0_3PIDIT_EEMSD_FvT0_ET1_EUlS2_E_E9_M_invokeERKSt9_Any_dataS2_
    @     0x2b5689f62b93  std::function<>::operator()()
    @     0x2b5689f48b97  process::ProcessBase::visit()
    @     0x2b5689f4ec3e  process::DispatchEvent::visit()
    @           0x999aec  process::ProcessBase::serve()
    @     0x2b5689f44d7a  process::ProcessManager::resume()
    @     0x2b5689f41e32  _ZZN7process14ProcessManager12init_threadsEvENKUlRKSt11atomic_boolE_clES3_
    @     0x2b5689f4e42a  _ZNSt5_BindIFZN7process14ProcessManager12init_threadsEvEUlRKSt11atomic_boolE_St17reference_wrapperIS3_EEE6__callIvIEILm0EEEET_OSt5tupleIIDpT0_EESt12_Index_tupleIIXspT1_EEE
    @     0x2b5689f4e3da  _ZNSt5_BindIFZN7process14ProcessManager12init_threadsEvEUlRKSt11atomic_boolE_St17reference_wrapperIS3_EEEclIIEvEET0_DpOT_
I0223 04:54:32.322123   808 status_update_manager.cpp:374] Forwarding update TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1 of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 to the slave
    @     0x2b5689f4e36c  _ZNSt12_Bind_simpleIFSt5_BindIFZN7process14ProcessManager12init_threadsEvEUlRKSt11atomic_boolE_St17reference_wrapperIS4_EEEvEE9_M_invokeIIEEEvSt12_Index_tupleIIXspT_EEE
W0223 04:54:32.322547   807 slave.cpp:3346] Dropping status update TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1 of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 sent by status update manager because the slave is in RECOVERING state
I0223 04:54:32.322633   807 slave.cpp:3294] Status update manager successfully handled status update TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1 of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
I0223 04:54:32.322684   808 status_update_manager.cpp:320] Received status update TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1 of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
W0223 04:54:32.322749   808 status_update_manager.cpp:729] Ignoring duplicate status update TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1 of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
I0223 04:54:32.322932   808 status_update_manager.cpp:320] Received status update TASK_FINISHED (UUID: e7010e72-616f-4612-a218-47b26031630c) for task 1 of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
I0223 04:54:32.322988   808 status_update_manager.cpp:824] Checkpointing UPDATE for status update TASK_FINISHED (UUID: e7010e72-616f-4612-a218-47b26031630c) for task 1 of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
I0223 04:54:32.322988   807 slave.cpp:3294] Status update manager successfully handled status update TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1 of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
I0223 04:54:32.323981  7030 executor.cpp:588] Enqueuing event ACKNOWLEDGED received from http://172.17.0.2:44225/slave/api/v1/executor
    @     0x2b5689f4e2c3  _ZNSt12_Bind_simpleIFSt5_BindIFZN7process14ProcessManager12init_threadsEvEUlRKSt11atomic_boolE_St17reference_wrapperIS4_EEEvEEclEv
Received an ACKNOWLEDGED event
I0223 04:54:32.324774  7035 executor.cpp:588] Enqueuing event ACKNOWLEDGED received from http://172.17.0.2:44225/slave/api/v1/executor
    @     0x2b5689f4e25c  _ZNSt6thread5_ImplISt12_Bind_simpleIFSt5_BindIFZN7process14ProcessManager12init_threadsEvEUlRKSt11atomic_boolE_St17reference_wrapperIS6_EEEvEEE6_M_runEv
Received an ACKNOWLEDGED event
    @     0x2b568b5a9a60  (unknown)
    @     0x2b568bd20182  start_thread
    @     0x2b568c03047d  (unknown)
make[4]: *** [check-local] Aborted
make[4]: Leaving directory `/mesos/mesos-0.28.0/_build/src'
E0223 04:54:32.388058  7045 executor.cpp:543] Failed to decode the stream of events: Pipe::Reader failure: failed to decode body
I0223 04:54:32.388109  7045 executor.cpp:357] Disconnected from agent: Pipe::Reader failure: failed to decode body
I0223 04:54:32.388885  7045 executor.cpp:411] Will retry connecting with the agent again in 229.335627ms
I0223 04:54:32.389420  7046 poll_socket.cpp:110] Socket error while connecting
I0223 04:54:32.390028  7046 poll_socket.cpp:110] Socket error while connecting
make[3]: Leaving directory `/mesos/mesos-0.28.0/_build/src'
make[3]: *** [check-am] Error 2
I0223 04:54:32.619915  7045 executor.cpp:411] Will retry connecting with the agent again in 1.731069628secs
I0223 04:54:32.620636  7046 poll_socket.cpp:110] Socket error while connecting
I0223 04:54:32.621196  7046 poll_socket.cpp:110] Socket error while connecting
I0223 04:54:32.741152  7036 executor.cpp:411] Will retry connecting with the agent again in 1.442011578secs
I0223 04:54:32.741855  7046 poll_socket.cpp:110] Socket error while connecting
I0223 04:54:32.742288  7046 poll_socket.cpp:110] Socket error while connecting
make[2]: *** [check] Error 2
I0223 04:54:32.791136  7033 executor.cpp:411] Will retry connecting with the agent again in 98.32492ms
I0223 04:54:32.791764  7046 poll_socket.cpp:110] Socket error while connecting
I0223 04:54:32.792192  7046 poll_socket.cpp:110] Socket error while connecting
I0223 04:54:32.890908  7044 executor.cpp:411] Will retry connecting with the agent again in 898.210224ms
I0223 04:54:32.891618  7046 poll_socket.cpp:110] Socket error while connecting
I0223 04:54:32.892107  7046 poll_socket.cpp:110] Socket error while connecting
make[2]: Leaving directory `/mesos/mesos-0.28.0/_build/src'
make[1]: *** [check-recursive] Error 1
make[1]: Leaving directory `/mesos/mesos-0.28.0/_build'
make: *** [distcheck] Error 1
I0223 04:54:33.790923  7043 executor.cpp:411] Will retry connecting with the agent again in 1.972934225secs
I0223 04:54:33.791704  7046 poll_socket.cpp:110] Socket error while connecting
I0223 04:54:33.792636  7046 poll_socket.cpp:110] Socket error while connecting
+ docker rmi mesos-1456200547-15739
Untagged: mesos-1456200547-15739:latest
Deleted: 9193de3f0b38b1882cbbfb3d6ee5694dcf5151ee1a2833f14b52cd380bae13fe
Deleted: 444d8fdf50952eab775164574e105039b53d0a2cd8aeda62f5b454a199492970
Deleted: c2a9e46445b708095875b4ac48bb198cf8d4d1dc098e73124651433d036a87ea
Deleted: c92e78316db33309e8507793d29edc592153213e2cc368edd76dbad592cad11f
Deleted: 93a3b0cd2f617ef9331ca299132efde27a542bd11aafd7d14589ad3199579c3e
Deleted: b2987b7d7df3fb45eee1162eba0ddc70447d5dff8df2cc87b27118710e95fb01
Deleted: 3630456d7de8d9282da45daff4b6102f96772375fe5af7b65a5c375434948b4a
Deleted: 6e9d7c56fd36b11fcee934853b8466e93dd6571eb50e7697a7f345d7157fc8db
Deleted: 2c29443c348e745bfa8a828118538004f7693467164171c3c671663029759841
Deleted: 79e8ad7b1a2ee67d9c90102ec162ffefe055d255852186ec63f0066c491df464
Deleted: 4c5d8dde86972bbe1c5dfa1e6704ff017ed6289b79172682fe7794707c52282b
Deleted: d2ea231d7b86171b40b287d858a7ade76ede5827c0bbcee2b69e4a36e9104470
Deleted: f9553eb5c4f2b4c7d810817fbd9589a677b0c7c3bf9e9946067bfec88e219952
Deleted: 94bbb7ff9d2a4c48e26b724b3b3636be51b02ac826931769d38f57f2cdce15b2
Deleted: 8b3ba91524a0977c4e605c3fc371fed0cf713493f912729ea7ef4a3a3cbc0f57
Deleted: 6a8a5578a15622143862e27b69966665af9f4fd419714233d1b4f7b201427c09
Build step 'Execute shell' marked build as failure

Jenkins build is back to normal : Mesos » gcc,--verbose,GLOG_v=1 MESOS_VERBOSE=1,ubuntu:14.04,(docker||Hadoop)&&(!ubuntu-us1) #1705

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/Mesos/COMPILER=gcc,CONFIGURATION=--verbose,ENVIRONMENT=GLOG_v=1%20MESOS_VERBOSE=1,OS=ubuntu%3A14.04,label_exp=(docker%7C%7CHadoop)&&(!ubuntu-us1)/1705/changes>


Re: Build failed in Jenkins: Mesos » gcc,--verbose,GLOG_v=1 MESOS_VERBOSE=1,ubuntu:14.04,(docker||Hadoop)&&(!ubuntu-us1) #1704

Posted by Anand Mazumdar <an...@mesosphere.io>.
Neil came across this yesterday too and filed:  https://issues.apache.org/jira/browse/MESOS-4739 <https://issues.apache.org/jira/browse/MESOS-4739>

	F0223 04:54:32.200620   806 process.cpp:1114] Check failed: items.size() > 0 

I updated the issue with the new logs.

-anand

> On Feb 22, 2016, at 10:19 PM, Vinod Kone <vi...@apache.org> wrote:
> 
> Anand, have you seen this before?
> 
> On Mon, Feb 22, 2016 at 8:54 PM, Apache Jenkins Server <
> jenkins@builds.apache.org> wrote:
> 
>> See <
>> https://builds.apache.org/job/Mesos/COMPILER=gcc,CONFIGURATION=--verbose,ENVIRONMENT=GLOG_v=1%20MESOS_VERBOSE=1,OS=ubuntu%3A14.04,label_exp=(docker%7C%7CHadoop)&&(!ubuntu-us1)/1704/changes
>>> 
>> 
>> Changes:
>> 
>> [mpark] Updated the website for 0.27.1 release.
>> 
>> ------------------------------------------
>> [...truncated 120917 lines...]
>> I0223 04:54:28.935920   808 master.cpp:4240] Registering slave at
>> slave@172.17.0.2:44225 (5847d87ad902) with id
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0
>> I0223 04:54:28.936285   819 registrar.cpp:439] Applied 1 operations in
>> 53091ns; attempting to update the 'registry'
>> I0223 04:54:28.936992   818 log.cpp:683] Attempting to append 339 bytes to
>> the log
>> I0223 04:54:28.937113   805 coordinator.cpp:348] Coordinator attempting to
>> write APPEND action at position 3
>> I0223 04:54:28.937728   816 replica.cpp:537] Replica received write
>> request for position 3 from (9614)@172.17.0.2:44225
>> I0223 04:54:28.952417   807 slave.cpp:1321] Will retry registration in
>> 35.446972ms if necessary
>> I0223 04:54:28.952584   814 master.cpp:4228] Ignoring register slave
>> message from slave@172.17.0.2:44225 (5847d87ad902) as admission is
>> already in progress
>> I0223 04:54:28.981781   816 leveldb.cpp:341] Persisting action (358 bytes)
>> to leveldb took 43.997431ms
>> I0223 04:54:28.981883   816 replica.cpp:712] Persisted action at 3
>> I0223 04:54:28.982956   816 replica.cpp:691] Replica received learned
>> notice for position 3 from @0.0.0.0:0
>> I0223 04:54:28.989023   818 slave.cpp:1321] Will retry registration in
>> 52.677739ms if necessary
>> I0223 04:54:28.989296   818 master.cpp:4228] Ignoring register slave
>> message from slave@172.17.0.2:44225 (5847d87ad902) as admission is
>> already in progress
>> I0223 04:54:29.032562   816 leveldb.cpp:341] Persisting action (360 bytes)
>> to leveldb took 49.562387ms
>> I0223 04:54:29.032641   816 replica.cpp:712] Persisted action at 3
>> I0223 04:54:29.032675   816 replica.cpp:697] Replica learned APPEND action
>> at position 3
>> I0223 04:54:29.034543   807 registrar.cpp:484] Successfully updated the
>> 'registry' in 98.188032ms
>> I0223 04:54:29.034868   818 log.cpp:702] Attempting to truncate the log to
>> 3
>> I0223 04:54:29.035054   819 coordinator.cpp:348] Coordinator attempting to
>> write TRUNCATE action at position 4
>> I0223 04:54:29.035475   806 slave.cpp:3482] Received ping from
>> slave-observer(278)@172.17.0.2:44225
>> I0223 04:54:29.035616   820 master.cpp:4308] Registered slave
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 at slave@172.17.0.2:44225
>> (5847d87ad902) with cpus(*):2; mem(*):1024; disk(*):1024;
>> ports(*):[31000-32000]
>> I0223 04:54:29.035703   809 slave.cpp:971] Registered with master
>> master@172.17.0.2:44225; given slave ID
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0
>> I0223 04:54:29.035728   809 fetcher.cpp:81] Clearing fetcher cache
>> I0223 04:54:29.035836   814 hierarchical.cpp:473] Added slave
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 (5847d87ad902) with cpus(*):2;
>> mem(*):1024; disk(*):1024; ports(*):[31000-32000] (allocated: )
>> I0223 04:54:29.035892   815 status_update_manager.cpp:181] Resuming
>> sending status updates
>> I0223 04:54:29.035941   819 replica.cpp:537] Replica received write
>> request for position 4 from (9615)@172.17.0.2:44225
>> I0223 04:54:29.036110   809 slave.cpp:994] Checkpointing SlaveInfo to
>> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/
>> slave.info'
>> I0223 04:54:29.036485   809 slave.cpp:1030] Forwarding total
>> oversubscribed resources
>> I0223 04:54:29.036645   813 master.cpp:4649] Received update of slave
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 at slave@172.17.0.2:44225
>> (5847d87ad902) with total oversubscribed resources
>> I0223 04:54:29.036782   814 hierarchical.cpp:1529] No inverse offers to
>> send out!
>> I0223 04:54:29.036818   814 hierarchical.cpp:1147] Performed allocation
>> for slave 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 in 935779ns
>> I0223 04:54:29.037040   813 master.cpp:5355] Sending 1 offers to framework
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (default) at
>> scheduler-3cf586e5-0306-4d44-a767-644193a0b441@172.17.0.2:44225
>> I0223 04:54:29.037104   814 hierarchical.cpp:531] Slave
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 (5847d87ad902) updated with
>> oversubscribed resources  (total: cpus(*):2; mem(*):1024; disk(*):1024;
>> ports(*):[31000-32000], allocated: cpus(*):2; mem(*):1024; disk(*):1024;
>> ports(*):[31000-32000])
>> I0223 04:54:29.037240   814 hierarchical.cpp:1434] No resources available
>> to allocate!
>> I0223 04:54:29.037282   814 hierarchical.cpp:1529] No inverse offers to
>> send out!
>> I0223 04:54:29.037307   814 hierarchical.cpp:1147] Performed allocation
>> for slave 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 in 160900ns
>> I0223 04:54:29.037569   809 sched.cpp:873] Scheduler::resourceOffers took
>> 195666ns
>> I0223 04:54:29.039176   807 master.cpp:3138] Processing ACCEPT call for
>> offers: [ 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-O0 ] on slave
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 at slave@172.17.0.2:44225
>> (5847d87ad902) for framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> (default) at
>> scheduler-3cf586e5-0306-4d44-a767-644193a0b441@172.17.0.2:44225
>> I0223 04:54:29.039221   807 master.cpp:2825] Authorizing framework
>> principal 'test-principal' to launch task 1 as user 'mesos'
>> W0223 04:54:29.040493   807 validation.cpp:404] Executor http for task 1
>> uses less CPUs (None) than the minimum required (0.01). Please update your
>> executor, as this will be mandatory in future releases.
>> W0223 04:54:29.040529   807 validation.cpp:416] Executor http for task 1
>> uses less memory (None) than the minimum required (32MB). Please update
>> your executor, as this will be mandatory in future releases.
>> I0223 04:54:29.040904   807 master.hpp:176] Adding task 1 with resources
>> cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] on slave
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 (5847d87ad902)
>> I0223 04:54:29.041144   807 master.cpp:3623] Launching task 1 of framework
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (default) at
>> scheduler-3cf586e5-0306-4d44-a767-644193a0b441@172.17.0.2:44225 with
>> resources cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] on
>> slave 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 at slave@172.17.0.2:44225
>> (5847d87ad902)
>> I0223 04:54:29.041574   809 slave.cpp:1361] Got assigned task 1 for
>> framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> I0223 04:54:29.041755   809 slave.cpp:5287] Checkpointing FrameworkInfo to
>> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/
>> framework.info'
>> I0223 04:54:29.042193   809 slave.cpp:5298] Checkpointing framework pid '
>> scheduler-3cf586e5-0306-4d44-a767-644193a0b441@172.17.0.2:44225' to
>> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/framework.pid'
>> I0223 04:54:29.043066   809 slave.cpp:1480] Launching task 1 for framework
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> I0223 04:54:29.043884   809 paths.cpp:474] Trying to chown
>> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc'
>> to user 'mesos'
>> I0223 04:54:29.055244   809 slave.cpp:5739] Checkpointing ExecutorInfo to
>> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/
>> executor.info'
>> I0223 04:54:29.055868   809 slave.cpp:5367] Launching executor http of
>> framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 with resources  in work
>> directory
>> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc'
>> I0223 04:54:29.056241   820 containerizer.cpp:666] Starting container
>> 'a43cbeed-f390-46aa-b7a1-67770a3dd4fc' for executor 'http' of framework
>> '81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000'
>> I0223 04:54:29.056298   809 slave.cpp:5762] Checkpointing TaskInfo to
>> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc/tasks/1/
>> task.info'
>> I0223 04:54:29.056675   809 slave.cpp:1698] Queuing task '1' for executor
>> 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> I0223 04:54:29.056779   809 slave.cpp:749] Successfully attached file
>> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc'
>> I0223 04:54:29.061602   815 launcher.cpp:147] Forked child with pid '6997'
>> for container 'a43cbeed-f390-46aa-b7a1-67770a3dd4fc'
>> I0223 04:54:29.061995   815 containerizer.cpp:1104] Checkpointing
>> executor's forked pid 6997 to
>> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc/pids/forked.pid'
>> I0223 04:54:29.083487   819 leveldb.cpp:341] Persisting action (16 bytes)
>> to leveldb took 47.478443ms
>> I0223 04:54:29.083585   819 replica.cpp:712] Persisted action at 4
>> I0223 04:54:29.084709   810 replica.cpp:691] Replica received learned
>> notice for position 4 from @0.0.0.0:0
>> I0223 04:54:29.122370   810 leveldb.cpp:341] Persisting action (18 bytes)
>> to leveldb took 37.598534ms
>> I0223 04:54:29.122570   810 leveldb.cpp:399] Deleting ~2 keys from leveldb
>> took 89419ns
>> I0223 04:54:29.122599   810 replica.cpp:712] Persisted action at 4
>> I0223 04:54:29.122635   810 replica.cpp:697] Replica learned TRUNCATE
>> action at position 4
>> I0223 04:54:29.606348   806 hierarchical.cpp:1434] No resources available
>> to allocate!
>> I0223 04:54:29.606449   806 hierarchical.cpp:1529] No inverse offers to
>> send out!
>> I0223 04:54:29.606494   806 hierarchical.cpp:1127] Performed allocation
>> for 1 slaves in 411327ns
>> I0223 04:54:30.607574   810 hierarchical.cpp:1434] No resources available
>> to allocate!
>> I0223 04:54:30.607647   810 hierarchical.cpp:1529] No inverse offers to
>> send out!
>> I0223 04:54:30.607676   810 hierarchical.cpp:1127] Performed allocation
>> for 1 slaves in 309149ns
>> WARNING: Logging before InitGoogleLogging() is written to STDERR
>> I0223 04:54:31.163267  7011 process.cpp:991] libprocess is initialized on
>> 172.17.0.2:47892 for 16 cpus
>> I0223 04:54:31.164299  7036 logging.cpp:193] Logging to STDERR
>> I0223 04:54:31.164322  7036 executor.cpp:172] Version: 0.28.0
>> I0223 04:54:31.166379  7045 executor.cpp:316] Connected with the agent
>> I0223 04:54:31.167551  7035 executor.cpp:247] Sending SUBSCRIBE call to
>> http://172.17.0.2:44225/slave/api/v1/executor
>> I0223 04:54:31.176286   808 process.cpp:3141] Handling HTTP event for
>> process 'slave' with path: '/slave/api/v1/executor'
>> I0223 04:54:31.176759   814 http.cpp:190] HTTP POST for
>> /slave/api/v1/executor from 172.17.0.2:42711
>> I0223 04:54:31.177016   814 slave.cpp:2476] Received Subscribe request for
>> HTTP executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> I0223 04:54:31.177106   814 slave.cpp:2539] Creating a marker file for
>> HTTP based executor 'http' of framework
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP) at path
>> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc/http.marker'
>> I0223 04:54:31.179092   813 slave.cpp:1863] Sending queued task '1' to
>> executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via
>> HTTP)
>> I0223 04:54:31.181721  7036 executor.cpp:588] Enqueuing event SUBSCRIBED
>> received from http://172.17.0.2:44225/slave/api/v1/executor
>> I0223 04:54:31.182701  7035 executor.cpp:588] Enqueuing event LAUNCH
>> received from http://172.17.0.2:44225/slave/api/v1/executor
>> Received a SUBSCRIBED event
>> Starting task 1
>> Finishing task 1
>> I0223 04:54:31.185159  7040 executor.cpp:247] Sending UPDATE call to
>> http://172.17.0.2:44225/slave/api/v1/executor
>> I0223 04:54:31.185442  7040 executor.cpp:247] Sending UPDATE call to
>> http://172.17.0.2:44225/slave/api/v1/executor
>> I0223 04:54:31.187504   811 slave.cpp:668] Slave terminating
>> I0223 04:54:31.187763   819 master.cpp:1174] Slave
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 at slave@172.17.0.2:44225
>> (5847d87ad902) disconnected
>> I0223 04:54:31.187794   819 master.cpp:2635] Disconnecting slave
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 at slave@172.17.0.2:44225
>> (5847d87ad902)
>> I0223 04:54:31.187850   819 master.cpp:2654] Deactivating slave
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 at slave@172.17.0.2:44225
>> (5847d87ad902)
>> I0223 04:54:31.187969   809 hierarchical.cpp:560] Slave
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 deactivated
>> I0223 04:54:31.188148  7037 executor.cpp:586] Enqueuing locally injected
>> event ERROR
>> Received an ERROR event
>> I0223 04:54:31.189012  7044 executor.cpp:586] Enqueuing locally injected
>> event ERROR
>> Received an ERROR event
>> E0223 04:54:31.189673  7044 executor.cpp:553] End-Of-File received from
>> agent. The agent closed the event stream
>> I0223 04:54:31.189709  7044 executor.cpp:357] Disconnected from agent:
>> End-Of-File received from agent. The agent closed the event stream
>> I0223 04:54:31.190441  7044 executor.cpp:411] Will retry connecting with
>> the agent again in 1.548772469secs
>> I0223 04:54:31.191680   786 containerizer.cpp:149] Using isolation:
>> posix/cpu,posix/mem,filesystem/posix
>> W0223 04:54:31.192128   786 backend.cpp:48] Failed to create 'bind'
>> backend: BindBackend requires root privileges
>> I0223 04:54:31.192425  7033 executor.cpp:316] Connected with the agent
>> I0223 04:54:31.193727  7034 executor.cpp:247] Sending SUBSCRIBE call to
>> http://172.17.0.2:44225/slave/api/v1/executor
>> I0223 04:54:31.194473   821 process.cpp:2409] Returning '404 Not Found'
>> for '/slave/api/v1/executor'
>> W0223 04:54:31.195523  7041 executor.cpp:509] Received '404 Not Found' ()
>> for SUBSCRIBE
>> I0223 04:54:31.195714   817 slave.cpp:193] Slave started on
>> 172.17.0.2:44225
>> I0223 04:54:31.195780   817 slave.cpp:194] Flags at startup:
>> --appc_simple_discovery_uri_prefix="http://"
>> --appc_store_dir="/tmp/mesos/store/appc" --authenticatee="crammd5"
>> --cgroups_cpu_enable_pids_and_tids_count="false"
>> --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup"
>> --cgroups_limit_swap="false" --cgroups_root="mesos"
>> --container_disk_watch_interval="15secs" --containerizers="mesos"
>> --credential="/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/credential"
>> --default_role="*" --disk_watch_interval="1mins" --docker="docker"
>> --docker_auth_server="https://auth.docker.io"
>> --docker_kill_orphans="true" --docker_puller_timeout="60"
>> --docker_registry="https://registry-1.docker.io"
>> --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock"
>> --docker_stop_timeout="0ns" --docker_store_dir="/tmp/mesos/store/docker"
>> --enforce_container_disk_quota="false"
>> --executor_registration_timeout="1mins"
>> --executor_shutdown_grace_period="5secs"
>> --fetcher_cache_dir="/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/fetch"
>> --fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks"
>> --gc_disk_headroom="0.1" --hadoop_home="" --help="false"
>> --hostname_lookup="true" --image_provisioner_backend="copy"
>> --initialize_driver_logging="true" --isolation="posix/cpu,posix/mem"
>> --launcher_dir="/mesos/mesos-0.28.0/_build/src" --logbufsecs="0"
>> --logging_level="INFO" --oversubscribed_resources_interval="15secs"
>> --perf_duration="10secs" --perf_interval="1mins"
>> --qos_correction_interval_min="0ns" --quiet="false" --recover="reconnect"
>> --recovery_timeout="15mins" --registration_backoff_factor="10ms"
>> --resources="cpus:2;mem:1024;disk:1024;ports:[31000-32000]"
>> --revocable_cpu_low_priority="true"
>> --sandbox_directory="/mnt/mesos/sandbox" --strict="true"
>> --switch_user="true" --systemd_enable_support="true"
>> --systemd_runtime_directory="/run/systemd/system" --version="false"
>> --work_dir="/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU"
>> I0223 04:54:31.196280   817 credentials.hpp:83] Loading credential for
>> authentication from
>> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/credential'
>> I0223 04:54:31.196491   817 slave.cpp:324] Slave using credential for:
>> test-principal
>> I0223 04:54:31.196655   817 resources.cpp:576] Parsing resources as JSON
>> failed: cpus:2;mem:1024;disk:1024;ports:[31000-32000]
>> Trying semicolon-delimited string format instead
>> I0223 04:54:31.197144   817 slave.cpp:464] Slave resources: cpus(*):2;
>> mem(*):1024; disk(*):1024; ports(*):[31000-32000]
>> I0223 04:54:31.197226   817 slave.cpp:472] Slave attributes: [  ]
>> I0223 04:54:31.197242   817 slave.cpp:477] Slave hostname: 5847d87ad902
>> I0223 04:54:31.198366   816 state.cpp:58] Recovering state from
>> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta'
>> I0223 04:54:31.198439   816 state.cpp:698] No checkpointed resources found
>> at '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/resources/
>> resources.info'
>> W0223 04:54:31.200115   816 state.cpp:607] Failed to find status updates
>> file
>> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc/tasks/1/task.updates'
>> I0223 04:54:31.202293   819 fetcher.cpp:81] Clearing fetcher cache
>> I0223 04:54:31.202379   819 slave.cpp:4653] Recovering framework
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> I0223 04:54:31.202507   819 slave.cpp:5476] Recovering executor 'http' of
>> framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> I0223 04:54:31.203364   810 status_update_manager.cpp:200] Recovering
>> status update manager
>> I0223 04:54:31.203483   810 status_update_manager.cpp:208] Recovering
>> executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> W0223 04:54:31.203572   810 status_update_manager.cpp:247] No updates
>> found for task 1 of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> I0223 04:54:31.203832   819 slave.cpp:749] Successfully attached file
>> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc'
>> I0223 04:54:31.204326   820 containerizer.cpp:407] Recovering containerizer
>> I0223 04:54:31.204448   820 containerizer.cpp:462] Recovering container
>> 'a43cbeed-f390-46aa-b7a1-67770a3dd4fc' for executor 'http' of framework
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> I0223 04:54:31.206951   820 provisioner.cpp:245] Provisioner recovery
>> complete
>> I0223 04:54:31.208343   806 slave.cpp:4512] Waiting for executor 'http' of
>> framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP) to subscribe
>> I0223 04:54:31.608290   815 hierarchical.cpp:1434] No resources available
>> to allocate!
>> I0223 04:54:31.608355   815 hierarchical.cpp:1529] No inverse offers to
>> send out!
>> I0223 04:54:31.608387   815 hierarchical.cpp:1127] Performed allocation
>> for 1 slaves in 252147ns
>> I0223 04:54:32.169790  7044 executor.cpp:247] Sending SUBSCRIBE call to
>> http://172.17.0.2:44225/slave/api/v1/executor
>> I0223 04:54:32.172236   807 process.cpp:3141] Handling HTTP event for
>> process 'slave' with path: '/slave/api/v1/executor'
>> I0223 04:54:32.173068   807 http.cpp:190] HTTP POST for
>> /slave/api/v1/executor from 172.17.0.2:42713
>> I0223 04:54:32.173709   807 slave.cpp:2476] Received Subscribe request for
>> HTTP executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> (via HTTP)
>> I0223 04:54:32.173815   807 slave.cpp:2539] Creating a marker file for
>> HTTP based executor 'http' of framework
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP) at path
>> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc/http.marker'
>> I0223 04:54:32.194341  7044 executor.cpp:247] Sending SUBSCRIBE call to
>> http://172.17.0.2:44225/slave/api/v1/executor
>> I0223 04:54:32.196682   807 slave.cpp:3002] Handling status update
>> TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1 of
>> framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> I0223 04:54:32.196950   807 slave.cpp:3002] Handling status update
>> TASK_FINISHED (UUID: e7010e72-616f-4612-a218-47b26031630c) for task 1 of
>> framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> I0223 04:54:32.198343   811 process.cpp:3141] Handling HTTP event for
>> process 'slave' with path: '/slave/api/v1/executor'
>> I0223 04:54:32.198863   808 status_update_manager.cpp:320] Received status
>> update TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1
>> of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> I0223 04:54:32.198905   808 status_update_manager.cpp:497] Creating
>> StatusUpdate stream for task 1 of framework
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> I0223 04:54:32.198945   811 http.cpp:190] HTTP POST for
>> /slave/api/v1/executor from 172.17.0.2:42713
>> I0223 04:54:32.199236   811 slave.cpp:2476] Received Subscribe request for
>> HTTP executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> (via HTTP)
>> W0223 04:54:32.199256   811 slave.cpp:2518] Closing already existing HTTP
>> connection from executor 'http' of framework
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP)
>> I0223 04:54:32.199362   811 slave.cpp:2539] Creating a marker file for
>> HTTP based executor 'http' of framework
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP) at path
>> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc/http.marker'
>> I0223 04:54:32.199448   808 status_update_manager.cpp:824] Checkpointing
>> UPDATE for status update TASK_RUNNING (UUID:
>> 848bc119-6693-4601-a8d4-4211db292639) for task 1 of framework
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> I0223 04:54:32.199654   811 slave.cpp:3002] Handling status update
>> TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1 of
>> framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> I0223 04:54:32.199822   811 slave.cpp:3002] Handling status update
>> TASK_FINISHED (UUID: e7010e72-616f-4612-a218-47b26031630c) for task 1 of
>> framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> I0223 04:54:32.200212  7040 executor.cpp:588] Enqueuing event SUBSCRIBED
>> received from http://172.17.0.2:44225/slave/api/v1/executor
>> I0223 04:54:32.200510   811 slave.cpp:5677] Terminating task 1
>> F0223 04:54:32.200620   806 process.cpp:1114] Check failed: items.size() >
>> 0
>> E0223 04:54:32.201045  7040 executor.cpp:553] End-Of-File received from
>> agent. The agent closed the event stream
>> I0223 04:54:32.201124  7040 executor.cpp:357] Disconnected from agent:
>> End-Of-File received from agent. The agent closed the event stream
>> Received a SUBSCRIBED event
>> I0223 04:54:32.201858  7040 executor.cpp:411] Will retry connecting with
>> the agent again in 587.356137ms
>> E0223 04:54:32.203120  7040 executor.cpp:543] Failed to decode the stream
>> of events: Pipe::Reader failure: failed to decode body
>> I0223 04:54:32.203341  7031 executor.cpp:316] Connected with the agent
>> I0223 04:54:32.204586  7040 executor.cpp:247] Sending SUBSCRIBE call to
>> http://172.17.0.2:44225/slave/api/v1/executor
>> *** Check failure stack trace: ***
>> I0223 04:54:32.205591   820 process.cpp:3141] Handling HTTP event for
>> process 'slave' with path: '/slave/api/v1/executor'
>> I0223 04:54:32.242341   819 http.cpp:190] HTTP POST for
>> /slave/api/v1/executor from 172.17.0.2:42715
>> I0223 04:54:32.242702   819 slave.cpp:2476] Received Subscribe request for
>> HTTP executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> (via HTTP)
>> W0223 04:54:32.242722   819 slave.cpp:2518] Closing already existing HTTP
>> connection from executor 'http' of framework
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP)
>> I0223 04:54:32.242769   819 slave.cpp:2539] Creating a marker file for
>> HTTP based executor 'http' of framework
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP) at path
>> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc/http.marker'
>>    @     0x2b5689fe3a4e  google::LogMessage::Fail()
>>    @     0x2b5689fe399a  google::LogMessage::SendToLog()
>> I0223 04:54:32.264030   819 slave.cpp:3002] Handling status update
>> TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1 of
>> framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> I0223 04:54:32.264382   819 slave.cpp:3002] Handling status update
>> TASK_FINISHED (UUID: e7010e72-616f-4612-a218-47b26031630c) for task 1 of
>> framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>>    @     0x2b5689fe339c  google::LogMessage::Flush()
>> I0223 04:54:32.268173  7045 executor.cpp:588] Enqueuing event SUBSCRIBED
>> received from http://172.17.0.2:44225/slave/api/v1/executor
>> Received a SUBSCRIBED event
>>    @     0x2b5689fe62b0  google::LogMessageFatal::~LogMessageFatal()
>>    @     0x2b5689f3b512  process::HttpProxy::waited()
>>    @     0x2b5689f68821
>> _ZZN7process8dispatchINS_9HttpProxyERKNS_6FutureINS_4http8ResponseEEES5_EEvRKNS_3PIDIT_EEMS9_FvT0_ET1_ENKUlPNS_11ProcessBaseEE_clESI_
>>    @     0x2b5689f84c72
>> _ZNSt17_Function_handlerIFvPN7process11ProcessBaseEEZNS0_8dispatchINS0_9HttpProxyERKNS0_6FutureINS0_4http8ResponseEEES9_EEvRKNS0_3PIDIT_EEMSD_FvT0_ET1_EUlS2_E_E9_M_invokeERKSt9_Any_dataS2_
>>    @     0x2b5689f62b93  std::function<>::operator()()
>>    @     0x2b5689f48b97  process::ProcessBase::visit()
>>    @     0x2b5689f4ec3e  process::DispatchEvent::visit()
>>    @           0x999aec  process::ProcessBase::serve()
>>    @     0x2b5689f44d7a  process::ProcessManager::resume()
>>    @     0x2b5689f41e32
>> _ZZN7process14ProcessManager12init_threadsEvENKUlRKSt11atomic_boolE_clES3_
>>    @     0x2b5689f4e42a
>> _ZNSt5_BindIFZN7process14ProcessManager12init_threadsEvEUlRKSt11atomic_boolE_St17reference_wrapperIS3_EEE6__callIvIEILm0EEEET_OSt5tupleIIDpT0_EESt12_Index_tupleIIXspT1_EEE
>>    @     0x2b5689f4e3da
>> _ZNSt5_BindIFZN7process14ProcessManager12init_threadsEvEUlRKSt11atomic_boolE_St17reference_wrapperIS3_EEEclIIEvEET0_DpOT_
>> I0223 04:54:32.322123   808 status_update_manager.cpp:374] Forwarding
>> update TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1
>> of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 to the slave
>>    @     0x2b5689f4e36c
>> _ZNSt12_Bind_simpleIFSt5_BindIFZN7process14ProcessManager12init_threadsEvEUlRKSt11atomic_boolE_St17reference_wrapperIS4_EEEvEE9_M_invokeIIEEEvSt12_Index_tupleIIXspT_EEE
>> W0223 04:54:32.322547   807 slave.cpp:3346] Dropping status update
>> TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1 of
>> framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 sent by status update
>> manager because the slave is in RECOVERING state
>> I0223 04:54:32.322633   807 slave.cpp:3294] Status update manager
>> successfully handled status update TASK_RUNNING (UUID:
>> 848bc119-6693-4601-a8d4-4211db292639) for task 1 of framework
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> I0223 04:54:32.322684   808 status_update_manager.cpp:320] Received status
>> update TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1
>> of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> W0223 04:54:32.322749   808 status_update_manager.cpp:729] Ignoring
>> duplicate status update TASK_RUNNING (UUID:
>> 848bc119-6693-4601-a8d4-4211db292639) for task 1 of framework
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> I0223 04:54:32.322932   808 status_update_manager.cpp:320] Received status
>> update TASK_FINISHED (UUID: e7010e72-616f-4612-a218-47b26031630c) for task
>> 1 of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> I0223 04:54:32.322988   808 status_update_manager.cpp:824] Checkpointing
>> UPDATE for status update TASK_FINISHED (UUID:
>> e7010e72-616f-4612-a218-47b26031630c) for task 1 of framework
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> I0223 04:54:32.322988   807 slave.cpp:3294] Status update manager
>> successfully handled status update TASK_RUNNING (UUID:
>> 848bc119-6693-4601-a8d4-4211db292639) for task 1 of framework
>> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>> I0223 04:54:32.323981  7030 executor.cpp:588] Enqueuing event ACKNOWLEDGED
>> received from http://172.17.0.2:44225/slave/api/v1/executor
>>    @     0x2b5689f4e2c3
>> _ZNSt12_Bind_simpleIFSt5_BindIFZN7process14ProcessManager12init_threadsEvEUlRKSt11atomic_boolE_St17reference_wrapperIS4_EEEvEEclEv
>> Received an ACKNOWLEDGED event
>> I0223 04:54:32.324774  7035 executor.cpp:588] Enqueuing event ACKNOWLEDGED
>> received from http://172.17.0.2:44225/slave/api/v1/executor
>>    @     0x2b5689f4e25c
>> _ZNSt6thread5_ImplISt12_Bind_simpleIFSt5_BindIFZN7process14ProcessManager12init_threadsEvEUlRKSt11atomic_boolE_St17reference_wrapperIS6_EEEvEEE6_M_runEv
>> Received an ACKNOWLEDGED event
>>    @     0x2b568b5a9a60  (unknown)
>>    @     0x2b568bd20182  start_thread
>>    @     0x2b568c03047d  (unknown)
>> make[4]: *** [check-local] Aborted
>> make[4]: Leaving directory `/mesos/mesos-0.28.0/_build/src'
>> E0223 04:54:32.388058  7045 executor.cpp:543] Failed to decode the stream
>> of events: Pipe::Reader failure: failed to decode body
>> I0223 04:54:32.388109  7045 executor.cpp:357] Disconnected from agent:
>> Pipe::Reader failure: failed to decode body
>> I0223 04:54:32.388885  7045 executor.cpp:411] Will retry connecting with
>> the agent again in 229.335627ms
>> I0223 04:54:32.389420  7046 poll_socket.cpp:110] Socket error while
>> connecting
>> I0223 04:54:32.390028  7046 poll_socket.cpp:110] Socket error while
>> connecting
>> make[3]: Leaving directory `/mesos/mesos-0.28.0/_build/src'
>> make[3]: *** [check-am] Error 2
>> I0223 04:54:32.619915  7045 executor.cpp:411] Will retry connecting with
>> the agent again in 1.731069628secs
>> I0223 04:54:32.620636  7046 poll_socket.cpp:110] Socket error while
>> connecting
>> I0223 04:54:32.621196  7046 poll_socket.cpp:110] Socket error while
>> connecting
>> I0223 04:54:32.741152  7036 executor.cpp:411] Will retry connecting with
>> the agent again in 1.442011578secs
>> I0223 04:54:32.741855  7046 poll_socket.cpp:110] Socket error while
>> connecting
>> I0223 04:54:32.742288  7046 poll_socket.cpp:110] Socket error while
>> connecting
>> make[2]: *** [check] Error 2
>> I0223 04:54:32.791136  7033 executor.cpp:411] Will retry connecting with
>> the agent again in 98.32492ms
>> I0223 04:54:32.791764  7046 poll_socket.cpp:110] Socket error while
>> connecting
>> I0223 04:54:32.792192  7046 poll_socket.cpp:110] Socket error while
>> connecting
>> I0223 04:54:32.890908  7044 executor.cpp:411] Will retry connecting with
>> the agent again in 898.210224ms
>> I0223 04:54:32.891618  7046 poll_socket.cpp:110] Socket error while
>> connecting
>> I0223 04:54:32.892107  7046 poll_socket.cpp:110] Socket error while
>> connecting
>> make[2]: Leaving directory `/mesos/mesos-0.28.0/_build/src'
>> make[1]: *** [check-recursive] Error 1
>> make[1]: Leaving directory `/mesos/mesos-0.28.0/_build'
>> make: *** [distcheck] Error 1
>> I0223 04:54:33.790923  7043 executor.cpp:411] Will retry connecting with
>> the agent again in 1.972934225secs
>> I0223 04:54:33.791704  7046 poll_socket.cpp:110] Socket error while
>> connecting
>> I0223 04:54:33.792636  7046 poll_socket.cpp:110] Socket error while
>> connecting
>> + docker rmi mesos-1456200547-15739
>> Untagged: mesos-1456200547-15739:latest
>> Deleted: 9193de3f0b38b1882cbbfb3d6ee5694dcf5151ee1a2833f14b52cd380bae13fe
>> Deleted: 444d8fdf50952eab775164574e105039b53d0a2cd8aeda62f5b454a199492970
>> Deleted: c2a9e46445b708095875b4ac48bb198cf8d4d1dc098e73124651433d036a87ea
>> Deleted: c92e78316db33309e8507793d29edc592153213e2cc368edd76dbad592cad11f
>> Deleted: 93a3b0cd2f617ef9331ca299132efde27a542bd11aafd7d14589ad3199579c3e
>> Deleted: b2987b7d7df3fb45eee1162eba0ddc70447d5dff8df2cc87b27118710e95fb01
>> Deleted: 3630456d7de8d9282da45daff4b6102f96772375fe5af7b65a5c375434948b4a
>> Deleted: 6e9d7c56fd36b11fcee934853b8466e93dd6571eb50e7697a7f345d7157fc8db
>> Deleted: 2c29443c348e745bfa8a828118538004f7693467164171c3c671663029759841
>> Deleted: 79e8ad7b1a2ee67d9c90102ec162ffefe055d255852186ec63f0066c491df464
>> Deleted: 4c5d8dde86972bbe1c5dfa1e6704ff017ed6289b79172682fe7794707c52282b
>> Deleted: d2ea231d7b86171b40b287d858a7ade76ede5827c0bbcee2b69e4a36e9104470
>> Deleted: f9553eb5c4f2b4c7d810817fbd9589a677b0c7c3bf9e9946067bfec88e219952
>> Deleted: 94bbb7ff9d2a4c48e26b724b3b3636be51b02ac826931769d38f57f2cdce15b2
>> Deleted: 8b3ba91524a0977c4e605c3fc371fed0cf713493f912729ea7ef4a3a3cbc0f57
>> Deleted: 6a8a5578a15622143862e27b69966665af9f4fd419714233d1b4f7b201427c09
>> Build step 'Execute shell' marked build as failure
>> 


Re: Build failed in Jenkins: Mesos » gcc,--verbose,GLOG_v=1 MESOS_VERBOSE=1,ubuntu:14.04,(docker||Hadoop)&&(!ubuntu-us1) #1704

Posted by Vinod Kone <vi...@apache.org>.
Anand, have you seen this before?

On Mon, Feb 22, 2016 at 8:54 PM, Apache Jenkins Server <
jenkins@builds.apache.org> wrote:

> See <
> https://builds.apache.org/job/Mesos/COMPILER=gcc,CONFIGURATION=--verbose,ENVIRONMENT=GLOG_v=1%20MESOS_VERBOSE=1,OS=ubuntu%3A14.04,label_exp=(docker%7C%7CHadoop)&&(!ubuntu-us1)/1704/changes
> >
>
> Changes:
>
> [mpark] Updated the website for 0.27.1 release.
>
> ------------------------------------------
> [...truncated 120917 lines...]
> I0223 04:54:28.935920   808 master.cpp:4240] Registering slave at
> slave@172.17.0.2:44225 (5847d87ad902) with id
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0
> I0223 04:54:28.936285   819 registrar.cpp:439] Applied 1 operations in
> 53091ns; attempting to update the 'registry'
> I0223 04:54:28.936992   818 log.cpp:683] Attempting to append 339 bytes to
> the log
> I0223 04:54:28.937113   805 coordinator.cpp:348] Coordinator attempting to
> write APPEND action at position 3
> I0223 04:54:28.937728   816 replica.cpp:537] Replica received write
> request for position 3 from (9614)@172.17.0.2:44225
> I0223 04:54:28.952417   807 slave.cpp:1321] Will retry registration in
> 35.446972ms if necessary
> I0223 04:54:28.952584   814 master.cpp:4228] Ignoring register slave
> message from slave@172.17.0.2:44225 (5847d87ad902) as admission is
> already in progress
> I0223 04:54:28.981781   816 leveldb.cpp:341] Persisting action (358 bytes)
> to leveldb took 43.997431ms
> I0223 04:54:28.981883   816 replica.cpp:712] Persisted action at 3
> I0223 04:54:28.982956   816 replica.cpp:691] Replica received learned
> notice for position 3 from @0.0.0.0:0
> I0223 04:54:28.989023   818 slave.cpp:1321] Will retry registration in
> 52.677739ms if necessary
> I0223 04:54:28.989296   818 master.cpp:4228] Ignoring register slave
> message from slave@172.17.0.2:44225 (5847d87ad902) as admission is
> already in progress
> I0223 04:54:29.032562   816 leveldb.cpp:341] Persisting action (360 bytes)
> to leveldb took 49.562387ms
> I0223 04:54:29.032641   816 replica.cpp:712] Persisted action at 3
> I0223 04:54:29.032675   816 replica.cpp:697] Replica learned APPEND action
> at position 3
> I0223 04:54:29.034543   807 registrar.cpp:484] Successfully updated the
> 'registry' in 98.188032ms
> I0223 04:54:29.034868   818 log.cpp:702] Attempting to truncate the log to
> 3
> I0223 04:54:29.035054   819 coordinator.cpp:348] Coordinator attempting to
> write TRUNCATE action at position 4
> I0223 04:54:29.035475   806 slave.cpp:3482] Received ping from
> slave-observer(278)@172.17.0.2:44225
> I0223 04:54:29.035616   820 master.cpp:4308] Registered slave
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 at slave@172.17.0.2:44225
> (5847d87ad902) with cpus(*):2; mem(*):1024; disk(*):1024;
> ports(*):[31000-32000]
> I0223 04:54:29.035703   809 slave.cpp:971] Registered with master
> master@172.17.0.2:44225; given slave ID
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0
> I0223 04:54:29.035728   809 fetcher.cpp:81] Clearing fetcher cache
> I0223 04:54:29.035836   814 hierarchical.cpp:473] Added slave
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 (5847d87ad902) with cpus(*):2;
> mem(*):1024; disk(*):1024; ports(*):[31000-32000] (allocated: )
> I0223 04:54:29.035892   815 status_update_manager.cpp:181] Resuming
> sending status updates
> I0223 04:54:29.035941   819 replica.cpp:537] Replica received write
> request for position 4 from (9615)@172.17.0.2:44225
> I0223 04:54:29.036110   809 slave.cpp:994] Checkpointing SlaveInfo to
> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/
> slave.info'
> I0223 04:54:29.036485   809 slave.cpp:1030] Forwarding total
> oversubscribed resources
> I0223 04:54:29.036645   813 master.cpp:4649] Received update of slave
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 at slave@172.17.0.2:44225
> (5847d87ad902) with total oversubscribed resources
> I0223 04:54:29.036782   814 hierarchical.cpp:1529] No inverse offers to
> send out!
> I0223 04:54:29.036818   814 hierarchical.cpp:1147] Performed allocation
> for slave 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 in 935779ns
> I0223 04:54:29.037040   813 master.cpp:5355] Sending 1 offers to framework
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (default) at
> scheduler-3cf586e5-0306-4d44-a767-644193a0b441@172.17.0.2:44225
> I0223 04:54:29.037104   814 hierarchical.cpp:531] Slave
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 (5847d87ad902) updated with
> oversubscribed resources  (total: cpus(*):2; mem(*):1024; disk(*):1024;
> ports(*):[31000-32000], allocated: cpus(*):2; mem(*):1024; disk(*):1024;
> ports(*):[31000-32000])
> I0223 04:54:29.037240   814 hierarchical.cpp:1434] No resources available
> to allocate!
> I0223 04:54:29.037282   814 hierarchical.cpp:1529] No inverse offers to
> send out!
> I0223 04:54:29.037307   814 hierarchical.cpp:1147] Performed allocation
> for slave 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 in 160900ns
> I0223 04:54:29.037569   809 sched.cpp:873] Scheduler::resourceOffers took
> 195666ns
> I0223 04:54:29.039176   807 master.cpp:3138] Processing ACCEPT call for
> offers: [ 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-O0 ] on slave
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 at slave@172.17.0.2:44225
> (5847d87ad902) for framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> (default) at
> scheduler-3cf586e5-0306-4d44-a767-644193a0b441@172.17.0.2:44225
> I0223 04:54:29.039221   807 master.cpp:2825] Authorizing framework
> principal 'test-principal' to launch task 1 as user 'mesos'
> W0223 04:54:29.040493   807 validation.cpp:404] Executor http for task 1
> uses less CPUs (None) than the minimum required (0.01). Please update your
> executor, as this will be mandatory in future releases.
> W0223 04:54:29.040529   807 validation.cpp:416] Executor http for task 1
> uses less memory (None) than the minimum required (32MB). Please update
> your executor, as this will be mandatory in future releases.
> I0223 04:54:29.040904   807 master.hpp:176] Adding task 1 with resources
> cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] on slave
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 (5847d87ad902)
> I0223 04:54:29.041144   807 master.cpp:3623] Launching task 1 of framework
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (default) at
> scheduler-3cf586e5-0306-4d44-a767-644193a0b441@172.17.0.2:44225 with
> resources cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] on
> slave 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 at slave@172.17.0.2:44225
> (5847d87ad902)
> I0223 04:54:29.041574   809 slave.cpp:1361] Got assigned task 1 for
> framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> I0223 04:54:29.041755   809 slave.cpp:5287] Checkpointing FrameworkInfo to
> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/
> framework.info'
> I0223 04:54:29.042193   809 slave.cpp:5298] Checkpointing framework pid '
> scheduler-3cf586e5-0306-4d44-a767-644193a0b441@172.17.0.2:44225' to
> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/framework.pid'
> I0223 04:54:29.043066   809 slave.cpp:1480] Launching task 1 for framework
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> I0223 04:54:29.043884   809 paths.cpp:474] Trying to chown
> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc'
> to user 'mesos'
> I0223 04:54:29.055244   809 slave.cpp:5739] Checkpointing ExecutorInfo to
> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/
> executor.info'
> I0223 04:54:29.055868   809 slave.cpp:5367] Launching executor http of
> framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 with resources  in work
> directory
> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc'
> I0223 04:54:29.056241   820 containerizer.cpp:666] Starting container
> 'a43cbeed-f390-46aa-b7a1-67770a3dd4fc' for executor 'http' of framework
> '81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000'
> I0223 04:54:29.056298   809 slave.cpp:5762] Checkpointing TaskInfo to
> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc/tasks/1/
> task.info'
> I0223 04:54:29.056675   809 slave.cpp:1698] Queuing task '1' for executor
> 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> I0223 04:54:29.056779   809 slave.cpp:749] Successfully attached file
> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc'
> I0223 04:54:29.061602   815 launcher.cpp:147] Forked child with pid '6997'
> for container 'a43cbeed-f390-46aa-b7a1-67770a3dd4fc'
> I0223 04:54:29.061995   815 containerizer.cpp:1104] Checkpointing
> executor's forked pid 6997 to
> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc/pids/forked.pid'
> I0223 04:54:29.083487   819 leveldb.cpp:341] Persisting action (16 bytes)
> to leveldb took 47.478443ms
> I0223 04:54:29.083585   819 replica.cpp:712] Persisted action at 4
> I0223 04:54:29.084709   810 replica.cpp:691] Replica received learned
> notice for position 4 from @0.0.0.0:0
> I0223 04:54:29.122370   810 leveldb.cpp:341] Persisting action (18 bytes)
> to leveldb took 37.598534ms
> I0223 04:54:29.122570   810 leveldb.cpp:399] Deleting ~2 keys from leveldb
> took 89419ns
> I0223 04:54:29.122599   810 replica.cpp:712] Persisted action at 4
> I0223 04:54:29.122635   810 replica.cpp:697] Replica learned TRUNCATE
> action at position 4
> I0223 04:54:29.606348   806 hierarchical.cpp:1434] No resources available
> to allocate!
> I0223 04:54:29.606449   806 hierarchical.cpp:1529] No inverse offers to
> send out!
> I0223 04:54:29.606494   806 hierarchical.cpp:1127] Performed allocation
> for 1 slaves in 411327ns
> I0223 04:54:30.607574   810 hierarchical.cpp:1434] No resources available
> to allocate!
> I0223 04:54:30.607647   810 hierarchical.cpp:1529] No inverse offers to
> send out!
> I0223 04:54:30.607676   810 hierarchical.cpp:1127] Performed allocation
> for 1 slaves in 309149ns
> WARNING: Logging before InitGoogleLogging() is written to STDERR
> I0223 04:54:31.163267  7011 process.cpp:991] libprocess is initialized on
> 172.17.0.2:47892 for 16 cpus
> I0223 04:54:31.164299  7036 logging.cpp:193] Logging to STDERR
> I0223 04:54:31.164322  7036 executor.cpp:172] Version: 0.28.0
> I0223 04:54:31.166379  7045 executor.cpp:316] Connected with the agent
> I0223 04:54:31.167551  7035 executor.cpp:247] Sending SUBSCRIBE call to
> http://172.17.0.2:44225/slave/api/v1/executor
> I0223 04:54:31.176286   808 process.cpp:3141] Handling HTTP event for
> process 'slave' with path: '/slave/api/v1/executor'
> I0223 04:54:31.176759   814 http.cpp:190] HTTP POST for
> /slave/api/v1/executor from 172.17.0.2:42711
> I0223 04:54:31.177016   814 slave.cpp:2476] Received Subscribe request for
> HTTP executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> I0223 04:54:31.177106   814 slave.cpp:2539] Creating a marker file for
> HTTP based executor 'http' of framework
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP) at path
> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc/http.marker'
> I0223 04:54:31.179092   813 slave.cpp:1863] Sending queued task '1' to
> executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via
> HTTP)
> I0223 04:54:31.181721  7036 executor.cpp:588] Enqueuing event SUBSCRIBED
> received from http://172.17.0.2:44225/slave/api/v1/executor
> I0223 04:54:31.182701  7035 executor.cpp:588] Enqueuing event LAUNCH
> received from http://172.17.0.2:44225/slave/api/v1/executor
> Received a SUBSCRIBED event
> Starting task 1
> Finishing task 1
> I0223 04:54:31.185159  7040 executor.cpp:247] Sending UPDATE call to
> http://172.17.0.2:44225/slave/api/v1/executor
> I0223 04:54:31.185442  7040 executor.cpp:247] Sending UPDATE call to
> http://172.17.0.2:44225/slave/api/v1/executor
> I0223 04:54:31.187504   811 slave.cpp:668] Slave terminating
> I0223 04:54:31.187763   819 master.cpp:1174] Slave
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 at slave@172.17.0.2:44225
> (5847d87ad902) disconnected
> I0223 04:54:31.187794   819 master.cpp:2635] Disconnecting slave
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 at slave@172.17.0.2:44225
> (5847d87ad902)
> I0223 04:54:31.187850   819 master.cpp:2654] Deactivating slave
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 at slave@172.17.0.2:44225
> (5847d87ad902)
> I0223 04:54:31.187969   809 hierarchical.cpp:560] Slave
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0 deactivated
> I0223 04:54:31.188148  7037 executor.cpp:586] Enqueuing locally injected
> event ERROR
> Received an ERROR event
> I0223 04:54:31.189012  7044 executor.cpp:586] Enqueuing locally injected
> event ERROR
> Received an ERROR event
> E0223 04:54:31.189673  7044 executor.cpp:553] End-Of-File received from
> agent. The agent closed the event stream
> I0223 04:54:31.189709  7044 executor.cpp:357] Disconnected from agent:
> End-Of-File received from agent. The agent closed the event stream
> I0223 04:54:31.190441  7044 executor.cpp:411] Will retry connecting with
> the agent again in 1.548772469secs
> I0223 04:54:31.191680   786 containerizer.cpp:149] Using isolation:
> posix/cpu,posix/mem,filesystem/posix
> W0223 04:54:31.192128   786 backend.cpp:48] Failed to create 'bind'
> backend: BindBackend requires root privileges
> I0223 04:54:31.192425  7033 executor.cpp:316] Connected with the agent
> I0223 04:54:31.193727  7034 executor.cpp:247] Sending SUBSCRIBE call to
> http://172.17.0.2:44225/slave/api/v1/executor
> I0223 04:54:31.194473   821 process.cpp:2409] Returning '404 Not Found'
> for '/slave/api/v1/executor'
> W0223 04:54:31.195523  7041 executor.cpp:509] Received '404 Not Found' ()
> for SUBSCRIBE
> I0223 04:54:31.195714   817 slave.cpp:193] Slave started on
> 172.17.0.2:44225
> I0223 04:54:31.195780   817 slave.cpp:194] Flags at startup:
> --appc_simple_discovery_uri_prefix="http://"
> --appc_store_dir="/tmp/mesos/store/appc" --authenticatee="crammd5"
> --cgroups_cpu_enable_pids_and_tids_count="false"
> --cgroups_enable_cfs="false" --cgroups_hierarchy="/sys/fs/cgroup"
> --cgroups_limit_swap="false" --cgroups_root="mesos"
> --container_disk_watch_interval="15secs" --containerizers="mesos"
> --credential="/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/credential"
> --default_role="*" --disk_watch_interval="1mins" --docker="docker"
> --docker_auth_server="https://auth.docker.io"
> --docker_kill_orphans="true" --docker_puller_timeout="60"
> --docker_registry="https://registry-1.docker.io"
> --docker_remove_delay="6hrs" --docker_socket="/var/run/docker.sock"
> --docker_stop_timeout="0ns" --docker_store_dir="/tmp/mesos/store/docker"
> --enforce_container_disk_quota="false"
> --executor_registration_timeout="1mins"
> --executor_shutdown_grace_period="5secs"
> --fetcher_cache_dir="/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/fetch"
> --fetcher_cache_size="2GB" --frameworks_home="" --gc_delay="1weeks"
> --gc_disk_headroom="0.1" --hadoop_home="" --help="false"
> --hostname_lookup="true" --image_provisioner_backend="copy"
> --initialize_driver_logging="true" --isolation="posix/cpu,posix/mem"
> --launcher_dir="/mesos/mesos-0.28.0/_build/src" --logbufsecs="0"
> --logging_level="INFO" --oversubscribed_resources_interval="15secs"
> --perf_duration="10secs" --perf_interval="1mins"
> --qos_correction_interval_min="0ns" --quiet="false" --recover="reconnect"
> --recovery_timeout="15mins" --registration_backoff_factor="10ms"
> --resources="cpus:2;mem:1024;disk:1024;ports:[31000-32000]"
> --revocable_cpu_low_priority="true"
> --sandbox_directory="/mnt/mesos/sandbox" --strict="true"
> --switch_user="true" --systemd_enable_support="true"
> --systemd_runtime_directory="/run/systemd/system" --version="false"
> --work_dir="/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU"
> I0223 04:54:31.196280   817 credentials.hpp:83] Loading credential for
> authentication from
> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/credential'
> I0223 04:54:31.196491   817 slave.cpp:324] Slave using credential for:
> test-principal
> I0223 04:54:31.196655   817 resources.cpp:576] Parsing resources as JSON
> failed: cpus:2;mem:1024;disk:1024;ports:[31000-32000]
> Trying semicolon-delimited string format instead
> I0223 04:54:31.197144   817 slave.cpp:464] Slave resources: cpus(*):2;
> mem(*):1024; disk(*):1024; ports(*):[31000-32000]
> I0223 04:54:31.197226   817 slave.cpp:472] Slave attributes: [  ]
> I0223 04:54:31.197242   817 slave.cpp:477] Slave hostname: 5847d87ad902
> I0223 04:54:31.198366   816 state.cpp:58] Recovering state from
> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta'
> I0223 04:54:31.198439   816 state.cpp:698] No checkpointed resources found
> at '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/resources/
> resources.info'
> W0223 04:54:31.200115   816 state.cpp:607] Failed to find status updates
> file
> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc/tasks/1/task.updates'
> I0223 04:54:31.202293   819 fetcher.cpp:81] Clearing fetcher cache
> I0223 04:54:31.202379   819 slave.cpp:4653] Recovering framework
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> I0223 04:54:31.202507   819 slave.cpp:5476] Recovering executor 'http' of
> framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> I0223 04:54:31.203364   810 status_update_manager.cpp:200] Recovering
> status update manager
> I0223 04:54:31.203483   810 status_update_manager.cpp:208] Recovering
> executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> W0223 04:54:31.203572   810 status_update_manager.cpp:247] No updates
> found for task 1 of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> I0223 04:54:31.203832   819 slave.cpp:749] Successfully attached file
> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc'
> I0223 04:54:31.204326   820 containerizer.cpp:407] Recovering containerizer
> I0223 04:54:31.204448   820 containerizer.cpp:462] Recovering container
> 'a43cbeed-f390-46aa-b7a1-67770a3dd4fc' for executor 'http' of framework
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> I0223 04:54:31.206951   820 provisioner.cpp:245] Provisioner recovery
> complete
> I0223 04:54:31.208343   806 slave.cpp:4512] Waiting for executor 'http' of
> framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP) to subscribe
> I0223 04:54:31.608290   815 hierarchical.cpp:1434] No resources available
> to allocate!
> I0223 04:54:31.608355   815 hierarchical.cpp:1529] No inverse offers to
> send out!
> I0223 04:54:31.608387   815 hierarchical.cpp:1127] Performed allocation
> for 1 slaves in 252147ns
> I0223 04:54:32.169790  7044 executor.cpp:247] Sending SUBSCRIBE call to
> http://172.17.0.2:44225/slave/api/v1/executor
> I0223 04:54:32.172236   807 process.cpp:3141] Handling HTTP event for
> process 'slave' with path: '/slave/api/v1/executor'
> I0223 04:54:32.173068   807 http.cpp:190] HTTP POST for
> /slave/api/v1/executor from 172.17.0.2:42713
> I0223 04:54:32.173709   807 slave.cpp:2476] Received Subscribe request for
> HTTP executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> (via HTTP)
> I0223 04:54:32.173815   807 slave.cpp:2539] Creating a marker file for
> HTTP based executor 'http' of framework
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP) at path
> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc/http.marker'
> I0223 04:54:32.194341  7044 executor.cpp:247] Sending SUBSCRIBE call to
> http://172.17.0.2:44225/slave/api/v1/executor
> I0223 04:54:32.196682   807 slave.cpp:3002] Handling status update
> TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1 of
> framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> I0223 04:54:32.196950   807 slave.cpp:3002] Handling status update
> TASK_FINISHED (UUID: e7010e72-616f-4612-a218-47b26031630c) for task 1 of
> framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> I0223 04:54:32.198343   811 process.cpp:3141] Handling HTTP event for
> process 'slave' with path: '/slave/api/v1/executor'
> I0223 04:54:32.198863   808 status_update_manager.cpp:320] Received status
> update TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1
> of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> I0223 04:54:32.198905   808 status_update_manager.cpp:497] Creating
> StatusUpdate stream for task 1 of framework
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> I0223 04:54:32.198945   811 http.cpp:190] HTTP POST for
> /slave/api/v1/executor from 172.17.0.2:42713
> I0223 04:54:32.199236   811 slave.cpp:2476] Received Subscribe request for
> HTTP executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> (via HTTP)
> W0223 04:54:32.199256   811 slave.cpp:2518] Closing already existing HTTP
> connection from executor 'http' of framework
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP)
> I0223 04:54:32.199362   811 slave.cpp:2539] Creating a marker file for
> HTTP based executor 'http' of framework
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP) at path
> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc/http.marker'
> I0223 04:54:32.199448   808 status_update_manager.cpp:824] Checkpointing
> UPDATE for status update TASK_RUNNING (UUID:
> 848bc119-6693-4601-a8d4-4211db292639) for task 1 of framework
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> I0223 04:54:32.199654   811 slave.cpp:3002] Handling status update
> TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1 of
> framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> I0223 04:54:32.199822   811 slave.cpp:3002] Handling status update
> TASK_FINISHED (UUID: e7010e72-616f-4612-a218-47b26031630c) for task 1 of
> framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> I0223 04:54:32.200212  7040 executor.cpp:588] Enqueuing event SUBSCRIBED
> received from http://172.17.0.2:44225/slave/api/v1/executor
> I0223 04:54:32.200510   811 slave.cpp:5677] Terminating task 1
> F0223 04:54:32.200620   806 process.cpp:1114] Check failed: items.size() >
> 0
> E0223 04:54:32.201045  7040 executor.cpp:553] End-Of-File received from
> agent. The agent closed the event stream
> I0223 04:54:32.201124  7040 executor.cpp:357] Disconnected from agent:
> End-Of-File received from agent. The agent closed the event stream
> Received a SUBSCRIBED event
> I0223 04:54:32.201858  7040 executor.cpp:411] Will retry connecting with
> the agent again in 587.356137ms
> E0223 04:54:32.203120  7040 executor.cpp:543] Failed to decode the stream
> of events: Pipe::Reader failure: failed to decode body
> I0223 04:54:32.203341  7031 executor.cpp:316] Connected with the agent
> I0223 04:54:32.204586  7040 executor.cpp:247] Sending SUBSCRIBE call to
> http://172.17.0.2:44225/slave/api/v1/executor
> *** Check failure stack trace: ***
> I0223 04:54:32.205591   820 process.cpp:3141] Handling HTTP event for
> process 'slave' with path: '/slave/api/v1/executor'
> I0223 04:54:32.242341   819 http.cpp:190] HTTP POST for
> /slave/api/v1/executor from 172.17.0.2:42715
> I0223 04:54:32.242702   819 slave.cpp:2476] Received Subscribe request for
> HTTP executor 'http' of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> (via HTTP)
> W0223 04:54:32.242722   819 slave.cpp:2518] Closing already existing HTTP
> connection from executor 'http' of framework
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP)
> I0223 04:54:32.242769   819 slave.cpp:2539] Creating a marker file for
> HTTP based executor 'http' of framework
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 (via HTTP) at path
> '/tmp/SlaveRecoveryTest_0_ReconnectHTTPExecutor_vAcZBU/meta/slaves/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-S0/frameworks/81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000/executors/http/runs/a43cbeed-f390-46aa-b7a1-67770a3dd4fc/http.marker'
>     @     0x2b5689fe3a4e  google::LogMessage::Fail()
>     @     0x2b5689fe399a  google::LogMessage::SendToLog()
> I0223 04:54:32.264030   819 slave.cpp:3002] Handling status update
> TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1 of
> framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> I0223 04:54:32.264382   819 slave.cpp:3002] Handling status update
> TASK_FINISHED (UUID: e7010e72-616f-4612-a218-47b26031630c) for task 1 of
> framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
>     @     0x2b5689fe339c  google::LogMessage::Flush()
> I0223 04:54:32.268173  7045 executor.cpp:588] Enqueuing event SUBSCRIBED
> received from http://172.17.0.2:44225/slave/api/v1/executor
> Received a SUBSCRIBED event
>     @     0x2b5689fe62b0  google::LogMessageFatal::~LogMessageFatal()
>     @     0x2b5689f3b512  process::HttpProxy::waited()
>     @     0x2b5689f68821
> _ZZN7process8dispatchINS_9HttpProxyERKNS_6FutureINS_4http8ResponseEEES5_EEvRKNS_3PIDIT_EEMS9_FvT0_ET1_ENKUlPNS_11ProcessBaseEE_clESI_
>     @     0x2b5689f84c72
> _ZNSt17_Function_handlerIFvPN7process11ProcessBaseEEZNS0_8dispatchINS0_9HttpProxyERKNS0_6FutureINS0_4http8ResponseEEES9_EEvRKNS0_3PIDIT_EEMSD_FvT0_ET1_EUlS2_E_E9_M_invokeERKSt9_Any_dataS2_
>     @     0x2b5689f62b93  std::function<>::operator()()
>     @     0x2b5689f48b97  process::ProcessBase::visit()
>     @     0x2b5689f4ec3e  process::DispatchEvent::visit()
>     @           0x999aec  process::ProcessBase::serve()
>     @     0x2b5689f44d7a  process::ProcessManager::resume()
>     @     0x2b5689f41e32
> _ZZN7process14ProcessManager12init_threadsEvENKUlRKSt11atomic_boolE_clES3_
>     @     0x2b5689f4e42a
> _ZNSt5_BindIFZN7process14ProcessManager12init_threadsEvEUlRKSt11atomic_boolE_St17reference_wrapperIS3_EEE6__callIvIEILm0EEEET_OSt5tupleIIDpT0_EESt12_Index_tupleIIXspT1_EEE
>     @     0x2b5689f4e3da
> _ZNSt5_BindIFZN7process14ProcessManager12init_threadsEvEUlRKSt11atomic_boolE_St17reference_wrapperIS3_EEEclIIEvEET0_DpOT_
> I0223 04:54:32.322123   808 status_update_manager.cpp:374] Forwarding
> update TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1
> of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 to the slave
>     @     0x2b5689f4e36c
> _ZNSt12_Bind_simpleIFSt5_BindIFZN7process14ProcessManager12init_threadsEvEUlRKSt11atomic_boolE_St17reference_wrapperIS4_EEEvEE9_M_invokeIIEEEvSt12_Index_tupleIIXspT_EEE
> W0223 04:54:32.322547   807 slave.cpp:3346] Dropping status update
> TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1 of
> framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000 sent by status update
> manager because the slave is in RECOVERING state
> I0223 04:54:32.322633   807 slave.cpp:3294] Status update manager
> successfully handled status update TASK_RUNNING (UUID:
> 848bc119-6693-4601-a8d4-4211db292639) for task 1 of framework
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> I0223 04:54:32.322684   808 status_update_manager.cpp:320] Received status
> update TASK_RUNNING (UUID: 848bc119-6693-4601-a8d4-4211db292639) for task 1
> of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> W0223 04:54:32.322749   808 status_update_manager.cpp:729] Ignoring
> duplicate status update TASK_RUNNING (UUID:
> 848bc119-6693-4601-a8d4-4211db292639) for task 1 of framework
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> I0223 04:54:32.322932   808 status_update_manager.cpp:320] Received status
> update TASK_FINISHED (UUID: e7010e72-616f-4612-a218-47b26031630c) for task
> 1 of framework 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> I0223 04:54:32.322988   808 status_update_manager.cpp:824] Checkpointing
> UPDATE for status update TASK_FINISHED (UUID:
> e7010e72-616f-4612-a218-47b26031630c) for task 1 of framework
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> I0223 04:54:32.322988   807 slave.cpp:3294] Status update manager
> successfully handled status update TASK_RUNNING (UUID:
> 848bc119-6693-4601-a8d4-4211db292639) for task 1 of framework
> 81a295fc-fe1b-4ff8-9291-cd54f5c6f303-0000
> I0223 04:54:32.323981  7030 executor.cpp:588] Enqueuing event ACKNOWLEDGED
> received from http://172.17.0.2:44225/slave/api/v1/executor
>     @     0x2b5689f4e2c3
> _ZNSt12_Bind_simpleIFSt5_BindIFZN7process14ProcessManager12init_threadsEvEUlRKSt11atomic_boolE_St17reference_wrapperIS4_EEEvEEclEv
> Received an ACKNOWLEDGED event
> I0223 04:54:32.324774  7035 executor.cpp:588] Enqueuing event ACKNOWLEDGED
> received from http://172.17.0.2:44225/slave/api/v1/executor
>     @     0x2b5689f4e25c
> _ZNSt6thread5_ImplISt12_Bind_simpleIFSt5_BindIFZN7process14ProcessManager12init_threadsEvEUlRKSt11atomic_boolE_St17reference_wrapperIS6_EEEvEEE6_M_runEv
> Received an ACKNOWLEDGED event
>     @     0x2b568b5a9a60  (unknown)
>     @     0x2b568bd20182  start_thread
>     @     0x2b568c03047d  (unknown)
> make[4]: *** [check-local] Aborted
> make[4]: Leaving directory `/mesos/mesos-0.28.0/_build/src'
> E0223 04:54:32.388058  7045 executor.cpp:543] Failed to decode the stream
> of events: Pipe::Reader failure: failed to decode body
> I0223 04:54:32.388109  7045 executor.cpp:357] Disconnected from agent:
> Pipe::Reader failure: failed to decode body
> I0223 04:54:32.388885  7045 executor.cpp:411] Will retry connecting with
> the agent again in 229.335627ms
> I0223 04:54:32.389420  7046 poll_socket.cpp:110] Socket error while
> connecting
> I0223 04:54:32.390028  7046 poll_socket.cpp:110] Socket error while
> connecting
> make[3]: Leaving directory `/mesos/mesos-0.28.0/_build/src'
> make[3]: *** [check-am] Error 2
> I0223 04:54:32.619915  7045 executor.cpp:411] Will retry connecting with
> the agent again in 1.731069628secs
> I0223 04:54:32.620636  7046 poll_socket.cpp:110] Socket error while
> connecting
> I0223 04:54:32.621196  7046 poll_socket.cpp:110] Socket error while
> connecting
> I0223 04:54:32.741152  7036 executor.cpp:411] Will retry connecting with
> the agent again in 1.442011578secs
> I0223 04:54:32.741855  7046 poll_socket.cpp:110] Socket error while
> connecting
> I0223 04:54:32.742288  7046 poll_socket.cpp:110] Socket error while
> connecting
> make[2]: *** [check] Error 2
> I0223 04:54:32.791136  7033 executor.cpp:411] Will retry connecting with
> the agent again in 98.32492ms
> I0223 04:54:32.791764  7046 poll_socket.cpp:110] Socket error while
> connecting
> I0223 04:54:32.792192  7046 poll_socket.cpp:110] Socket error while
> connecting
> I0223 04:54:32.890908  7044 executor.cpp:411] Will retry connecting with
> the agent again in 898.210224ms
> I0223 04:54:32.891618  7046 poll_socket.cpp:110] Socket error while
> connecting
> I0223 04:54:32.892107  7046 poll_socket.cpp:110] Socket error while
> connecting
> make[2]: Leaving directory `/mesos/mesos-0.28.0/_build/src'
> make[1]: *** [check-recursive] Error 1
> make[1]: Leaving directory `/mesos/mesos-0.28.0/_build'
> make: *** [distcheck] Error 1
> I0223 04:54:33.790923  7043 executor.cpp:411] Will retry connecting with
> the agent again in 1.972934225secs
> I0223 04:54:33.791704  7046 poll_socket.cpp:110] Socket error while
> connecting
> I0223 04:54:33.792636  7046 poll_socket.cpp:110] Socket error while
> connecting
> + docker rmi mesos-1456200547-15739
> Untagged: mesos-1456200547-15739:latest
> Deleted: 9193de3f0b38b1882cbbfb3d6ee5694dcf5151ee1a2833f14b52cd380bae13fe
> Deleted: 444d8fdf50952eab775164574e105039b53d0a2cd8aeda62f5b454a199492970
> Deleted: c2a9e46445b708095875b4ac48bb198cf8d4d1dc098e73124651433d036a87ea
> Deleted: c92e78316db33309e8507793d29edc592153213e2cc368edd76dbad592cad11f
> Deleted: 93a3b0cd2f617ef9331ca299132efde27a542bd11aafd7d14589ad3199579c3e
> Deleted: b2987b7d7df3fb45eee1162eba0ddc70447d5dff8df2cc87b27118710e95fb01
> Deleted: 3630456d7de8d9282da45daff4b6102f96772375fe5af7b65a5c375434948b4a
> Deleted: 6e9d7c56fd36b11fcee934853b8466e93dd6571eb50e7697a7f345d7157fc8db
> Deleted: 2c29443c348e745bfa8a828118538004f7693467164171c3c671663029759841
> Deleted: 79e8ad7b1a2ee67d9c90102ec162ffefe055d255852186ec63f0066c491df464
> Deleted: 4c5d8dde86972bbe1c5dfa1e6704ff017ed6289b79172682fe7794707c52282b
> Deleted: d2ea231d7b86171b40b287d858a7ade76ede5827c0bbcee2b69e4a36e9104470
> Deleted: f9553eb5c4f2b4c7d810817fbd9589a677b0c7c3bf9e9946067bfec88e219952
> Deleted: 94bbb7ff9d2a4c48e26b724b3b3636be51b02ac826931769d38f57f2cdce15b2
> Deleted: 8b3ba91524a0977c4e605c3fc371fed0cf713493f912729ea7ef4a3a3cbc0f57
> Deleted: 6a8a5578a15622143862e27b69966665af9f4fd419714233d1b4f7b201427c09
> Build step 'Execute shell' marked build as failure
>