You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mesos.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/09/01 15:48:14 UTC
Build failed in Jenkins:
Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME #1611
See <https://builds.apache.org/job/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME/1611/>
------------------------------------------
[...truncated 16801 lines...]
I0901 13:48:12.445449 14237 master.cpp:206] Shutting down master
W0901 13:48:12.448010 14277 slave.cpp:1969] Master disconnected! Waiting for a new master to be elected
I0901 13:48:12.448873 14237 master.hpp:329] Removing task 0 with resources cpus(*):1; mem(*):500 on slave 201309011348-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:48:12.450603 14277 status_update_manager.cpp:375] Received status update acknowledgement (UUID: e5bf2fdb-e422-42fb-b945-49490d8ae8f0) for task 0 of framework 201309011348-453759884-42454-14237-0000
I0901 13:48:12.451619 14237 master.cpp:234] Removing slave 201309011348-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:48:12.451670 14268 hierarchical_allocator_process.hpp:598] Recovered cpus(*):1; mem(*):500 (total allocatable: cpus(*):2; mem(*):1024; disk(*):127026; ports(*):[31000-32000]) on slave 201309011348-453759884-42454-14237-0 from framework 201309011348-453759884-42454-14237-0000
I0901 13:48:12.452736 14277 slave.cpp:1381] Status update manager successfully handled status update acknowledgement (UUID: e5bf2fdb-e422-42fb-b945-49490d8ae8f0) for task 0 of framework 201309011348-453759884-42454-14237-0000
I0901 13:48:12.456701 14268 master.cpp:262] Master started on 140.211.11.27:42454
I0901 13:48:12.457206 14268 master.cpp:277] Master ID: 201309011348-453759884-42454-14237
I0901 13:48:12.458112 14259 detector.cpp:420] Master detector (slave(131)@140.211.11.27:42454) found 0 registered masters
I0901 13:48:12.466596 14259 detector.cpp:441] Master detector (slave(131)@140.211.11.27:42454) couldn't find any masters
I0901 13:48:12.460623 14261 detector.cpp:234] Master detector (master@140.211.11.27:42454) connected to ZooKeeper ...
I0901 13:48:12.468416 14261 detector.cpp:251] Trying to create path '/znode' in ZooKeeper
I0901 13:48:12.465838 14274 hierarchical_allocator_process.hpp:291] Initializing hierarchical allocator process with master : master@140.211.11.27:42454
I0901 13:48:12.458631 14273 detector.cpp:420] Master detector (scheduler(113)@140.211.11.27:42454) found 0 registered masters
I0901 13:48:12.471071 14273 detector.cpp:441] Master detector (scheduler(113)@140.211.11.27:42454) couldn't find any masters
W0901 13:48:12.465535 14277 master.cpp:80] No whitelist given. Advertising offers for all slaves
I0901 13:48:12.474067 14278 detector.cpp:420] Master detector (slave(131)@140.211.11.27:42454) found 1 registered masters
I0901 13:48:12.471848 14273 sched.cpp:202] No master detected, waiting for another master
I0901 13:48:12.478742 14273 sched.cpp:214] Scheduler::disconnected took 15.324us
I0901 13:48:12.473634 14267 detector.cpp:420] Master detector (scheduler(113)@140.211.11.27:42454) found 1 registered masters
I0901 13:48:12.467483 14259 slave.cpp:578] Lost master(s) ... waiting
I0901 13:48:12.478446 14278 detector.cpp:467] Master detector (slave(131)@140.211.11.27:42454) got new master pid: master@140.211.11.27:42454
I0901 13:48:12.472808 14261 detector.cpp:281] Created ephemeral/sequence znode at '/znode/0000000002'
I0901 13:48:12.481369 14267 detector.cpp:467] Master detector (scheduler(113)@140.211.11.27:42454) got new master pid: master@140.211.11.27:42454
I0901 13:48:12.482713 14278 slave.cpp:544] New master detected at master@140.211.11.27:42454
I0901 13:48:12.484776 14261 detector.cpp:420] Master detector (master@140.211.11.27:42454) found 1 registered masters
I0901 13:48:12.485153 14270 sched.cpp:178] New master at master@140.211.11.27:42454
I0901 13:48:12.485795 14267 status_update_manager.cpp:157] New master detected at master@140.211.11.27:42454
W0901 13:48:12.487934 14271 master.cpp:714] Ignoring re-register framework message since not elected yet
I0901 13:48:12.487932 14261 detector.cpp:467] Master detector (master@140.211.11.27:42454) got new master pid: master@140.211.11.27:42454
I0901 13:48:12.491312 14261 master.cpp:642] Elected as master!
I0901 13:48:13.398939 14260 master.cpp:734] Re-registering framework 201309011348-453759884-42454-14237-0000 at scheduler(113)@140.211.11.27:42454
I0901 13:48:13.400677 14270 sched.cpp:237] Framework registered with 201309011348-453759884-42454-14237-0000
I0901 13:48:13.401135 14261 hierarchical_allocator_process.hpp:321] Added framework 201309011348-453759884-42454-14237-0000
I0901 13:48:13.403525 14261 hierarchical_allocator_process.hpp:687] No resources available to allocate!
I0901 13:48:13.404464 14261 hierarchical_allocator_process.hpp:649] Performed allocation for 0 slaves in 939.955us
I0901 13:48:13.402282 14270 sched.cpp:251] Scheduler::registered took 14.111us
I0901 13:48:13.471325 14278 hierarchical_allocator_process.hpp:687] No resources available to allocate!
I0901 13:48:13.472589 14278 hierarchical_allocator_process.hpp:649] Performed allocation for 0 slaves in 1.269516ms
I0901 13:48:13.486690 14263 master.cpp:1159] Attempting to re-register slave 201309011348-453759884-42454-14237-0 at slave(131)@140.211.11.27:42454 (hemera.apache.org)
I0901 13:48:13.487660 14263 master.cpp:2078] Adding slave 201309011348-453759884-42454-14237-0 at hemera.apache.org with cpus(*):2; mem(*):1024; disk(*):127026; ports(*):[31000-32000]
I0901 13:48:13.488994 14263 master.hpp:316] Adding task 0 with resources cpus(*):1; mem(*):500 on slave 201309011348-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:48:13.489035 14267 slave.cpp:645] Re-registered with master master@140.211.11.27:42454
I0901 13:48:13.490772 14276 hierarchical_allocator_process.hpp:434] Added slave 201309011348-453759884-42454-14237-0 (hemera.apache.org) with cpus(*):2; mem(*):1024; disk(*):127026; ports(*):[31000-32000] (and cpus(*):1; mem(*):524; disk(*):127026; ports(*):[31000-32000] available)
I0901 13:48:13.491698 14267 slave.cpp:1327] Updating framework 201309011348-453759884-42454-14237-0000 pid to scheduler(113)@140.211.11.27:42454
I0901 13:48:13.493104 14276 hierarchical_allocator_process.hpp:712] Offering cpus(*):1; mem(*):524; disk(*):127026; ports(*):[31000-32000] on slave 201309011348-453759884-42454-14237-0 to framework 201309011348-453759884-42454-14237-0000
I0901 13:48:13.495089 14276 hierarchical_allocator_process.hpp:669] Performed allocation for slave 201309011348-453759884-42454-14237-0 in 2.015672ms
I0901 13:48:13.495221 14260 master.hpp:339] Adding offer 201309011348-453759884-42454-14237-0 with resources cpus(*):1; mem(*):524; disk(*):127026; ports(*):[31000-32000] on slave 201309011348-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:48:13.497177 14260 master.cpp:1439] Sending 1 offers to framework 201309011348-453759884-42454-14237-0000
I0901 13:48:13.498236 14260 sched.cpp:340] Scheduler::resourceOffers took 24.876us
I0901 13:48:13.499927 14260 sched.cpp:498] Stopping framework '201309011348-453759884-42454-14237-0000'
I0901 13:48:13.499023 14237 master.cpp:478] Master terminating
I0901 13:48:13.501727 14237 master.cpp:206] Shutting down master
I0901 13:48:13.501747 14261 slave.cpp:1966] master@140.211.11.27:42454 exited
W0901 13:48:13.513283 14261 slave.cpp:1969] Master disconnected! Waiting for a new master to be elected
I0901 13:48:13.502653 14237 master.hpp:329] Removing task 0 with resources cpus(*):1; mem(*):500 on slave 201309011348-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:48:13.516372 14237 master.hpp:349] Removing offer 201309011348-453759884-42454-14237-0 with resources cpus(*):1; mem(*):524; disk(*):127026; ports(*):[31000-32000] on slave 201309011348-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:48:13.516594 14266 hierarchical_allocator_process.hpp:598] Recovered cpus(*):1; mem(*):500 (total allocatable: cpus(*):1; mem(*):500) on slave 201309011348-453759884-42454-14237-0 from framework 201309011348-453759884-42454-14237-0000
I0901 13:48:13.517467 14237 master.cpp:234] Removing slave 201309011348-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:48:13.520035 14237 slave.cpp:454] Slave terminating
I0901 13:48:13.520344 14237 slave.cpp:1162] Asked to shut down framework 201309011348-453759884-42454-14237-0000 by @0.0.0.0:0
I0901 13:48:13.521235 14237 slave.cpp:1187] Shutting down framework 201309011348-453759884-42454-14237-0000
I0901 13:48:13.529317 14237 slave.cpp:2417] Shutting down executor 'default' of framework 201309011348-453759884-42454-14237-0000
I0901 13:48:13.522156 14270 detector.cpp:420] Master detector (slave(131)@140.211.11.27:42454) found 0 registered masters
I0901 13:48:13.530541 14276 exec.cpp:371] Executor asked to shutdown
GMOCK WARNING:
Uninteresting mock function call - returning directly.
Function call: shutdown(0x2b504800a800)
Stack trace:
I0901 13:48:13.531070 14270 detector.cpp:441] Master detector (slave(131)@140.211.11.27:42454) couldn't find any masters
I0901 13:48:13.532029 14276 exec.cpp:386] Executor::shutdown took 87.169us
[ OK ] AllocatorZooKeeperTest/0.FrameworkReregistersFirst (1184 ms)
[ RUN ] AllocatorZooKeeperTest/0.SlaveReregistersFirst
I0901 13:48:13.535174 14271 master.cpp:262] Master started on 140.211.11.27:42454
2013-09-01 13:48:13,536:14237(0x2b4fdcac0700):ZOO_INFO@log_env@687: Client environment:user.home=/home/jenkins
2013-09-01 13:48:13,537:14237(0x2b4fdcac0700):ZOO_INFO@log_env@699: Client environment:user.dir=/x1/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME/build/src
2013-09-01 13:48:13,537:14237(0x2b4fdcac0700):ZOO_INFO@zookeeper_init@727: Initiating client connection, host=127.0.0.1:54195 sessionTimeout=10000 watcher=0x2b4fd95a75f0 sessionId=0 sessionPasswd=<null> context=0x2b5034008020 flags=0
2013-09-01 13:48:13,537:14237(0x2b4fdcac0700):ZOO_DEBUG@start_threads@152: starting threads...
2013-09-01 13:48:13,537:14237(0x2b526d118700):ZOO_DEBUG@do_completion@326: started completion thread
2013-09-01 13:48:13,537:14237(0x2b526cd16700):ZOO_DEBUG@do_io@279: started IO thread
2013-09-01 13:48:13,537:14237(0x2b526cd16700):ZOO_INFO@check_events@1585: initiated connection to server [127.0.0.1:54195]
2013-09-01 13:48:13,537:14237(0x2b4fdbcb9700):ZOO_INFO@log_env@658: Client environment:zookeeper.version=zookeeper C client 3.3.4
2013-09-01 13:48:13,537:14237(0x2b4fdbcb9700):ZOO_INFO@log_env@662: Client environment:host.name=hemera
2013-09-01 13:48:13,537:14237(0x2b4fdbcb9700):ZOO_INFO@log_env@669: Client environment:os.name=Linux
2013-09-01 13:48:13,537:14237(0x2b4fdbcb9700):ZOO_INFO@log_env@670: Client environment:os.arch=3.2.0-51-generic
2013-09-01 13:48:13,538:14237(0x2b4fdbcb9700):ZOO_INFO@log_env@671: Client environment:os.version=#77-Ubuntu SMP Wed Jul 24 20:18:19 UTC 2013
I0901 13:48:13.536084 14271 master.cpp:277] Master ID: 201309011348-453759884-42454-14237
I0901 13:48:13.536978 14266 slave.cpp:108] Slave started on 132)@140.211.11.27:42454
I0901 13:48:13.540307 14275 detector.cpp:234] Master detector (master@140.211.11.27:42454) connected to ZooKeeper ...
I0901 13:48:13.541383 14261 detector.cpp:234] Master detector (slave(132)@140.211.11.27:42454) connected to ZooKeeper ...
I0901 13:48:13.542315 14265 detector.cpp:234] Master detector (scheduler(114)@140.211.11.27:42454) connected to ZooKeeper ...
I0901 13:48:13.552961 14265 detector.cpp:251] Trying to create path '/znode' in ZooKeeper
W0901 13:48:13.549511 14262 master.cpp:80] No whitelist given. Advertising offers for all slaves
I0901 13:48:13.550516 14266 slave.cpp:208] Slave resources: cpus(*):2; mem(*):1024; disk(*):127026; ports(*):[31000-32000]
I0901 13:48:13.551337 14275 detector.cpp:251] Trying to create path '/znode' in ZooKeeper
I0901 13:48:13.557495 14267 slave.cpp:399] Finished recovery
I0901 13:48:13.549383 14269 hierarchical_allocator_process.hpp:291] Initializing hierarchical allocator process with master : master@140.211.11.27:42454
I0901 13:48:13.555846 14265 detector.cpp:420] Master detector (scheduler(114)@140.211.11.27:42454) found 0 registered masters
I0901 13:48:13.560029 14265 detector.cpp:441] Master detector (scheduler(114)@140.211.11.27:42454) couldn't find any masters
I0901 13:48:13.552140 14261 detector.cpp:251] Trying to create path '/znode' in ZooKeeper
I0901 13:48:13.561058 14275 detector.cpp:281] Created ephemeral/sequence znode at '/znode/0000000004'
I0901 13:48:13.561540 14268 sched.cpp:202] No master detected, waiting for another master
I0901 13:48:13.562340 14265 detector.cpp:420] Master detector (scheduler(114)@140.211.11.27:42454) found 1 registered masters
I0901 13:48:13.571676 14275 detector.cpp:420] Master detector (master@140.211.11.27:42454) found 1 registered masters
I0901 13:48:13.572437 14261 detector.cpp:420] Master detector (slave(132)@140.211.11.27:42454) found 1 registered masters
I0901 13:48:13.574686 14275 detector.cpp:467] Master detector (master@140.211.11.27:42454) got new master pid: master@140.211.11.27:42454
I0901 13:48:13.575845 14261 detector.cpp:467] Master detector (slave(132)@140.211.11.27:42454) got new master pid: master@140.211.11.27:42454
I0901 13:48:13.573832 14265 detector.cpp:467] Master detector (scheduler(114)@140.211.11.27:42454) got new master pid: master@140.211.11.27:42454
I0901 13:48:13.576040 14271 master.cpp:642] Elected as master!
I0901 13:48:13.576923 14261 slave.cpp:544] New master detected at master@140.211.11.27:42454
I0901 13:48:13.577908 14265 sched.cpp:178] New master at master@140.211.11.27:42454
I0901 13:48:13.580078 14261 status_update_manager.cpp:157] New master detected at master@140.211.11.27:42454
I0901 13:48:13.580137 14272 master.cpp:1065] Attempting to register slave on hemera.apache.org at slave(132)@140.211.11.27:42454
I0901 13:48:13.582753 14272 master.cpp:2078] Adding slave 201309011348-453759884-42454-14237-0 at hemera.apache.org with cpus(*):2; mem(*):1024; disk(*):127026; ports(*):[31000-32000]
I0901 13:48:13.583590 14275 slave.cpp:604] Registered with master master@140.211.11.27:42454; given slave ID 201309011348-453759884-42454-14237-0
I0901 13:48:13.583637 14272 master.cpp:692] Registering framework 201309011348-453759884-42454-14237-0000 at scheduler(114)@140.211.11.27:42454
I0901 13:48:13.583740 14267 hierarchical_allocator_process.hpp:434] Added slave 201309011348-453759884-42454-14237-0 (hemera.apache.org) with cpus(*):2; mem(*):1024; disk(*):127026; ports(*):[31000-32000] (and cpus(*):2; mem(*):1024; disk(*):127026; ports(*):[31000-32000] available)
I0901 13:48:13.586906 14267 hierarchical_allocator_process.hpp:669] Performed allocation for slave 201309011348-453759884-42454-14237-0 in 7.212us
I0901 13:48:13.585821 14272 sched.cpp:237] Framework registered with 201309011348-453759884-42454-14237-0000
I0901 13:48:13.588476 14272 sched.cpp:251] Scheduler::registered took 14.118us
I0901 13:48:13.587802 14267 hierarchical_allocator_process.hpp:321] Added framework 201309011348-453759884-42454-14237-0000
I0901 13:48:13.590303 14267 hierarchical_allocator_process.hpp:712] Offering cpus(*):2; mem(*):1024; disk(*):127026; ports(*):[31000-32000] on slave 201309011348-453759884-42454-14237-0 to framework 201309011348-453759884-42454-14237-0000
I0901 13:48:13.591161 14267 hierarchical_allocator_process.hpp:649] Performed allocation for 1 slaves in 887.382us
I0901 13:48:13.591251 14275 master.hpp:339] Adding offer 201309011348-453759884-42454-14237-0 with resources cpus(*):2; mem(*):1024; disk(*):127026; ports(*):[31000-32000] on slave 201309011348-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:48:13.593179 14275 master.cpp:1439] Sending 1 offers to framework 201309011348-453759884-42454-14237-0000
I0901 13:48:13.594245 14275 sched.cpp:340] Scheduler::resourceOffers took 173.024us
I0901 13:48:13.595309 14260 master.cpp:1676] Processing reply for offer 201309011348-453759884-42454-14237-0 on slave 201309011348-453759884-42454-14237-0 (hemera.apache.org) for framework 201309011348-453759884-42454-14237-0000
I0901 13:48:13.596417 14260 master.hpp:316] Adding task 0 with resources cpus(*):1; mem(*):500 on slave 201309011348-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:48:13.597250 14260 master.cpp:1796] Launching task 0 of framework 201309011348-453759884-42454-14237-0000 with resources cpus(*):1; mem(*):500 on slave 201309011348-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:48:13.598248 14275 slave.cpp:767] Got assigned task 0 for framework 201309011348-453759884-42454-14237-0000
I0901 13:48:13.598276 14258 hierarchical_allocator_process.hpp:508] Framework 201309011348-453759884-42454-14237-0000 left cpus(*):1; mem(*):524; disk(*):127026; ports(*):[31000-32000] unused on slave 201309011348-453759884-42454-14237-0
I0901 13:48:13.598302 14260 master.hpp:349] Removing offer 201309011348-453759884-42454-14237-0 with resources cpus(*):2; mem(*):1024; disk(*):127026; ports(*):[31000-32000] on slave 201309011348-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:48:13.599207 14275 slave.cpp:878] Launching task 0 for framework 201309011348-453759884-42454-14237-0000
I0901 13:48:13.600075 14258 hierarchical_allocator_process.hpp:551] Framework 201309011348-453759884-42454-14237-0000 filtered slave 201309011348-453759884-42454-14237-0 for 5secs
I0901 13:48:13.604182 14275 paths.hpp:336] Created executor directory '/tmp/AllocatorZooKeeperTest_0_SlaveReregistersFirst_WWMWtl/slaves/201309011348-453759884-42454-14237-0/frameworks/201309011348-453759884-42454-14237-0000/executors/default/runs/93a0b8d4-5990-4a4c-b71c-09251a7d810a'
I0901 13:48:13.605113 14275 slave.cpp:989] Queuing task '0' for executor default of framework '201309011348-453759884-42454-14237-0000
I0901 13:48:13.605960 14275 slave.cpp:526] Successfully attached file '/tmp/AllocatorZooKeeperTest_0_SlaveReregistersFirst_WWMWtl/slaves/201309011348-453759884-42454-14237-0/frameworks/201309011348-453759884-42454-14237-0000/executors/default/runs/93a0b8d4-5990-4a4c-b71c-09251a7d810a'
I0901 13:48:13.607786 14262 exec.cpp:174] Executor started at: executor(41)@140.211.11.27:42454 with pid 14237
I0901 13:48:13.609359 14262 slave.cpp:1435] Got registration for executor 'default' of framework 201309011348-453759884-42454-14237-0000
I0901 13:48:13.610697 14262 slave.cpp:1556] Flushing queued task 0 for executor 'default' of framework 201309011348-453759884-42454-14237-0000
I0901 13:48:13.610751 14270 exec.cpp:198] Executor registered on slave 201309011348-453759884-42454-14237-0
I0901 13:48:13.614671 14270 exec.cpp:210] Executor::registered took 15.764us
I0901 13:48:13.615511 14270 exec.cpp:285] Executor asked to run task '0'
I0901 13:48:13.616446 14270 exec.cpp:294] Executor::launchTask took 26.847us
I0901 13:48:13.619410 14270 exec.cpp:501] Executor sending status update TASK_RUNNING (UUID: a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for task 0 of framework 201309011348-453759884-42454-14237-0000
I0901 13:48:13.620187 14270 slave.cpp:1766] Handling status update TASK_RUNNING (UUID: a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for task 0 of framework 201309011348-453759884-42454-14237-0000 from executor(41)@140.211.11.27:42454
I0901 13:48:13.621244 14270 status_update_manager.cpp:300] Received status update TASK_RUNNING (UUID: a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for task 0 of framework 201309011348-453759884-42454-14237-0000
I0901 13:48:13.622117 14270 status_update_manager.cpp:471] Creating StatusUpdate stream for task 0 of framework 201309011348-453759884-42454-14237-0000
I0901 13:48:13.622891 14270 status_update_manager.cpp:351] Forwarding status update TASK_RUNNING (UUID: a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for task 0 of framework 201309011348-453759884-42454-14237-0000 to master@140.211.11.27:42454
I0901 13:48:13.623790 14270 slave.cpp:1885] Status update manager successfully handled status update TASK_RUNNING (UUID: a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for task 0 of framework 201309011348-453759884-42454-14237-0000
I0901 13:48:13.623805 14260 master.cpp:1205] Status update TASK_RUNNING (UUID: a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for task 0 of framework 201309011348-453759884-42454-14237-0000 from slave(132)@140.211.11.27:42454
I0901 13:48:13.624639 14270 slave.cpp:1891] Sending acknowledgement for status update TASK_RUNNING (UUID: a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for task 0 of framework 201309011348-453759884-42454-14237-0000 to executor(41)@140.211.11.27:42454
I0901 13:48:13.625607 14260 sched.cpp:395] Scheduler::statusUpdate took 37.834us
I0901 13:48:13.625895 14237 master.cpp:478] Master terminating
I0901 13:48:13.626421 14279 exec.cpp:331] Executor received status update acknowledgement a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8 for task 0 of framework 201309011348-453759884-42454-14237-0000
I0901 13:48:13.627312 14273 status_update_manager.cpp:375] Received status update acknowledgement (UUID: a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for task 0 of framework 201309011348-453759884-42454-14237-0000
I0901 13:48:13.628062 14237 master.cpp:206] Shutting down master
I0901 13:48:13.628278 14270 slave.cpp:1966] master@140.211.11.27:42454 exited
W0901 13:48:13.631556 14270 slave.cpp:1969] Master disconnected! Waiting for a new master to be elected
I0901 13:48:13.633021 14270 slave.cpp:1381] Status update manager successfully handled status update acknowledgement (UUID: a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for task 0 of framework 201309011348-453759884-42454-14237-0000
I0901 13:48:13.630784 14237 master.hpp:329] Removing task 0 with resources cpus(*):1; mem(*):500 on slave 201309011348-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:48:13.634773 14237 master.cpp:234] Removing slave 201309011348-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:48:13.634845 14272 hierarchical_allocator_process.hpp:598] Recovered cpus(*):1; mem(*):500 (total allocatable: cpus(*):2; mem(*):1024; disk(*):127026; ports(*):[31000-32000]) on slave 201309011348-453759884-42454-14237-0 from framework 201309011348-453759884-42454-14237-0000
I0901 13:48:13.639075 14271 master.cpp:262] Master started on 140.211.11.27:42454
I0901 13:48:13.639225 14271 master.cpp:277] Master ID: 201309011348-453759884-42454-14237
I0901 13:48:13.640260 14267 detector.cpp:420] Master detector (slave(132)@140.211.11.27:42454) found 0 registered masters
I0901 13:48:13.650336 14267 detector.cpp:441] Master detector (slave(132)@140.211.11.27:42454) couldn't find any masters
I0901 13:48:13.642727 14259 detector.cpp:234] Master detector (master@140.211.11.27:42454) connected to ZooKeeper ...
I0901 13:48:13.652062 14259 detector.cpp:251] Trying to create path '/znode' in ZooKeeper
I0901 13:48:13.649737 14261 hierarchical_allocator_process.hpp:291] Initializing hierarchical allocator process with master : master@140.211.11.27:42454
I0901 13:48:13.640332 14260 detector.cpp:420] Master detector (scheduler(114)@140.211.11.27:42454) found 0 registered masters
I0901 13:48:13.655550 14260 detector.cpp:441] Master detector (scheduler(114)@140.211.11.27:42454) couldn't find any masters
W0901 13:48:13.649432 14275 master.cpp:80] No whitelist given. Advertising offers for all slaves
I0901 13:48:13.651140 14267 slave.cpp:578] Lost master(s) ... waiting
I0901 13:48:13.656458 14261 sched.cpp:202] No master detected, waiting for another master
I0901 13:48:13.665989 14261 sched.cpp:214] Scheduler::disconnected took 14.189us
I0901 13:48:13.658159 14260 detector.cpp:420] Master detector (scheduler(114)@140.211.11.27:42454) found 1 registered masters
I0901 13:48:13.658639 14264 detector.cpp:420] Master detector (slave(132)@140.211.11.27:42454) found 1 registered masters
I0901 13:48:13.657196 14259 detector.cpp:281] Created ephemeral/sequence znode at '/znode/0000000006'
I0901 13:48:13.669733 14264 detector.cpp:467] Master detector (slave(132)@140.211.11.27:42454) got new master pid: master@140.211.11.27:42454
I0901 13:48:13.668481 14260 detector.cpp:467] Master detector (scheduler(114)@140.211.11.27:42454) got new master pid: master@140.211.11.27:42454
I0901 13:48:13.670785 14264 slave.cpp:544] New master detected at master@140.211.11.27:42454
I0901 13:48:13.670862 14259 detector.cpp:420] Master detector (master@140.211.11.27:42454) found 1 registered masters
I0901 13:48:13.671875 14260 sched.cpp:178] New master at master@140.211.11.27:42454
I0901 13:48:13.673040 14270 status_update_manager.cpp:157] New master detected at master@140.211.11.27:42454
W0901 13:48:13.673425 14276 master.cpp:1092] Ignoring re-register slave message from hemera.apache.org since not elected yet
I0901 13:48:13.675158 14259 detector.cpp:467] Master detector (master@140.211.11.27:42454) got new master pid: master@140.211.11.27:42454
I0901 13:48:13.678570 14259 master.cpp:642] Elected as master!
I0901 13:48:14.581439 14274 master.cpp:1159] Attempting to re-register slave 201309011348-453759884-42454-14237-0 at slave(132)@140.211.11.27:42454 (hemera.apache.org)
I0901 13:48:14.582810 14274 master.cpp:2078] Adding slave 201309011348-453759884-42454-14237-0 at hemera.apache.org with cpus(*):2; mem(*):1024; disk(*):127026; ports(*):[31000-32000]
I0901 13:48:14.584097 14274 master.hpp:316] Adding task 0 with resources cpus(*):1; mem(*):500 on slave 201309011348-453759884-42454-14237-0 (hemera.apache.org)
W0901 13:48:14.585726 14274 master.cpp:2170] Possibly orphaned task 0 of framework 201309011348-453759884-42454-14237-0000 running on slave 201309011348-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:48:14.584163 14267 slave.cpp:645] Re-registered with master master@140.211.11.27:42454
I0901 13:48:14.587880 14273 hierarchical_allocator_process.hpp:434] Added slave 201309011348-453759884-42454-14237-0 (hemera.apache.org) with cpus(*):2; mem(*):1024; disk(*):127026; ports(*):[31000-32000] (and cpus(*):1; mem(*):524; disk(*):127026; ports(*):[31000-32000] available)
I0901 13:48:14.588932 14273 hierarchical_allocator_process.hpp:669] Performed allocation for slave 201309011348-453759884-42454-14237-0 in 7.832us
I0901 13:48:14.654443 14265 hierarchical_allocator_process.hpp:649] Performed allocation for 1 slaves in 55.654us
I0901 13:48:14.675817 14259 master.cpp:734] Re-registering framework 201309011348-453759884-42454-14237-0000 at scheduler(114)@140.211.11.27:42454
I0901 13:48:14.677146 14278 sched.cpp:237] Framework registered with 201309011348-453759884-42454-14237-0000
I0901 13:48:14.678576 14278 sched.cpp:251] Scheduler::registered took 13.324us
I0901 13:48:14.678074 14266 hierarchical_allocator_process.hpp:321] Added framework 201309011348-453759884-42454-14237-0000
I0901 13:48:14.677261 14273 slave.cpp:1327] Updating framework 201309011348-453759884-42454-14237-0000 pid to scheduler(114)@140.211.11.27:42454
I0901 13:48:14.680332 14266 hierarchical_allocator_process.hpp:712] Offering cpus(*):1; mem(*):524; disk(*):127026; ports(*):[31000-32000] on slave 201309011348-453759884-42454-14237-0 to framework 201309011348-453759884-42454-14237-0000
I0901 13:48:14.682147 14266 hierarchical_allocator_process.hpp:649] Performed allocation for 1 slaves in 1.846988ms
I0901 13:48:14.682236 14259 master.hpp:339] Adding offer 201309011348-453759884-42454-14237-0 with resources cpus(*):1; mem(*):524; disk(*):127026; ports(*):[31000-32000] on slave 201309011348-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:48:14.684241 14259 master.cpp:1439] Sending 1 offers to framework 201309011348-453759884-42454-14237-0000
I0901 13:48:14.685359 14259 sched.cpp:340] Scheduler::resourceOffers took 64.241us
I0901 13:48:14.686481 14259 sched.cpp:498] Stopping framework '201309011348-453759884-42454-14237-0000'
I0901 13:48:14.686502 14276 master.cpp:478] Master terminating
I0901 13:48:14.688787 14276 slave.cpp:1966] master@140.211.11.27:42454 exited
I0901 13:48:14.688899 14237 master.cpp:206] Shutting down master
W0901 13:48:14.689703 14276 slave.cpp:1969] Master disconnected! Waiting for a new master to be elected
I0901 13:48:14.690634 14237 master.hpp:329] Removing task 0 with resources cpus(*):1; mem(*):500 on slave 201309011348-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:48:14.692858 14237 master.hpp:349] Removing offer 201309011348-453759884-42454-14237-0 with resources cpus(*):1; mem(*):524; disk(*):127026; ports(*):[31000-32000] on slave 201309011348-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:48:14.693017 14275 hierarchical_allocator_process.hpp:598] Recovered cpus(*):1; mem(*):500 (total allocatable: cpus(*):1; mem(*):500) on slave 201309011348-453759884-42454-14237-0 from framework 201309011348-453759884-42454-14237-0000
I0901 13:48:14.694078 14237 master.cpp:234] Removing slave 201309011348-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:48:14.697295 14237 slave.cpp:454] Slave terminating
I0901 13:48:14.697499 14237 slave.cpp:1162] Asked to shut down framework 201309011348-453759884-42454-14237-0000 by @0.0.0.0:0
I0901 13:48:14.698477 14237 slave.cpp:1187] Shutting down framework 201309011348-453759884-42454-14237-0000
I0901 13:48:14.699030 14237 slave.cpp:2417] Shutting down executor 'default' of framework 201309011348-453759884-42454-14237-0000
I0901 13:48:14.699874 14260 detector.cpp:420] Master detector (slave(132)@140.211.11.27:42454) found 0 registered masters
I0901 13:48:14.701004 14260 detector.cpp:441] Master detector (slave(132)@140.211.11.27:42454) couldn't find any masters
I0901 13:48:14.700330 14263 exec.cpp:371] Executor asked to shutdown
GMOCK WARNING:
Uninteresting mock function call - returning directly.
Function call: shutdown(0x2b502c009cb0)
Stack trace:
I0901 13:48:14.703187 14263 exec.cpp:386] Executor::shutdown took 21.98us
[ OK ] AllocatorZooKeeperTest/0.SlaveReregistersFirst (1170 ms)
I0901 13:48:14.706209 14237 zookeeper_test_server.cpp:93] Shutdown ZooKeeperTestServer on port 54195
[----------] 2 tests from AllocatorZooKeeperTest/0 (2354 ms total)
[----------] Global test environment tear-down
[==========] 220 tests from 39 test cases ran. (89659 ms total)
[ PASSED ] 219 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SlaveRecoveryTest/0.MultipleFrameworks, where TypeParam = mesos::internal::slave::ProcessIsolator
1 FAILED TEST
make[3]: *** [check-local] Error 1
make[3]: Leaving directory `/x1/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME/build/src'
make[2]: *** [check-am] Error 2
make[2]: Leaving directory `/x1/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME/build/src'
make[1]: *** [check] Error 2
make[1]: Leaving directory `/x1/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME/build/src'
make: *** [check-recursive] Error 1
Build step 'Execute shell' marked build as failure
Re: Build failed in Jenkins: Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME
#1611
Posted by Benjamin Mahler <be...@gmail.com>.
+yan
Can you take a look?
commit 9a866c1a05be10d821df8b569f2af3722986745b
Author: Vinod Kone <vi...@twitter.com>
Date: Mon Aug 26 12:18:20 2013 -0400
Added SlaveRecoveryTest.MultipleFrameworks test.
From: Jiang Yan Xu <ya...@jxu.me>
Review: https://reviews.apache.org/r/13786
Looks as though this new test is flaky:
[ RUN ] SlaveRecoveryTest/0.MultipleFrameworks
I0901 13:47:13.326684 14273 master.cpp:262] Master started on
140.211.11.27:42454
I0901 13:47:13.327330 14273 master.cpp:277] Master ID:
201309011347-453759884-42454-14237
I0901 13:47:13.327973 14258 slave.cpp:108] Slave started on 49)@
140.211.11.27:42454
I0901 13:47:13.329138 14260 sched.cpp:178] New master at
master@140.211.11.27:42454
I0901 13:47:13.329493 14258 slave.cpp:208] Slave resources: cpus(*):2;
mem(*):1024; disk(*):1024; ports(*):[31000-32000]
I0901 13:47:13.329577 14265 hierarchical_allocator_process.hpp:291]
Initializing hierarchical allocator process with master :
master@140.211.11.27:42454
W0901 13:47:13.329728 14257 master.cpp:80] No whitelist given. Advertising
offers for all slaves
I0901 13:47:13.330232 14273 master.cpp:642] Elected as master!
I0901 13:47:13.332312 14258 slave.cpp:544] New master detected at
master@140.211.11.27:42454
I0901 13:47:13.332336 14259 process_isolator.cpp:314] Recovering isolator
I0901 13:47:13.335870 14258 slave.cpp:559] Postponing registration until
recovery is complete
I0901 13:47:13.337651 14258 slave.cpp:399] Finished recovery
I0901 13:47:13.335991 14277 status_update_manager.cpp:157] New master
detected at master@140.211.11.27:42454
I0901 13:47:13.335897 14273 master.cpp:692] Registering framework
201309011347-453759884-42454-14237-0000 at scheduler(35)@140.211.11.27:42454
I0901 13:47:13.340131 14273 master.cpp:1065] Attempting to register slave
on hemera.apache.org at slave(49)@140.211.11.27:42454
I0901 13:47:13.341320 14273 master.cpp:2078] Adding slave
201309011347-453759884-42454-14237-0 at hemera.apache.org with cpus(*):2;
mem(*):1024; disk(*):1024; ports(*):[31000-32000]
I0901 13:47:13.340276 14266 hierarchical_allocator_process.hpp:321] Added
framework 201309011347-453759884-42454-14237-0000
I0901 13:47:13.343111 14266 hierarchical_allocator_process.hpp:687] No
resources available to allocate!
I0901 13:47:13.343863 14266 hierarchical_allocator_process.hpp:649]
Performed allocation for 0 slaves in 754.239us
I0901 13:47:13.344509 14266 hierarchical_allocator_process.hpp:434] Added
slave 201309011347-453759884-42454-14237-0 (hemera.apache.org) with
cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] (and
cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] available)
I0901 13:47:13.342264 14259 slave.cpp:604] Registered with master
master@140.211.11.27:42454; given slave ID
201309011347-453759884-42454-14237-0
I0901 13:47:13.340152 14258 sched.cpp:237] Framework registered with
201309011347-453759884-42454-14237-0000
I0901 13:47:13.346920 14258 sched.cpp:251] Scheduler::registered took
14.203us
I0901 13:47:13.346210 14259 paths.hpp:369] Created slave directory
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/meta/slaves/201309011347-453759884-42454-14237-0'
I0901 13:47:13.345264 14266 hierarchical_allocator_process.hpp:712]
Offering cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] on
slave 201309011347-453759884-42454-14237-0 to framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.348455 14259 slave.cpp:617] Checkpointing SlaveInfo to
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/meta/slaves/201309011347-453759884-42454-14237-0/
slave.info'
I0901 13:47:13.349161 14266 hierarchical_allocator_process.hpp:669]
Performed allocation for slave 201309011347-453759884-42454-14237-0 in
3.922137ms
I0901 13:47:13.349222 14273 master.hpp:339] Adding offer
201309011347-453759884-42454-14237-0 with resources cpus(*):2; mem(*):1024;
disk(*):1024; ports(*):[31000-32000] on slave
201309011347-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:47:13.352144 14273 master.cpp:1439] Sending 1 offers to framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.352936 14273 sched.cpp:340] Scheduler::resourceOffers took
24.019us
I0901 13:47:13.355837 14257 master.cpp:1676] Processing reply for offer
201309011347-453759884-42454-14237-0 on slave
201309011347-453759884-42454-14237-0 (hemera.apache.org) for framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.356725 14257 master.hpp:316] Adding task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 with resources cpus(*):1; mem(*):512
on slave 201309011347-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:47:13.357466 14257 master.cpp:1796] Launching task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000 with resources cpus(*):1;
mem(*):512 on slave 201309011347-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:47:13.358337 14272 slave.cpp:767] Got assigned task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 for framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.358333 14257 master.hpp:349] Removing offer
201309011347-453759884-42454-14237-0 with resources cpus(*):2; mem(*):1024;
disk(*):1024; ports(*):[31000-32000] on slave
201309011347-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:47:13.358503 14275 hierarchical_allocator_process.hpp:508]
Framework 201309011347-453759884-42454-14237-0000 left cpus(*):1;
mem(*):512; disk(*):1024; ports(*):[31000-32000] unused on slave
201309011347-453759884-42454-14237-0
I0901 13:47:13.359561 14272 slave.cpp:2815] Checkpointing FrameworkInfo to
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/meta/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0000/
framework.info'
I0901 13:47:13.361071 14275 hierarchical_allocator_process.hpp:551]
Framework 201309011347-453759884-42454-14237-0000 filtered slave
201309011347-453759884-42454-14237-0 for 5secs
I0901 13:47:13.361999 14272 slave.cpp:2822] Checkpointing framework pid
'scheduler(35)@140.211.11.27:42454' to
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/meta/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0000/framework.pid'
I0901 13:47:13.363802 14272 slave.cpp:878] Launching task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 for framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.366718 14272 paths.hpp:336] Created executor directory
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0000/executors/c2dcd6ba-07e8-401d-93e7-2fd62f8dd442/runs/7467900c-ab42-4188-b647-bcf7d09843c9'
I0901 13:47:13.367657 14272 slave.cpp:3062] Checkpointing ExecutorInfo to
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/meta/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0000/executors/c2dcd6ba-07e8-401d-93e7-2fd62f8dd442/
executor.info'
I0901 13:47:13.368641 14272 paths.hpp:336] Created executor directory
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/meta/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0000/executors/c2dcd6ba-07e8-401d-93e7-2fd62f8dd442/runs/7467900c-ab42-4188-b647-bcf7d09843c9'
I0901 13:47:13.369608 14272 slave.cpp:3150] Checkpointing TaskInfo to
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/meta/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0000/executors/c2dcd6ba-07e8-401d-93e7-2fd62f8dd442/runs/7467900c-ab42-4188-b647-bcf7d09843c9/tasks/c2dcd6ba-07e8-401d-93e7-2fd62f8dd442/
task.info'
I0901 13:47:13.369722 14266 process_isolator.cpp:100] Launching
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442
(/x1/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME/build/src/mesos-executor)
in
/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0000/executors/c2dcd6ba-07e8-401d-93e7-2fd62f8dd442/runs/7467900c-ab42-4188-b647-bcf7d09843c9
with resources ' for framework 201309011347-453759884-42454-14237-0000
I0901 13:47:13.371217 14272 slave.cpp:989] Queuing task
'c2dcd6ba-07e8-401d-93e7-2fd62f8dd442' for executor
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
'201309011347-453759884-42454-14237-0000
I0901 13:47:13.373070 14272 slave.cpp:526] Successfully attached file
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0000/executors/c2dcd6ba-07e8-401d-93e7-2fd62f8dd442/runs/7467900c-ab42-4188-b647-bcf7d09843c9'
I0901 13:47:13.373814 14266 process_isolator.cpp:163] Forked executor at
15775
Checkpointing executor's forked pid 15775 to
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/meta/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0000/executors/c2dcd6ba-07e8-401d-93e7-2fd62f8dd442/runs/7467900c-ab42-4188-b647-bcf7d09843c9/pids/forked.pid'
Fetching resources into
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0000/executors/c2dcd6ba-07e8-401d-93e7-2fd62f8dd442/runs/7467900c-ab42-4188-b647-bcf7d09843c9'
WARNING: Logging before InitGoogleLogging() is written to STDERR
I0901 13:47:13.435832 15793 process.cpp:1555] libprocess is initialized on
140.211.11.27:40862 for 24 cpus
I0901 13:47:13.439733 15818 exec.cpp:174] Executor started at: executor(1)@
140.211.11.27:40862 with pid 15793
I0901 13:47:13.440418 14266 slave.cpp:1435] Got registration for executor
'c2dcd6ba-07e8-401d-93e7-2fd62f8dd442' of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.441761 14266 slave.cpp:1520] Checkpointing executor pid
'executor(1)@140.211.11.27:40862' to
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/meta/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0000/executors/c2dcd6ba-07e8-401d-93e7-2fd62f8dd442/runs/7467900c-ab42-4188-b647-bcf7d09843c9/pids/libprocess.pid'
I0901 13:47:13.443284 15832 process.cpp:986] Socket closed while receiving
I0901 13:47:13.443500 15816 exec.cpp:198] Executor registered on slave
201309011347-453759884-42454-14237-0
I0901 13:47:13.443044 14266 slave.cpp:1556] Flushing queued task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 for executor
'c2dcd6ba-07e8-401d-93e7-2fd62f8dd442' of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.443999 15832 process.cpp:986] Socket closed while receiving
I0901 13:47:13.445152 15816 exec.cpp:210] Executor::registered took 97.287us
Registered executor on hemera.apache.org
I0901 13:47:13.445260 15816 exec.cpp:285] Executor asked to run task
'c2dcd6ba-07e8-401d-93e7-2fd62f8dd442'
I0901 13:47:13.445344 15816 exec.cpp:294] Executor::launchTask took 71.803us
Starting task c2dcd6ba-07e8-401d-93e7-2fd62f8dd442
sh -c 'sleep 1000'
Forked command at 15833
I0901 13:47:13.448685 15825 exec.cpp:501] Executor sending status update
TASK_RUNNING (UUID: 75bc40f1-0a9f-4ff7-bd7e-b8489328295f) for task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.449189 14258 slave.cpp:1766] Handling status update
TASK_RUNNING (UUID: 75bc40f1-0a9f-4ff7-bd7e-b8489328295f) for task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000 from executor(1)@140.211.11.27:40862
I0901 13:47:13.450886 14268 status_update_manager.cpp:300] Received status
update TASK_RUNNING (UUID: 75bc40f1-0a9f-4ff7-bd7e-b8489328295f) for task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.451813 14268 status_update_manager.cpp:471] Creating
StatusUpdate stream for task c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of
framework 201309011347-453759884-42454-14237-0000
I0901 13:47:13.452527 14268 status_update_manager.hpp:337] Checkpointing
UPDATE for status update TASK_RUNNING (UUID:
75bc40f1-0a9f-4ff7-bd7e-b8489328295f) for task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.454654 14268 status_update_manager.cpp:351] Forwarding
status update TASK_RUNNING (UUID: 75bc40f1-0a9f-4ff7-bd7e-b8489328295f) for
task c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000 to master@140.211.11.27:42454
I0901 13:47:13.455593 14268 master.cpp:1205] Status update TASK_RUNNING
(UUID: 75bc40f1-0a9f-4ff7-bd7e-b8489328295f) for task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000 from slave(49)@140.211.11.27:42454
I0901 13:47:13.455643 14258 slave.cpp:1885] Status update manager
successfully handled status update TASK_RUNNING (UUID:
75bc40f1-0a9f-4ff7-bd7e-b8489328295f) for task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.462687 14258 slave.cpp:1891] Sending acknowledgement for
status update TASK_RUNNING (UUID: 75bc40f1-0a9f-4ff7-bd7e-b8489328295f) for
task c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000 to executor(1)@140.211.11.27:40862
I0901 13:47:13.463878 15832 process.cpp:986] Socket closed while receiving
II0901 13:47:13.464118 15816 exec.cpp:331] Executor received status update
acknowledgement 75bc40f1-0a9f-4ff7-bd7e-b8489328295f for task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000
0901 13:47:13.463145 14257 sched.cpp:395] Scheduler::statusUpdate took
381.578us
I0901 13:47:13.464964 14259 status_update_manager.cpp:375] Received status
update acknowledgement (UUID: 75bc40f1-0a9f-4ff7-bd7e-b8489328295f) for
task c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.465759 14259 status_update_manager.hpp:337] Checkpointing
ACK for status update TASK_RUNNING (UUID:
75bc40f1-0a9f-4ff7-bd7e-b8489328295f) for task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.468274 14277 slave.cpp:1381] Status update manager
successfully handled status update acknowledgement (UUID:
75bc40f1-0a9f-4ff7-bd7e-b8489328295f) for task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.470440 14264 sched.cpp:178] New master at
master@140.211.11.27:42454
I0901 13:47:13.478124 14264 master.cpp:692] Registering framework
201309011347-453759884-42454-14237-0001 at scheduler(36)@140.211.11.27:42454
I0901 13:47:13.479123 14264 sched.cpp:237] Framework registered with
201309011347-453759884-42454-14237-0001
I0901 13:47:13.480240 14260 hierarchical_allocator_process.hpp:321] Added
framework 201309011347-453759884-42454-14237-0001
I0901 13:47:13.480262 14264 sched.cpp:251] Scheduler::registered took
13.623us
I0901 13:47:13.481243 14260 hierarchical_allocator_process.hpp:712]
Offering cpus(*):1; mem(*):512; disk(*):1024; ports(*):[31000-32000] on
slave 201309011347-453759884-42454-14237-0 to framework
201309011347-453759884-42454-14237-0001
I0901 13:47:13.483145 14260 hierarchical_allocator_process.hpp:795]
Filtered on slave 201309011347-453759884-42454-14237-0 for framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.483619 14275 master.hpp:339] Adding offer
201309011347-453759884-42454-14237-1 with resources cpus(*):1; mem(*):512;
disk(*):1024; ports(*):[31000-32000] on slave
201309011347-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:47:13.484292 14260 hierarchical_allocator_process.hpp:649]
Performed allocation for 1 slaves in 3.107434ms
I0901 13:47:13.485239 14275 master.cpp:1439] Sending 1 offers to framework
201309011347-453759884-42454-14237-0001
I0901 13:47:13.486989 14275 sched.cpp:340] Scheduler::resourceOffers took
22.288us
I0901 13:47:13.490892 14274 master.cpp:1676] Processing reply for offer
201309011347-453759884-42454-14237-1 on slave
201309011347-453759884-42454-14237-0 (hemera.apache.org) for framework
201309011347-453759884-42454-14237-0001
I0901 13:47:13.491742 14274 master.hpp:316] Adding task
0498e8e5-085f-43d2-9fba-b73815cc3a38 with resources cpus(*):1; mem(*):512;
disk(*):1024; ports(*):[31000-32000] on slave
201309011347-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:47:13.492617 14274 master.cpp:1796] Launching task
0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001 with resources cpus(*):1;
mem(*):512; disk(*):1024; ports(*):[31000-32000] on slave
201309011347-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:47:13.493603 14274 master.hpp:349] Removing offer
201309011347-453759884-42454-14237-1 with resources cpus(*):1; mem(*):512;
disk(*):1024; ports(*):[31000-32000] on slave
201309011347-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:47:13.493626 14257 slave.cpp:767] Got assigned task
0498e8e5-085f-43d2-9fba-b73815cc3a38 for framework
201309011347-453759884-42454-14237-0001
I0901 13:47:13.495802 14257 slave.cpp:2815] Checkpointing FrameworkInfo to
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/meta/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0001/
framework.info'
I0901 13:47:13.496345 14257 slave.cpp:2822] Checkpointing framework pid
'scheduler(36)@140.211.11.27:42454' to
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/meta/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0001/framework.pid'
I0901 13:47:13.497522 14257 slave.cpp:878] Launching task
0498e8e5-085f-43d2-9fba-b73815cc3a38 for framework
201309011347-453759884-42454-14237-0001
I0901 13:47:13.500495 14257 paths.hpp:336] Created executor directory
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0001/executors/0498e8e5-085f-43d2-9fba-b73815cc3a38/runs/1e748173-ac79-4c1e-ade8-0d84d568c754'
I0901 13:47:13.501533 14257 slave.cpp:3062] Checkpointing ExecutorInfo to
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/meta/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0001/executors/0498e8e5-085f-43d2-9fba-b73815cc3a38/
executor.info'
I0901 13:47:13.502779 14257 paths.hpp:336] Created executor directory
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/meta/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0001/executors/0498e8e5-085f-43d2-9fba-b73815cc3a38/runs/1e748173-ac79-4c1e-ade8-0d84d568c754'
I0901 13:47:13.503705 14257 slave.cpp:3150] Checkpointing TaskInfo to
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/meta/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0001/executors/0498e8e5-085f-43d2-9fba-b73815cc3a38/runs/1e748173-ac79-4c1e-ade8-0d84d568c754/tasks/0498e8e5-085f-43d2-9fba-b73815cc3a38/
task.info'
I0901 13:47:13.503869 14269 process_isolator.cpp:100] Launching
0498e8e5-085f-43d2-9fba-b73815cc3a38
(/x1/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME/build/src/mesos-executor)
in
/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0001/executors/0498e8e5-085f-43d2-9fba-b73815cc3a38/runs/1e748173-ac79-4c1e-ade8-0d84d568c754
with resources ' for framework 201309011347-453759884-42454-14237-0001
I0901 13:47:13.505147 14257 slave.cpp:989] Queuing task
'0498e8e5-085f-43d2-9fba-b73815cc3a38' for executor
0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
'201309011347-453759884-42454-14237-0001
I0901 13:47:13.507715 14257 slave.cpp:526] Successfully attached file
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0001/executors/0498e8e5-085f-43d2-9fba-b73815cc3a38/runs/1e748173-ac79-4c1e-ade8-0d84d568c754'
I0901 13:47:13.508342 14269 process_isolator.cpp:163] Forked executor at
15835
Checkpointing executor's forked pid 15835 to
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/meta/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0001/executors/0498e8e5-085f-43d2-9fba-b73815cc3a38/runs/1e748173-ac79-4c1e-ade8-0d84d568c754/pids/forked.pid'
Fetching resources into
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0001/executors/0498e8e5-085f-43d2-9fba-b73815cc3a38/runs/1e748173-ac79-4c1e-ade8-0d84d568c754'
WARNING: Logging before InitGoogleLogging() is written to STDERR
I0901 13:47:13.570809 15903 process.cpp:1555] libprocess is initialized on
140.211.11.27:37262 for 24 cpus
I0901 13:47:13.573983 15918 exec.cpp:174] Executor started at: executor(1)@
140.211.11.27:37262 with pid 15903
I0901 13:47:13.574930 14270 slave.cpp:1435] Got registration for executor
'0498e8e5-085f-43d2-9fba-b73815cc3a38' of framework
201309011347-453759884-42454-14237-0001
I0901 13:47:13.576093 14270 slave.cpp:1520] Checkpointing executor pid
'executor(1)@140.211.11.27:37262' to
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/meta/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0001/executors/0498e8e5-085f-43d2-9fba-b73815cc3a38/runs/1e748173-ac79-4c1e-ade8-0d84d568c754/pids/libprocess.pid'
I0901 13:47:13.577858 15941 process.cpp:986] Socket closed while receiving
I0901 13:47:13.578158 15937 exec.cpp:198] Executor registered on slave
201309011347-453759884-42454-14237-0
I0901 13:47:13.577512 14270 slave.cpp:1556] Flushing queued task
0498e8e5-085f-43d2-9fba-b73815cc3a38 for executor
'0498e8e5-085f-43d2-9fba-b73815cc3a38' of framework
201309011347-453759884-42454-14237-0001
I0901 13:47:13.579125 15941 process.cpp:986] Socket closed while receiving
I0901 13:47:13.579854 15937 exec.cpp:210] Executor::registered took 94.388us
Registered executor on hemera.apache.org
I0901 13:47:13.579968 15937 exec.cpp:285] Executor asked to run task
'0498e8e5-085f-43d2-9fba-b73815cc3a38'
I0901 13:47:13.580104 15937 exec.cpp:294] Executor::launchTask took
120.315us
Starting task 0498e8e5-085f-43d2-9fba-b73815cc3a38
sh -c 'sleep 1000'
Forked command at 15942
I0901 13:47:13.583273 15919 exec.cpp:501] Executor sending status update
TASK_RUNNING (UUID: 9f3ae6cc-2f66-42a0-87ca-61421ee57587) for task
0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001
I0901 13:47:13.583823 14262 slave.cpp:1766] Handling status update
TASK_RUNNING (UUID: 9f3ae6cc-2f66-42a0-87ca-61421ee57587) for task
0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001 from executor(1)@140.211.11.27:37262
I0901 13:47:13.585561 14279 status_update_manager.cpp:300] Received status
update TASK_RUNNING (UUID: 9f3ae6cc-2f66-42a0-87ca-61421ee57587) for task
0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001
I0901 13:47:13.586334 14279 status_update_manager.cpp:471] Creating
StatusUpdate stream for task 0498e8e5-085f-43d2-9fba-b73815cc3a38 of
framework 201309011347-453759884-42454-14237-0001
I0901 13:47:13.587190 14279 status_update_manager.hpp:337] Checkpointing
UPDATE for status update TASK_RUNNING (UUID:
9f3ae6cc-2f66-42a0-87ca-61421ee57587) for task
0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001
I0901 13:47:13.589246 14279 status_update_manager.cpp:351] Forwarding
status update TASK_RUNNING (UUID: 9f3ae6cc-2f66-42a0-87ca-61421ee57587) for
task 0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001 to master@140.211.11.27:42454
I0901 13:47:13.590339 14262 master.cpp:1205] Status update TASK_RUNNING
(UUID: 9f3ae6cc-2f66-42a0-87ca-61421ee57587) for task
0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001 from slave(49)@140.211.11.27:42454
I0901 13:47:13.591611 14261 slave.cpp:1885] Status update manager
successfully handled status update TASK_RUNNING (UUID:
9f3ae6cc-2f66-42a0-87ca-61421ee57587) for task
0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001
I0901 13:47:13.597858 14262 sched.cpp:395] Scheduler::statusUpdate took
298.475us
I0901 13:47:13.598829 14261 slave.cpp:1891] Sending acknowledgement for
status update TASK_RUNNING (UUID: 9f3ae6cc-2f66-42a0-87ca-61421ee57587) for
task 0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001 to executor(1)@140.211.11.27:37262
I0901 13:47:13.600772 15941 process.cpp:986] Socket closed while receiving
I0901 13:47:13.600929 15931 exec.cpp:331] Executor received status update
acknowledgement 9f3ae6cc-2f66-42a0-87ca-61421ee57587 for task
0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001
I0901 13:47:13.600586 14261 status_update_manager.cpp:375] Received status
update acknowledgement (UUID: 9f3ae6cc-2f66-42a0-87ca-61421ee57587) for
task 0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001
I0901 13:47:13.601729 14261 status_update_manager.hpp:337] Checkpointing
ACK for status update TASK_RUNNING (UUID:
9f3ae6cc-2f66-42a0-87ca-61421ee57587) for task
0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001
I0901 13:47:13.603888 14261 slave.cpp:1381] Status update manager
successfully handled status update acknowledgement (UUID:
9f3ae6cc-2f66-42a0-87ca-61421ee57587) for task
0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001
I0901 13:47:13.604854 14237 slave.cpp:454] Slave terminating
I0901 13:47:13.609611 14279 master.cpp:550] Slave
201309011347-453759884-42454-14237-0 (hemera.apache.org) disconnected
I0901 13:47:13.611862 14273 hierarchical_allocator_process.hpp:459] Removed
slave 201309011347-453759884-42454-14237-0
I0901 13:47:13.616055 14264 slave.cpp:108] Slave started on 50)@
140.211.11.27:42454
I0901 13:47:13.616775 14264 slave.cpp:208] Slave resources: cpus(*):2;
mem(*):1024; disk(*):1024; ports(*):[31000-32000]
I0901 13:47:13.618336 14264 state.cpp:33] Recovering state from
/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/meta
I0901 13:47:13.621260 14264 slave.cpp:2754] Recovering framework
201309011347-453759884-42454-14237-0001
I0901 13:47:13.622084 14264 slave.cpp:2930] Recovering executor
'0498e8e5-085f-43d2-9fba-b73815cc3a38' of framework
201309011347-453759884-42454-14237-0001
I0901 13:47:13.622946 14264 slave.cpp:2754] Recovering framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.623697 14264 slave.cpp:2930] Recovering executor
'c2dcd6ba-07e8-401d-93e7-2fd62f8dd442' of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.627058 14260 status_update_manager.cpp:179] Recovering
status update manager
I0901 13:47:13.628176 14260 status_update_manager.cpp:183] Recovering
executor '0498e8e5-085f-43d2-9fba-b73815cc3a38' of framework
201309011347-453759884-42454-14237-0001
I0901 13:47:13.628183 14264 slave.cpp:544] New master detected at
master@140.211.11.27:42454
I0901 13:47:13.628732 14260 status_update_manager.cpp:471] Creating
StatusUpdate stream for task 0498e8e5-085f-43d2-9fba-b73815cc3a38 of
framework 201309011347-453759884-42454-14237-0001
I0901 13:47:13.629585 14264 slave.cpp:559] Postponing registration until
recovery is complete
I0901 13:47:13.630358 14260 status_update_manager.hpp:301] Replaying status
update stream for task 0498e8e5-085f-43d2-9fba-b73815cc3a38
I0901 13:47:13.631078 14264 slave.cpp:526] Successfully attached file
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0001/executors/0498e8e5-085f-43d2-9fba-b73815cc3a38/runs/1e748173-ac79-4c1e-ade8-0d84d568c754'
I0901 13:47:13.631796 14260 status_update_manager.cpp:183] Recovering
executor 'c2dcd6ba-07e8-401d-93e7-2fd62f8dd442' of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.632529 14264 slave.cpp:526] Successfully attached file
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0000/executors/c2dcd6ba-07e8-401d-93e7-2fd62f8dd442/runs/7467900c-ab42-4188-b647-bcf7d09843c9'
I0901 13:47:13.633414 14260 status_update_manager.cpp:471] Creating
StatusUpdate stream for task c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of
framework 201309011347-453759884-42454-14237-0000
I0901 13:47:13.635264 14260 status_update_manager.hpp:301] Replaying status
update stream for task c2dcd6ba-07e8-401d-93e7-2fd62f8dd442
I0901 13:47:13.637058 14260 status_update_manager.cpp:157] New master
detected at master@140.211.11.27:42454
I0901 13:47:13.637073 14273 process_isolator.cpp:314] Recovering isolator
I0901 13:47:13.638957 14273 process_isolator.cpp:322] Recovering executor
'0498e8e5-085f-43d2-9fba-b73815cc3a38' of framework
201309011347-453759884-42454-14237-0001
I0901 13:47:13.639804 14273 process_isolator.cpp:322] Recovering executor
'c2dcd6ba-07e8-401d-93e7-2fd62f8dd442' of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.642921 14275 slave.cpp:2704] Sending reconnect request to
executor c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000 at executor(1)@140.211.11.27:40862
I0901 13:47:13.643983 15832 process.cpp:986] Socket closed while receiving
I0901 13:47:13.644206 15827 exec.cpp:244] Received reconnect request from
slave 201309011347-453759884-42454-14237-0
I0901 13:47:13.644140 14275 slave.cpp:2704] Sending reconnect request to
executor 0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001 at executor(1)@140.211.11.27:37262
I0901 13:47:13.644714 15941 process.cpp:986] Socket closed while receiving
I0901 13:47:13.644894 15924 exec.cpp:244] Received reconnect request from
slave 201309011347-453759884-42454-14237-0
I0901 13:47:13.644625 14275 slave.cpp:1600] Re-registering executor
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.645283 15832 process.cpp:986] Socket closed while receiving
I0901 13:47:13.645387 15810 exec.cpp:221] Executor re-registered on slave
201309011347-453759884-42454-14237-0
I0901 13:47:13.646265 14275 slave.cpp:1600] Re-registering executor
0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001
I0901 13:47:13.646785 15941 process.cpp:986] Socket closed while receiving
I0901 13:47:13.646914 15926 exec.cpp:221] Executor re-registered on slave
201309011347-453759884-42454-14237-0
Re-registered executor on hemera.apache.org
I0901 13:47:13.647294 15810 exec.cpp:233] Executor::reregistered took
47.797us
Re-registered executor on hemera.apache.org
I0901 13:47:13.648502 15926 exec.cpp:233] Executor::reregistered took
43.628us
I0901 13:47:13.654582 14265 slave.cpp:1714] Cleaning up un-reregistered
executors
I0901 13:47:13.654615 14278 hierarchical_allocator_process.hpp:687] No
resources available to allocate!
I0901 13:47:13.655547 14265 slave.cpp:399] Finished recovery
I0901 13:47:13.656339 14278 hierarchical_allocator_process.hpp:649]
Performed allocation for 0 slaves in 2.828822ms
W0901 13:47:13.657848 14265 master.cpp:1120] Slave at slave(50)@
140.211.11.27:42454 (hemera.apache.org) is being allowed to re-register
with an already in use id (201309011347-453759884-42454-14237-0)
I0901 13:47:13.660595 14265 master.cpp:930] Asked to kill task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.661541 14265 master.cpp:948] Telling slave
201309011347-453759884-42454-14237-0 (hemera.apache.org) to kill task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.660835 14280 slave.cpp:645] Re-registered with master
master@140.211.11.27:42454
I0901 13:47:13.661695 14267 hierarchical_allocator_process.hpp:434] Added
slave 201309011347-453759884-42454-14237-0 (hemera.apache.org) with
cpus(*):2; mem(*):1024; disk(*):1024; ports(*):[31000-32000] (and
available)
I0901 13:47:13.663125 14280 slave.cpp:1327] Updating framework
201309011347-453759884-42454-14237-0000 pid to scheduler(35)@
140.211.11.27:42454
I0901 13:47:13.663918 14267 hierarchical_allocator_process.hpp:795]
Filtered on slave 201309011347-453759884-42454-14237-0 for framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.665385 14267 hierarchical_allocator_process.hpp:669]
Performed allocation for slave 201309011347-453759884-42454-14237-0 in
1.490006ms
I0901 13:47:13.664595 14280 slave.cpp:1335] Checkpointing framework pid
'scheduler(35)@140.211.11.27:42454' to
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/meta/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0000/framework.pid'
I0901 13:47:13.666965 14280 slave.cpp:1327] Updating framework
201309011347-453759884-42454-14237-0001 pid to scheduler(36)@
140.211.11.27:42454
I0901 13:47:13.667834 14280 slave.cpp:1335] Checkpointing framework pid
'scheduler(36)@140.211.11.27:42454' to
'/tmp/SlaveRecoveryTest_0_MultipleFrameworks_vgq4T5/meta/slaves/201309011347-453759884-42454-14237-0/frameworks/201309011347-453759884-42454-14237-0001/framework.pid'
I0901 13:47:13.668751 14280 slave.cpp:1037] Asked to kill task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:13.669797 15832 process.cpp:986] Socket closed while receiving
I0901 13:47:13.669893 15808 exec.cpp:305] Executor asked to kill task
'c2dcd6ba-07e8-401d-93e7-2fd62f8dd442'
Shutting down
Killing process tree at pid 15833
I0901 13:47:13.669970 15808 exec.cpp:314] Executor::killTask took 56.789us
Killed the following process trees:
[
-+- 15833 sh -c sleep 1000
\--- 15834 sleep 1000
]
Command terminated with signal Killed (pid: 15833)
I0901 13:47:14.439859 15808 exec.cpp:501] Executor sending status update
TASK_KILLED (UUID: 7925abe3-511f-4390-815d-d7f376c94e39) for task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:14.440372 14276 slave.cpp:1766] Handling status update
TASK_KILLED (UUID: 7925abe3-511f-4390-815d-d7f376c94e39) for task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000 from executor(1)@140.211.11.27:40862
I0901 13:47:14.441823 14276 slave.cpp:3106] Terminating task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442
I0901 13:47:14.486299 14266 status_update_manager.cpp:300] Received status
update TASK_KILLED (UUID: 7925abe3-511f-4390-815d-d7f376c94e39) for task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:14.517102 14266 status_update_manager.hpp:337] Checkpointing
UPDATE for status update TASK_KILLED (UUID:
7925abe3-511f-4390-815d-d7f376c94e39) for task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:14.519927 14266 status_update_manager.cpp:351] Forwarding
status update TASK_KILLED (UUID: 7925abe3-511f-4390-815d-d7f376c94e39) for
task c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000 to master@140.211.11.27:42454
I0901 13:47:14.521199 14271 slave.cpp:1885] Status update manager
successfully handled status update TASK_KILLED (UUID:
7925abe3-511f-4390-815d-d7f376c94e39) for task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:14.525583 14271 slave.cpp:1891] Sending acknowledgement for
status update TASK_KILLED (UUID: 7925abe3-511f-4390-815d-d7f376c94e39) for
task c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000 to executor(1)@140.211.11.27:40862
I0901 13:47:14.527132 15832 process.cpp:986] Socket closed while receiving
I0901 13:47:14.527189 15829 exec.cpp:331] Executor received status update
acknowledgement 7925abe3-511f-4390-815d-d7f376c94e39 for task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:14.521203 14272 master.cpp:1205] Status update TASK_KILLED
(UUID: 7925abe3-511f-4390-815d-d7f376c94e39) for task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000 from slave(50)@140.211.11.27:42454
I0901 13:47:14.528347 14272 master.hpp:329] Removing task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 with resources cpus(*):1; mem(*):512
on slave 201309011347-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:47:14.528504 14264 sched.cpp:395] Scheduler::statusUpdate took
27.065us
I0901 13:47:14.529675 14272 master.cpp:930] Asked to kill task
0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001
I0901 13:47:14.529747 14266 hierarchical_allocator_process.hpp:598]
Recovered cpus(*):1; mem(*):512 (total allocatable: cpus(*):1; mem(*):512)
on slave 201309011347-453759884-42454-14237-0 from framework
201309011347-453759884-42454-14237-0000
I0901 13:47:14.531157 14264 status_update_manager.cpp:375] Received status
update acknowledgement (UUID: 7925abe3-511f-4390-815d-d7f376c94e39) for
task c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:14.533889 14264 status_update_manager.hpp:337] Checkpointing
ACK for status update TASK_KILLED (UUID:
7925abe3-511f-4390-815d-d7f376c94e39) for task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:14.531978 14272 master.cpp:948] Telling slave
201309011347-453759884-42454-14237-0 (hemera.apache.org) to kill task
0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001
I0901 13:47:14.535738 14272 slave.cpp:1037] Asked to kill task
0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001
I0901 13:47:14.541985 15941 process.cpp:986] Socket closed while receiving
I0901 13:47:14.542145 15934 exec.cpp:305] Executor asked to kill task
'0498e8e5-085f-43d2-9fba-b73815cc3a38'
Shutting down
Killing process tree at pid 15942
I0901 13:47:14.542250 15934 exec.cpp:314] Executor::killTask took 80.418us
I0901 13:47:14.548738 14264 status_update_manager.cpp:502] Cleaning up
status update stream for task c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of
framework 201309011347-453759884-42454-14237-0000
I0901 13:47:14.549985 14259 slave.cpp:1381] Status update manager
successfully handled status update acknowledgement (UUID:
7925abe3-511f-4390-815d-d7f376c94e39) for task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442 of framework
201309011347-453759884-42454-14237-0000
I0901 13:47:14.557396 14259 slave.cpp:3129] Completing task
c2dcd6ba-07e8-401d-93e7-2fd62f8dd442
Killed the following process trees:
[
-+- 15942 sh -c sleep 1000
\--- 15943 sleep 1000
]
I0901 13:47:14.659404 14276 hierarchical_allocator_process.hpp:795]
Filtered cpus(*):1; mem(*):512 on slave
201309011347-453759884-42454-14237-0 for framework
201309011347-453759884-42454-14237-0000
I0901 13:47:14.660862 14276 hierarchical_allocator_process.hpp:712]
Offering cpus(*):1; mem(*):512 on slave
201309011347-453759884-42454-14237-0 to framework
201309011347-453759884-42454-14237-0001
I0901 13:47:14.662184 14276 hierarchical_allocator_process.hpp:649]
Performed allocation for 1 slaves in 2.871565ms
I0901 13:47:14.662304 14278 master.hpp:339] Adding offer
201309011347-453759884-42454-14237-2 with resources cpus(*):1; mem(*):512
on slave 201309011347-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:47:14.664882 14278 master.cpp:1439] Sending 1 offers to framework
201309011347-453759884-42454-14237-0001
../../src/tests/slave_recovery_tests.cpp:2274: Failure
Mock function called more times than expected - returning directly.
Function call: resourceOffers(0x7ffffc32cc40, @0x2b4fde6cdc60 {
224-byte object <F0-FE BD-D9 4F-2B 00-00 00-00 00-00 00-00 00-00 40-1A
00-54 50-2B 00-00 70-4B 00-54 50-2B 00-00 A0-4B 00-54 50-2B 00-00 30-7B
00-54 50-2B 00-00 D8-40 00-54 50-2B 00-00 02-00 00-00 02-00 00-00 ... 48-41
00-54 50-2B 00-00 00-00 00-00 00-00 00-00 04-00 00-00 4F-2B 00-00 41-00
00-00 00-00 00-00 70-5B 00-54 50-2B 00-00 00-54 00-54 50-2B 00-00 D0-13
49-D9 4F-2B 00-00 00-00 00-00 0F-00 00-00> })
Expected: to be called once
Actual: called twice - over-saturated and active
I0901 13:47:14.666410 14278 sched.cpp:340] Scheduler::resourceOffers took
325.202us
I0901 13:47:15.441553 14281 process.cpp:986] Socket closed while receiving
Command terminated with signal Killed (pid: 15942)
I0901 13:47:15.574158 15937 exec.cpp:501] Executor sending status update
TASK_KILLED (UUID: 49ed0754-c0df-4e20-b87a-571fd59f8b04) for task
0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001
I0901 13:47:15.574645 14257 slave.cpp:1766] Handling status update
TASK_KILLED (UUID: 49ed0754-c0df-4e20-b87a-571fd59f8b04) for task
0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001 from executor(1)@140.211.11.27:37262
I0901 13:47:15.575892 14257 slave.cpp:3106] Terminating task
0498e8e5-085f-43d2-9fba-b73815cc3a38
I0901 13:47:15.577260 14277 status_update_manager.cpp:300] Received status
update TASK_KILLED (UUID: 49ed0754-c0df-4e20-b87a-571fd59f8b04) for task
0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001
I0901 13:47:15.578742 14277 status_update_manager.hpp:337] Checkpointing
UPDATE for status update TASK_KILLED (UUID:
49ed0754-c0df-4e20-b87a-571fd59f8b04) for task
0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001
I0901 13:47:15.580684 14277 status_update_manager.cpp:351] Forwarding
status update TASK_KILLED (UUID: 49ed0754-c0df-4e20-b87a-571fd59f8b04) for
task 0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001 to master@140.211.11.27:42454
I0901 13:47:15.581979 14257 master.cpp:1205] Status update TASK_KILLED
(UUID: 49ed0754-c0df-4e20-b87a-571fd59f8b04) for task
0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001 from slave(50)@140.211.11.27:42454
I0901 13:47:15.582154 14258 slave.cpp:1885] Status update manager
successfully handled status update TASK_KILLED (UUID:
49ed0754-c0df-4e20-b87a-571fd59f8b04) for task
0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001
I0901 13:47:15.590971 14258 slave.cpp:1891] Sending acknowledgement for
status update TASK_KILLED (UUID: 49ed0754-c0df-4e20-b87a-571fd59f8b04) for
task 0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001 to executor(1)@140.211.11.27:37262
I0901 13:47:15.592141 15941 process.cpp:986] Socket closed while receiving
I0901 13:47:15.592351 15917 exec.cpp:331] Executor received status update
acknowledgement 49ed0754-c0df-4e20-b87a-571fd59f8b04 for task
0498e8e5-085f-43d2-9fba-b73815cc3a38 of framework
201309011347-453759884-42454-14237-0001
I0901 13:47:15.589752 14264 sched.cpp:395] Scheduler::statusUpdate took
17.817us
I0901 13:47:15.592840 14264 sched.cpp:498] Stopping framework
'201309011347-453759884-42454-14237-0001'
I0901 13:47:15.589645 14257 master.hpp:329] Removing task
0498e8e5-085f-43d2-9fba-b73815cc3a38 with resources cpus(*):1; mem(*):512;
disk(*):1024; ports(*):[31000-32000] on slave
201309011347-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:47:15.590407 14268 sched.cpp:498] Stopping framework
'201309011347-453759884-42454-14237-0000'
I0901 13:47:15.594913 14257 master.cpp:478] Master terminating
I0901 13:47:15.595060 14277 hierarchical_allocator_process.hpp:598]
Recovered cpus(*):1; mem(*):512; disk(*):1024; ports(*):[31000-32000]
(total allocatable: cpus(*):1; mem(*):512; disk(*):1024;
ports(*):[31000-32000]) on slave 201309011347-453759884-42454-14237-0 from
framework 201309011347-453759884-42454-14237-0001
I0901 13:47:15.597136 14257 slave.cpp:1966] master@140.211.11.27:42454exited
W0901 13:47:15.598986 14257 slave.cpp:1969] Master disconnected! Waiting
for a new master to be elected
I0901 13:47:15.597240 14237 master.cpp:206] Shutting down master
I0901 13:47:15.601188 14237 master.hpp:349] Removing offer
201309011347-453759884-42454-14237-2 with resources cpus(*):1; mem(*):512
on slave 201309011347-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:47:15.601994 14237 master.cpp:234] Removing slave
201309011347-453759884-42454-14237-0 (hemera.apache.org)
I0901 13:47:15.603039 14237 slave.cpp:454] Slave terminating
[ FAILED ] SlaveRecoveryTest/0.MultipleFrameworks, where TypeParam =
mesos::internal::slave::ProcessIsolator (2280 ms)
On Sun, Sep 1, 2013 at 6:48 AM, Apache Jenkins Server <
jenkins@builds.apache.org> wrote:
> See <
> https://builds.apache.org/job/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME/1611/
> >
>
> ------------------------------------------
> [...truncated 16801 lines...]
> I0901 13:48:12.445449 14237 master.cpp:206] Shutting down master
> W0901 13:48:12.448010 14277 slave.cpp:1969] Master disconnected! Waiting
> for a new master to be elected
> I0901 13:48:12.448873 14237 master.hpp:329] Removing task 0 with resources
> cpus(*):1; mem(*):500 on slave 201309011348-453759884-42454-14237-0 (
> hemera.apache.org)
> I0901 13:48:12.450603 14277 status_update_manager.cpp:375] Received status
> update acknowledgement (UUID: e5bf2fdb-e422-42fb-b945-49490d8ae8f0) for
> task 0 of framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:12.451619 14237 master.cpp:234] Removing slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org)
> I0901 13:48:12.451670 14268 hierarchical_allocator_process.hpp:598]
> Recovered cpus(*):1; mem(*):500 (total allocatable: cpus(*):2; mem(*):1024;
> disk(*):127026; ports(*):[31000-32000]) on slave
> 201309011348-453759884-42454-14237-0 from framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:12.452736 14277 slave.cpp:1381] Status update manager
> successfully handled status update acknowledgement (UUID:
> e5bf2fdb-e422-42fb-b945-49490d8ae8f0) for task 0 of framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:12.456701 14268 master.cpp:262] Master started on
> 140.211.11.27:42454
> I0901 13:48:12.457206 14268 master.cpp:277] Master ID:
> 201309011348-453759884-42454-14237
> I0901 13:48:12.458112 14259 detector.cpp:420] Master detector (slave(131)@
> 140.211.11.27:42454) found 0 registered masters
> I0901 13:48:12.466596 14259 detector.cpp:441] Master detector (slave(131)@
> 140.211.11.27:42454) couldn't find any masters
> I0901 13:48:12.460623 14261 detector.cpp:234] Master detector (
> master@140.211.11.27:42454) connected to ZooKeeper ...
> I0901 13:48:12.468416 14261 detector.cpp:251] Trying to create path
> '/znode' in ZooKeeper
> I0901 13:48:12.465838 14274 hierarchical_allocator_process.hpp:291]
> Initializing hierarchical allocator process with master :
> master@140.211.11.27:42454
> I0901 13:48:12.458631 14273 detector.cpp:420] Master detector
> (scheduler(113)@140.211.11.27:42454) found 0 registered masters
> I0901 13:48:12.471071 14273 detector.cpp:441] Master detector
> (scheduler(113)@140.211.11.27:42454) couldn't find any masters
> W0901 13:48:12.465535 14277 master.cpp:80] No whitelist given. Advertising
> offers for all slaves
> I0901 13:48:12.474067 14278 detector.cpp:420] Master detector (slave(131)@
> 140.211.11.27:42454) found 1 registered masters
> I0901 13:48:12.471848 14273 sched.cpp:202] No master detected, waiting for
> another master
> I0901 13:48:12.478742 14273 sched.cpp:214] Scheduler::disconnected took
> 15.324us
> I0901 13:48:12.473634 14267 detector.cpp:420] Master detector
> (scheduler(113)@140.211.11.27:42454) found 1 registered masters
> I0901 13:48:12.467483 14259 slave.cpp:578] Lost master(s) ... waiting
> I0901 13:48:12.478446 14278 detector.cpp:467] Master detector (slave(131)@
> 140.211.11.27:42454) got new master pid: master@140.211.11.27:42454
> I0901 13:48:12.472808 14261 detector.cpp:281] Created ephemeral/sequence
> znode at '/znode/0000000002'
> I0901 13:48:12.481369 14267 detector.cpp:467] Master detector
> (scheduler(113)@140.211.11.27:42454) got new master pid:
> master@140.211.11.27:42454
> I0901 13:48:12.482713 14278 slave.cpp:544] New master detected at
> master@140.211.11.27:42454
> I0901 13:48:12.484776 14261 detector.cpp:420] Master detector (
> master@140.211.11.27:42454) found 1 registered masters
> I0901 13:48:12.485153 14270 sched.cpp:178] New master at
> master@140.211.11.27:42454
> I0901 13:48:12.485795 14267 status_update_manager.cpp:157] New master
> detected at master@140.211.11.27:42454
> W0901 13:48:12.487934 14271 master.cpp:714] Ignoring re-register framework
> message since not elected yet
> I0901 13:48:12.487932 14261 detector.cpp:467] Master detector (
> master@140.211.11.27:42454) got new master pid:
> master@140.211.11.27:42454
> I0901 13:48:12.491312 14261 master.cpp:642] Elected as master!
> I0901 13:48:13.398939 14260 master.cpp:734] Re-registering framework
> 201309011348-453759884-42454-14237-0000 at scheduler(113)@
> 140.211.11.27:42454
> I0901 13:48:13.400677 14270 sched.cpp:237] Framework registered with
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.401135 14261 hierarchical_allocator_process.hpp:321] Added
> framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.403525 14261 hierarchical_allocator_process.hpp:687] No
> resources available to allocate!
> I0901 13:48:13.404464 14261 hierarchical_allocator_process.hpp:649]
> Performed allocation for 0 slaves in 939.955us
> I0901 13:48:13.402282 14270 sched.cpp:251] Scheduler::registered took
> 14.111us
> I0901 13:48:13.471325 14278 hierarchical_allocator_process.hpp:687] No
> resources available to allocate!
> I0901 13:48:13.472589 14278 hierarchical_allocator_process.hpp:649]
> Performed allocation for 0 slaves in 1.269516ms
> I0901 13:48:13.486690 14263 master.cpp:1159] Attempting to re-register
> slave 201309011348-453759884-42454-14237-0 at slave(131)@
> 140.211.11.27:42454 (hemera.apache.org)
> I0901 13:48:13.487660 14263 master.cpp:2078] Adding slave
> 201309011348-453759884-42454-14237-0 at hemera.apache.org with cpus(*):2;
> mem(*):1024; disk(*):127026; ports(*):[31000-32000]
> I0901 13:48:13.488994 14263 master.hpp:316] Adding task 0 with resources
> cpus(*):1; mem(*):500 on slave 201309011348-453759884-42454-14237-0 (
> hemera.apache.org)
> I0901 13:48:13.489035 14267 slave.cpp:645] Re-registered with master
> master@140.211.11.27:42454
> I0901 13:48:13.490772 14276 hierarchical_allocator_process.hpp:434] Added
> slave 201309011348-453759884-42454-14237-0 (hemera.apache.org) with
> cpus(*):2; mem(*):1024; disk(*):127026; ports(*):[31000-32000] (and
> cpus(*):1; mem(*):524; disk(*):127026; ports(*):[31000-32000] available)
> I0901 13:48:13.491698 14267 slave.cpp:1327] Updating framework
> 201309011348-453759884-42454-14237-0000 pid to scheduler(113)@
> 140.211.11.27:42454
> I0901 13:48:13.493104 14276 hierarchical_allocator_process.hpp:712]
> Offering cpus(*):1; mem(*):524; disk(*):127026; ports(*):[31000-32000] on
> slave 201309011348-453759884-42454-14237-0 to framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.495089 14276 hierarchical_allocator_process.hpp:669]
> Performed allocation for slave 201309011348-453759884-42454-14237-0 in
> 2.015672ms
> I0901 13:48:13.495221 14260 master.hpp:339] Adding offer
> 201309011348-453759884-42454-14237-0 with resources cpus(*):1; mem(*):524;
> disk(*):127026; ports(*):[31000-32000] on slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org)
> I0901 13:48:13.497177 14260 master.cpp:1439] Sending 1 offers to framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.498236 14260 sched.cpp:340] Scheduler::resourceOffers took
> 24.876us
> I0901 13:48:13.499927 14260 sched.cpp:498] Stopping framework
> '201309011348-453759884-42454-14237-0000'
> I0901 13:48:13.499023 14237 master.cpp:478] Master terminating
> I0901 13:48:13.501727 14237 master.cpp:206] Shutting down master
> I0901 13:48:13.501747 14261 slave.cpp:1966] master@140.211.11.27:42454exited
> W0901 13:48:13.513283 14261 slave.cpp:1969] Master disconnected! Waiting
> for a new master to be elected
> I0901 13:48:13.502653 14237 master.hpp:329] Removing task 0 with resources
> cpus(*):1; mem(*):500 on slave 201309011348-453759884-42454-14237-0 (
> hemera.apache.org)
> I0901 13:48:13.516372 14237 master.hpp:349] Removing offer
> 201309011348-453759884-42454-14237-0 with resources cpus(*):1; mem(*):524;
> disk(*):127026; ports(*):[31000-32000] on slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org)
> I0901 13:48:13.516594 14266 hierarchical_allocator_process.hpp:598]
> Recovered cpus(*):1; mem(*):500 (total allocatable: cpus(*):1; mem(*):500)
> on slave 201309011348-453759884-42454-14237-0 from framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.517467 14237 master.cpp:234] Removing slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org)
> I0901 13:48:13.520035 14237 slave.cpp:454] Slave terminating
> I0901 13:48:13.520344 14237 slave.cpp:1162] Asked to shut down framework
> 201309011348-453759884-42454-14237-0000 by @0.0.0.0:0
> I0901 13:48:13.521235 14237 slave.cpp:1187] Shutting down framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.529317 14237 slave.cpp:2417] Shutting down executor
> 'default' of framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.522156 14270 detector.cpp:420] Master detector (slave(131)@
> 140.211.11.27:42454) found 0 registered masters
> I0901 13:48:13.530541 14276 exec.cpp:371] Executor asked to shutdown
>
> GMOCK WARNING:
> Uninteresting mock function call - returning directly.
> Function call: shutdown(0x2b504800a800)
> Stack trace:
> I0901 13:48:13.531070 14270 detector.cpp:441] Master detector (slave(131)@
> 140.211.11.27:42454) couldn't find any masters
> I0901 13:48:13.532029 14276 exec.cpp:386] Executor::shutdown took 87.169us
> [ OK ] AllocatorZooKeeperTest/0.FrameworkReregistersFirst (1184 ms)
> [ RUN ] AllocatorZooKeeperTest/0.SlaveReregistersFirst
> I0901 13:48:13.535174 14271 master.cpp:262] Master started on
> 140.211.11.27:42454
> 2013-09-01 13:48:13,536:14237(0x2b4fdcac0700):ZOO_INFO@log_env@687:
> Client environment:user.home=/home/jenkins
> 2013-09-01 13:48:13,537:14237(0x2b4fdcac0700):ZOO_INFO@log_env@699:
> Client
> environment:user.dir=/x1/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME/build/src
> 2013-09-01 13:48:13,537:14237(0x2b4fdcac0700):ZOO_INFO@zookeeper_init@727:
> Initiating client connection, host=127.0.0.1:54195 sessionTimeout=10000
> watcher=0x2b4fd95a75f0 sessionId=0 sessionPasswd=<null>
> context=0x2b5034008020 flags=0
> 2013-09-01 13:48:13,537:14237(0x2b4fdcac0700):ZOO_DEBUG@start_threads@152:
> starting threads...
> 2013-09-01 13:48:13,537:14237(0x2b526d118700):ZOO_DEBUG@do_completion@326:
> started completion thread
> 2013-09-01 13:48:13,537:14237(0x2b526cd16700):ZOO_DEBUG@do_io@279:
> started IO thread
> 2013-09-01 13:48:13,537:14237(0x2b526cd16700):ZOO_INFO@check_events@1585:
> initiated connection to server [127.0.0.1:54195]
> 2013-09-01 13:48:13,537:14237(0x2b4fdbcb9700):ZOO_INFO@log_env@658:
> Client environment:zookeeper.version=zookeeper C client 3.3.4
> 2013-09-01 13:48:13,537:14237(0x2b4fdbcb9700):ZOO_INFO@log_env@662:
> Client environment:host.name=hemera
> 2013-09-01 13:48:13,537:14237(0x2b4fdbcb9700):ZOO_INFO@log_env@669:
> Client environment:os.name=Linux
> 2013-09-01 13:48:13,537:14237(0x2b4fdbcb9700):ZOO_INFO@log_env@670:
> Client environment:os.arch=3.2.0-51-generic
> 2013-09-01 13:48:13,538:14237(0x2b4fdbcb9700):ZOO_INFO@log_env@671:
> Client environment:os.version=#77-Ubuntu SMP Wed Jul 24 20:18:19 UTC 2013
> I0901 13:48:13.536084 14271 master.cpp:277] Master ID:
> 201309011348-453759884-42454-14237
> I0901 13:48:13.536978 14266 slave.cpp:108] Slave started on 132)@
> 140.211.11.27:42454
> I0901 13:48:13.540307 14275 detector.cpp:234] Master detector (
> master@140.211.11.27:42454) connected to ZooKeeper ...
> I0901 13:48:13.541383 14261 detector.cpp:234] Master detector (slave(132)@
> 140.211.11.27:42454) connected to ZooKeeper ...
> I0901 13:48:13.542315 14265 detector.cpp:234] Master detector
> (scheduler(114)@140.211.11.27:42454) connected to ZooKeeper ...
> I0901 13:48:13.552961 14265 detector.cpp:251] Trying to create path
> '/znode' in ZooKeeper
> W0901 13:48:13.549511 14262 master.cpp:80] No whitelist given. Advertising
> offers for all slaves
> I0901 13:48:13.550516 14266 slave.cpp:208] Slave resources: cpus(*):2;
> mem(*):1024; disk(*):127026; ports(*):[31000-32000]
> I0901 13:48:13.551337 14275 detector.cpp:251] Trying to create path
> '/znode' in ZooKeeper
> I0901 13:48:13.557495 14267 slave.cpp:399] Finished recovery
> I0901 13:48:13.549383 14269 hierarchical_allocator_process.hpp:291]
> Initializing hierarchical allocator process with master :
> master@140.211.11.27:42454
> I0901 13:48:13.555846 14265 detector.cpp:420] Master detector
> (scheduler(114)@140.211.11.27:42454) found 0 registered masters
> I0901 13:48:13.560029 14265 detector.cpp:441] Master detector
> (scheduler(114)@140.211.11.27:42454) couldn't find any masters
> I0901 13:48:13.552140 14261 detector.cpp:251] Trying to create path
> '/znode' in ZooKeeper
> I0901 13:48:13.561058 14275 detector.cpp:281] Created ephemeral/sequence
> znode at '/znode/0000000004'
> I0901 13:48:13.561540 14268 sched.cpp:202] No master detected, waiting for
> another master
> I0901 13:48:13.562340 14265 detector.cpp:420] Master detector
> (scheduler(114)@140.211.11.27:42454) found 1 registered masters
> I0901 13:48:13.571676 14275 detector.cpp:420] Master detector (
> master@140.211.11.27:42454) found 1 registered masters
> I0901 13:48:13.572437 14261 detector.cpp:420] Master detector (slave(132)@
> 140.211.11.27:42454) found 1 registered masters
> I0901 13:48:13.574686 14275 detector.cpp:467] Master detector (
> master@140.211.11.27:42454) got new master pid:
> master@140.211.11.27:42454
> I0901 13:48:13.575845 14261 detector.cpp:467] Master detector (slave(132)@
> 140.211.11.27:42454) got new master pid: master@140.211.11.27:42454
> I0901 13:48:13.573832 14265 detector.cpp:467] Master detector
> (scheduler(114)@140.211.11.27:42454) got new master pid:
> master@140.211.11.27:42454
> I0901 13:48:13.576040 14271 master.cpp:642] Elected as master!
> I0901 13:48:13.576923 14261 slave.cpp:544] New master detected at
> master@140.211.11.27:42454
> I0901 13:48:13.577908 14265 sched.cpp:178] New master at
> master@140.211.11.27:42454
> I0901 13:48:13.580078 14261 status_update_manager.cpp:157] New master
> detected at master@140.211.11.27:42454
> I0901 13:48:13.580137 14272 master.cpp:1065] Attempting to register slave
> on hemera.apache.org at slave(132)@140.211.11.27:42454
> I0901 13:48:13.582753 14272 master.cpp:2078] Adding slave
> 201309011348-453759884-42454-14237-0 at hemera.apache.org with cpus(*):2;
> mem(*):1024; disk(*):127026; ports(*):[31000-32000]
> I0901 13:48:13.583590 14275 slave.cpp:604] Registered with master
> master@140.211.11.27:42454; given slave ID
> 201309011348-453759884-42454-14237-0
> I0901 13:48:13.583637 14272 master.cpp:692] Registering framework
> 201309011348-453759884-42454-14237-0000 at scheduler(114)@
> 140.211.11.27:42454
> I0901 13:48:13.583740 14267 hierarchical_allocator_process.hpp:434] Added
> slave 201309011348-453759884-42454-14237-0 (hemera.apache.org) with
> cpus(*):2; mem(*):1024; disk(*):127026; ports(*):[31000-32000] (and
> cpus(*):2; mem(*):1024; disk(*):127026; ports(*):[31000-32000] available)
> I0901 13:48:13.586906 14267 hierarchical_allocator_process.hpp:669]
> Performed allocation for slave 201309011348-453759884-42454-14237-0 in
> 7.212us
> I0901 13:48:13.585821 14272 sched.cpp:237] Framework registered with
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.588476 14272 sched.cpp:251] Scheduler::registered took
> 14.118us
> I0901 13:48:13.587802 14267 hierarchical_allocator_process.hpp:321] Added
> framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.590303 14267 hierarchical_allocator_process.hpp:712]
> Offering cpus(*):2; mem(*):1024; disk(*):127026; ports(*):[31000-32000] on
> slave 201309011348-453759884-42454-14237-0 to framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.591161 14267 hierarchical_allocator_process.hpp:649]
> Performed allocation for 1 slaves in 887.382us
> I0901 13:48:13.591251 14275 master.hpp:339] Adding offer
> 201309011348-453759884-42454-14237-0 with resources cpus(*):2; mem(*):1024;
> disk(*):127026; ports(*):[31000-32000] on slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org)
> I0901 13:48:13.593179 14275 master.cpp:1439] Sending 1 offers to framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.594245 14275 sched.cpp:340] Scheduler::resourceOffers took
> 173.024us
> I0901 13:48:13.595309 14260 master.cpp:1676] Processing reply for offer
> 201309011348-453759884-42454-14237-0 on slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org) for framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.596417 14260 master.hpp:316] Adding task 0 with resources
> cpus(*):1; mem(*):500 on slave 201309011348-453759884-42454-14237-0 (
> hemera.apache.org)
> I0901 13:48:13.597250 14260 master.cpp:1796] Launching task 0 of framework
> 201309011348-453759884-42454-14237-0000 with resources cpus(*):1;
> mem(*):500 on slave 201309011348-453759884-42454-14237-0 (
> hemera.apache.org)
> I0901 13:48:13.598248 14275 slave.cpp:767] Got assigned task 0 for
> framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.598276 14258 hierarchical_allocator_process.hpp:508]
> Framework 201309011348-453759884-42454-14237-0000 left cpus(*):1;
> mem(*):524; disk(*):127026; ports(*):[31000-32000] unused on slave
> 201309011348-453759884-42454-14237-0
> I0901 13:48:13.598302 14260 master.hpp:349] Removing offer
> 201309011348-453759884-42454-14237-0 with resources cpus(*):2; mem(*):1024;
> disk(*):127026; ports(*):[31000-32000] on slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org)
> I0901 13:48:13.599207 14275 slave.cpp:878] Launching task 0 for framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.600075 14258 hierarchical_allocator_process.hpp:551]
> Framework 201309011348-453759884-42454-14237-0000 filtered slave
> 201309011348-453759884-42454-14237-0 for 5secs
> I0901 13:48:13.604182 14275 paths.hpp:336] Created executor directory
> '/tmp/AllocatorZooKeeperTest_0_SlaveReregistersFirst_WWMWtl/slaves/201309011348-453759884-42454-14237-0/frameworks/201309011348-453759884-42454-14237-0000/executors/default/runs/93a0b8d4-5990-4a4c-b71c-09251a7d810a'
> I0901 13:48:13.605113 14275 slave.cpp:989] Queuing task '0' for executor
> default of framework '201309011348-453759884-42454-14237-0000
> I0901 13:48:13.605960 14275 slave.cpp:526] Successfully attached file
> '/tmp/AllocatorZooKeeperTest_0_SlaveReregistersFirst_WWMWtl/slaves/201309011348-453759884-42454-14237-0/frameworks/201309011348-453759884-42454-14237-0000/executors/default/runs/93a0b8d4-5990-4a4c-b71c-09251a7d810a'
> I0901 13:48:13.607786 14262 exec.cpp:174] Executor started at:
> executor(41)@140.211.11.27:42454 with pid 14237
> I0901 13:48:13.609359 14262 slave.cpp:1435] Got registration for executor
> 'default' of framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.610697 14262 slave.cpp:1556] Flushing queued task 0 for
> executor 'default' of framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.610751 14270 exec.cpp:198] Executor registered on slave
> 201309011348-453759884-42454-14237-0
> I0901 13:48:13.614671 14270 exec.cpp:210] Executor::registered took
> 15.764us
> I0901 13:48:13.615511 14270 exec.cpp:285] Executor asked to run task '0'
> I0901 13:48:13.616446 14270 exec.cpp:294] Executor::launchTask took
> 26.847us
> I0901 13:48:13.619410 14270 exec.cpp:501] Executor sending status update
> TASK_RUNNING (UUID: a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for task 0 of
> framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.620187 14270 slave.cpp:1766] Handling status update
> TASK_RUNNING (UUID: a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for task 0 of
> framework 201309011348-453759884-42454-14237-0000 from executor(41)@
> 140.211.11.27:42454
> I0901 13:48:13.621244 14270 status_update_manager.cpp:300] Received status
> update TASK_RUNNING (UUID: a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for task 0
> of framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.622117 14270 status_update_manager.cpp:471] Creating
> StatusUpdate stream for task 0 of framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.622891 14270 status_update_manager.cpp:351] Forwarding
> status update TASK_RUNNING (UUID: a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for
> task 0 of framework 201309011348-453759884-42454-14237-0000 to
> master@140.211.11.27:42454
> I0901 13:48:13.623790 14270 slave.cpp:1885] Status update manager
> successfully handled status update TASK_RUNNING (UUID:
> a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for task 0 of framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.623805 14260 master.cpp:1205] Status update TASK_RUNNING
> (UUID: a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for task 0 of framework
> 201309011348-453759884-42454-14237-0000 from slave(132)@
> 140.211.11.27:42454
> I0901 13:48:13.624639 14270 slave.cpp:1891] Sending acknowledgement for
> status update TASK_RUNNING (UUID: a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for
> task 0 of framework 201309011348-453759884-42454-14237-0000 to executor(41)@
> 140.211.11.27:42454
> I0901 13:48:13.625607 14260 sched.cpp:395] Scheduler::statusUpdate took
> 37.834us
> I0901 13:48:13.625895 14237 master.cpp:478] Master terminating
> I0901 13:48:13.626421 14279 exec.cpp:331] Executor received status update
> acknowledgement a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8 for task 0 of
> framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.627312 14273 status_update_manager.cpp:375] Received status
> update acknowledgement (UUID: a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for
> task 0 of framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.628062 14237 master.cpp:206] Shutting down master
> I0901 13:48:13.628278 14270 slave.cpp:1966] master@140.211.11.27:42454exited
> W0901 13:48:13.631556 14270 slave.cpp:1969] Master disconnected! Waiting
> for a new master to be elected
> I0901 13:48:13.633021 14270 slave.cpp:1381] Status update manager
> successfully handled status update acknowledgement (UUID:
> a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for task 0 of framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.630784 14237 master.hpp:329] Removing task 0 with resources
> cpus(*):1; mem(*):500 on slave 201309011348-453759884-42454-14237-0 (
> hemera.apache.org)
> I0901 13:48:13.634773 14237 master.cpp:234] Removing slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org)
> I0901 13:48:13.634845 14272 hierarchical_allocator_process.hpp:598]
> Recovered cpus(*):1; mem(*):500 (total allocatable: cpus(*):2; mem(*):1024;
> disk(*):127026; ports(*):[31000-32000]) on slave
> 201309011348-453759884-42454-14237-0 from framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.639075 14271 master.cpp:262] Master started on
> 140.211.11.27:42454
> I0901 13:48:13.639225 14271 master.cpp:277] Master ID:
> 201309011348-453759884-42454-14237
> I0901 13:48:13.640260 14267 detector.cpp:420] Master detector (slave(132)@
> 140.211.11.27:42454) found 0 registered masters
> I0901 13:48:13.650336 14267 detector.cpp:441] Master detector (slave(132)@
> 140.211.11.27:42454) couldn't find any masters
> I0901 13:48:13.642727 14259 detector.cpp:234] Master detector (
> master@140.211.11.27:42454) connected to ZooKeeper ...
> I0901 13:48:13.652062 14259 detector.cpp:251] Trying to create path
> '/znode' in ZooKeeper
> I0901 13:48:13.649737 14261 hierarchical_allocator_process.hpp:291]
> Initializing hierarchical allocator process with master :
> master@140.211.11.27:42454
> I0901 13:48:13.640332 14260 detector.cpp:420] Master detector
> (scheduler(114)@140.211.11.27:42454) found 0 registered masters
> I0901 13:48:13.655550 14260 detector.cpp:441] Master detector
> (scheduler(114)@140.211.11.27:42454) couldn't find any masters
> W0901 13:48:13.649432 14275 master.cpp:80] No whitelist given. Advertising
> offers for all slaves
> I0901 13:48:13.651140 14267 slave.cpp:578] Lost master(s) ... waiting
> I0901 13:48:13.656458 14261 sched.cpp:202] No master detected, waiting for
> another master
> I0901 13:48:13.665989 14261 sched.cpp:214] Scheduler::disconnected took
> 14.189us
> I0901 13:48:13.658159 14260 detector.cpp:420] Master detector
> (scheduler(114)@140.211.11.27:42454) found 1 registered masters
> I0901 13:48:13.658639 14264 detector.cpp:420] Master detector (slave(132)@
> 140.211.11.27:42454) found 1 registered masters
> I0901 13:48:13.657196 14259 detector.cpp:281] Created ephemeral/sequence
> znode at '/znode/0000000006'
> I0901 13:48:13.669733 14264 detector.cpp:467] Master detector (slave(132)@
> 140.211.11.27:42454) got new master pid: master@140.211.11.27:42454
> I0901 13:48:13.668481 14260 detector.cpp:467] Master detector
> (scheduler(114)@140.211.11.27:42454) got new master pid:
> master@140.211.11.27:42454
> I0901 13:48:13.670785 14264 slave.cpp:544] New master detected at
> master@140.211.11.27:42454
> I0901 13:48:13.670862 14259 detector.cpp:420] Master detector (
> master@140.211.11.27:42454) found 1 registered masters
> I0901 13:48:13.671875 14260 sched.cpp:178] New master at
> master@140.211.11.27:42454
> I0901 13:48:13.673040 14270 status_update_manager.cpp:157] New master
> detected at master@140.211.11.27:42454
> W0901 13:48:13.673425 14276 master.cpp:1092] Ignoring re-register slave
> message from hemera.apache.org since not elected yet
> I0901 13:48:13.675158 14259 detector.cpp:467] Master detector (
> master@140.211.11.27:42454) got new master pid:
> master@140.211.11.27:42454
> I0901 13:48:13.678570 14259 master.cpp:642] Elected as master!
> I0901 13:48:14.581439 14274 master.cpp:1159] Attempting to re-register
> slave 201309011348-453759884-42454-14237-0 at slave(132)@
> 140.211.11.27:42454 (hemera.apache.org)
> I0901 13:48:14.582810 14274 master.cpp:2078] Adding slave
> 201309011348-453759884-42454-14237-0 at hemera.apache.org with cpus(*):2;
> mem(*):1024; disk(*):127026; ports(*):[31000-32000]
> I0901 13:48:14.584097 14274 master.hpp:316] Adding task 0 with resources
> cpus(*):1; mem(*):500 on slave 201309011348-453759884-42454-14237-0 (
> hemera.apache.org)
> W0901 13:48:14.585726 14274 master.cpp:2170] Possibly orphaned task 0 of
> framework 201309011348-453759884-42454-14237-0000 running on slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org)
> I0901 13:48:14.584163 14267 slave.cpp:645] Re-registered with master
> master@140.211.11.27:42454
> I0901 13:48:14.587880 14273 hierarchical_allocator_process.hpp:434] Added
> slave 201309011348-453759884-42454-14237-0 (hemera.apache.org) with
> cpus(*):2; mem(*):1024; disk(*):127026; ports(*):[31000-32000] (and
> cpus(*):1; mem(*):524; disk(*):127026; ports(*):[31000-32000] available)
> I0901 13:48:14.588932 14273 hierarchical_allocator_process.hpp:669]
> Performed allocation for slave 201309011348-453759884-42454-14237-0 in
> 7.832us
> I0901 13:48:14.654443 14265 hierarchical_allocator_process.hpp:649]
> Performed allocation for 1 slaves in 55.654us
> I0901 13:48:14.675817 14259 master.cpp:734] Re-registering framework
> 201309011348-453759884-42454-14237-0000 at scheduler(114)@
> 140.211.11.27:42454
> I0901 13:48:14.677146 14278 sched.cpp:237] Framework registered with
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:14.678576 14278 sched.cpp:251] Scheduler::registered took
> 13.324us
> I0901 13:48:14.678074 14266 hierarchical_allocator_process.hpp:321] Added
> framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:14.677261 14273 slave.cpp:1327] Updating framework
> 201309011348-453759884-42454-14237-0000 pid to scheduler(114)@
> 140.211.11.27:42454
> I0901 13:48:14.680332 14266 hierarchical_allocator_process.hpp:712]
> Offering cpus(*):1; mem(*):524; disk(*):127026; ports(*):[31000-32000] on
> slave 201309011348-453759884-42454-14237-0 to framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:14.682147 14266 hierarchical_allocator_process.hpp:649]
> Performed allocation for 1 slaves in 1.846988ms
> I0901 13:48:14.682236 14259 master.hpp:339] Adding offer
> 201309011348-453759884-42454-14237-0 with resources cpus(*):1; mem(*):524;
> disk(*):127026; ports(*):[31000-32000] on slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org)
> I0901 13:48:14.684241 14259 master.cpp:1439] Sending 1 offers to framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:14.685359 14259 sched.cpp:340] Scheduler::resourceOffers took
> 64.241us
> I0901 13:48:14.686481 14259 sched.cpp:498] Stopping framework
> '201309011348-453759884-42454-14237-0000'
> I0901 13:48:14.686502 14276 master.cpp:478] Master terminating
> I0901 13:48:14.688787 14276 slave.cpp:1966] master@140.211.11.27:42454exited
> I0901 13:48:14.688899 14237 master.cpp:206] Shutting down master
> W0901 13:48:14.689703 14276 slave.cpp:1969] Master disconnected! Waiting
> for a new master to be elected
> I0901 13:48:14.690634 14237 master.hpp:329] Removing task 0 with resources
> cpus(*):1; mem(*):500 on slave 201309011348-453759884-42454-14237-0 (
> hemera.apache.org)
> I0901 13:48:14.692858 14237 master.hpp:349] Removing offer
> 201309011348-453759884-42454-14237-0 with resources cpus(*):1; mem(*):524;
> disk(*):127026; ports(*):[31000-32000] on slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org)
> I0901 13:48:14.693017 14275 hierarchical_allocator_process.hpp:598]
> Recovered cpus(*):1; mem(*):500 (total allocatable: cpus(*):1; mem(*):500)
> on slave 201309011348-453759884-42454-14237-0 from framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:14.694078 14237 master.cpp:234] Removing slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org)
> I0901 13:48:14.697295 14237 slave.cpp:454] Slave terminating
> I0901 13:48:14.697499 14237 slave.cpp:1162] Asked to shut down framework
> 201309011348-453759884-42454-14237-0000 by @0.0.0.0:0
> I0901 13:48:14.698477 14237 slave.cpp:1187] Shutting down framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:14.699030 14237 slave.cpp:2417] Shutting down executor
> 'default' of framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:14.699874 14260 detector.cpp:420] Master detector (slave(132)@
> 140.211.11.27:42454) found 0 registered masters
> I0901 13:48:14.701004 14260 detector.cpp:441] Master detector (slave(132)@
> 140.211.11.27:42454) couldn't find any masters
> I0901 13:48:14.700330 14263 exec.cpp:371] Executor asked to shutdown
>
> GMOCK WARNING:
> Uninteresting mock function call - returning directly.
> Function call: shutdown(0x2b502c009cb0)
> Stack trace:
> I0901 13:48:14.703187 14263 exec.cpp:386] Executor::shutdown took 21.98us
> [ OK ] AllocatorZooKeeperTest/0.SlaveReregistersFirst (1170 ms)
> I0901 13:48:14.706209 14237 zookeeper_test_server.cpp:93] Shutdown
> ZooKeeperTestServer on port 54195
> [----------] 2 tests from AllocatorZooKeeperTest/0 (2354 ms total)
>
> [----------] Global test environment tear-down
> [==========] 220 tests from 39 test cases ran. (89659 ms total)
> [ PASSED ] 219 tests.
> [ FAILED ] 1 test, listed below:
> [ FAILED ] SlaveRecoveryTest/0.MultipleFrameworks, where TypeParam =
> mesos::internal::slave::ProcessIsolator
>
> 1 FAILED TEST
> make[3]: *** [check-local] Error 1
> make[3]: Leaving directory
> `/x1/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME/build/src'
> make[2]: *** [check-am] Error 2
> make[2]: Leaving directory
> `/x1/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME/build/src'
> make[1]: *** [check] Error 2
> make[1]: Leaving directory
> `/x1/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME/build/src'
> make: *** [check-recursive] Error 1
> Build step 'Execute shell' marked build as failure
>
Jenkins build is back to normal :
Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME #1612
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME/1612/>
Re: Build failed in Jenkins: Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME
#1611
Posted by Yan Xu <ya...@twitter.com>.
This is https://issues.apache.org/jira/browse/MESOS-668
--
Jiang Yan Xu <ya...@twitter.com> @xujyan <http://twitter.com/xujyan>
On Sun, Sep 1, 2013 at 6:48 AM, Apache Jenkins Server <
jenkins@builds.apache.org> wrote:
> See <
> https://builds.apache.org/job/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME/1611/
> >
>
> ------------------------------------------
> [...truncated 16801 lines...]
> I0901 13:48:12.445449 14237 master.cpp:206] Shutting down master
> W0901 13:48:12.448010 14277 slave.cpp:1969] Master disconnected! Waiting
> for a new master to be elected
> I0901 13:48:12.448873 14237 master.hpp:329] Removing task 0 with resources
> cpus(*):1; mem(*):500 on slave 201309011348-453759884-42454-14237-0 (
> hemera.apache.org)
> I0901 13:48:12.450603 14277 status_update_manager.cpp:375] Received status
> update acknowledgement (UUID: e5bf2fdb-e422-42fb-b945-49490d8ae8f0) for
> task 0 of framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:12.451619 14237 master.cpp:234] Removing slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org)
> I0901 13:48:12.451670 14268 hierarchical_allocator_process.hpp:598]
> Recovered cpus(*):1; mem(*):500 (total allocatable: cpus(*):2; mem(*):1024;
> disk(*):127026; ports(*):[31000-32000]) on slave
> 201309011348-453759884-42454-14237-0 from framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:12.452736 14277 slave.cpp:1381] Status update manager
> successfully handled status update acknowledgement (UUID:
> e5bf2fdb-e422-42fb-b945-49490d8ae8f0) for task 0 of framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:12.456701 14268 master.cpp:262] Master started on
> 140.211.11.27:42454
> I0901 13:48:12.457206 14268 master.cpp:277] Master ID:
> 201309011348-453759884-42454-14237
> I0901 13:48:12.458112 14259 detector.cpp:420] Master detector (slave(131)@
> 140.211.11.27:42454) found 0 registered masters
> I0901 13:48:12.466596 14259 detector.cpp:441] Master detector (slave(131)@
> 140.211.11.27:42454) couldn't find any masters
> I0901 13:48:12.460623 14261 detector.cpp:234] Master detector (
> master@140.211.11.27:42454) connected to ZooKeeper ...
> I0901 13:48:12.468416 14261 detector.cpp:251] Trying to create path
> '/znode' in ZooKeeper
> I0901 13:48:12.465838 14274 hierarchical_allocator_process.hpp:291]
> Initializing hierarchical allocator process with master :
> master@140.211.11.27:42454
> I0901 13:48:12.458631 14273 detector.cpp:420] Master detector
> (scheduler(113)@140.211.11.27:42454) found 0 registered masters
> I0901 13:48:12.471071 14273 detector.cpp:441] Master detector
> (scheduler(113)@140.211.11.27:42454) couldn't find any masters
> W0901 13:48:12.465535 14277 master.cpp:80] No whitelist given. Advertising
> offers for all slaves
> I0901 13:48:12.474067 14278 detector.cpp:420] Master detector (slave(131)@
> 140.211.11.27:42454) found 1 registered masters
> I0901 13:48:12.471848 14273 sched.cpp:202] No master detected, waiting for
> another master
> I0901 13:48:12.478742 14273 sched.cpp:214] Scheduler::disconnected took
> 15.324us
> I0901 13:48:12.473634 14267 detector.cpp:420] Master detector
> (scheduler(113)@140.211.11.27:42454) found 1 registered masters
> I0901 13:48:12.467483 14259 slave.cpp:578] Lost master(s) ... waiting
> I0901 13:48:12.478446 14278 detector.cpp:467] Master detector (slave(131)@
> 140.211.11.27:42454) got new master pid: master@140.211.11.27:42454
> I0901 13:48:12.472808 14261 detector.cpp:281] Created ephemeral/sequence
> znode at '/znode/0000000002'
> I0901 13:48:12.481369 14267 detector.cpp:467] Master detector
> (scheduler(113)@140.211.11.27:42454) got new master pid:
> master@140.211.11.27:42454
> I0901 13:48:12.482713 14278 slave.cpp:544] New master detected at
> master@140.211.11.27:42454
> I0901 13:48:12.484776 14261 detector.cpp:420] Master detector (
> master@140.211.11.27:42454) found 1 registered masters
> I0901 13:48:12.485153 14270 sched.cpp:178] New master at
> master@140.211.11.27:42454
> I0901 13:48:12.485795 14267 status_update_manager.cpp:157] New master
> detected at master@140.211.11.27:42454
> W0901 13:48:12.487934 14271 master.cpp:714] Ignoring re-register framework
> message since not elected yet
> I0901 13:48:12.487932 14261 detector.cpp:467] Master detector (
> master@140.211.11.27:42454) got new master pid:
> master@140.211.11.27:42454
> I0901 13:48:12.491312 14261 master.cpp:642] Elected as master!
> I0901 13:48:13.398939 14260 master.cpp:734] Re-registering framework
> 201309011348-453759884-42454-14237-0000 at scheduler(113)@
> 140.211.11.27:42454
> I0901 13:48:13.400677 14270 sched.cpp:237] Framework registered with
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.401135 14261 hierarchical_allocator_process.hpp:321] Added
> framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.403525 14261 hierarchical_allocator_process.hpp:687] No
> resources available to allocate!
> I0901 13:48:13.404464 14261 hierarchical_allocator_process.hpp:649]
> Performed allocation for 0 slaves in 939.955us
> I0901 13:48:13.402282 14270 sched.cpp:251] Scheduler::registered took
> 14.111us
> I0901 13:48:13.471325 14278 hierarchical_allocator_process.hpp:687] No
> resources available to allocate!
> I0901 13:48:13.472589 14278 hierarchical_allocator_process.hpp:649]
> Performed allocation for 0 slaves in 1.269516ms
> I0901 13:48:13.486690 14263 master.cpp:1159] Attempting to re-register
> slave 201309011348-453759884-42454-14237-0 at slave(131)@
> 140.211.11.27:42454 (hemera.apache.org)
> I0901 13:48:13.487660 14263 master.cpp:2078] Adding slave
> 201309011348-453759884-42454-14237-0 at hemera.apache.org with cpus(*):2;
> mem(*):1024; disk(*):127026; ports(*):[31000-32000]
> I0901 13:48:13.488994 14263 master.hpp:316] Adding task 0 with resources
> cpus(*):1; mem(*):500 on slave 201309011348-453759884-42454-14237-0 (
> hemera.apache.org)
> I0901 13:48:13.489035 14267 slave.cpp:645] Re-registered with master
> master@140.211.11.27:42454
> I0901 13:48:13.490772 14276 hierarchical_allocator_process.hpp:434] Added
> slave 201309011348-453759884-42454-14237-0 (hemera.apache.org) with
> cpus(*):2; mem(*):1024; disk(*):127026; ports(*):[31000-32000] (and
> cpus(*):1; mem(*):524; disk(*):127026; ports(*):[31000-32000] available)
> I0901 13:48:13.491698 14267 slave.cpp:1327] Updating framework
> 201309011348-453759884-42454-14237-0000 pid to scheduler(113)@
> 140.211.11.27:42454
> I0901 13:48:13.493104 14276 hierarchical_allocator_process.hpp:712]
> Offering cpus(*):1; mem(*):524; disk(*):127026; ports(*):[31000-32000] on
> slave 201309011348-453759884-42454-14237-0 to framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.495089 14276 hierarchical_allocator_process.hpp:669]
> Performed allocation for slave 201309011348-453759884-42454-14237-0 in
> 2.015672ms
> I0901 13:48:13.495221 14260 master.hpp:339] Adding offer
> 201309011348-453759884-42454-14237-0 with resources cpus(*):1; mem(*):524;
> disk(*):127026; ports(*):[31000-32000] on slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org)
> I0901 13:48:13.497177 14260 master.cpp:1439] Sending 1 offers to framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.498236 14260 sched.cpp:340] Scheduler::resourceOffers took
> 24.876us
> I0901 13:48:13.499927 14260 sched.cpp:498] Stopping framework
> '201309011348-453759884-42454-14237-0000'
> I0901 13:48:13.499023 14237 master.cpp:478] Master terminating
> I0901 13:48:13.501727 14237 master.cpp:206] Shutting down master
> I0901 13:48:13.501747 14261 slave.cpp:1966] master@140.211.11.27:42454exited
> W0901 13:48:13.513283 14261 slave.cpp:1969] Master disconnected! Waiting
> for a new master to be elected
> I0901 13:48:13.502653 14237 master.hpp:329] Removing task 0 with resources
> cpus(*):1; mem(*):500 on slave 201309011348-453759884-42454-14237-0 (
> hemera.apache.org)
> I0901 13:48:13.516372 14237 master.hpp:349] Removing offer
> 201309011348-453759884-42454-14237-0 with resources cpus(*):1; mem(*):524;
> disk(*):127026; ports(*):[31000-32000] on slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org)
> I0901 13:48:13.516594 14266 hierarchical_allocator_process.hpp:598]
> Recovered cpus(*):1; mem(*):500 (total allocatable: cpus(*):1; mem(*):500)
> on slave 201309011348-453759884-42454-14237-0 from framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.517467 14237 master.cpp:234] Removing slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org)
> I0901 13:48:13.520035 14237 slave.cpp:454] Slave terminating
> I0901 13:48:13.520344 14237 slave.cpp:1162] Asked to shut down framework
> 201309011348-453759884-42454-14237-0000 by @0.0.0.0:0
> I0901 13:48:13.521235 14237 slave.cpp:1187] Shutting down framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.529317 14237 slave.cpp:2417] Shutting down executor
> 'default' of framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.522156 14270 detector.cpp:420] Master detector (slave(131)@
> 140.211.11.27:42454) found 0 registered masters
> I0901 13:48:13.530541 14276 exec.cpp:371] Executor asked to shutdown
>
> GMOCK WARNING:
> Uninteresting mock function call - returning directly.
> Function call: shutdown(0x2b504800a800)
> Stack trace:
> I0901 13:48:13.531070 14270 detector.cpp:441] Master detector (slave(131)@
> 140.211.11.27:42454) couldn't find any masters
> I0901 13:48:13.532029 14276 exec.cpp:386] Executor::shutdown took 87.169us
> [ OK ] AllocatorZooKeeperTest/0.FrameworkReregistersFirst (1184 ms)
> [ RUN ] AllocatorZooKeeperTest/0.SlaveReregistersFirst
> I0901 13:48:13.535174 14271 master.cpp:262] Master started on
> 140.211.11.27:42454
> 2013-09-01 13:48:13,536:14237(0x2b4fdcac0700):ZOO_INFO@log_env@687:
> Client environment:user.home=/home/jenkins
> 2013-09-01 13:48:13,537:14237(0x2b4fdcac0700):ZOO_INFO@log_env@699:
> Client
> environment:user.dir=/x1/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME/build/src
> 2013-09-01 13:48:13,537:14237(0x2b4fdcac0700):ZOO_INFO@zookeeper_init@727:
> Initiating client connection, host=127.0.0.1:54195 sessionTimeout=10000
> watcher=0x2b4fd95a75f0 sessionId=0 sessionPasswd=<null>
> context=0x2b5034008020 flags=0
> 2013-09-01 13:48:13,537:14237(0x2b4fdcac0700):ZOO_DEBUG@start_threads@152:
> starting threads...
> 2013-09-01 13:48:13,537:14237(0x2b526d118700):ZOO_DEBUG@do_completion@326:
> started completion thread
> 2013-09-01 13:48:13,537:14237(0x2b526cd16700):ZOO_DEBUG@do_io@279:
> started IO thread
> 2013-09-01 13:48:13,537:14237(0x2b526cd16700):ZOO_INFO@check_events@1585:
> initiated connection to server [127.0.0.1:54195]
> 2013-09-01 13:48:13,537:14237(0x2b4fdbcb9700):ZOO_INFO@log_env@658:
> Client environment:zookeeper.version=zookeeper C client 3.3.4
> 2013-09-01 13:48:13,537:14237(0x2b4fdbcb9700):ZOO_INFO@log_env@662:
> Client environment:host.name=hemera
> 2013-09-01 13:48:13,537:14237(0x2b4fdbcb9700):ZOO_INFO@log_env@669:
> Client environment:os.name=Linux
> 2013-09-01 13:48:13,537:14237(0x2b4fdbcb9700):ZOO_INFO@log_env@670:
> Client environment:os.arch=3.2.0-51-generic
> 2013-09-01 13:48:13,538:14237(0x2b4fdbcb9700):ZOO_INFO@log_env@671:
> Client environment:os.version=#77-Ubuntu SMP Wed Jul 24 20:18:19 UTC 2013
> I0901 13:48:13.536084 14271 master.cpp:277] Master ID:
> 201309011348-453759884-42454-14237
> I0901 13:48:13.536978 14266 slave.cpp:108] Slave started on 132)@
> 140.211.11.27:42454
> I0901 13:48:13.540307 14275 detector.cpp:234] Master detector (
> master@140.211.11.27:42454) connected to ZooKeeper ...
> I0901 13:48:13.541383 14261 detector.cpp:234] Master detector (slave(132)@
> 140.211.11.27:42454) connected to ZooKeeper ...
> I0901 13:48:13.542315 14265 detector.cpp:234] Master detector
> (scheduler(114)@140.211.11.27:42454) connected to ZooKeeper ...
> I0901 13:48:13.552961 14265 detector.cpp:251] Trying to create path
> '/znode' in ZooKeeper
> W0901 13:48:13.549511 14262 master.cpp:80] No whitelist given. Advertising
> offers for all slaves
> I0901 13:48:13.550516 14266 slave.cpp:208] Slave resources: cpus(*):2;
> mem(*):1024; disk(*):127026; ports(*):[31000-32000]
> I0901 13:48:13.551337 14275 detector.cpp:251] Trying to create path
> '/znode' in ZooKeeper
> I0901 13:48:13.557495 14267 slave.cpp:399] Finished recovery
> I0901 13:48:13.549383 14269 hierarchical_allocator_process.hpp:291]
> Initializing hierarchical allocator process with master :
> master@140.211.11.27:42454
> I0901 13:48:13.555846 14265 detector.cpp:420] Master detector
> (scheduler(114)@140.211.11.27:42454) found 0 registered masters
> I0901 13:48:13.560029 14265 detector.cpp:441] Master detector
> (scheduler(114)@140.211.11.27:42454) couldn't find any masters
> I0901 13:48:13.552140 14261 detector.cpp:251] Trying to create path
> '/znode' in ZooKeeper
> I0901 13:48:13.561058 14275 detector.cpp:281] Created ephemeral/sequence
> znode at '/znode/0000000004'
> I0901 13:48:13.561540 14268 sched.cpp:202] No master detected, waiting for
> another master
> I0901 13:48:13.562340 14265 detector.cpp:420] Master detector
> (scheduler(114)@140.211.11.27:42454) found 1 registered masters
> I0901 13:48:13.571676 14275 detector.cpp:420] Master detector (
> master@140.211.11.27:42454) found 1 registered masters
> I0901 13:48:13.572437 14261 detector.cpp:420] Master detector (slave(132)@
> 140.211.11.27:42454) found 1 registered masters
> I0901 13:48:13.574686 14275 detector.cpp:467] Master detector (
> master@140.211.11.27:42454) got new master pid:
> master@140.211.11.27:42454
> I0901 13:48:13.575845 14261 detector.cpp:467] Master detector (slave(132)@
> 140.211.11.27:42454) got new master pid: master@140.211.11.27:42454
> I0901 13:48:13.573832 14265 detector.cpp:467] Master detector
> (scheduler(114)@140.211.11.27:42454) got new master pid:
> master@140.211.11.27:42454
> I0901 13:48:13.576040 14271 master.cpp:642] Elected as master!
> I0901 13:48:13.576923 14261 slave.cpp:544] New master detected at
> master@140.211.11.27:42454
> I0901 13:48:13.577908 14265 sched.cpp:178] New master at
> master@140.211.11.27:42454
> I0901 13:48:13.580078 14261 status_update_manager.cpp:157] New master
> detected at master@140.211.11.27:42454
> I0901 13:48:13.580137 14272 master.cpp:1065] Attempting to register slave
> on hemera.apache.org at slave(132)@140.211.11.27:42454
> I0901 13:48:13.582753 14272 master.cpp:2078] Adding slave
> 201309011348-453759884-42454-14237-0 at hemera.apache.org with cpus(*):2;
> mem(*):1024; disk(*):127026; ports(*):[31000-32000]
> I0901 13:48:13.583590 14275 slave.cpp:604] Registered with master
> master@140.211.11.27:42454; given slave ID
> 201309011348-453759884-42454-14237-0
> I0901 13:48:13.583637 14272 master.cpp:692] Registering framework
> 201309011348-453759884-42454-14237-0000 at scheduler(114)@
> 140.211.11.27:42454
> I0901 13:48:13.583740 14267 hierarchical_allocator_process.hpp:434] Added
> slave 201309011348-453759884-42454-14237-0 (hemera.apache.org) with
> cpus(*):2; mem(*):1024; disk(*):127026; ports(*):[31000-32000] (and
> cpus(*):2; mem(*):1024; disk(*):127026; ports(*):[31000-32000] available)
> I0901 13:48:13.586906 14267 hierarchical_allocator_process.hpp:669]
> Performed allocation for slave 201309011348-453759884-42454-14237-0 in
> 7.212us
> I0901 13:48:13.585821 14272 sched.cpp:237] Framework registered with
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.588476 14272 sched.cpp:251] Scheduler::registered took
> 14.118us
> I0901 13:48:13.587802 14267 hierarchical_allocator_process.hpp:321] Added
> framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.590303 14267 hierarchical_allocator_process.hpp:712]
> Offering cpus(*):2; mem(*):1024; disk(*):127026; ports(*):[31000-32000] on
> slave 201309011348-453759884-42454-14237-0 to framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.591161 14267 hierarchical_allocator_process.hpp:649]
> Performed allocation for 1 slaves in 887.382us
> I0901 13:48:13.591251 14275 master.hpp:339] Adding offer
> 201309011348-453759884-42454-14237-0 with resources cpus(*):2; mem(*):1024;
> disk(*):127026; ports(*):[31000-32000] on slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org)
> I0901 13:48:13.593179 14275 master.cpp:1439] Sending 1 offers to framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.594245 14275 sched.cpp:340] Scheduler::resourceOffers took
> 173.024us
> I0901 13:48:13.595309 14260 master.cpp:1676] Processing reply for offer
> 201309011348-453759884-42454-14237-0 on slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org) for framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.596417 14260 master.hpp:316] Adding task 0 with resources
> cpus(*):1; mem(*):500 on slave 201309011348-453759884-42454-14237-0 (
> hemera.apache.org)
> I0901 13:48:13.597250 14260 master.cpp:1796] Launching task 0 of framework
> 201309011348-453759884-42454-14237-0000 with resources cpus(*):1;
> mem(*):500 on slave 201309011348-453759884-42454-14237-0 (
> hemera.apache.org)
> I0901 13:48:13.598248 14275 slave.cpp:767] Got assigned task 0 for
> framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.598276 14258 hierarchical_allocator_process.hpp:508]
> Framework 201309011348-453759884-42454-14237-0000 left cpus(*):1;
> mem(*):524; disk(*):127026; ports(*):[31000-32000] unused on slave
> 201309011348-453759884-42454-14237-0
> I0901 13:48:13.598302 14260 master.hpp:349] Removing offer
> 201309011348-453759884-42454-14237-0 with resources cpus(*):2; mem(*):1024;
> disk(*):127026; ports(*):[31000-32000] on slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org)
> I0901 13:48:13.599207 14275 slave.cpp:878] Launching task 0 for framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.600075 14258 hierarchical_allocator_process.hpp:551]
> Framework 201309011348-453759884-42454-14237-0000 filtered slave
> 201309011348-453759884-42454-14237-0 for 5secs
> I0901 13:48:13.604182 14275 paths.hpp:336] Created executor directory
> '/tmp/AllocatorZooKeeperTest_0_SlaveReregistersFirst_WWMWtl/slaves/201309011348-453759884-42454-14237-0/frameworks/201309011348-453759884-42454-14237-0000/executors/default/runs/93a0b8d4-5990-4a4c-b71c-09251a7d810a'
> I0901 13:48:13.605113 14275 slave.cpp:989] Queuing task '0' for executor
> default of framework '201309011348-453759884-42454-14237-0000
> I0901 13:48:13.605960 14275 slave.cpp:526] Successfully attached file
> '/tmp/AllocatorZooKeeperTest_0_SlaveReregistersFirst_WWMWtl/slaves/201309011348-453759884-42454-14237-0/frameworks/201309011348-453759884-42454-14237-0000/executors/default/runs/93a0b8d4-5990-4a4c-b71c-09251a7d810a'
> I0901 13:48:13.607786 14262 exec.cpp:174] Executor started at:
> executor(41)@140.211.11.27:42454 with pid 14237
> I0901 13:48:13.609359 14262 slave.cpp:1435] Got registration for executor
> 'default' of framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.610697 14262 slave.cpp:1556] Flushing queued task 0 for
> executor 'default' of framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.610751 14270 exec.cpp:198] Executor registered on slave
> 201309011348-453759884-42454-14237-0
> I0901 13:48:13.614671 14270 exec.cpp:210] Executor::registered took
> 15.764us
> I0901 13:48:13.615511 14270 exec.cpp:285] Executor asked to run task '0'
> I0901 13:48:13.616446 14270 exec.cpp:294] Executor::launchTask took
> 26.847us
> I0901 13:48:13.619410 14270 exec.cpp:501] Executor sending status update
> TASK_RUNNING (UUID: a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for task 0 of
> framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.620187 14270 slave.cpp:1766] Handling status update
> TASK_RUNNING (UUID: a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for task 0 of
> framework 201309011348-453759884-42454-14237-0000 from executor(41)@
> 140.211.11.27:42454
> I0901 13:48:13.621244 14270 status_update_manager.cpp:300] Received status
> update TASK_RUNNING (UUID: a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for task 0
> of framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.622117 14270 status_update_manager.cpp:471] Creating
> StatusUpdate stream for task 0 of framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.622891 14270 status_update_manager.cpp:351] Forwarding
> status update TASK_RUNNING (UUID: a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for
> task 0 of framework 201309011348-453759884-42454-14237-0000 to
> master@140.211.11.27:42454
> I0901 13:48:13.623790 14270 slave.cpp:1885] Status update manager
> successfully handled status update TASK_RUNNING (UUID:
> a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for task 0 of framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.623805 14260 master.cpp:1205] Status update TASK_RUNNING
> (UUID: a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for task 0 of framework
> 201309011348-453759884-42454-14237-0000 from slave(132)@
> 140.211.11.27:42454
> I0901 13:48:13.624639 14270 slave.cpp:1891] Sending acknowledgement for
> status update TASK_RUNNING (UUID: a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for
> task 0 of framework 201309011348-453759884-42454-14237-0000 to executor(41)@
> 140.211.11.27:42454
> I0901 13:48:13.625607 14260 sched.cpp:395] Scheduler::statusUpdate took
> 37.834us
> I0901 13:48:13.625895 14237 master.cpp:478] Master terminating
> I0901 13:48:13.626421 14279 exec.cpp:331] Executor received status update
> acknowledgement a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8 for task 0 of
> framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.627312 14273 status_update_manager.cpp:375] Received status
> update acknowledgement (UUID: a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for
> task 0 of framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.628062 14237 master.cpp:206] Shutting down master
> I0901 13:48:13.628278 14270 slave.cpp:1966] master@140.211.11.27:42454exited
> W0901 13:48:13.631556 14270 slave.cpp:1969] Master disconnected! Waiting
> for a new master to be elected
> I0901 13:48:13.633021 14270 slave.cpp:1381] Status update manager
> successfully handled status update acknowledgement (UUID:
> a9ceb5e9-b85b-4cd3-ad61-879afeaf19a8) for task 0 of framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.630784 14237 master.hpp:329] Removing task 0 with resources
> cpus(*):1; mem(*):500 on slave 201309011348-453759884-42454-14237-0 (
> hemera.apache.org)
> I0901 13:48:13.634773 14237 master.cpp:234] Removing slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org)
> I0901 13:48:13.634845 14272 hierarchical_allocator_process.hpp:598]
> Recovered cpus(*):1; mem(*):500 (total allocatable: cpus(*):2; mem(*):1024;
> disk(*):127026; ports(*):[31000-32000]) on slave
> 201309011348-453759884-42454-14237-0 from framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:13.639075 14271 master.cpp:262] Master started on
> 140.211.11.27:42454
> I0901 13:48:13.639225 14271 master.cpp:277] Master ID:
> 201309011348-453759884-42454-14237
> I0901 13:48:13.640260 14267 detector.cpp:420] Master detector (slave(132)@
> 140.211.11.27:42454) found 0 registered masters
> I0901 13:48:13.650336 14267 detector.cpp:441] Master detector (slave(132)@
> 140.211.11.27:42454) couldn't find any masters
> I0901 13:48:13.642727 14259 detector.cpp:234] Master detector (
> master@140.211.11.27:42454) connected to ZooKeeper ...
> I0901 13:48:13.652062 14259 detector.cpp:251] Trying to create path
> '/znode' in ZooKeeper
> I0901 13:48:13.649737 14261 hierarchical_allocator_process.hpp:291]
> Initializing hierarchical allocator process with master :
> master@140.211.11.27:42454
> I0901 13:48:13.640332 14260 detector.cpp:420] Master detector
> (scheduler(114)@140.211.11.27:42454) found 0 registered masters
> I0901 13:48:13.655550 14260 detector.cpp:441] Master detector
> (scheduler(114)@140.211.11.27:42454) couldn't find any masters
> W0901 13:48:13.649432 14275 master.cpp:80] No whitelist given. Advertising
> offers for all slaves
> I0901 13:48:13.651140 14267 slave.cpp:578] Lost master(s) ... waiting
> I0901 13:48:13.656458 14261 sched.cpp:202] No master detected, waiting for
> another master
> I0901 13:48:13.665989 14261 sched.cpp:214] Scheduler::disconnected took
> 14.189us
> I0901 13:48:13.658159 14260 detector.cpp:420] Master detector
> (scheduler(114)@140.211.11.27:42454) found 1 registered masters
> I0901 13:48:13.658639 14264 detector.cpp:420] Master detector (slave(132)@
> 140.211.11.27:42454) found 1 registered masters
> I0901 13:48:13.657196 14259 detector.cpp:281] Created ephemeral/sequence
> znode at '/znode/0000000006'
> I0901 13:48:13.669733 14264 detector.cpp:467] Master detector (slave(132)@
> 140.211.11.27:42454) got new master pid: master@140.211.11.27:42454
> I0901 13:48:13.668481 14260 detector.cpp:467] Master detector
> (scheduler(114)@140.211.11.27:42454) got new master pid:
> master@140.211.11.27:42454
> I0901 13:48:13.670785 14264 slave.cpp:544] New master detected at
> master@140.211.11.27:42454
> I0901 13:48:13.670862 14259 detector.cpp:420] Master detector (
> master@140.211.11.27:42454) found 1 registered masters
> I0901 13:48:13.671875 14260 sched.cpp:178] New master at
> master@140.211.11.27:42454
> I0901 13:48:13.673040 14270 status_update_manager.cpp:157] New master
> detected at master@140.211.11.27:42454
> W0901 13:48:13.673425 14276 master.cpp:1092] Ignoring re-register slave
> message from hemera.apache.org since not elected yet
> I0901 13:48:13.675158 14259 detector.cpp:467] Master detector (
> master@140.211.11.27:42454) got new master pid:
> master@140.211.11.27:42454
> I0901 13:48:13.678570 14259 master.cpp:642] Elected as master!
> I0901 13:48:14.581439 14274 master.cpp:1159] Attempting to re-register
> slave 201309011348-453759884-42454-14237-0 at slave(132)@
> 140.211.11.27:42454 (hemera.apache.org)
> I0901 13:48:14.582810 14274 master.cpp:2078] Adding slave
> 201309011348-453759884-42454-14237-0 at hemera.apache.org with cpus(*):2;
> mem(*):1024; disk(*):127026; ports(*):[31000-32000]
> I0901 13:48:14.584097 14274 master.hpp:316] Adding task 0 with resources
> cpus(*):1; mem(*):500 on slave 201309011348-453759884-42454-14237-0 (
> hemera.apache.org)
> W0901 13:48:14.585726 14274 master.cpp:2170] Possibly orphaned task 0 of
> framework 201309011348-453759884-42454-14237-0000 running on slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org)
> I0901 13:48:14.584163 14267 slave.cpp:645] Re-registered with master
> master@140.211.11.27:42454
> I0901 13:48:14.587880 14273 hierarchical_allocator_process.hpp:434] Added
> slave 201309011348-453759884-42454-14237-0 (hemera.apache.org) with
> cpus(*):2; mem(*):1024; disk(*):127026; ports(*):[31000-32000] (and
> cpus(*):1; mem(*):524; disk(*):127026; ports(*):[31000-32000] available)
> I0901 13:48:14.588932 14273 hierarchical_allocator_process.hpp:669]
> Performed allocation for slave 201309011348-453759884-42454-14237-0 in
> 7.832us
> I0901 13:48:14.654443 14265 hierarchical_allocator_process.hpp:649]
> Performed allocation for 1 slaves in 55.654us
> I0901 13:48:14.675817 14259 master.cpp:734] Re-registering framework
> 201309011348-453759884-42454-14237-0000 at scheduler(114)@
> 140.211.11.27:42454
> I0901 13:48:14.677146 14278 sched.cpp:237] Framework registered with
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:14.678576 14278 sched.cpp:251] Scheduler::registered took
> 13.324us
> I0901 13:48:14.678074 14266 hierarchical_allocator_process.hpp:321] Added
> framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:14.677261 14273 slave.cpp:1327] Updating framework
> 201309011348-453759884-42454-14237-0000 pid to scheduler(114)@
> 140.211.11.27:42454
> I0901 13:48:14.680332 14266 hierarchical_allocator_process.hpp:712]
> Offering cpus(*):1; mem(*):524; disk(*):127026; ports(*):[31000-32000] on
> slave 201309011348-453759884-42454-14237-0 to framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:14.682147 14266 hierarchical_allocator_process.hpp:649]
> Performed allocation for 1 slaves in 1.846988ms
> I0901 13:48:14.682236 14259 master.hpp:339] Adding offer
> 201309011348-453759884-42454-14237-0 with resources cpus(*):1; mem(*):524;
> disk(*):127026; ports(*):[31000-32000] on slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org)
> I0901 13:48:14.684241 14259 master.cpp:1439] Sending 1 offers to framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:14.685359 14259 sched.cpp:340] Scheduler::resourceOffers took
> 64.241us
> I0901 13:48:14.686481 14259 sched.cpp:498] Stopping framework
> '201309011348-453759884-42454-14237-0000'
> I0901 13:48:14.686502 14276 master.cpp:478] Master terminating
> I0901 13:48:14.688787 14276 slave.cpp:1966] master@140.211.11.27:42454exited
> I0901 13:48:14.688899 14237 master.cpp:206] Shutting down master
> W0901 13:48:14.689703 14276 slave.cpp:1969] Master disconnected! Waiting
> for a new master to be elected
> I0901 13:48:14.690634 14237 master.hpp:329] Removing task 0 with resources
> cpus(*):1; mem(*):500 on slave 201309011348-453759884-42454-14237-0 (
> hemera.apache.org)
> I0901 13:48:14.692858 14237 master.hpp:349] Removing offer
> 201309011348-453759884-42454-14237-0 with resources cpus(*):1; mem(*):524;
> disk(*):127026; ports(*):[31000-32000] on slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org)
> I0901 13:48:14.693017 14275 hierarchical_allocator_process.hpp:598]
> Recovered cpus(*):1; mem(*):500 (total allocatable: cpus(*):1; mem(*):500)
> on slave 201309011348-453759884-42454-14237-0 from framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:14.694078 14237 master.cpp:234] Removing slave
> 201309011348-453759884-42454-14237-0 (hemera.apache.org)
> I0901 13:48:14.697295 14237 slave.cpp:454] Slave terminating
> I0901 13:48:14.697499 14237 slave.cpp:1162] Asked to shut down framework
> 201309011348-453759884-42454-14237-0000 by @0.0.0.0:0
> I0901 13:48:14.698477 14237 slave.cpp:1187] Shutting down framework
> 201309011348-453759884-42454-14237-0000
> I0901 13:48:14.699030 14237 slave.cpp:2417] Shutting down executor
> 'default' of framework 201309011348-453759884-42454-14237-0000
> I0901 13:48:14.699874 14260 detector.cpp:420] Master detector (slave(132)@
> 140.211.11.27:42454) found 0 registered masters
> I0901 13:48:14.701004 14260 detector.cpp:441] Master detector (slave(132)@
> 140.211.11.27:42454) couldn't find any masters
> I0901 13:48:14.700330 14263 exec.cpp:371] Executor asked to shutdown
>
> GMOCK WARNING:
> Uninteresting mock function call - returning directly.
> Function call: shutdown(0x2b502c009cb0)
> Stack trace:
> I0901 13:48:14.703187 14263 exec.cpp:386] Executor::shutdown took 21.98us
> [ OK ] AllocatorZooKeeperTest/0.SlaveReregistersFirst (1170 ms)
> I0901 13:48:14.706209 14237 zookeeper_test_server.cpp:93] Shutdown
> ZooKeeperTestServer on port 54195
> [----------] 2 tests from AllocatorZooKeeperTest/0 (2354 ms total)
>
> [----------] Global test environment tear-down
> [==========] 220 tests from 39 test cases ran. (89659 ms total)
> [ PASSED ] 219 tests.
> [ FAILED ] 1 test, listed below:
> [ FAILED ] SlaveRecoveryTest/0.MultipleFrameworks, where TypeParam =
> mesos::internal::slave::ProcessIsolator
>
> 1 FAILED TEST
> make[3]: *** [check-local] Error 1
> make[3]: Leaving directory
> `/x1/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME/build/src'
> make[2]: *** [check-am] Error 2
> make[2]: Leaving directory
> `/x1/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME/build/src'
> make[1]: *** [check] Error 2
> make[1]: Leaving directory
> `/x1/jenkins/jenkins-slave/workspace/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME/build/src'
> make: *** [check-recursive] Error 1
> Build step 'Execute shell' marked build as failure
>