You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mesos.apache.org by Xiaoying Zheng <zh...@sari.ac.cn> on 2013/04/17 08:54:29 UTC
Does Mesos support running a job from a slave node?
hi, all,
We failed to run a job from a slave node on a Mesos cluster but we think
Mesos should support it. We set up a small Mesos cluster consisting of
only two nodes, one master and one slave. When we ran the C++ test
framework on the slave node, the framework kept getting connected and
disconnected. BTW, when we ran the C++ test framework on the master
node, everything went okay. We attached the logs. Any help is appreciated.
Regards,
Xiaoying
1. On the master node (192.168.1.130), we ran "bin/mesos-master.sh
--ip=192.168.1.130".
Log file created at: 2013/04/17 14:25:53
Running on machine: master
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0417 14:25:53.069144 3253 logging.cpp:72] Logging to logs
I0417 14:25:53.070135 3253 main.cpp:105] Build: 2013-01-22 20:32:32 by
hadoop
I0417 14:25:53.070175 3253 main.cpp:106] Starting Mesos master
I0417 14:25:53.070313 3268 master.cpp:268] Master started on
192.168.1.130:5050
I0417 14:25:53.070438 3268 master.cpp:283] Master ID:
201304171425-2113820480-5050-3253
I0417 14:25:53.071903 3268 master.cpp:483] Elected as master!
I0417 14:25:53.083060 3272 webui_utils.cpp:45] Loading webui script at
'/home/hadoop/mesos-0.9.0/src/webui/master/webui.py'
I0417 14:26:28.812635 3268 master.cpp:844] Attempting to register slave
201304171425-2113820480-5050-3253-0 at slave@192.168.1.132:53221
I0417 14:26:28.812717 3268 master.cpp:1097] Master now considering a
slave at hdfs2:53221 as active
I0417 14:26:28.812746 3268 master.cpp:1633] Adding slave
201304171425-2113820480-5050-3253-0 at hdfs2 with cpus=4; mem=968
I0417 14:26:28.813254 3268 simple_allocator.cpp:69] Added slave
201304171425-2113820480-5050-3253-0 with cpus=4; mem=968
I0417 14:26:49.963219 3270 master.cpp:526] Registering framework
201304171425-2113820480-5050-3253-0000 at 1@127.0.1.1:50381
I0417 14:26:49.963736 3270 simple_allocator.cpp:46] Added framework
201304171425-2113820480-5050-3253-0000
I0417 14:26:49.963889 3270 master.cpp:1188] Sending 1 offers to
framework 201304171425-2113820480-5050-3253-0000
I0417 14:26:49.964043 3270 master.cpp:430] Framework
201304171425-2113820480-5050-3253-0000 disconnected
I0417 14:26:50.968178 3269 master.cpp:1147] Framework failover timeout,
removing framework 201304171425-2113820480-5050-3253-0000
I0417 14:26:50.968356 3269 simple_allocator.cpp:59] Removed framework
201304171425-2113820480-5050-3253-0000
I0417 14:26:50.973130 3268 master.cpp:526] Registering framework
201304171425-2113820480-5050-3253-0001 at 1@127.0.1.1:50381
I0417 14:26:50.973316 3268 simple_allocator.cpp:46] Added framework
201304171425-2113820480-5050-3253-0001
I0417 14:26:50.973417 3268 master.cpp:1188] Sending 1 offers to
framework 201304171425-2113820480-5050-3253-0001
I0417 14:26:50.973528 3268 master.cpp:430] Framework
201304171425-2113820480-5050-3253-0001 disconnected
I0417 14:26:51.978101 3267 master.cpp:1147] Framework failover timeout,
removing framework 201304171425-2113820480-5050-3253-0001
I0417 14:26:51.978263 3267 simple_allocator.cpp:59] Removed framework
201304171425-2113820480-5050-3253-0001
I0417 14:26:51.983166 3269 master.cpp:526] Registering framework
201304171425-2113820480-5050-3253-0002 at 1@127.0.1.1:50381
I0417 14:26:51.983443 3269 simple_allocator.cpp:46] Added framework
201304171425-2113820480-5050-3253-0002
I0417 14:26:51.983575 3269 master.cpp:1188] Sending 1 offers to
framework 201304171425-2113820480-5050-3253-0002
I0417 14:26:51.983705 3269 master.cpp:430] Framework
201304171425-2113820480-5050-3253-0002 disconnected
I0417 14:26:52.988116 3268 master.cpp:1147] Framework failover timeout,
removing framework 201304171425-2113820480-5050-3253-0002
I0417 14:26:52.988281 3268 simple_allocator.cpp:59] Removed framework
201304171425-2113820480-5050-3253-0002
I0417 14:26:52.993340 3267 master.cpp:526] Registering framework
201304171425-2113820480-5050-3253-0003 at 1@127.0.1.1:50381
I0417 14:26:52.993530 3267 simple_allocator.cpp:46] Added framework
201304171425-2113820480-5050-3253-0003
I0417 14:26:52.993625 3267 master.cpp:1188] Sending 1 offers to
framework 201304171425-2113820480-5050-3253-0003
I0417 14:26:52.993737 3267 master.cpp:430] Framework
201304171425-2113820480-5050-3253-0003 disconnected
I0417 14:26:53.998100 3270 master.cpp:1147] Framework failover timeout,
removing framework 201304171425-2113820480-5050-3253-0003
I0417 14:26:53.998241 3270 simple_allocator.cpp:59] Removed framework
201304171425-2113820480-5050-3253-0003
I0417 14:26:54.006017 3269 master.cpp:526] Registering framework
201304171425-2113820480-5050-3253-0004 at 1@127.0.1.1:50381
I0417 14:26:54.006289 3269 simple_allocator.cpp:46] Added framework
201304171425-2113820480-5050-3253-0004
I0417 14:26:54.006477 3269 master.cpp:1188] Sending 1 offers to
framework 201304171425-2113820480-5050-3253-0004
I0417 14:26:54.006607 3269 master.cpp:430] Framework
201304171425-2113820480-5050-3253-0004 disconnected
I0417 14:26:55.010612 3268 master.cpp:1147] Framework failover timeout,
removing framework 201304171425-2113820480-5050-3253-0004
I0417 14:26:55.010838 3268 simple_allocator.cpp:59] Removed framework
201304171425-2113820480-5050-3253-0004
I0417 14:26:55.016173 3267 master.cpp:526] Registering framework
201304171425-2113820480-5050-3253-0005 at 1@127.0.1.1:50381
I0417 14:26:55.016374 3267 simple_allocator.cpp:46] Added framework
201304171425-2113820480-5050-3253-0005
I0417 14:26:55.016474 3267 master.cpp:1188] Sending 1 offers to
framework 201304171425-2113820480-5050-3253-0005
I0417 14:26:55.016592 3267 master.cpp:430] Framework
201304171425-2113820480-5050-3253-0005 disconnected
I0417 14:26:56.018100 3269 master.cpp:1147] Framework failover timeout,
removing framework 201304171425-2113820480-5050-3253-0005
I0417 14:26:56.018290 3269 simple_allocator.cpp:59] Removed framework
201304171425-2113820480-5050-3253-0005
I0417 14:26:56.026458 3268 master.cpp:526] Registering framework
201304171425-2113820480-5050-3253-0006 at 1@127.0.1.1:50381
I0417 14:26:56.026661 3268 simple_allocator.cpp:46] Added framework
201304171425-2113820480-5050-3253-0006
I0417 14:26:56.026759 3268 master.cpp:1188] Sending 1 offers to
framework 201304171425-2113820480-5050-3253-0006
I0417 14:26:56.026876 3268 master.cpp:430] Framework
201304171425-2113820480-5050-3253-0006 disconnected
I0417 14:26:57.028127 3267 master.cpp:1147] Framework failover timeout,
removing framework 201304171425-2113820480-5050-3253-0006
I0417 14:26:57.028327 3267 simple_allocator.cpp:59] Removed framework
201304171425-2113820480-5050-3253-0006
I0417 14:26:57.036485 3269 master.cpp:526] Registering framework
201304171425-2113820480-5050-3253-0007 at 1@127.0.1.1:50381
I0417 14:26:57.036756 3269 simple_allocator.cpp:46] Added framework
201304171425-2113820480-5050-3253-0007
I0417 14:26:57.036861 3269 master.cpp:1188] Sending 1 offers to
framework 201304171425-2113820480-5050-3253-0007
I0417 14:26:57.036993 3269 master.cpp:430] Framework
201304171425-2113820480-5050-3253-0007 disconnected
I0417 14:26:58.040633 3270 master.cpp:1147] Framework failover timeout,
removing framework 201304171425-2113820480-5050-3253-0007
I0417 14:26:58.040828 3270 simple_allocator.cpp:59] Removed framework
201304171425-2113820480-5050-3253-0007
I0417 14:26:58.046758 3267 master.cpp:526] Registering framework
201304171425-2113820480-5050-3253-0008 at 1@127.0.1.1:50381
I0417 14:26:58.047071 3267 simple_allocator.cpp:46] Added framework
201304171425-2113820480-5050-3253-0008
I0417 14:26:58.047216 3267 master.cpp:1188] Sending 1 offers to
framework 201304171425-2113820480-5050-3253-0008
I0417 14:26:58.047349 3267 master.cpp:430] Framework
201304171425-2113820480-5050-3253-0008 disconnected
I0417 14:26:59.048115 3270 master.cpp:1147] Framework failover timeout,
removing framework 201304171425-2113820480-5050-3253-0008
I0417 14:26:59.048280 3270 simple_allocator.cpp:59] Removed framework
201304171425-2113820480-5050-3253-0008
I0417 14:26:59.056917 3269 master.cpp:526] Registering framework
201304171425-2113820480-5050-3253-0009 at 1@127.0.1.1:50381
I0417 14:26:59.057204 3269 simple_allocator.cpp:46] Added framework
201304171425-2113820480-5050-3253-0009
I0417 14:26:59.057329 3269 master.cpp:1188] Sending 1 offers to
framework 201304171425-2113820480-5050-3253-0009
I0417 14:26:59.057471 3269 master.cpp:430] Framework
201304171425-2113820480-5050-3253-0009 disconnected
I0417 14:27:00.061285 3268 master.cpp:1147] Framework failover timeout,
removing framework 201304171425-2113820480-5050-3253-0009
I0417 14:27:00.061535 3268 simple_allocator.cpp:59] Removed framework
201304171425-2113820480-5050-3253-0009
I0417 14:27:00.067119 3270 master.cpp:526] Registering framework
201304171425-2113820480-5050-3253-0010 at 1@127.0.1.1:50381
I0417 14:27:00.067361 3270 simple_allocator.cpp:46] Added framework
201304171425-2113820480-5050-3253-0010
I0417 14:27:00.067471 3270 master.cpp:1188] Sending 1 offers to
framework 201304171425-2113820480-5050-3253-0010
I0417 14:27:00.067586 3270 master.cpp:430] Framework
201304171425-2113820480-5050-3253-0010 disconnected
I0417 14:27:01.070636 3269 master.cpp:1147] Framework failover timeout,
removing framework 201304171425-2113820480-5050-3253-0010
I0417 14:27:01.070832 3269 simple_allocator.cpp:59] Removed framework
201304171425-2113820480-5050-3253-0010
I0417 14:27:01.077214 3268 master.cpp:526] Registering framework
201304171425-2113820480-5050-3253-0011 at 1@127.0.1.1:50381
I0417 14:27:01.077497 3268 simple_allocator.cpp:46] Added framework
201304171425-2113820480-5050-3253-0011
I0417 14:27:01.077616 3268 master.cpp:1188] Sending 1 offers to
framework 201304171425-2113820480-5050-3253-0011
I0417 14:27:01.077760 3268 master.cpp:430] Framework
201304171425-2113820480-5050-3253-0011 disconnected
I0417 14:27:02.080665 3267 master.cpp:1147] Framework failover timeout,
removing framework 201304171425-2113820480-5050-3253-0011
I0417 14:27:02.080870 3267 simple_allocator.cpp:59] Removed framework
201304171425-2113820480-5050-3253-0011
I0417 14:27:02.087455 3270 master.cpp:526] Registering framework
201304171425-2113820480-5050-3253-0012 at 1@127.0.1.1:50381
I0417 14:27:02.087746 3270 simple_allocator.cpp:46] Added framework
201304171425-2113820480-5050-3253-0012
I0417 14:27:02.087867 3270 master.cpp:1188] Sending 1 offers to
framework 201304171425-2113820480-5050-3253-0012
I0417 14:27:02.088044 3270 master.cpp:430] Framework
201304171425-2113820480-5050-3253-0012 disconnected
I0417 14:27:03.097745 3268 master.cpp:1147] Framework failover timeout,
removing framework 201304171425-2113820480-5050-3253-0012
I0417 14:27:03.097934 3268 simple_allocator.cpp:59] Removed framework
201304171425-2113820480-5050-3253-0012
I0417 14:27:03.098002 3268 master.cpp:526] Registering framework
201304171425-2113820480-5050-3253-0013 at 1@127.0.1.1:50381
I0417 14:27:03.098170 3268 simple_allocator.cpp:46] Added framework
201304171425-2113820480-5050-3253-0013
I0417 14:27:03.098273 3268 master.cpp:1188] Sending 1 offers to
framework 201304171425-2113820480-5050-3253-0013
I0417 14:27:03.098388 3268 master.cpp:430] Framework
201304171425-2113820480-5050-3253-0013 disconnected
I0417 14:27:04.107770 3270 master.cpp:1147] Framework failover timeout,
removing framework 201304171425-2113820480-5050-3253-0013
I0417 14:27:04.107971 3270 simple_allocator.cpp:59] Removed framework
201304171425-2113820480-5050-3253-0013
I0417 14:27:04.108072 3270 master.cpp:526] Registering framework
201304171425-2113820480-5050-3253-0014 at 1@127.0.1.1:50381
I0417 14:27:04.108361 3270 simple_allocator.cpp:46] Added framework
201304171425-2113820480-5050-3253-0014
I0417 14:27:04.108464 3270 master.cpp:1188] Sending 1 offers to
framework 201304171425-2113820480-5050-3253-0014
I0417 14:27:04.108542 3270 master.cpp:430] Framework
201304171425-2113820480-5050-3253-0014 disconnected
I0417 14:27:05.118046 3267 master.cpp:1147] Framework failover timeout,
removing framework 201304171425-2113820480-5050-3253-0014
I0417 14:27:05.118283 3267 simple_allocator.cpp:59] Removed framework
201304171425-2113820480-5050-3253-0014
I0417 14:27:05.118834 3267 master.cpp:526] Registering framework
201304171425-2113820480-5050-3253-0015 at 1@127.0.1.1:50381
I0417 14:27:05.119031 3267 simple_allocator.cpp:46] Added framework
201304171425-2113820480-5050-3253-0015
I0417 14:27:05.119133 3267 master.cpp:1188] Sending 1 offers to
framework 201304171425-2113820480-5050-3253-0015
I0417 14:27:05.119261 3267 master.cpp:430] Framework
201304171425-2113820480-5050-3253-0015 disconnected
I0417 14:27:06.128176 3270 master.cpp:1147] Framework failover timeout,
removing framework 201304171425-2113820480-5050-3253-0015
I0417 14:27:06.128389 3270 simple_allocator.cpp:59] Removed framework
201304171425-2113820480-5050-3253-0015
I0417 14:27:06.128525 3270 master.cpp:526] Registering framework
201304171425-2113820480-5050-3253-0016 at 1@127.0.1.1:50381
I0417 14:27:06.128854 3270 simple_allocator.cpp:46] Added framework
201304171425-2113820480-5050-3253-0016
I0417 14:27:06.129014 3270 master.cpp:1188] Sending 1 offers to
framework 201304171425-2113820480-5050-3253-0016
I0417 14:27:06.129128 3270 master.cpp:430] Framework
201304171425-2113820480-5050-3253-0016 disconnected
I0417 14:27:07.138417 3268 master.cpp:1147] Framework failover timeout,
removing framework 201304171425-2113820480-5050-3253-0016
I0417 14:27:07.138607 3268 simple_allocator.cpp:59] Removed framework
201304171425-2113820480-5050-3253-0016
I0417 14:27:07.138677 3268 master.cpp:526] Registering framework
201304171425-2113820480-5050-3253-0017 at 1@127.0.1.1:50381
I0417 14:27:07.138838 3268 simple_allocator.cpp:46] Added framework
201304171425-2113820480-5050-3253-0017
I0417 14:27:07.138934 3268 master.cpp:1188] Sending 1 offers to
framework 201304171425-2113820480-5050-3253-0017
I0417 14:27:07.139050 3268 master.cpp:430] Framework
201304171425-2113820480-5050-3253-0017 disconnected
I0417 14:27:08.148147 3267 master.cpp:1147] Framework failover timeout,
removing framework 201304171425-2113820480-5050-3253-0017
I0417 14:27:08.148331 3267 simple_allocator.cpp:59] Removed framework
201304171425-2113820480-5050-3253-0017
2. On the slave node (192.168.1.132), we ran "bin/mesos-master.sh
--ip=192.168.1.132 --master=192.168.1.130:5050".
Log file created at: 2013/04/17 14:25:01
Running on machine: hdfs2
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0417 14:25:01.151159 2430 logging.cpp:72] Logging to logs
I0417 14:25:01.152088 2430 main.cpp:111] Creating "process" isolation
module
I0417 14:25:01.152246 2430 main.cpp:119] Build: 2013-01-22 20:32:32 by
hadoop
I0417 14:25:01.152283 2430 main.cpp:120] Starting Mesos slave
I0417 14:25:01.152614 2444 slave.cpp:191] Slave started on
192.168.1.132:53221
I0417 14:25:01.152660 2444 slave.cpp:192] Slave resources: cpus=4; mem=968
I0417 14:25:01.154165 2444 slave.cpp:357] New master detected at
master@192.168.1.130:5050
I0417 14:25:01.156548 2445 slave.cpp:377] Registered with master; given
slave ID 201304171425-2113820480-5050-3253-0
I0417 14:25:01.165132 2449 webui_utils.cpp:45] Loading webui script at
'/home/hadoop/mesos-0.9.0/src/webui/slave/webui.py'
I0417 14:25:23.307472 2446 slave.cpp:604] Asked to shut down framework
201304171425-2113820480-5050-3253-0000
I0417 14:25:24.317137 2447 slave.cpp:604] Asked to shut down framework
201304171425-2113820480-5050-3253-0001
I0417 14:25:25.326979 2446 slave.cpp:604] Asked to shut down framework
201304171425-2113820480-5050-3253-0002
I0417 14:25:26.336750 2444 slave.cpp:604] Asked to shut down framework
201304171425-2113820480-5050-3253-0003
I0417 14:25:27.349195 2445 slave.cpp:604] Asked to shut down framework
201304171425-2113820480-5050-3253-0004
I0417 14:25:28.356397 2446 slave.cpp:604] Asked to shut down framework
201304171425-2113820480-5050-3253-0005
I0417 14:25:29.366291 2447 slave.cpp:604] Asked to shut down framework
201304171425-2113820480-5050-3253-0006
I0417 14:25:30.378608 2446 slave.cpp:604] Asked to shut down framework
201304171425-2113820480-5050-3253-0007
I0417 14:25:31.385884 2445 slave.cpp:604] Asked to shut down framework
201304171425-2113820480-5050-3253-0008
I0417 14:25:32.398939 2446 slave.cpp:604] Asked to shut down framework
201304171425-2113820480-5050-3253-0009
I0417 14:25:33.408038 2447 slave.cpp:604] Asked to shut down framework
201304171425-2113820480-5050-3253-0010
I0417 14:25:34.417917 2445 slave.cpp:604] Asked to shut down framework
201304171425-2113820480-5050-3253-0011
I0417 14:25:35.434813 2444 slave.cpp:604] Asked to shut down framework
201304171425-2113820480-5050-3253-0012
I0417 14:25:36.444607 2446 slave.cpp:604] Asked to shut down framework
201304171425-2113820480-5050-3253-0013
I0417 14:25:37.454766 2445 slave.cpp:604] Asked to shut down framework
201304171425-2113820480-5050-3253-0014
I0417 14:25:38.464651 2446 slave.cpp:604] Asked to shut down framework
201304171425-2113820480-5050-3253-0015
I0417 14:25:39.474720 2445 slave.cpp:604] Asked to shut down framework
201304171425-2113820480-5050-3253-0016
I0417 14:25:40.484283 2444 slave.cpp:604] Asked to shut down framework
201304171425-2113820480-5050-3253-0017
I0417 14:25:46.626567 2446 slave.cpp:1104] Process exited: @0.0.0.0:0
W0417 14:25:46.626637 2446 slave.cpp:1107] WARNING! Master
disconnected! Waiting for a new master to be elected.
3. On the slave node (192.168.1.132), we started the C++ test frame work
by "src/test-framework 192.168.1.130:5050"
Re: Does Mesos support running a job from a slave node?
Posted by Vinod Kone <vi...@gmail.com>.
Hmm. That does seem strange. If the slave was able to connect to the
master, the framework should've been able to connect too.
I see that you specified --ip for slave. What happens if you don't specify
it?
On Tue, Apr 16, 2013 at 11:54 PM, Xiaoying Zheng <zh...@sari.ac.cn> wrote:
> hi, all,
>
> We failed to run a job from a slave node on a Mesos cluster but we think
> Mesos should support it. We set up a small Mesos cluster consisting of only
> two nodes, one master and one slave. When we ran the C++ test framework on
> the slave node, the framework kept getting connected and disconnected. BTW,
> when we ran the C++ test framework on the master node, everything went
> okay. We attached the logs. Any help is appreciated.
>
> Regards,
> Xiaoying
>
> 1. On the master node (192.168.1.130), we ran "bin/mesos-master.sh
> --ip=192.168.1.130".
>
> Log file created at: 2013/04/17 14:25:53
> Running on machine: master
> Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
> I0417 14:25:53.069144 3253 logging.cpp:72] Logging to logs
> I0417 14:25:53.070135 3253 main.cpp:105] Build: 2013-01-22 20:32:32 by
> hadoop
> I0417 14:25:53.070175 3253 main.cpp:106] Starting Mesos master
> I0417 14:25:53.070313 3268 master.cpp:268] Master started on
> 192.168.1.130:5050
> I0417 14:25:53.070438 3268 master.cpp:283] Master ID:
> 201304171425-2113820480-5050-**3253
> I0417 14:25:53.071903 3268 master.cpp:483] Elected as master!
> I0417 14:25:53.083060 3272 webui_utils.cpp:45] Loading webui script at
> '/home/hadoop/mesos-0.9.0/src/**webui/master/webui.py'
> I0417 14:26:28.812635 3268 master.cpp:844] Attempting to register slave
> 201304171425-2113820480-5050-**3253-0 at slave@192.168.1.132:53221
> I0417 14:26:28.812717 3268 master.cpp:1097] Master now considering a
> slave at hdfs2:53221 as active
> I0417 14:26:28.812746 3268 master.cpp:1633] Adding slave
> 201304171425-2113820480-5050-**3253-0 at hdfs2 with cpus=4; mem=968
> I0417 14:26:28.813254 3268 simple_allocator.cpp:69] Added slave
> 201304171425-2113820480-5050-**3253-0 with cpus=4; mem=968
> I0417 14:26:49.963219 3270 master.cpp:526] Registering framework
> 201304171425-2113820480-5050-**3253-0000 at 1@127.0.1.1:50381
> I0417 14:26:49.963736 3270 simple_allocator.cpp:46] Added framework
> 201304171425-2113820480-5050-**3253-0000
> I0417 14:26:49.963889 3270 master.cpp:1188] Sending 1 offers to framework
> 201304171425-2113820480-5050-**3253-0000
> I0417 14:26:49.964043 3270 master.cpp:430] Framework
> 201304171425-2113820480-5050-**3253-0000 disconnected
> I0417 14:26:50.968178 3269 master.cpp:1147] Framework failover timeout,
> removing framework 201304171425-2113820480-5050-**3253-0000
> I0417 14:26:50.968356 3269 simple_allocator.cpp:59] Removed framework
> 201304171425-2113820480-5050-**3253-0000
> I0417 14:26:50.973130 3268 master.cpp:526] Registering framework
> 201304171425-2113820480-5050-**3253-0001 at 1@127.0.1.1:50381
> I0417 14:26:50.973316 3268 simple_allocator.cpp:46] Added framework
> 201304171425-2113820480-5050-**3253-0001
> I0417 14:26:50.973417 3268 master.cpp:1188] Sending 1 offers to framework
> 201304171425-2113820480-5050-**3253-0001
> I0417 14:26:50.973528 3268 master.cpp:430] Framework
> 201304171425-2113820480-5050-**3253-0001 disconnected
> I0417 14:26:51.978101 3267 master.cpp:1147] Framework failover timeout,
> removing framework 201304171425-2113820480-5050-**3253-0001
> I0417 14:26:51.978263 3267 simple_allocator.cpp:59] Removed framework
> 201304171425-2113820480-5050-**3253-0001
> I0417 14:26:51.983166 3269 master.cpp:526] Registering framework
> 201304171425-2113820480-5050-**3253-0002 at 1@127.0.1.1:50381
> I0417 14:26:51.983443 3269 simple_allocator.cpp:46] Added framework
> 201304171425-2113820480-5050-**3253-0002
> I0417 14:26:51.983575 3269 master.cpp:1188] Sending 1 offers to framework
> 201304171425-2113820480-5050-**3253-0002
> I0417 14:26:51.983705 3269 master.cpp:430] Framework
> 201304171425-2113820480-5050-**3253-0002 disconnected
> I0417 14:26:52.988116 3268 master.cpp:1147] Framework failover timeout,
> removing framework 201304171425-2113820480-5050-**3253-0002
> I0417 14:26:52.988281 3268 simple_allocator.cpp:59] Removed framework
> 201304171425-2113820480-5050-**3253-0002
> I0417 14:26:52.993340 3267 master.cpp:526] Registering framework
> 201304171425-2113820480-5050-**3253-0003 at 1@127.0.1.1:50381
> I0417 14:26:52.993530 3267 simple_allocator.cpp:46] Added framework
> 201304171425-2113820480-5050-**3253-0003
> I0417 14:26:52.993625 3267 master.cpp:1188] Sending 1 offers to framework
> 201304171425-2113820480-5050-**3253-0003
> I0417 14:26:52.993737 3267 master.cpp:430] Framework
> 201304171425-2113820480-5050-**3253-0003 disconnected
> I0417 14:26:53.998100 3270 master.cpp:1147] Framework failover timeout,
> removing framework 201304171425-2113820480-5050-**3253-0003
> I0417 14:26:53.998241 3270 simple_allocator.cpp:59] Removed framework
> 201304171425-2113820480-5050-**3253-0003
> I0417 14:26:54.006017 3269 master.cpp:526] Registering framework
> 201304171425-2113820480-5050-**3253-0004 at 1@127.0.1.1:50381
> I0417 14:26:54.006289 3269 simple_allocator.cpp:46] Added framework
> 201304171425-2113820480-5050-**3253-0004
> I0417 14:26:54.006477 3269 master.cpp:1188] Sending 1 offers to framework
> 201304171425-2113820480-5050-**3253-0004
> I0417 14:26:54.006607 3269 master.cpp:430] Framework
> 201304171425-2113820480-5050-**3253-0004 disconnected
> I0417 14:26:55.010612 3268 master.cpp:1147] Framework failover timeout,
> removing framework 201304171425-2113820480-5050-**3253-0004
> I0417 14:26:55.010838 3268 simple_allocator.cpp:59] Removed framework
> 201304171425-2113820480-5050-**3253-0004
> I0417 14:26:55.016173 3267 master.cpp:526] Registering framework
> 201304171425-2113820480-5050-**3253-0005 at 1@127.0.1.1:50381
> I0417 14:26:55.016374 3267 simple_allocator.cpp:46] Added framework
> 201304171425-2113820480-5050-**3253-0005
> I0417 14:26:55.016474 3267 master.cpp:1188] Sending 1 offers to framework
> 201304171425-2113820480-5050-**3253-0005
> I0417 14:26:55.016592 3267 master.cpp:430] Framework
> 201304171425-2113820480-5050-**3253-0005 disconnected
> I0417 14:26:56.018100 3269 master.cpp:1147] Framework failover timeout,
> removing framework 201304171425-2113820480-5050-**3253-0005
> I0417 14:26:56.018290 3269 simple_allocator.cpp:59] Removed framework
> 201304171425-2113820480-5050-**3253-0005
> I0417 14:26:56.026458 3268 master.cpp:526] Registering framework
> 201304171425-2113820480-5050-**3253-0006 at 1@127.0.1.1:50381
> I0417 14:26:56.026661 3268 simple_allocator.cpp:46] Added framework
> 201304171425-2113820480-5050-**3253-0006
> I0417 14:26:56.026759 3268 master.cpp:1188] Sending 1 offers to framework
> 201304171425-2113820480-5050-**3253-0006
> I0417 14:26:56.026876 3268 master.cpp:430] Framework
> 201304171425-2113820480-5050-**3253-0006 disconnected
> I0417 14:26:57.028127 3267 master.cpp:1147] Framework failover timeout,
> removing framework 201304171425-2113820480-5050-**3253-0006
> I0417 14:26:57.028327 3267 simple_allocator.cpp:59] Removed framework
> 201304171425-2113820480-5050-**3253-0006
> I0417 14:26:57.036485 3269 master.cpp:526] Registering framework
> 201304171425-2113820480-5050-**3253-0007 at 1@127.0.1.1:50381
> I0417 14:26:57.036756 3269 simple_allocator.cpp:46] Added framework
> 201304171425-2113820480-5050-**3253-0007
> I0417 14:26:57.036861 3269 master.cpp:1188] Sending 1 offers to framework
> 201304171425-2113820480-5050-**3253-0007
> I0417 14:26:57.036993 3269 master.cpp:430] Framework
> 201304171425-2113820480-5050-**3253-0007 disconnected
> I0417 14:26:58.040633 3270 master.cpp:1147] Framework failover timeout,
> removing framework 201304171425-2113820480-5050-**3253-0007
> I0417 14:26:58.040828 3270 simple_allocator.cpp:59] Removed framework
> 201304171425-2113820480-5050-**3253-0007
> I0417 14:26:58.046758 3267 master.cpp:526] Registering framework
> 201304171425-2113820480-5050-**3253-0008 at 1@127.0.1.1:50381
> I0417 14:26:58.047071 3267 simple_allocator.cpp:46] Added framework
> 201304171425-2113820480-5050-**3253-0008
> I0417 14:26:58.047216 3267 master.cpp:1188] Sending 1 offers to framework
> 201304171425-2113820480-5050-**3253-0008
> I0417 14:26:58.047349 3267 master.cpp:430] Framework
> 201304171425-2113820480-5050-**3253-0008 disconnected
> I0417 14:26:59.048115 3270 master.cpp:1147] Framework failover timeout,
> removing framework 201304171425-2113820480-5050-**3253-0008
> I0417 14:26:59.048280 3270 simple_allocator.cpp:59] Removed framework
> 201304171425-2113820480-5050-**3253-0008
> I0417 14:26:59.056917 3269 master.cpp:526] Registering framework
> 201304171425-2113820480-5050-**3253-0009 at 1@127.0.1.1:50381
> I0417 14:26:59.057204 3269 simple_allocator.cpp:46] Added framework
> 201304171425-2113820480-5050-**3253-0009
> I0417 14:26:59.057329 3269 master.cpp:1188] Sending 1 offers to framework
> 201304171425-2113820480-5050-**3253-0009
> I0417 14:26:59.057471 3269 master.cpp:430] Framework
> 201304171425-2113820480-5050-**3253-0009 disconnected
> I0417 14:27:00.061285 3268 master.cpp:1147] Framework failover timeout,
> removing framework 201304171425-2113820480-5050-**3253-0009
> I0417 14:27:00.061535 3268 simple_allocator.cpp:59] Removed framework
> 201304171425-2113820480-5050-**3253-0009
> I0417 14:27:00.067119 3270 master.cpp:526] Registering framework
> 201304171425-2113820480-5050-**3253-0010 at 1@127.0.1.1:50381
> I0417 14:27:00.067361 3270 simple_allocator.cpp:46] Added framework
> 201304171425-2113820480-5050-**3253-0010
> I0417 14:27:00.067471 3270 master.cpp:1188] Sending 1 offers to framework
> 201304171425-2113820480-5050-**3253-0010
> I0417 14:27:00.067586 3270 master.cpp:430] Framework
> 201304171425-2113820480-5050-**3253-0010 disconnected
> I0417 14:27:01.070636 3269 master.cpp:1147] Framework failover timeout,
> removing framework 201304171425-2113820480-5050-**3253-0010
> I0417 14:27:01.070832 3269 simple_allocator.cpp:59] Removed framework
> 201304171425-2113820480-5050-**3253-0010
> I0417 14:27:01.077214 3268 master.cpp:526] Registering framework
> 201304171425-2113820480-5050-**3253-0011 at 1@127.0.1.1:50381
> I0417 14:27:01.077497 3268 simple_allocator.cpp:46] Added framework
> 201304171425-2113820480-5050-**3253-0011
> I0417 14:27:01.077616 3268 master.cpp:1188] Sending 1 offers to framework
> 201304171425-2113820480-5050-**3253-0011
> I0417 14:27:01.077760 3268 master.cpp:430] Framework
> 201304171425-2113820480-5050-**3253-0011 disconnected
> I0417 14:27:02.080665 3267 master.cpp:1147] Framework failover timeout,
> removing framework 201304171425-2113820480-5050-**3253-0011
> I0417 14:27:02.080870 3267 simple_allocator.cpp:59] Removed framework
> 201304171425-2113820480-5050-**3253-0011
> I0417 14:27:02.087455 3270 master.cpp:526] Registering framework
> 201304171425-2113820480-5050-**3253-0012 at 1@127.0.1.1:50381
> I0417 14:27:02.087746 3270 simple_allocator.cpp:46] Added framework
> 201304171425-2113820480-5050-**3253-0012
> I0417 14:27:02.087867 3270 master.cpp:1188] Sending 1 offers to framework
> 201304171425-2113820480-5050-**3253-0012
> I0417 14:27:02.088044 3270 master.cpp:430] Framework
> 201304171425-2113820480-5050-**3253-0012 disconnected
> I0417 14:27:03.097745 3268 master.cpp:1147] Framework failover timeout,
> removing framework 201304171425-2113820480-5050-**3253-0012
> I0417 14:27:03.097934 3268 simple_allocator.cpp:59] Removed framework
> 201304171425-2113820480-5050-**3253-0012
> I0417 14:27:03.098002 3268 master.cpp:526] Registering framework
> 201304171425-2113820480-5050-**3253-0013 at 1@127.0.1.1:50381
> I0417 14:27:03.098170 3268 simple_allocator.cpp:46] Added framework
> 201304171425-2113820480-5050-**3253-0013
> I0417 14:27:03.098273 3268 master.cpp:1188] Sending 1 offers to framework
> 201304171425-2113820480-5050-**3253-0013
> I0417 14:27:03.098388 3268 master.cpp:430] Framework
> 201304171425-2113820480-5050-**3253-0013 disconnected
> I0417 14:27:04.107770 3270 master.cpp:1147] Framework failover timeout,
> removing framework 201304171425-2113820480-5050-**3253-0013
> I0417 14:27:04.107971 3270 simple_allocator.cpp:59] Removed framework
> 201304171425-2113820480-5050-**3253-0013
> I0417 14:27:04.108072 3270 master.cpp:526] Registering framework
> 201304171425-2113820480-5050-**3253-0014 at 1@127.0.1.1:50381
> I0417 14:27:04.108361 3270 simple_allocator.cpp:46] Added framework
> 201304171425-2113820480-5050-**3253-0014
> I0417 14:27:04.108464 3270 master.cpp:1188] Sending 1 offers to framework
> 201304171425-2113820480-5050-**3253-0014
> I0417 14:27:04.108542 3270 master.cpp:430] Framework
> 201304171425-2113820480-5050-**3253-0014 disconnected
> I0417 14:27:05.118046 3267 master.cpp:1147] Framework failover timeout,
> removing framework 201304171425-2113820480-5050-**3253-0014
> I0417 14:27:05.118283 3267 simple_allocator.cpp:59] Removed framework
> 201304171425-2113820480-5050-**3253-0014
> I0417 14:27:05.118834 3267 master.cpp:526] Registering framework
> 201304171425-2113820480-5050-**3253-0015 at 1@127.0.1.1:50381
> I0417 14:27:05.119031 3267 simple_allocator.cpp:46] Added framework
> 201304171425-2113820480-5050-**3253-0015
> I0417 14:27:05.119133 3267 master.cpp:1188] Sending 1 offers to framework
> 201304171425-2113820480-5050-**3253-0015
> I0417 14:27:05.119261 3267 master.cpp:430] Framework
> 201304171425-2113820480-5050-**3253-0015 disconnected
> I0417 14:27:06.128176 3270 master.cpp:1147] Framework failover timeout,
> removing framework 201304171425-2113820480-5050-**3253-0015
> I0417 14:27:06.128389 3270 simple_allocator.cpp:59] Removed framework
> 201304171425-2113820480-5050-**3253-0015
> I0417 14:27:06.128525 3270 master.cpp:526] Registering framework
> 201304171425-2113820480-5050-**3253-0016 at 1@127.0.1.1:50381
> I0417 14:27:06.128854 3270 simple_allocator.cpp:46] Added framework
> 201304171425-2113820480-5050-**3253-0016
> I0417 14:27:06.129014 3270 master.cpp:1188] Sending 1 offers to framework
> 201304171425-2113820480-5050-**3253-0016
> I0417 14:27:06.129128 3270 master.cpp:430] Framework
> 201304171425-2113820480-5050-**3253-0016 disconnected
> I0417 14:27:07.138417 3268 master.cpp:1147] Framework failover timeout,
> removing framework 201304171425-2113820480-5050-**3253-0016
> I0417 14:27:07.138607 3268 simple_allocator.cpp:59] Removed framework
> 201304171425-2113820480-5050-**3253-0016
> I0417 14:27:07.138677 3268 master.cpp:526] Registering framework
> 201304171425-2113820480-5050-**3253-0017 at 1@127.0.1.1:50381
> I0417 14:27:07.138838 3268 simple_allocator.cpp:46] Added framework
> 201304171425-2113820480-5050-**3253-0017
> I0417 14:27:07.138934 3268 master.cpp:1188] Sending 1 offers to framework
> 201304171425-2113820480-5050-**3253-0017
> I0417 14:27:07.139050 3268 master.cpp:430] Framework
> 201304171425-2113820480-5050-**3253-0017 disconnected
> I0417 14:27:08.148147 3267 master.cpp:1147] Framework failover timeout,
> removing framework 201304171425-2113820480-5050-**3253-0017
> I0417 14:27:08.148331 3267 simple_allocator.cpp:59] Removed framework
> 201304171425-2113820480-5050-**3253-0017
>
> 2. On the slave node (192.168.1.132), we ran "bin/mesos-master.sh
> --ip=192.168.1.132 --master=192.168.1.130:5050".
>
> Log file created at: 2013/04/17 14:25:01
> Running on machine: hdfs2
> Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
> I0417 14:25:01.151159 2430 logging.cpp:72] Logging to logs
> I0417 14:25:01.152088 2430 main.cpp:111] Creating "process" isolation
> module
> I0417 14:25:01.152246 2430 main.cpp:119] Build: 2013-01-22 20:32:32 by
> hadoop
> I0417 14:25:01.152283 2430 main.cpp:120] Starting Mesos slave
> I0417 14:25:01.152614 2444 slave.cpp:191] Slave started on
> 192.168.1.132:53221
> I0417 14:25:01.152660 2444 slave.cpp:192] Slave resources: cpus=4; mem=968
> I0417 14:25:01.154165 2444 slave.cpp:357] New master detected at
> master@192.168.1.130:5050
> I0417 14:25:01.156548 2445 slave.cpp:377] Registered with master; given
> slave ID 201304171425-2113820480-5050-**3253-0
> I0417 14:25:01.165132 2449 webui_utils.cpp:45] Loading webui script at
> '/home/hadoop/mesos-0.9.0/src/**webui/slave/webui.py'
> I0417 14:25:23.307472 2446 slave.cpp:604] Asked to shut down framework
> 201304171425-2113820480-5050-**3253-0000
> I0417 14:25:24.317137 2447 slave.cpp:604] Asked to shut down framework
> 201304171425-2113820480-5050-**3253-0001
> I0417 14:25:25.326979 2446 slave.cpp:604] Asked to shut down framework
> 201304171425-2113820480-5050-**3253-0002
> I0417 14:25:26.336750 2444 slave.cpp:604] Asked to shut down framework
> 201304171425-2113820480-5050-**3253-0003
> I0417 14:25:27.349195 2445 slave.cpp:604] Asked to shut down framework
> 201304171425-2113820480-5050-**3253-0004
> I0417 14:25:28.356397 2446 slave.cpp:604] Asked to shut down framework
> 201304171425-2113820480-5050-**3253-0005
> I0417 14:25:29.366291 2447 slave.cpp:604] Asked to shut down framework
> 201304171425-2113820480-5050-**3253-0006
> I0417 14:25:30.378608 2446 slave.cpp:604] Asked to shut down framework
> 201304171425-2113820480-5050-**3253-0007
> I0417 14:25:31.385884 2445 slave.cpp:604] Asked to shut down framework
> 201304171425-2113820480-5050-**3253-0008
> I0417 14:25:32.398939 2446 slave.cpp:604] Asked to shut down framework
> 201304171425-2113820480-5050-**3253-0009
> I0417 14:25:33.408038 2447 slave.cpp:604] Asked to shut down framework
> 201304171425-2113820480-5050-**3253-0010
> I0417 14:25:34.417917 2445 slave.cpp:604] Asked to shut down framework
> 201304171425-2113820480-5050-**3253-0011
> I0417 14:25:35.434813 2444 slave.cpp:604] Asked to shut down framework
> 201304171425-2113820480-5050-**3253-0012
> I0417 14:25:36.444607 2446 slave.cpp:604] Asked to shut down framework
> 201304171425-2113820480-5050-**3253-0013
> I0417 14:25:37.454766 2445 slave.cpp:604] Asked to shut down framework
> 201304171425-2113820480-5050-**3253-0014
> I0417 14:25:38.464651 2446 slave.cpp:604] Asked to shut down framework
> 201304171425-2113820480-5050-**3253-0015
> I0417 14:25:39.474720 2445 slave.cpp:604] Asked to shut down framework
> 201304171425-2113820480-5050-**3253-0016
> I0417 14:25:40.484283 2444 slave.cpp:604] Asked to shut down framework
> 201304171425-2113820480-5050-**3253-0017
> I0417 14:25:46.626567 2446 slave.cpp:1104] Process exited: @0.0.0.0:0
> W0417 14:25:46.626637 2446 slave.cpp:1107] WARNING! Master disconnected!
> Waiting for a new master to be elected.
>
> 3. On the slave node (192.168.1.132), we started the C++ test frame work
> by "src/test-framework 192.168.1.130:5050"
>
>
Re: Does Mesos support running a job from a slave node?
Posted by Xiaoying Zheng <zh...@sari.ac.cn>.
hi, Vinodkone,
When we had the line "127.0.1.1 hdfs2" in the file /etc/hosts, a Spark
standalone cluster worked correctly and the Spark streaming example
NetworkWordCount worked well on a standalone Spark cluster with one
master and two slaves. But the Mesos cluster didn't.
Xiaoying
于 2013/4/18 13:52, Vinod Kone 写道:
> I see. Looks like Mesos components cannot talk from a non-local ip address
> (e.g. 192.x.x.x) to local address (127.0.0.1), even though the reverse
> direction works. I'm not sure if its a networking issue or if its unique to
> how Mesos does communication between 2 endpoints.
>
> The fact that you either had to manually specify --ip or change /etc/hosts,
> tells me that by default Mesos picks host ip from /etc/hosts.
>
>
> @vinodkone
>
>
> On Wed, Apr 17, 2013 at 10:40 PM, Xiaoying Zheng <zh...@sari.ac.cn> wrote:
>
>> hi,
>>
>> We had a line "127.0.1.1 hdfs2" in /etc/hosts of the slave node, where
>> hdfs2 is the machine name of the slave. After removing the line, it is
>> alright now.
>>
>>
>>
>> 于 2013/4/18 13:24, Vinod Kone 写道:
>>
>> Hi Xiaoying,
>>> Could you tell us what you mean by fixing /etc/hosts?
>>>
>>> Thanks,
>>>
>>>
>>> On Wed, Apr 17, 2013 at 10:14 PM, Xiaoying Zheng <zh...@sari.ac.cn>
>>> wrote:
>>>
>>> hi, Ben,
>>>> We fixed errors in our /etc/hosts configuration. It works well now.
>>>> Thanks.
>>>>
>>>> Xiaoying
>>>>
>>>>
>>>>
>>
--
郑小盈 博士 副研究员
中国科学院上海高等研究院
高性能计算与数据中心
上海浦东新区张江高科技园区海科路99号 201210
邮箱: zhengxy@sari.ac.cn
电话: 0086-21-2032-5118
Xiaoying Zheng, Ph.D., Associate Professor
R&D Center for Cloud Computing
Shanghai Advanced Research Institute, Chinese Academy of Sciences
Email: zhengxy@sari.ac.cn
Tel.: 0086-21-2032-5118
Re: Does Mesos support running a job from a slave node?
Posted by Vinod Kone <vi...@twitter.com>.
I see. Looks like Mesos components cannot talk from a non-local ip address
(e.g. 192.x.x.x) to local address (127.0.0.1), even though the reverse
direction works. I'm not sure if its a networking issue or if its unique to
how Mesos does communication between 2 endpoints.
The fact that you either had to manually specify --ip or change /etc/hosts,
tells me that by default Mesos picks host ip from /etc/hosts.
@vinodkone
On Wed, Apr 17, 2013 at 10:40 PM, Xiaoying Zheng <zh...@sari.ac.cn> wrote:
> hi,
>
> We had a line "127.0.1.1 hdfs2" in /etc/hosts of the slave node, where
> hdfs2 is the machine name of the slave. After removing the line, it is
> alright now.
>
>
>
> 于 2013/4/18 13:24, Vinod Kone 写道:
>
> Hi Xiaoying,
>>
>> Could you tell us what you mean by fixing /etc/hosts?
>>
>> Thanks,
>>
>>
>> On Wed, Apr 17, 2013 at 10:14 PM, Xiaoying Zheng <zh...@sari.ac.cn>
>> wrote:
>>
>> hi, Ben,
>>>
>>> We fixed errors in our /etc/hosts configuration. It works well now.
>>> Thanks.
>>>
>>> Xiaoying
>>>
>>>
>>>
>
>
Re: Does Mesos support running a job from a slave node?
Posted by Xiaoying Zheng <zh...@sari.ac.cn>.
hi,
We had a line "127.0.1.1 hdfs2" in /etc/hosts of the slave node, where
hdfs2 is the machine name of the slave. After removing the line, it is
alright now.
于 2013/4/18 13:24, Vinod Kone 写道:
> Hi Xiaoying,
>
> Could you tell us what you mean by fixing /etc/hosts?
>
> Thanks,
>
>
> On Wed, Apr 17, 2013 at 10:14 PM, Xiaoying Zheng <zh...@sari.ac.cn> wrote:
>
>> hi, Ben,
>>
>> We fixed errors in our /etc/hosts configuration. It works well now. Thanks.
>>
>> Xiaoying
>>
>>
Re: Does Mesos support running a job from a slave node?
Posted by Vinod Kone <vi...@gmail.com>.
Hi Xiaoying,
Could you tell us what you mean by fixing /etc/hosts?
Thanks,
On Wed, Apr 17, 2013 at 10:14 PM, Xiaoying Zheng <zh...@sari.ac.cn> wrote:
> hi, Ben,
>
> We fixed errors in our /etc/hosts configuration. It works well now. Thanks.
>
> Xiaoying
>
>
Re: Does Mesos support running a job from a slave node?
Posted by Xiaoying Zheng <zh...@sari.ac.cn>.
hi, Ben,
We fixed errors in our /etc/hosts configuration. It works well now. Thanks.
Xiaoying
Re: Does Mesos support running a job from a slave node?
Posted by Xiaoying Zheng <zh...@sari.ac.cn>.
hi, Ben,
Here are the logs. Thanks.
Xiaoying
TEST 1:
1. On the master node (192.168.1.130), we ran "bin/mesos-master.sh --ip=192.168.1.130 --log_dir=logs".
Log file created at: 2013/04/18 09:23:14
Running on machine: master
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0418 09:23:14.498967 2422 logging.cpp:72] Logging to logs
I0418 09:23:14.500563 2422 process.cpp:2105] Spawned process
__gc__@192.168.1.130:5050
I0418 09:23:14.500589 2437 process.cpp:2115] Resuming
__gc__@192.168.1.130:5050 at 1366248194.500575066
I0418 09:23:14.500646 2422 process.cpp:1346] libprocess is initialized
on 192.168.1.130:5050 for 4 cpus
I0418 09:23:14.500706 2422 main.cpp:105] Build: 2013-01-22 20:32:32 by
hadoop
I0418 09:23:14.500732 2422 main.cpp:106] Starting Mesos master
I0418 09:23:14.500812 2422 process.cpp:2105] Spawned process
master@192.168.1.130:5050
I0418 09:23:14.500836 2438 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248194.500824928
I0418 09:23:14.500955 2438 master.cpp:268] Master started on
192.168.1.130:5050
I0418 09:23:14.501019 2438 master.cpp:283] Master ID:
201304180923-2113820480-5050-2422
I0418 09:23:14.501096 2438 process.cpp:2105] Spawned process
1@192.168.1.130:5050
I0418 09:23:14.501111 2436 process.cpp:2115] Resuming
1@192.168.1.130:5050 at 1366248194.501105070
I0418 09:23:14.501184 2438 process.cpp:2105] Spawned process
slaves@192.168.1.130:5050
I0418 09:23:14.501193 2439 process.cpp:2115] Resuming
slaves@192.168.1.130:5050 at 1366248194.501178026
I0418 09:23:14.501260 2438 process.cpp:2466] Created a timer for
1366248195.501250982
I0418 09:23:14.502344 2438 pid.cpp:89] Attempting to parse
'master@192.168.1.130:5050' into a PID
I0418 09:23:14.502498 2438 master.cpp:483] Elected as master!
I0418 09:23:14.513334 2441 webui_utils.cpp:45] Loading webui script at
'/home/hadoop/mesos-0.9.0/src/webui/master/webui.py'
I0418 09:23:15.508343 2440 process.cpp:724] Handling timeouts up to
1366248195.508313894
I0418 09:23:15.508460 2440 process.cpp:732] Have timeout(s) at
1366248195.501250982
I0418 09:23:15.508641 2437 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248195.508632898
I0418 09:23:15.508738 2437 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:15.508767 2437 process.cpp:2466] Created a timer for
1366248196.508764982
I0418 09:23:16.520834 2440 process.cpp:724] Handling timeouts up to
1366248196.520823956
I0418 09:23:16.520905 2440 process.cpp:732] Have timeout(s) at
1366248196.508764982
I0418 09:23:16.520994 2436 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248196.520987034
I0418 09:23:16.521050 2436 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:16.521075 2436 process.cpp:2466] Created a timer for
1366248197.521073103
I0418 09:23:16.709519 2440 pid.cpp:89] Attempting to parse
'slave@127.0.1.1:55694' into a PID
I0418 09:23:16.709642 2440 process.cpp:661] Parsed message name
'mesos.internal.RegisterSlaveMessage' for master@192.168.1.130:5050 from
slave@127.0.1.1:55694
I0418 09:23:16.709728 2439 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248196.709722042
I0418 09:23:16.709851 2439 master.cpp:844] Attempting to register slave
201304180923-2113820480-5050-2422-0 at slave@127.0.1.1:55694
I0418 09:23:16.709890 2439 master.cpp:1097] Master now considering a
slave at hdfs2:55694 as active
I0418 09:23:16.709916 2439 master.cpp:1633] Adding slave
201304180923-2113820480-5050-2422-0 at hdfs2 with cpus=4; mem=968
I0418 09:23:16.710137 2440 process.cpp:1032] Socket error while connecting
I0418 09:23:16.710582 2440 process.cpp:1007] Socket error while connecting
I0418 09:23:16.710628 2439 process.cpp:2105] Spawned process
2@192.168.1.130:5050
I0418 09:23:16.710674 2439 simple_allocator.cpp:69] Added slave
201304180923-2113820480-5050-2422-0 with cpus=4; mem=968
I0418 09:23:16.710724 2438 process.cpp:2115] Resuming
2@192.168.1.130:5050 at 1366248196.710716009
I0418 09:23:16.710744 2439 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:16.710829 2439 master.cpp:455] Slave
201304180923-2113820480-5050-2422-0 disconnected
I0418 09:23:16.710902 2438 process.cpp:2466] Created a timer for
1366248211.710896015
I0418 09:23:16.711056 2438 process.cpp:2183] Cleaning up
2@192.168.1.130:5050
I0418 09:23:16.711156 2440 process.cpp:1007] Socket error while connecting
I0418 09:23:16.711206 2439 simple_allocator.cpp:81] Removed slave
201304180923-2113820480-5050-2422-0
I0418 09:23:17.530838 2440 process.cpp:724] Handling timeouts up to
1366248197.530823946
I0418 09:23:17.530946 2440 process.cpp:732] Have timeout(s) at
1366248197.521073103
I0418 09:23:17.531083 2437 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248197.531074047
I0418 09:23:17.531169 2437 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:17.531203 2437 process.cpp:2466] Created a timer for
1366248198.531198978
I0418 09:23:17.712214 2440 pid.cpp:89] Attempting to parse
'slave@127.0.1.1:55694' into a PID
I0418 09:23:17.712291 2440 process.cpp:661] Parsed message name
'mesos.internal.RegisterSlaveMessage' for master@192.168.1.130:5050 from
slave@127.0.1.1:55694
I0418 09:23:17.712391 2436 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248197.712383032
I0418 09:23:17.712497 2436 master.cpp:844] Attempting to register slave
201304180923-2113820480-5050-2422-1 at slave@127.0.1.1:55694
I0418 09:23:17.712535 2436 master.cpp:1097] Master now considering a
slave at hdfs2:55694 as active
I0418 09:23:17.712559 2436 master.cpp:1633] Adding slave
201304180923-2113820480-5050-2422-1 at hdfs2 with cpus=4; mem=968
I0418 09:23:17.712724 2440 process.cpp:1032] Socket error while connecting
I0418 09:23:17.712769 2436 process.cpp:2105] Spawned process
3@192.168.1.130:5050
I0418 09:23:17.712818 2438 process.cpp:2115] Resuming
3@192.168.1.130:5050 at 1366248197.712783098
I0418 09:23:17.712844 2436 simple_allocator.cpp:69] Added slave
201304180923-2113820480-5050-2422-1 with cpus=4; mem=968
I0418 09:23:17.712931 2436 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:17.712970 2436 master.cpp:455] Slave
201304180923-2113820480-5050-2422-1 disconnected
I0418 09:23:17.712985 2438 process.cpp:2466] Created a timer for
1366248212.712975979
I0418 09:23:17.713009 2440 process.cpp:891] Socket error while sending:
Connection refused
I0418 09:23:17.713063 2438 process.cpp:2183] Cleaning up
3@192.168.1.130:5050
I0418 09:23:17.713184 2436 simple_allocator.cpp:81] Removed slave
201304180923-2113820480-5050-2422-1
I0418 09:23:18.528333 2440 process.cpp:1007] Socket error while connecting
I0418 09:23:18.540843 2440 process.cpp:724] Handling timeouts up to
1366248198.540833950
I0418 09:23:18.540935 2440 process.cpp:732] Have timeout(s) at
1366248198.531198978
I0418 09:23:18.541064 2439 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248198.541054964
I0418 09:23:18.541169 2439 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:18.541204 2439 process.cpp:2466] Created a timer for
1366248199.541202068
I0418 09:23:18.722184 2440 pid.cpp:89] Attempting to parse
'slave@127.0.1.1:55694' into a PID
I0418 09:23:18.722272 2440 process.cpp:661] Parsed message name
'mesos.internal.RegisterSlaveMessage' for master@192.168.1.130:5050 from
slave@127.0.1.1:55694
I0418 09:23:18.722380 2437 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248198.722372055
I0418 09:23:18.722486 2437 master.cpp:844] Attempting to register slave
201304180923-2113820480-5050-2422-2 at slave@127.0.1.1:55694
I0418 09:23:18.722524 2437 master.cpp:1097] Master now considering a
slave at hdfs2:55694 as active
I0418 09:23:18.722549 2437 master.cpp:1633] Adding slave
201304180923-2113820480-5050-2422-2 at hdfs2 with cpus=4; mem=968
I0418 09:23:18.722715 2440 process.cpp:1032] Socket error while connecting
I0418 09:23:18.722767 2437 process.cpp:2105] Spawned process
4@192.168.1.130:5050
I0418 09:23:18.722790 2438 process.cpp:2115] Resuming
4@192.168.1.130:5050 at 1366248198.722781897
I0418 09:23:18.722815 2437 simple_allocator.cpp:69] Added slave
201304180923-2113820480-5050-2422-2 with cpus=4; mem=968
I0418 09:23:18.722908 2437 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:18.722954 2438 process.cpp:2466] Created a timer for
1366248213.722949028
I0418 09:23:18.723000 2437 master.cpp:455] Slave
201304180923-2113820480-5050-2422-2 disconnected
I0418 09:23:18.722965 2440 process.cpp:891] Socket error while sending:
Connection refused
I0418 09:23:18.723064 2436 process.cpp:2115] Resuming
4@192.168.1.130:5050 at 1366248198.723058939
I0418 09:23:18.723127 2436 process.cpp:2183] Cleaning up
4@192.168.1.130:5050
I0418 09:23:18.723232 2437 simple_allocator.cpp:81] Removed slave
201304180923-2113820480-5050-2422-2
I0418 09:23:19.538347 2440 process.cpp:1007] Socket error while connecting
I0418 09:23:19.550840 2440 process.cpp:724] Handling timeouts up to
1366248199.550832033
I0418 09:23:19.550952 2440 process.cpp:732] Have timeout(s) at
1366248199.541202068
I0418 09:23:19.551084 2439 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248199.551073074
I0418 09:23:19.551175 2439 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:19.551208 2439 process.cpp:2466] Created a timer for
1366248200.551206112
I0418 09:23:19.732329 2440 pid.cpp:89] Attempting to parse
'slave@127.0.1.1:55694' into a PID
I0418 09:23:19.732405 2440 process.cpp:661] Parsed message name
'mesos.internal.RegisterSlaveMessage' for master@192.168.1.130:5050 from
slave@127.0.1.1:55694
I0418 09:23:19.732507 2438 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248199.732498884
I0418 09:23:19.732610 2438 master.cpp:844] Attempting to register slave
201304180923-2113820480-5050-2422-3 at slave@127.0.1.1:55694
I0418 09:23:19.732647 2438 master.cpp:1097] Master now considering a
slave at hdfs2:55694 as active
I0418 09:23:19.732672 2438 master.cpp:1633] Adding slave
201304180923-2113820480-5050-2422-3 at hdfs2 with cpus=4; mem=968
I0418 09:23:19.732836 2440 process.cpp:1032] Socket error while connecting
I0418 09:23:19.732872 2438 process.cpp:2105] Spawned process
5@192.168.1.130:5050
I0418 09:23:19.732897 2436 process.cpp:2115] Resuming
5@192.168.1.130:5050 at 1366248199.732888937
I0418 09:23:19.732944 2438 simple_allocator.cpp:69] Added slave
201304180923-2113820480-5050-2422-3 with cpus=4; mem=968
I0418 09:23:19.733011 2438 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:19.733044 2438 master.cpp:455] Slave
201304180923-2113820480-5050-2422-3 disconnected
I0418 09:23:19.733078 2436 process.cpp:2466] Created a timer for
1366248214.733071089
I0418 09:23:19.733098 2440 process.cpp:891] Socket error while sending:
Connection refused
I0418 09:23:19.733157 2436 process.cpp:2183] Cleaning up
5@192.168.1.130:5050
I0418 09:23:19.733280 2438 simple_allocator.cpp:81] Removed slave
201304180923-2113820480-5050-2422-3
I0418 09:23:20.548380 2440 process.cpp:1007] Socket error while connecting
I0418 09:23:20.560845 2440 process.cpp:724] Handling timeouts up to
1366248200.560836077
I0418 09:23:20.560936 2440 process.cpp:732] Have timeout(s) at
1366248200.551206112
I0418 09:23:20.561033 2437 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248200.561026096
I0418 09:23:20.561096 2437 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:20.561141 2437 process.cpp:2466] Created a timer for
1366248201.561137915
I0418 09:23:20.742589 2440 pid.cpp:89] Attempting to parse
'slave@127.0.1.1:55694' into a PID
I0418 09:23:20.742665 2440 process.cpp:661] Parsed message name
'mesos.internal.RegisterSlaveMessage' for master@192.168.1.130:5050 from
slave@127.0.1.1:55694
I0418 09:23:20.742768 2439 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248200.742758989
I0418 09:23:20.742869 2439 master.cpp:844] Attempting to register slave
201304180923-2113820480-5050-2422-4 at slave@127.0.1.1:55694
I0418 09:23:20.742905 2439 master.cpp:1097] Master now considering a
slave at hdfs2:55694 as active
I0418 09:23:20.742929 2439 master.cpp:1633] Adding slave
201304180923-2113820480-5050-2422-4 at hdfs2 with cpus=4; mem=968
I0418 09:23:20.743094 2440 process.cpp:1032] Socket error while connecting
I0418 09:23:20.743134 2439 process.cpp:2105] Spawned process
6@192.168.1.130:5050
I0418 09:23:20.743151 2436 process.cpp:2115] Resuming
6@192.168.1.130:5050 at 1366248200.743144989
I0418 09:23:20.743242 2439 simple_allocator.cpp:69] Added slave
201304180923-2113820480-5050-2422-4 with cpus=4; mem=968
I0418 09:23:20.743319 2439 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:20.743373 2439 master.cpp:455] Slave
201304180923-2113820480-5050-2422-4 disconnected
I0418 09:23:20.743373 2436 process.cpp:2466] Created a timer for
1366248215.743366957
I0418 09:23:20.743419 2440 process.cpp:891] Socket error while sending:
Connection refused
I0418 09:23:20.743470 2436 process.cpp:2183] Cleaning up
6@192.168.1.130:5050
I0418 09:23:20.743582 2439 simple_allocator.cpp:81] Removed slave
201304180923-2113820480-5050-2422-4
I0418 09:23:21.558354 2440 process.cpp:1007] Socket error while connecting
I0418 09:23:21.570862 2440 process.cpp:724] Handling timeouts up to
1366248201.570852995
I0418 09:23:21.570956 2440 process.cpp:732] Have timeout(s) at
1366248201.561137915
I0418 09:23:21.571086 2438 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248201.571077108
I0418 09:23:21.571197 2438 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:21.571244 2438 process.cpp:2466] Created a timer for
1366248202.571240902
I0418 09:23:21.753399 2440 pid.cpp:89] Attempting to parse
'slave@127.0.1.1:55694' into a PID
I0418 09:23:21.753479 2440 process.cpp:661] Parsed message name
'mesos.internal.RegisterSlaveMessage' for master@192.168.1.130:5050 from
slave@127.0.1.1:55694
I0418 09:23:21.753553 2437 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248201.753545046
I0418 09:23:21.753636 2437 master.cpp:844] Attempting to register slave
201304180923-2113820480-5050-2422-5 at slave@127.0.1.1:55694
I0418 09:23:21.753670 2437 master.cpp:1097] Master now considering a
slave at hdfs2:55694 as active
I0418 09:23:21.753695 2437 master.cpp:1633] Adding slave
201304180923-2113820480-5050-2422-5 at hdfs2 with cpus=4; mem=968
I0418 09:23:21.753824 2440 process.cpp:1032] Socket error while connecting
I0418 09:23:21.753929 2437 process.cpp:2105] Spawned process
7@192.168.1.130:5050
I0418 09:23:21.753942 2436 process.cpp:2115] Resuming
7@192.168.1.130:5050 at 1366248201.753935099
I0418 09:23:21.753986 2437 simple_allocator.cpp:69] Added slave
201304180923-2113820480-5050-2422-5 with cpus=4; mem=968
I0418 09:23:21.754061 2437 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:21.754114 2437 master.cpp:455] Slave
201304180923-2113820480-5050-2422-5 disconnected
I0418 09:23:21.754117 2436 process.cpp:2466] Created a timer for
1366248216.754111052
I0418 09:23:21.754210 2436 process.cpp:2183] Cleaning up
7@192.168.1.130:5050
I0418 09:23:21.754289 2437 simple_allocator.cpp:81] Removed slave
201304180923-2113820480-5050-2422-5
I0418 09:23:21.754302 2440 process.cpp:1007] Socket error while connecting
I0418 09:23:21.754412 2440 process.cpp:891] Socket error while sending:
Bad file descriptor
I0418 09:23:22.580824 2440 process.cpp:724] Handling timeouts up to
1366248202.580813885
I0418 09:23:22.580924 2440 process.cpp:732] Have timeout(s) at
1366248202.571240902
I0418 09:23:22.581055 2439 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248202.581047058
I0418 09:23:22.581141 2439 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:22.581174 2439 process.cpp:2466] Created a timer for
1366248203.581171989
I0418 09:23:22.762837 2440 pid.cpp:89] Attempting to parse
'slave@127.0.1.1:55694' into a PID
I0418 09:23:22.762927 2440 process.cpp:661] Parsed message name
'mesos.internal.RegisterSlaveMessage' for master@192.168.1.130:5050 from
slave@127.0.1.1:55694
I0418 09:23:22.763036 2438 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248202.763025999
I0418 09:23:22.763142 2438 master.cpp:844] Attempting to register slave
201304180923-2113820480-5050-2422-6 at slave@127.0.1.1:55694
I0418 09:23:22.763180 2438 master.cpp:1097] Master now considering a
slave at hdfs2:55694 as active
I0418 09:23:22.763247 2438 master.cpp:1633] Adding slave
201304180923-2113820480-5050-2422-6 at hdfs2 with cpus=4; mem=968
I0418 09:23:22.763420 2440 process.cpp:1032] Socket error while connecting
I0418 09:23:22.763460 2438 process.cpp:2105] Spawned process
8@192.168.1.130:5050
I0418 09:23:22.763483 2436 process.cpp:2115] Resuming
8@192.168.1.130:5050 at 1366248202.763474941
I0418 09:23:22.763499 2438 simple_allocator.cpp:69] Added slave
201304180923-2113820480-5050-2422-6 with cpus=4; mem=968
I0418 09:23:22.763594 2438 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:22.763633 2438 master.cpp:455] Slave
201304180923-2113820480-5050-2422-6 disconnected
I0418 09:23:22.763658 2440 process.cpp:891] Socket error while sending:
Connection refused
I0418 09:23:22.763648 2436 process.cpp:2466] Created a timer for
1366248217.763641119
I0418 09:23:22.763758 2436 process.cpp:2183] Cleaning up
8@192.168.1.130:5050
I0418 09:23:22.763870 2438 simple_allocator.cpp:81] Removed slave
201304180923-2113820480-5050-2422-6
I0418 09:23:23.580833 2440 process.cpp:1007] Socket error while connecting
I0418 09:23:23.590862 2440 process.cpp:724] Handling timeouts up to
1366248203.590852022
I0418 09:23:23.590956 2440 process.cpp:732] Have timeout(s) at
1366248203.581171989
I0418 09:23:23.591055 2437 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248203.591047049
I0418 09:23:23.591120 2437 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:23.591163 2437 process.cpp:2466] Created a timer for
1366248204.591161013
I0418 09:23:23.772948 2440 pid.cpp:89] Attempting to parse
'slave@127.0.1.1:55694' into a PID
I0418 09:23:23.773027 2440 process.cpp:661] Parsed message name
'mesos.internal.RegisterSlaveMessage' for master@192.168.1.130:5050 from
slave@127.0.1.1:55694
I0418 09:23:23.773130 2439 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248203.773122072
I0418 09:23:23.773231 2439 master.cpp:844] Attempting to register slave
201304180923-2113820480-5050-2422-7 at slave@127.0.1.1:55694
I0418 09:23:23.773268 2439 master.cpp:1097] Master now considering a
slave at hdfs2:55694 as active
I0418 09:23:23.773293 2439 master.cpp:1633] Adding slave
201304180923-2113820480-5050-2422-7 at hdfs2 with cpus=4; mem=968
I0418 09:23:23.773457 2440 process.cpp:1032] Socket error while connecting
I0418 09:23:23.773494 2439 process.cpp:2105] Spawned process
9@192.168.1.130:5050
I0418 09:23:23.773511 2436 process.cpp:2115] Resuming
9@192.168.1.130:5050 at 1366248203.773504019
I0418 09:23:23.773552 2439 simple_allocator.cpp:69] Added slave
201304180923-2113820480-5050-2422-7 with cpus=4; mem=968
I0418 09:23:23.773628 2439 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:23.773681 2439 master.cpp:455] Slave
201304180923-2113820480-5050-2422-7 disconnected
I0418 09:23:23.773681 2436 process.cpp:2466] Created a timer for
1366248218.773675919
I0418 09:23:23.773727 2440 process.cpp:891] Socket error while sending:
Connection refused
I0418 09:23:23.773782 2436 process.cpp:2183] Cleaning up
9@192.168.1.130:5050
I0418 09:23:23.773895 2439 simple_allocator.cpp:81] Removed slave
201304180923-2113820480-5050-2422-7
I0418 09:23:24.590812 2440 process.cpp:1007] Socket error while connecting
I0418 09:23:24.600842 2440 process.cpp:724] Handling timeouts up to
1366248204.600832939
I0418 09:23:24.600954 2440 process.cpp:732] Have timeout(s) at
1366248204.591161013
I0418 09:23:24.601057 2437 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248204.601049900
I0418 09:23:24.601120 2437 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:24.601151 2437 process.cpp:2466] Created a timer for
1366248205.601149082
I0418 09:23:24.783104 2440 pid.cpp:89] Attempting to parse
'slave@127.0.1.1:55694' into a PID
I0418 09:23:24.783180 2440 process.cpp:661] Parsed message name
'mesos.internal.RegisterSlaveMessage' for master@192.168.1.130:5050 from
slave@127.0.1.1:55694
I0418 09:23:24.783339 2438 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248204.783329010
I0418 09:23:24.783442 2438 master.cpp:844] Attempting to register slave
201304180923-2113820480-5050-2422-8 at slave@127.0.1.1:55694
I0418 09:23:24.783478 2438 master.cpp:1097] Master now considering a
slave at hdfs2:55694 as active
I0418 09:23:24.783501 2438 master.cpp:1633] Adding slave
201304180923-2113820480-5050-2422-8 at hdfs2 with cpus=4; mem=968
I0418 09:23:24.783665 2440 process.cpp:1032] Socket error while connecting
I0418 09:23:24.783706 2438 process.cpp:2105] Spawned process
10@192.168.1.130:5050
I0418 09:23:24.783726 2436 process.cpp:2115] Resuming
10@192.168.1.130:5050 at 1366248204.783715963
I0418 09:23:24.783761 2438 simple_allocator.cpp:69] Added slave
201304180923-2113820480-5050-2422-8 with cpus=4; mem=968
I0418 09:23:24.783835 2438 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:24.783889 2438 master.cpp:455] Slave
201304180923-2113820480-5050-2422-8 disconnected
I0418 09:23:24.783889 2436 process.cpp:2466] Created a timer for
1366248219.783879995
I0418 09:23:24.783936 2440 process.cpp:891] Socket error while sending:
Connection refused
I0418 09:23:24.783994 2436 process.cpp:2183] Cleaning up
10@192.168.1.130:5050
I0418 09:23:24.784093 2438 simple_allocator.cpp:81] Removed slave
201304180923-2113820480-5050-2422-8
I0418 09:23:25.600837 2440 process.cpp:1007] Socket error while connecting
I0418 09:23:25.610859 2440 process.cpp:724] Handling timeouts up to
1366248205.610851049
I0418 09:23:25.610955 2440 process.cpp:732] Have timeout(s) at
1366248205.601149082
I0418 09:23:25.611055 2437 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248205.611048937
I0418 09:23:25.611119 2437 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:25.611162 2437 process.cpp:2466] Created a timer for
1366248206.611159086
I0418 09:23:25.793242 2440 pid.cpp:89] Attempting to parse
'slave@127.0.1.1:55694' into a PID
I0418 09:23:25.793339 2440 process.cpp:661] Parsed message name
'mesos.internal.RegisterSlaveMessage' for master@192.168.1.130:5050 from
slave@127.0.1.1:55694
I0418 09:23:25.793452 2439 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248205.793442965
I0418 09:23:25.793561 2439 master.cpp:844] Attempting to register slave
201304180923-2113820480-5050-2422-9 at slave@127.0.1.1:55694
I0418 09:23:25.793597 2439 master.cpp:1097] Master now considering a
slave at hdfs2:55694 as active
I0418 09:23:25.793622 2439 master.cpp:1633] Adding slave
201304180923-2113820480-5050-2422-9 at hdfs2 with cpus=4; mem=968
I0418 09:23:25.793788 2440 process.cpp:1032] Socket error while connecting
I0418 09:23:25.793834 2439 process.cpp:2105] Spawned process
11@192.168.1.130:5050
I0418 09:23:25.793853 2436 process.cpp:2115] Resuming
11@192.168.1.130:5050 at 1366248205.793843985
I0418 09:23:25.793887 2439 simple_allocator.cpp:69] Added slave
201304180923-2113820480-5050-2422-9 with cpus=4; mem=968
I0418 09:23:25.793966 2439 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:25.794018 2439 master.cpp:455] Slave
201304180923-2113820480-5050-2422-9 disconnected
I0418 09:23:25.794008 2436 process.cpp:2466] Created a timer for
1366248220.794003010
I0418 09:23:25.794057 2440 process.cpp:891] Socket error while sending:
Connection refused
I0418 09:23:25.794113 2436 process.cpp:2183] Cleaning up
11@192.168.1.130:5050
I0418 09:23:25.794224 2439 simple_allocator.cpp:81] Removed slave
201304180923-2113820480-5050-2422-9
I0418 09:23:26.610832 2440 process.cpp:1007] Socket error while connecting
I0418 09:23:26.620854 2440 process.cpp:724] Handling timeouts up to
1366248206.620845079
I0418 09:23:26.620947 2440 process.cpp:732] Have timeout(s) at
1366248206.611159086
I0418 09:23:26.621093 2438 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248206.621084929
I0418 09:23:26.621191 2438 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:26.621225 2438 process.cpp:2466] Created a timer for
1366248207.621222973
I0418 09:23:26.811534 2440 pid.cpp:89] Attempting to parse
'slave@127.0.1.1:55694' into a PID
I0418 09:23:26.811621 2440 process.cpp:661] Parsed message name
'mesos.internal.RegisterSlaveMessage' for master@192.168.1.130:5050 from
slave@127.0.1.1:55694
I0418 09:23:26.811678 2437 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248206.811674118
I0418 09:23:26.811755 2437 master.cpp:844] Attempting to register slave
201304180923-2113820480-5050-2422-10 at slave@127.0.1.1:55694
I0418 09:23:26.811789 2437 master.cpp:1097] Master now considering a
slave at hdfs2:55694 as active
I0418 09:23:26.811815 2437 master.cpp:1633] Adding slave
201304180923-2113820480-5050-2422-10 at hdfs2 with cpus=4; mem=968
I0418 09:23:26.811957 2440 process.cpp:1032] Socket error while connecting
I0418 09:23:26.812038 2437 process.cpp:2105] Spawned process
12@192.168.1.130:5050
I0418 09:23:26.812063 2437 simple_allocator.cpp:69] Added slave
201304180923-2113820480-5050-2422-10 with cpus=4; mem=968
I0418 09:23:26.812072 2436 process.cpp:2115] Resuming
12@192.168.1.130:5050 at 1366248206.812067986
I0418 09:23:26.812104 2437 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:26.812130 2437 master.cpp:455] Slave
201304180923-2113820480-5050-2422-10 disconnected
I0418 09:23:26.812157 2436 process.cpp:2466] Created a timer for
1366248221.812154055
I0418 09:23:26.812194 2436 process.cpp:2183] Cleaning up
12@192.168.1.130:5050
I0418 09:23:26.812232 2440 process.cpp:891] Socket error while sending:
Connection refused
I0418 09:23:26.812232 2437 simple_allocator.cpp:81] Removed slave
201304180923-2113820480-5050-2422-10
I0418 09:23:27.594087 2440 process.cpp:834] Socket closed while receiving
I0418 09:23:27.594225 2440 process.cpp:1007] Socket error while connecting
I0418 09:23:27.630831 2440 process.cpp:724] Handling timeouts up to
1366248207.630824089
I0418 09:23:27.630909 2440 process.cpp:732] Have timeout(s) at
1366248207.621222973
I0418 09:23:27.631039 2439 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248207.631031036
I0418 09:23:27.631124 2439 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:27.631157 2439 process.cpp:2466] Created a timer for
1366248208.631154060
I0418 09:23:28.640837 2440 process.cpp:724] Handling timeouts up to
1366248208.640821934
I0418 09:23:28.640956 2440 process.cpp:732] Have timeout(s) at
1366248208.631154060
I0418 09:23:28.641101 2438 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248208.641087055
I0418 09:23:28.641193 2438 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:28.641227 2438 process.cpp:2466] Created a timer for
1366248209.641223907
I0418 09:23:29.650840 2440 process.cpp:724] Handling timeouts up to
1366248209.650821924
I0418 09:23:29.650998 2440 process.cpp:732] Have timeout(s) at
1366248209.641223907
I0418 09:23:29.652115 2436 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248209.652107000
I0418 09:23:29.652192 2436 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:29.652225 2436 process.cpp:2466] Created a timer for
1366248210.652221918
I0418 09:23:30.658367 2440 process.cpp:724] Handling timeouts up to
1366248210.658322096
I0418 09:23:30.658493 2440 process.cpp:732] Have timeout(s) at
1366248210.652221918
I0418 09:23:30.658609 2437 process.cpp:2115] Resuming
master@192.168.1.130:5050 at 1366248210.658600092
I0418 09:23:30.658700 2437 simple_allocator.cpp:236] No frameworks to
allocate resources!
I0418 09:23:30.658781 2437 process.cpp:2466] Created a timer for
1366248211.658776999
2. On the slave node (192.168.1.132), we ran "bin/mesos-slave.sh --master=192.168.1.130:5050 --log_dir=logs".
Log file created at: 2013/04/18 09:23:14
Running on machine: hdfs2
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0418 09:23:14.970929 3392 logging.cpp:72] Logging to logs
I0418 09:23:14.972159 3392 process.cpp:2105] Spawned process __gc__@127.0.1.1:55694
I0418 09:23:14.972239 3392 process.cpp:1346] libprocess is initialized on 127.0.1.1:55694 for 4 cpus
I0418 09:23:14.972208 3407 process.cpp:2115] Resuming __gc__@127.0.1.1:55694 at 1366248194.972171068
I0418 09:23:14.972285 3392 main.cpp:111] Creating "process" isolation module
I0418 09:23:14.972393 3392 process.cpp:2105] Spawned process 2@127.0.1.1:55694
I0418 09:23:14.972412 3406 process.cpp:2115] Resuming 2@127.0.1.1:55694 at 1366248194.972402096
I0418 09:23:14.972455 3392 main.cpp:119] Build: 2013-01-22 20:32:32 by hadoop
I0418 09:23:14.972494 3392 main.cpp:120] Starting Mesos slave
I0418 09:23:14.972501 3406 process.cpp:2466] Created a timer for 1366248195.972491026
I0418 09:23:14.972843 3392 process.cpp:2105] Spawned process slave@127.0.1.1:55694
I0418 09:23:14.972916 3392 pid.cpp:89] Attempting to parse 'master@192.168.1.130:5050' into a PID
I0418 09:23:14.972894 3408 process.cpp:2115] Resuming slave@127.0.1.1:55694 at 1366248194.972883940
I0418 09:23:14.973007 3408 slave.cpp:191] Slave started on 127.0.1.1:55694
I0418 09:23:14.973033 3408 slave.cpp:192] Slave resources: cpus=4; mem=968
I0418 09:23:14.973186 3408 process.cpp:2105] Spawned process 1@127.0.1.1:55694
I0418 09:23:14.973199 3406 process.cpp:2115] Resuming 1@127.0.1.1:55694 at 1366248194.973193884
I0418 09:23:14.973297 3406 process.cpp:2115] Resuming 1@127.0.1.1:55694 at 1366248194.973289013
I0418 09:23:14.974400 3408 pid.cpp:89] Attempting to parse 'master@192.168.1.130:5050' into a PID
I0418 09:23:14.974459 3408 slave.cpp:357] New master detected at master@192.168.1.130:5050
I0418 09:23:14.974971 3408 process.cpp:2466] Created a timer for 1366248195.974963903
I0418 09:23:14.985259 3411 webui_utils.cpp:45] Loading webui script at '/home/hadoop/mesos-0.9.0/src/webui/slave/webui.py'
I0418 09:23:15.983485 3410 process.cpp:724] Handling timeouts up to 1366248195.983459949
I0418 09:23:15.983594 3410 process.cpp:732] Have timeout(s) at 1366248195.972491026
I0418 09:23:15.983657 3410 process.cpp:732] Have timeout(s) at 1366248195.974963903
I0418 09:23:15.983772 3406 process.cpp:2115] Resuming 2@127.0.1.1:55694 at 1366248195.983763933
I0418 09:23:15.983782 3409 process.cpp:2115] Resuming slave@127.0.1.1:55694 at 1366248195.983771086
I0418 09:23:15.983852 3406 process.cpp:2466] Created a timer for 1366248196.983848095
I0418 09:23:15.983966 3409 process.cpp:2466] Created a timer for 1366248196.983962059
I0418 09:23:16.993475 3410 process.cpp:724] Handling timeouts up to 1366248196.993468046
I0418 09:23:16.993531 3410 process.cpp:732] Have timeout(s) at 1366248196.983848095
I0418 09:23:16.993566 3410 process.cpp:732] Have timeout(s) at 1366248196.983962059
I0418 09:23:16.993674 3408 process.cpp:2115] Resuming slave@127.0.1.1:55694 at 1366248196.993665934
I0418 09:23:16.993666 3407 process.cpp:2115] Resuming 2@127.0.1.1:55694 at 1366248196.993657112
I0418 09:23:16.993774 3407 process.cpp:2466] Created a timer for 1366248197.993769884
I0418 09:23:16.993818 3408 process.cpp:2466] Created a timer for 1366248197.993812084
I0418 09:23:18.003476 3410 process.cpp:724] Handling timeouts up to 1366248198.003468990
I0418 09:23:18.003531 3410 process.cpp:732] Have timeout(s) at 1366248197.993769884
I0418 09:23:18.003566 3410 process.cpp:732] Have timeout(s) at 1366248197.993812084
I0418 09:23:18.003638 3406 process.cpp:2115] Resuming 2@127.0.1.1:55694 at 1366248198.003628969
I0418 09:23:18.003638 3409 process.cpp:2115] Resuming slave@127.0.1.1:55694 at 1366248198.003633022
I0418 09:23:18.003711 3406 process.cpp:2466] Created a timer for 1366248199.003705025
I0418 09:23:18.003785 3409 process.cpp:2466] Created a timer for 1366248199.003779888
I0418 09:23:19.013474 3410 process.cpp:724] Handling timeouts up to 1366248199.013467073
I0418 09:23:19.013530 3410 process.cpp:732] Have timeout(s) at 1366248199.003705025
I0418 09:23:19.013633 3410 process.cpp:732] Have timeout(s) at 1366248199.003779888
I0418 09:23:19.013749 3408 process.cpp:2115] Resuming slave@127.0.1.1:55694 at 1366248199.013744116
I0418 09:23:19.013744 3407 process.cpp:2115] Resuming 2@127.0.1.1:55694 at 1366248199.013735056
I0418 09:23:19.013877 3407 process.cpp:2466] Created a timer for 1366248200.013873100
I0418 09:23:19.013910 3408 process.cpp:2466] Created a timer for 1366248200.013902903
I0418 09:23:20.023462 3410 process.cpp:724] Handling timeouts up to 1366248200.023452997
I0418 09:23:20.023540 3410 process.cpp:732] Have timeout(s) at 1366248200.013873100
I0418 09:23:20.024297 3410 process.cpp:732] Have timeout(s) at 1366248200.013902903
I0418 09:23:20.024394 3406 process.cpp:2115] Resuming 2@127.0.1.1:55694 at 1366248200.024385929
I0418 09:23:20.024395 3409 process.cpp:2115] Resuming slave@127.0.1.1:55694 at 1366248200.024390936
I0418 09:23:20.024474 3406 process.cpp:2466] Created a timer for 1366248201.024468899
I0418 09:23:20.024559 3409 process.cpp:2466] Created a timer for 1366248201.024553061
I0418 09:23:21.033475 3410 process.cpp:724] Handling timeouts up to 1366248201.033468008
I0418 09:23:21.033547 3410 process.cpp:732] Have timeout(s) at 1366248201.024468899
I0418 09:23:21.033587 3410 process.cpp:732] Have timeout(s) at 1366248201.024553061
I0418 09:23:21.033700 3408 process.cpp:2115] Resuming slave@127.0.1.1:55694 at 1366248201.033693075
I0418 09:23:21.033694 3407 process.cpp:2115] Resuming 2@127.0.1.1:55694 at 1366248201.033684015
I0418 09:23:21.033817 3407 process.cpp:2466] Created a timer for 1366248202.033811092
I0418 09:23:21.033850 3408 process.cpp:2466] Created a timer for 1366248202.033843994
I0418 09:23:22.043474 3410 process.cpp:724] Handling timeouts up to 1366248202.043467999
I0418 09:23:22.043550 3410 process.cpp:732] Have timeout(s) at 1366248202.033811092
I0418 09:23:22.043591 3410 process.cpp:732] Have timeout(s) at 1366248202.033843994
I0418 09:23:22.043668 3406 process.cpp:2115] Resuming 2@127.0.1.1:55694 at 1366248202.043658972
I0418 09:23:22.043668 3409 process.cpp:2115] Resuming slave@127.0.1.1:55694 at 1366248202.043663025
I0418 09:23:22.043745 3406 process.cpp:2466] Created a timer for 1366248203.043740988
I0418 09:23:22.043831 3409 process.cpp:2466] Created a timer for 1366248203.043826103
I0418 09:23:23.053473 3410 process.cpp:724] Handling timeouts up to 1366248203.053467035
I0418 09:23:23.053546 3410 process.cpp:732] Have timeout(s) at 1366248203.043740988
I0418 09:23:23.053586 3410 process.cpp:732] Have timeout(s) at 1366248203.043826103
I0418 09:23:23.053689 3407 process.cpp:2115] Resuming 2@127.0.1.1:55694 at 1366248203.053679943
I0418 09:23:23.053697 3408 process.cpp:2115] Resuming slave@127.0.1.1:55694 at 1366248203.053690910
I0418 09:23:23.053782 3407 process.cpp:2466] Created a timer for 1366248204.053776979
I0418 09:23:23.053870 3408 process.cpp:2466] Created a timer for 1366248204.053864956
I0418 09:23:24.063462 3410 process.cpp:724] Handling timeouts up to 1366248204.063455105
I0418 09:23:24.063535 3410 process.cpp:732] Have timeout(s) at 1366248204.053776979
I0418 09:23:24.063576 3410 process.cpp:732] Have timeout(s) at 1366248204.053864956
I0418 09:23:24.063652 3406 process.cpp:2115] Resuming 2@127.0.1.1:55694 at 1366248204.063644886
I0418 09:23:24.063652 3409 process.cpp:2115] Resuming slave@127.0.1.1:55694 at 1366248204.063647985
I0418 09:23:24.063730 3406 process.cpp:2466] Created a timer for 1366248205.063724995
I0418 09:23:24.063812 3409 process.cpp:2466] Created a timer for 1366248205.063807011
I0418 09:23:25.081012 3410 process.cpp:724] Handling timeouts up to 1366248205.080970049
I0418 09:23:25.081161 3410 process.cpp:732] Have timeout(s) at 1366248205.063724995
I0418 09:23:25.081630 3410 process.cpp:732] Have timeout(s) at 1366248205.063807011
I0418 09:23:25.081750 3407 process.cpp:2115] Resuming 2@127.0.1.1:55694 at 1366248205.081736088
I0418 09:23:25.081755 3408 process.cpp:2115] Resuming slave@127.0.1.1:55694 at 1366248205.081747055
I0418 09:23:25.081856 3407 process.cpp:2466] Created a timer for 1366248206.081851006
I0418 09:23:25.082022 3408 process.cpp:2466] Created a timer for 1366248206.082016945
TEST 2:
1. On the master node (192.168.1.130), we ran "bin/mesos-master.sh --ip=192.168.1.130 --log_dir=logs".
Log file created at: 2013/04/18 09:46:46
Running on machine: master
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0418 09:46:46.498764 2815 logging.cpp:72] Logging to logs
I0418 09:46:46.499728 2815 process.cpp:2105] Spawned process __gc__@192.168.1.130:5050
I0418 09:46:46.499752 2830 process.cpp:2115] Resuming __gc__@192.168.1.130:5050 at 1366249606.499737978
I0418 09:46:46.499810 2815 process.cpp:1346] libprocess is initialized on 192.168.1.130:5050 for 4 cpus
I0418 09:46:46.499868 2815 main.cpp:105] Build: 2013-01-22 20:32:32 by hadoop
I0418 09:46:46.499894 2815 main.cpp:106] Starting Mesos master
I0418 09:46:46.499972 2815 process.cpp:2105] Spawned process master@192.168.1.130:5050
I0418 09:46:46.499994 2829 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249606.499979973
I0418 09:46:46.500092 2829 master.cpp:268] Master started on 192.168.1.130:5050
I0418 09:46:46.500154 2829 master.cpp:283] Master ID: 201304180946-2113820480-5050-2815
I0418 09:46:46.500231 2829 process.cpp:2105] Spawned process 1@192.168.1.130:5050
I0418 09:46:46.500247 2831 process.cpp:2115] Resuming 1@192.168.1.130:5050 at 1366249606.500241041
I0418 09:46:46.500327 2829 process.cpp:2105] Spawned process slaves@192.168.1.130:5050
I0418 09:46:46.500339 2832 process.cpp:2115] Resuming slaves@192.168.1.130:5050 at 1366249606.500333071
I0418 09:46:46.500407 2829 process.cpp:2466] Created a timer for 1366249607.500394106
I0418 09:46:46.501443 2829 pid.cpp:89] Attempting to parse 'master@192.168.1.130:5050' into a PID
I0418 09:46:46.501576 2829 master.cpp:483] Elected as master!
I0418 09:46:46.512385 2834 webui_utils.cpp:45] Loading webui script at '/home/hadoop/mesos-0.9.0/src/webui/master/webui.py'
I0418 09:46:47.508358 2833 process.cpp:724] Handling timeouts up to 1366249607.508327961
I0418 09:46:47.508474 2833 process.cpp:732] Have timeout(s) at 1366249607.500394106
I0418 09:46:47.508656 2830 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249607.508647919
I0418 09:46:47.508752 2830 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:46:47.508782 2830 process.cpp:2466] Created a timer for 1366249608.508780003
I0418 09:46:48.518306 2833 process.cpp:724] Handling timeouts up to 1366249608.518296957
I0418 09:46:48.518374 2833 process.cpp:732] Have timeout(s) at 1366249608.508780003
I0418 09:46:48.518460 2831 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249608.518451929
I0418 09:46:48.518514 2831 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:46:48.518540 2831 process.cpp:2466] Created a timer for 1366249609.518537998
I0418 09:46:49.056766 2833 pid.cpp:89] Attempting to parse 'slave@192.168.1.132:60675' into a PID
I0418 09:46:49.056887 2833 process.cpp:661] Parsed message name 'mesos.internal.RegisterSlaveMessage' for master@192.168.1.130:5050 from slave@192.168.1.132:60675
I0418 09:46:49.056972 2829 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249609.056962967
I0418 09:46:49.057096 2829 master.cpp:844] Attempting to register slave 201304180946-2113820480-5050-2815-0 at slave@192.168.1.132:60675
I0418 09:46:49.057133 2829 master.cpp:1097] Master now considering a slave at hdfs2:60675 as active
I0418 09:46:49.057158 2829 master.cpp:1633] Adding slave 201304180946-2113820480-5050-2815-0 at hdfs2 with cpus=4; mem=968
I0418 09:46:49.057672 2829 process.cpp:2105] Spawned process 2@192.168.1.130:5050
I0418 09:46:49.057718 2829 simple_allocator.cpp:69] Added slave 201304180946-2113820480-5050-2815-0 with cpus=4; mem=968
I0418 09:46:49.057728 2832 process.cpp:2115] Resuming 2@192.168.1.130:5050 at 1366249609.057715893
I0418 09:46:49.057802 2829 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:46:49.057894 2832 process.cpp:2466] Created a timer for 1366249624.057888985
I0418 09:46:49.058796 2833 pid.cpp:89] Attempting to parse 'slave@192.168.1.132:60675' into a PID
I0418 09:46:49.058851 2833 process.cpp:661] Parsed message name 'PONG' for 2@192.168.1.130:5050 from slave@192.168.1.132:60675
I0418 09:46:49.059025 2830 process.cpp:2115] Resuming 2@192.168.1.130:5050 at 1366249609.059015036
I0418 09:46:49.528321 2833 process.cpp:724] Handling timeouts up to 1366249609.528310061
I0418 09:46:49.528419 2833 process.cpp:732] Have timeout(s) at 1366249609.518537998
I0418 09:46:49.528553 2831 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249609.528544903
I0418 09:46:49.528645 2831 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:46:49.528681 2831 process.cpp:2466] Created a timer for 1366249610.528676987
I0418 09:46:50.540834 2833 process.cpp:724] Handling timeouts up to 1366249610.540824890
I0418 09:46:50.540927 2833 process.cpp:732] Have timeout(s) at 1366249610.528676987
I0418 09:46:50.541024 2829 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249610.541016102
I0418 09:46:50.541092 2829 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:46:50.541122 2829 process.cpp:2466] Created a timer for 1366249611.541120052
I0418 09:46:51.550819 2833 process.cpp:724] Handling timeouts up to 1366249611.550810099
I0418 09:46:51.550911 2833 process.cpp:732] Have timeout(s) at 1366249611.541120052
I0418 09:46:51.552165 2832 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249611.552156925
I0418 09:46:51.552237 2832 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:46:51.552268 2832 process.cpp:2466] Created a timer for 1366249612.552264929
I0418 09:46:51.833930 2833 pid.cpp:89] Attempting to parse '1@127.0.1.1:56060' into a PID
I0418 09:46:51.834018 2833 process.cpp:661] Parsed message name 'mesos.internal.RegisterFrameworkMessage' for master@192.168.1.130:5050 from 1@127.0.1.1:56060
I0418 09:46:51.834131 2830 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249611.834120989
I0418 09:46:51.834264 2830 master.cpp:526] Registering framework 201304180946-2113820480-5050-2815-0000 at 1@127.0.1.1:56060
I0418 09:46:51.834455 2833 process.cpp:1032] Socket error while connecting
I0418 09:46:51.834488 2830 simple_allocator.cpp:46] Added framework 201304180946-2113820480-5050-2815-0000
I0418 09:46:51.834547 2830 master.hpp:338] Calculating resources free on slave 201304180946-2113820480-5050-2815-0
Resources: cpus=4; mem=968
Resources Offered:
Resources In Use:
Resources Free: cpus=4; mem=968
I0418 09:46:51.834621 2830 simple_allocator.cpp:263] Found available resources: cpus=4; mem=968 on slave 201304180946-2113820480-5050-2815-0
I0418 09:46:51.834674 2830 simple_allocator.cpp:290] Offering cpus=4; mem=968 on slave 201304180946-2113820480-5050-2815-0 to framework 201304180946-2113820480-5050-2815-0000
I0418 09:46:51.834745 2830 master.hpp:290] Adding offer with resources cpus=4; mem=968 on slave 201304180946-2113820480-5050-2815-0
I0418 09:46:51.834800 2830 master.cpp:1188] Sending 1 offers to framework 201304180946-2113820480-5050-2815-0000
I0418 09:46:51.834954 2830 master.cpp:430] Framework 201304180946-2113820480-5050-2815-0000 disconnected
I0418 09:46:51.834998 2833 process.cpp:891] Socket error while sending: Connection refused
I0418 09:46:51.835018 2830 process.cpp:2466] Created a timer for 1366249612.835014105
I0418 09:46:51.835127 2830 simple_allocator.cpp:124] Recovered cpus=4; mem=968 on slave 201304180946-2113820480-5050-2815-0 from framework 201304180946-2113820480-5050-2815-0000
I0418 09:46:51.835171 2830 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:46:51.835216 2830 master.hpp:299] Removing offer with resources cpus=4; mem=968 on slave 201304180946-2113820480-5050-2815-0
I0418 09:46:52.548375 2833 process.cpp:1007] Socket error while connecting
I0418 09:46:52.560848 2833 process.cpp:724] Handling timeouts up to 1366249612.560838938
I0418 09:46:52.560943 2833 process.cpp:732] Have timeout(s) at 1366249612.552264929
I0418 09:46:52.561081 2831 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249612.561069965
I0418 09:46:52.561194 2831 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:46:52.561229 2831 process.cpp:2466] Created a timer for 1366249613.561227083
I0418 09:46:52.838338 2833 process.cpp:724] Handling timeouts up to 1366249612.838327885
I0418 09:46:52.838431 2833 process.cpp:732] Have timeout(s) at 1366249612.835014105
I0418 09:46:52.838552 2829 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249612.838543892
I0418 09:46:52.838637 2829 master.cpp:1147] Framework failover timeout, removing framework 201304180946-2113820480-5050-2815-0000
I0418 09:46:52.838757 2829 simple_allocator.cpp:59] Removed framework 201304180946-2113820480-5050-2815-0000
I0418 09:46:52.838795 2829 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:46:52.843267 2833 pid.cpp:89] Attempting to parse '1@127.0.1.1:56060' into a PID
I0418 09:46:52.843329 2833 process.cpp:661] Parsed message name 'mesos.internal.RegisterFrameworkMessage' for master@192.168.1.130:5050 from 1@127.0.1.1:56060
I0418 09:46:52.843395 2832 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249612.843388081
I0418 09:46:52.843469 2832 master.cpp:526] Registering framework 201304180946-2113820480-5050-2815-0001 at 1@127.0.1.1:56060
I0418 09:46:52.843600 2833 process.cpp:1032] Socket error while connecting
I0418 09:46:52.843662 2832 simple_allocator.cpp:46] Added framework 201304180946-2113820480-5050-2815-0001
I0418 09:46:52.843739 2832 master.hpp:338] Calculating resources free on slave 201304180946-2113820480-5050-2815-0
Resources: cpus=4; mem=968
Resources Offered: cpus=0; mem=0
Resources In Use:
Resources Free: cpus=4; mem=968
I0418 09:46:52.843806 2832 simple_allocator.cpp:263] Found available resources: cpus=4; mem=968 on slave 201304180946-2113820480-5050-2815-0
I0418 09:46:52.843844 2832 simple_allocator.cpp:290] Offering cpus=4; mem=968 on slave 201304180946-2113820480-5050-2815-0 to framework 201304180946-2113820480-5050-2815-0001
I0418 09:46:52.843894 2832 master.hpp:290] Adding offer with resources cpus=4; mem=968 on slave 201304180946-2113820480-5050-2815-0
I0418 09:46:52.843947 2832 master.cpp:1188] Sending 1 offers to framework 201304180946-2113820480-5050-2815-0001
I0418 09:46:52.844069 2832 master.cpp:430] Framework 201304180946-2113820480-5050-2815-0001 disconnected
I0418 09:46:52.844073 2833 process.cpp:891] Socket error while sending: Connection refused
I0418 09:46:52.844126 2832 process.cpp:2466] Created a timer for 1366249613.844120979
I0418 09:46:52.844203 2832 simple_allocator.cpp:124] Recovered cpus=4; mem=968 on slave 201304180946-2113820480-5050-2815-0 from framework 201304180946-2113820480-5050-2815-0001
I0418 09:46:52.844248 2832 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:46:52.844281 2832 master.hpp:299] Removing offer with resources cpus=4; mem=968 on slave 201304180946-2113820480-5050-2815-0
I0418 09:46:53.558348 2833 process.cpp:1007] Socket error while connecting
I0418 09:46:53.570858 2833 process.cpp:724] Handling timeouts up to 1366249613.570848942
I0418 09:46:53.570952 2833 process.cpp:732] Have timeout(s) at 1366249613.561227083
I0418 09:46:53.571050 2830 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249613.571043968
I0418 09:46:53.571138 2830 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:46:53.571172 2830 process.cpp:2466] Created a timer for 1366249614.571170092
I0418 09:46:53.848353 2833 process.cpp:724] Handling timeouts up to 1366249613.848345995
I0418 09:46:53.848425 2833 process.cpp:732] Have timeout(s) at 1366249613.844120979
I0418 09:46:53.848541 2831 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249613.848530054
I0418 09:46:53.848613 2831 master.cpp:1147] Framework failover timeout, removing framework 201304180946-2113820480-5050-2815-0001
I0418 09:46:53.848717 2831 simple_allocator.cpp:59] Removed framework 201304180946-2113820480-5050-2815-0001
I0418 09:46:53.848754 2831 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:46:53.853513 2833 pid.cpp:89] Attempting to parse '1@127.0.1.1:56060' into a PID
I0418 09:46:53.853575 2833 process.cpp:661] Parsed message name 'mesos.internal.RegisterFrameworkMessage' for master@192.168.1.130:5050 from 1@127.0.1.1:56060
I0418 09:46:53.853713 2829 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249613.853703022
I0418 09:46:53.853809 2829 master.cpp:526] Registering framework 201304180946-2113820480-5050-2815-0002 at 1@127.0.1.1:56060
I0418 09:46:53.853971 2829 simple_allocator.cpp:46] Added framework 201304180946-2113820480-5050-2815-0002
I0418 09:46:53.853981 2833 process.cpp:1032] Socket error while connecting
I0418 09:46:53.854032 2829 master.hpp:338] Calculating resources free on slave 201304180946-2113820480-5050-2815-0
Resources: cpus=4; mem=968
Resources Offered: cpus=0; mem=0
Resources In Use:
Resources Free: cpus=4; mem=968
I0418 09:46:53.854090 2829 simple_allocator.cpp:263] Found available resources: cpus=4; mem=968 on slave 201304180946-2113820480-5050-2815-0
I0418 09:46:53.854127 2829 simple_allocator.cpp:290] Offering cpus=4; mem=968 on slave 201304180946-2113820480-5050-2815-0 to framework 201304180946-2113820480-5050-2815-0002
I0418 09:46:53.854176 2829 master.hpp:290] Adding offer with resources cpus=4; mem=968 on slave 201304180946-2113820480-5050-2815-0
I0418 09:46:53.854225 2829 master.cpp:1188] Sending 1 offers to framework 201304180946-2113820480-5050-2815-0002
I0418 09:46:53.854337 2829 master.cpp:430] Framework 201304180946-2113820480-5050-2815-0002 disconnected
I0418 09:46:53.854377 2829 process.cpp:2466] Created a timer for 1366249614.854372978
I0418 09:46:53.854378 2833 process.cpp:891] Socket error while sending: Connection refused
I0418 09:46:53.854431 2829 simple_allocator.cpp:124] Recovered cpus=4; mem=968 on slave 201304180946-2113820480-5050-2815-0 from framework 201304180946-2113820480-5050-2815-0002
I0418 09:46:53.854472 2829 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:46:53.854506 2829 master.hpp:299] Removing offer with resources cpus=4; mem=968 on slave 201304180946-2113820480-5050-2815-0
I0418 09:46:54.568375 2833 process.cpp:1007] Socket error while connecting
I0418 09:46:54.580858 2833 process.cpp:724] Handling timeouts up to 1366249614.580849886
I0418 09:46:54.580950 2833 process.cpp:732] Have timeout(s) at 1366249614.571170092
I0418 09:46:54.581046 2832 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249614.581036091
I0418 09:46:54.581114 2832 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:46:54.581143 2832 process.cpp:2466] Created a timer for 1366249615.581140995
I0418 09:46:54.858355 2833 process.cpp:724] Handling timeouts up to 1366249614.858344078
I0418 09:46:54.858443 2833 process.cpp:732] Have timeout(s) at 1366249614.854372978
I0418 09:46:54.858535 2832 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249614.858526945
I0418 09:46:54.858593 2832 master.cpp:1147] Framework failover timeout, removing framework 201304180946-2113820480-5050-2815-0002
I0418 09:46:54.858697 2832 simple_allocator.cpp:59] Removed framework 201304180946-2113820480-5050-2815-0002
I0418 09:46:54.858757 2832 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:46:54.866071 2833 pid.cpp:89] Attempting to parse '1@127.0.1.1:56060' into a PID
I0418 09:46:54.866133 2833 process.cpp:661] Parsed message name 'mesos.internal.RegisterFrameworkMessage' for master@192.168.1.130:5050 from 1@127.0.1.1:56060
I0418 09:46:54.866204 2830 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249614.866194963
I0418 09:46:54.866278 2830 master.cpp:526] Registering framework 201304180946-2113820480-5050-2815-0003 at 1@127.0.1.1:56060
I0418 09:46:54.866408 2833 process.cpp:1032] Socket error while connecting
I0418 09:46:54.866453 2830 simple_allocator.cpp:46] Added framework 201304180946-2113820480-5050-2815-0003
I0418 09:46:54.866526 2830 master.hpp:338] Calculating resources free on slave 201304180946-2113820480-5050-2815-0
Resources: cpus=4; mem=968
Resources Offered: cpus=0; mem=0
Resources In Use:
Resources Free: cpus=4; mem=968
I0418 09:46:54.866636 2830 simple_allocator.cpp:263] Found available resources: cpus=4; mem=968 on slave 201304180946-2113820480-5050-2815-0
I0418 09:46:54.866677 2830 simple_allocator.cpp:290] Offering cpus=4; mem=968 on slave 201304180946-2113820480-5050-2815-0 to framework 201304180946-2113820480-5050-2815-0003
I0418 09:46:54.866727 2830 master.hpp:290] Adding offer with resources cpus=4; mem=968 on slave 201304180946-2113820480-5050-2815-0
I0418 09:46:54.866775 2830 master.cpp:1188] Sending 1 offers to framework 201304180946-2113820480-5050-2815-0003
I0418 09:46:54.866897 2830 master.cpp:430] Framework 201304180946-2113820480-5050-2815-0003 disconnected
I0418 09:46:54.866900 2833 process.cpp:891] Socket error while sending: Connection refused
I0418 09:46:54.866962 2830 process.cpp:2466] Created a timer for 1366249615.866955996
I0418 09:46:54.867041 2830 simple_allocator.cpp:124] Recovered cpus=4; mem=968 on slave 201304180946-2113820480-5050-2815-0 from framework 201304180946-2113820480-5050-2815-0003
I0418 09:46:54.867086 2830 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:46:54.867120 2830 master.hpp:299] Removing offer with resources cpus=4; mem=968 on slave 201304180946-2113820480-5050-2815-0
I0418 09:46:55.578372 2833 process.cpp:1007] Socket error while connecting
I0418 09:46:55.600846 2833 process.cpp:724] Handling timeouts up to 1366249615.600836992
I0418 09:46:55.600939 2833 process.cpp:732] Have timeout(s) at 1366249615.581140995
I0418 09:46:55.601070 2831 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249615.601058960
I0418 09:46:55.601171 2831 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:46:55.601219 2831 process.cpp:2466] Created a timer for 1366249616.601216078
I0418 09:46:55.716205 2833 process.cpp:834] Socket closed while receiving
I0418 09:46:55.868329 2833 process.cpp:724] Handling timeouts up to 1366249615.868318081
I0418 09:46:55.868412 2833 process.cpp:732] Have timeout(s) at 1366249615.866955996
I0418 09:46:55.868537 2829 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249615.868525028
I0418 09:46:55.868618 2829 master.cpp:1147] Framework failover timeout, removing framework 201304180946-2113820480-5050-2815-0003
I0418 09:46:55.868721 2829 simple_allocator.cpp:59] Removed framework 201304180946-2113820480-5050-2815-0003
I0418 09:46:55.868759 2829 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:46:56.608368 2833 process.cpp:724] Handling timeouts up to 1366249616.608355045
I0418 09:46:56.608464 2833 process.cpp:732] Have timeout(s) at 1366249616.601216078
I0418 09:46:56.609606 2832 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249616.609596968
I0418 09:46:56.609675 2832 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:46:56.609705 2832 process.cpp:2466] Created a timer for 1366249617.609703064
I0418 09:46:57.610813 2833 process.cpp:724] Handling timeouts up to 1366249617.610800982
I0418 09:46:57.610910 2833 process.cpp:732] Have timeout(s) at 1366249617.609703064
I0418 09:46:57.611009 2830 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249617.611001968
I0418 09:46:57.611083 2830 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:46:57.611115 2830 process.cpp:2466] Created a timer for 1366249618.611113071
I0418 09:46:58.620832 2833 process.cpp:724] Handling timeouts up to 1366249618.620822906
I0418 09:46:58.620923 2833 process.cpp:732] Have timeout(s) at 1366249618.611113071
I0418 09:46:58.621048 2831 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249618.621037960
I0418 09:46:58.621132 2831 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:46:58.621165 2831 process.cpp:2466] Created a timer for 1366249619.621161938
I0418 09:46:59.630839 2833 process.cpp:724] Handling timeouts up to 1366249619.630825996
I0418 09:46:59.630946 2833 process.cpp:732] Have timeout(s) at 1366249619.621161938
I0418 09:46:59.631081 2829 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249619.631071091
I0418 09:46:59.631237 2829 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:46:59.631274 2829 process.cpp:2466] Created a timer for 1366249620.631270885
I0418 09:46:59.857597 2833 process.cpp:834] Socket closed while receiving
I0418 09:46:59.857712 2833 process.cpp:834] Socket closed while receiving
I0418 09:46:59.857820 2832 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249619.857806921
I0418 09:46:59.857890 2832 master.cpp:455] Slave 201304180946-2113820480-5050-2815-0 disconnected
I0418 09:46:59.858016 2830 process.cpp:2115] Resuming 2@192.168.1.130:5050 at 1366249619.858009100
I0418 09:46:59.858067 2830 process.cpp:2183] Cleaning up 2@192.168.1.130:5050
I0418 09:46:59.858212 2832 simple_allocator.cpp:81] Removed slave 201304180946-2113820480-5050-2815-0
I0418 09:47:00.640840 2833 process.cpp:724] Handling timeouts up to 1366249620.640825033
I0418 09:47:00.640950 2833 process.cpp:732] Have timeout(s) at 1366249620.631270885
I0418 09:47:00.641089 2829 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249620.641077042
I0418 09:47:00.641176 2829 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:47:00.641208 2829 process.cpp:2466] Created a timer for 1366249621.641206026
I0418 09:47:01.650830 2833 process.cpp:724] Handling timeouts up to 1366249621.650820017
I0418 09:47:01.650930 2833 process.cpp:732] Have timeout(s) at 1366249621.641206026
I0418 09:47:01.652197 2831 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249621.652189016
I0418 09:47:01.652287 2831 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:47:01.652320 2831 process.cpp:2466] Created a timer for 1366249622.652318001
I0418 09:47:02.660867 2833 process.cpp:724] Handling timeouts up to 1366249622.660821915
I0418 09:47:02.660995 2833 process.cpp:732] Have timeout(s) at 1366249622.652318001
I0418 09:47:02.661105 2830 process.cpp:2115] Resuming master@192.168.1.130:5050 at 1366249622.661096096
I0418 09:47:02.661177 2830 simple_allocator.cpp:236] No frameworks to allocate resources!
I0418 09:47:02.661208 2830 process.cpp:2466] Created a timer for 1366249623.661206007
2. On the slave node (192.168.1.132), we ran "bin/mesos-slave.sh --ip=192.168.1.132 --master=192.168.1.130:5050 --log_dir=logs".
Log file created at: 2013/04/18 09:46:47
Running on machine: hdfs2
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0418 09:46:47.121172 3660 logging.cpp:72] Logging to logs
I0418 09:46:47.122092 3660 process.cpp:2105] Spawned process __gc__@192.168.1.132:60675
I0418 09:46:47.122117 3675 process.cpp:2115] Resuming __gc__@192.168.1.132:60675 at 1366249607.122102976
I0418 09:46:47.122170 3660 process.cpp:1346] libprocess is initialized on 192.168.1.132:60675 for 4 cpus
I0418 09:46:47.122236 3660 main.cpp:111] Creating "process" isolation module
I0418 09:46:47.122333 3660 process.cpp:2105] Spawned process 2@192.168.1.132:60675
I0418 09:46:47.122396 3660 main.cpp:119] Build: 2013-01-22 20:32:32 by hadoop
I0418 09:46:47.122385 3674 process.cpp:2115] Resuming 2@192.168.1.132:60675 at 1366249607.122374058
I0418 09:46:47.122421 3660 main.cpp:120] Starting Mesos slave
I0418 09:46:47.122478 3674 process.cpp:2466] Created a timer for 1366249608.122467995
I0418 09:46:47.122712 3660 process.cpp:2105] Spawned process slave@192.168.1.132:60675
I0418 09:46:47.122788 3660 pid.cpp:89] Attempting to parse 'master@192.168.1.130:5050' into a PID
I0418 09:46:47.122761 3676 process.cpp:2115] Resuming slave@192.168.1.132:60675 at 1366249607.122751951
I0418 09:46:47.122869 3676 slave.cpp:191] Slave started on 192.168.1.132:60675
I0418 09:46:47.122895 3676 slave.cpp:192] Slave resources: cpus=4; mem=968
I0418 09:46:47.123317 3676 process.cpp:2105] Spawned process 1@192.168.1.132:60675
I0418 09:46:47.123337 3675 process.cpp:2115] Resuming 1@192.168.1.132:60675 at 1366249607.123330116
I0418 09:46:47.124335 3676 pid.cpp:89] Attempting to parse 'master@192.168.1.130:5050' into a PID
I0418 09:46:47.124419 3676 slave.cpp:357] New master detected at master@192.168.1.130:5050
I0418 09:46:47.124946 3676 process.cpp:2466] Created a timer for 1366249608.124938965
I0418 09:46:47.126811 3678 pid.cpp:89] Attempting to parse 'master@192.168.1.130:5050' into a PID
I0418 09:46:47.126903 3678 process.cpp:661] Parsed message name 'mesos.internal.SlaveRegisteredMessage' for slave@192.168.1.132:60675 from master@192.168.1.130:5050
I0418 09:46:47.127010 3675 process.cpp:2115] Resuming slave@192.168.1.132:60675 at 1366249607.126986027
I0418 09:46:47.127064 3678 pid.cpp:89] Attempting to parse '2@192.168.1.130:5050' into a PID
I0418 09:46:47.127089 3675 slave.cpp:377] Registered with master; given slave ID 201304180946-2113820480-5050-2815-0
I0418 09:46:47.127116 3678 process.cpp:661] Parsed message name 'PING' for slave@192.168.1.132:60675 from 2@192.168.1.130:5050
I0418 09:46:47.127190 3677 process.cpp:2115] Resuming slave@192.168.1.132:60675 at 1366249607.127182007
I0418 09:46:47.135381 3679 webui_utils.cpp:45] Loading webui script at '/home/hadoop/mesos-0.9.0/src/webui/slave/webui.py'
I0418 09:46:48.133492 3678 process.cpp:724] Handling timeouts up to 1366249608.133472919
I0418 09:46:48.133604 3678 process.cpp:732] Have timeout(s) at 1366249608.122467995
I0418 09:46:48.133666 3678 process.cpp:732] Have timeout(s) at 1366249608.124938965
I0418 09:46:48.133784 3675 process.cpp:2115] Resuming slave@192.168.1.132:60675 at 1366249608.133776903
I0418 09:46:48.133785 3674 process.cpp:2115] Resuming 2@192.168.1.132:60675 at 1366249608.133773088
I0418 09:46:48.133884 3674 process.cpp:2466] Created a timer for 1366249609.133877993
I0418 09:46:49.143476 3678 process.cpp:724] Handling timeouts up to 1366249609.143466949
I0418 09:46:49.143530 3678 process.cpp:732] Have timeout(s) at 1366249609.133877993
I0418 09:46:49.143633 3677 process.cpp:2115] Resuming 2@192.168.1.132:60675 at 1366249609.143625975
I0418 09:46:49.143702 3677 process.cpp:2466] Created a timer for 1366249610.143698931
I0418 09:46:50.153461 3678 process.cpp:724] Handling timeouts up to 1366249610.153449059
I0418 09:46:50.153537 3678 process.cpp:732] Have timeout(s) at 1366249610.143698931
I0418 09:46:50.153627 3675 process.cpp:2115] Resuming 2@192.168.1.132:60675 at 1366249610.153620005
I0418 09:46:50.153688 3675 process.cpp:2466] Created a timer for 1366249611.153685093
I0418 09:46:50.907402 3678 pid.cpp:89] Attempting to parse 'master@192.168.1.130:5050' into a PID
I0418 09:46:50.907485 3678 process.cpp:661] Parsed message name 'mesos.internal.ShutdownFrameworkMessage' for slave@192.168.1.132:60675 from master@192.168.1.130:5050
I0418 09:46:50.907559 3674 process.cpp:2115] Resuming slave@192.168.1.132:60675 at 1366249610.907550097
I0418 09:46:50.907634 3674 slave.cpp:604] Asked to shut down framework 201304180946-2113820480-5050-2815-0000
I0418 09:46:51.163470 3678 process.cpp:724] Handling timeouts up to 1366249611.163460970
I0418 09:46:51.163544 3678 process.cpp:732] Have timeout(s) at 1366249611.153685093
I0418 09:46:51.163625 3676 process.cpp:2115] Resuming 2@192.168.1.132:60675 at 1366249611.163619041
I0418 09:46:51.163687 3676 process.cpp:2466] Created a timer for 1366249612.163682938
I0418 09:46:51.917239 3678 pid.cpp:89] Attempting to parse 'master@192.168.1.130:5050' into a PID
I0418 09:46:51.917314 3678 process.cpp:661] Parsed message name 'mesos.internal.ShutdownFrameworkMessage' for slave@192.168.1.132:60675 from master@192.168.1.130:5050
I0418 09:46:51.917415 3677 process.cpp:2115] Resuming slave@192.168.1.132:60675 at 1366249611.917406082
I0418 09:46:51.917492 3677 slave.cpp:604] Asked to shut down framework 201304180946-2113820480-5050-2815-0001
I0418 09:46:52.173475 3678 process.cpp:724] Handling timeouts up to 1366249612.173466921
I0418 09:46:52.173552 3678 process.cpp:732] Have timeout(s) at 1366249612.163682938
I0418 09:46:52.174325 3675 process.cpp:2115] Resuming 2@192.168.1.132:60675 at 1366249612.174318075
I0418 09:46:52.174408 3675 process.cpp:2466] Created a timer for 1366249613.174405098
I0418 09:46:52.927047 3678 pid.cpp:89] Attempting to parse 'master@192.168.1.130:5050' into a PID
I0418 09:46:52.927119 3678 process.cpp:661] Parsed message name 'mesos.internal.ShutdownFrameworkMessage' for slave@192.168.1.132:60675 from master@192.168.1.130:5050
I0418 09:46:52.927191 3674 process.cpp:2115] Resuming slave@192.168.1.132:60675 at 1366249612.927184105
I0418 09:46:52.927253 3674 slave.cpp:604] Asked to shut down framework 201304180946-2113820480-5050-2815-0002
I0418 09:46:53.183476 3678 process.cpp:724] Handling timeouts up to 1366249613.183468103
I0418 09:46:53.183549 3678 process.cpp:732] Have timeout(s) at 1366249613.174405098
I0418 09:46:53.183629 3676 process.cpp:2115] Resuming 2@192.168.1.132:60675 at 1366249613.183624029
I0418 09:46:53.183691 3676 process.cpp:2466] Created a timer for 1366249614.183686018
I0418 09:46:53.936926 3678 pid.cpp:89] Attempting to parse 'master@192.168.1.130:5050' into a PID
I0418 09:46:53.937006 3678 process.cpp:661] Parsed message name 'mesos.internal.ShutdownFrameworkMessage' for slave@192.168.1.132:60675 from master@192.168.1.130:5050
I0418 09:46:53.937109 3677 process.cpp:2115] Resuming slave@192.168.1.132:60675 at 1366249613.937099934
I0418 09:46:53.937188 3677 slave.cpp:604] Asked to shut down framework 201304180946-2113820480-5050-2815-0003
I0418 09:46:54.193462 3678 process.cpp:724] Handling timeouts up to 1366249614.193454027
I0418 09:46:54.193536 3678 process.cpp:732] Have timeout(s) at 1366249614.183686018
I0418 09:46:54.193646 3675 process.cpp:2115] Resuming 2@192.168.1.132:60675 at 1366249614.193638086
I0418 09:46:54.193738 3675 process.cpp:2466] Created a timer for 1366249615.193733931
I0418 09:46:55.203474 3678 process.cpp:724] Handling timeouts up to 1366249615.203466892
I0418 09:46:55.203547 3678 process.cpp:732] Have timeout(s) at 1366249615.193733931
I0418 09:46:55.203629 3674 process.cpp:2115] Resuming 2@192.168.1.132:60675 at 1366249615.203622103
I0418 09:46:55.203691 3674 process.cpp:2466] Created a timer for 1366249616.203687906
I0418 09:46:56.213476 3678 process.cpp:724] Handling timeouts up to 1366249616.213468075
I0418 09:46:56.213551 3678 process.cpp:732] Have timeout(s) at 1366249616.203687906
I0418 09:46:56.213635 3676 process.cpp:2115] Resuming 2@192.168.1.132:60675 at 1366249616.213629007
I0418 09:46:56.213701 3676 process.cpp:2466] Created a timer for 1366249617.213696957
I0418 09:46:57.230988 3678 process.cpp:724] Handling timeouts up to 1366249617.230971098
I0418 09:46:57.231160 3678 process.cpp:732] Have timeout(s) at 1366249617.213696957
I0418 09:46:57.231835 3677 process.cpp:2115] Resuming 2@192.168.1.132:60675 at 1366249617.231797934
I0418 09:46:57.231915 3677 process.cpp:2466] Created a timer for 1366249618.231911898
3. On the slave node (192.168.1.132), we ran "src/test-framework 192.168.1.130:5050".
Re: Does Mesos support running a job from a slave node?
Posted by Benjamin Mahler <be...@gmail.com>.
Hi Xiaoying, can you re-run with GLOG_v=2 in your environment? This will
enable verbose logging which may help us diagnose better.
Thanks!
On Wed, Apr 17, 2013 at 12:50 AM, Xiaoying Zheng <zh...@sari.ac.cn> wrote:
> hi,
>
> Without specifying IP at the slave node, the slave node itself kept
> connecting and disconnecting to the master. Thanks.
>
>
> 1. On the master node (192.168.1.130), we ran "bin/mesos-master.sh
> --ip=192.168.1.130".
>
> Log file created at: 2013/04/17 15:47:03
>
> Running on machine: master
> Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
> I0417 15:47:03.479331 4381 logging.cpp:72] Logging to logs
> I0417 15:47:03.480342 4381 main.cpp:105] Build: 2013-01-22 20:32:32 by
> hadoop
> I0417 15:47:03.480383 4381 main.cpp:106] Starting Mesos master
> I0417 15:47:03.480571 4398 master.cpp:268] Master started on
> 192.168.1.130:5050
> I0417 15:47:03.480655 4398 master.cpp:283] Master ID:
> 201304171547-2113820480-5050-**4381
> I0417 15:47:03.482028 4398 master.cpp:483] Elected as master!
> I0417 15:47:03.493221 4400 webui_utils.cpp:45] Loading webui script at
> '/home/hadoop/mesos-0.9.0/src/**webui/master/webui.py'
> I0417 15:47:12.886644 4396 master.cpp:844] Attempting to register slave
> 201304171547-2113820480-5050-**4381-0 at slave@127.0.1.1:36966
> I0417 15:47:12.886725 4396 master.cpp:1097] Master now considering a
> slave at hdfs2:36966 as active
> I0417 15:47:12.886754 4396 master.cpp:1633] Adding slave
> 201304171547-2113820480-5050-**4381-0 at hdfs2 with cpus=4; mem=968
> I0417 15:47:12.887498 4396 simple_allocator.cpp:69] Added slave
> 201304171547-2113820480-5050-**4381-0 with cpus=4; mem=968
> I0417 15:47:12.887603 4396 master.cpp:455] Slave
> 201304171547-2113820480-5050-**4381-0 disconnected
> I0417 15:47:12.887863 4396 simple_allocator.cpp:81] Removed slave
> 201304171547-2113820480-5050-**4381-0
> I0417 15:47:13.893245 4398 master.cpp:844] Attempting to register slave
> 201304171547-2113820480-5050-**4381-1 at slave@127.0.1.1:36966
> I0417 15:47:13.893322 4398 master.cpp:1097] Master now considering a
> slave at hdfs2:36966 as active
> I0417 15:47:13.893344 4398 master.cpp:1633] Adding slave
> 201304171547-2113820480-5050-**4381-1 at hdfs2 with cpus=4; mem=968
> I0417 15:47:13.893545 4398 simple_allocator.cpp:69] Added slave
> 201304171547-2113820480-5050-**4381-1 with cpus=4; mem=968
> I0417 15:47:13.893630 4398 master.cpp:455] Slave
> 201304171547-2113820480-5050-**4381-1 disconnected
> I0417 15:47:13.893779 4398 simple_allocator.cpp:81] Removed slave
> 201304171547-2113820480-5050-**4381-1
> I0417 15:47:14.903282 4396 master.cpp:844] Attempting to register slave
> 201304171547-2113820480-5050-**4381-2 at slave@127.0.1.1:36966
> I0417 15:47:14.903359 4396 master.cpp:1097] Master now considering a
> slave at hdfs2:36966 as active
> I0417 15:47:14.903381 4396 master.cpp:1633] Adding slave
> 201304171547-2113820480-5050-**4381-2 at hdfs2 with cpus=4; mem=968
> I0417 15:47:14.903586 4396 simple_allocator.cpp:69] Added slave
> 201304171547-2113820480-5050-**4381-2 with cpus=4; mem=968
> I0417 15:47:14.903662 4396 master.cpp:455] Slave
> 201304171547-2113820480-5050-**4381-2 disconnected
> I0417 15:47:14.903825 4396 simple_allocator.cpp:81] Removed slave
> 201304171547-2113820480-5050-**4381-2
> I0417 15:47:15.913488 4398 master.cpp:844] Attempting to register slave
> 201304171547-2113820480-5050-**4381-3 at slave@127.0.1.1:36966
> I0417 15:47:15.913547 4398 master.cpp:1097] Master now considering a
> slave at hdfs2:36966 as active
> I0417 15:47:15.913568 4398 master.cpp:1633] Adding slave
> 201304171547-2113820480-5050-**4381-3 at hdfs2 with cpus=4; mem=968
> I0417 15:47:15.913749 4398 simple_allocator.cpp:69] Added slave
> 201304171547-2113820480-5050-**4381-3 with cpus=4; mem=968
> I0417 15:47:15.913833 4398 master.cpp:455] Slave
> 201304171547-2113820480-5050-**4381-3 disconnected
> I0417 15:47:15.914034 4398 simple_allocator.cpp:81] Removed slave
> 201304171547-2113820480-5050-**4381-3
> I0417 15:47:16.923637 4395 master.cpp:844] Attempting to register slave
> 201304171547-2113820480-5050-**4381-4 at slave@127.0.1.1:36966
> I0417 15:47:16.923703 4395 master.cpp:1097] Master now considering a
> slave at hdfs2:36966 as active
> I0417 15:47:16.923727 4395 master.cpp:1633] Adding slave
> 201304171547-2113820480-5050-**4381-4 at hdfs2 with cpus=4; mem=968
> I0417 15:47:16.923910 4395 simple_allocator.cpp:69] Added slave
> 201304171547-2113820480-5050-**4381-4 with cpus=4; mem=968
> I0417 15:47:16.923984 4395 master.cpp:455] Slave
> 201304171547-2113820480-5050-**4381-4 disconnected
> I0417 15:47:16.924165 4395 simple_allocator.cpp:81] Removed slave
> 201304171547-2113820480-5050-**4381-4
> I0417 15:47:17.933886 4398 master.cpp:844] Attempting to register slave
> 201304171547-2113820480-5050-**4381-5 at slave@127.0.1.1:36966
> I0417 15:47:17.934022 4398 master.cpp:1097] Master now considering a
> slave at hdfs2:36966 as active
> I0417 15:47:17.934849 4398 master.cpp:1633] Adding slave
> 201304171547-2113820480-5050-**4381-5 at hdfs2 with cpus=4; mem=968
> I0417 15:47:17.935056 4398 simple_allocator.cpp:69] Added slave
> 201304171547-2113820480-5050-**4381-5 with cpus=4; mem=968
> I0417 15:47:17.935143 4398 master.cpp:455] Slave
> 201304171547-2113820480-5050-**4381-5 disconnected
> I0417 15:47:17.935303 4398 simple_allocator.cpp:81] Removed slave
> 201304171547-2113820480-5050-**4381-5
> I0417 15:47:18.944039 4396 master.cpp:844] Attempting to register slave
> 201304171547-2113820480-5050-**4381-6 at slave@127.0.1.1:36966
> I0417 15:47:18.944144 4396 master.cpp:1097] Master now considering a
> slave at hdfs2:36966 as active
> I0417 15:47:18.944172 4396 master.cpp:1633] Adding slave
> 201304171547-2113820480-5050-**4381-6 at hdfs2 with cpus=4; mem=968
> I0417 15:47:18.944496 4396 simple_allocator.cpp:69] Added slave
> 201304171547-2113820480-5050-**4381-6 with cpus=4; mem=968
> I0417 15:47:18.944571 4396 master.cpp:455] Slave
> 201304171547-2113820480-5050-**4381-6 disconnected
> I0417 15:47:18.944804 4396 simple_allocator.cpp:81] Removed slave
> 201304171547-2113820480-5050-**4381-6
> I0417 15:47:19.954175 4398 master.cpp:844] Attempting to register slave
> 201304171547-2113820480-5050-**4381-7 at slave@127.0.1.1:36966
> I0417 15:47:19.954265 4398 master.cpp:1097] Master now considering a
> slave at hdfs2:36966 as active
> I0417 15:47:19.954294 4398 master.cpp:1633] Adding slave
> 201304171547-2113820480-5050-**4381-7 at hdfs2 with cpus=4; mem=968
> I0417 15:47:19.954597 4398 simple_allocator.cpp:69] Added slave
> 201304171547-2113820480-5050-**4381-7 with cpus=4; mem=968
> I0417 15:47:19.954680 4398 master.cpp:455] Slave
> 201304171547-2113820480-5050-**4381-7 disconnected
> I0417 15:47:19.954807 4398 simple_allocator.cpp:81] Removed slave
> 201304171547-2113820480-5050-**4381-7
>
>
>
>
> 2. On the slave node (192.168.1.132), we ran "bin/mesos-master.sh --master=
> 192.168.1.130:5050".
>
> Log file created at: 2013/04/17 15:45:44
>
> Running on machine: hdfs2
> Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
> I0417 15:45:44.330966 2864 logging.cpp:72] Logging to logs
> I0417 15:45:44.332208 2864 main.cpp:111] Creating "process" isolation
> module
> I0417 15:45:44.332365 2864 main.cpp:119] Build: 2013-01-22 20:32:32 by
> hadoop
> I0417 15:45:44.332392 2864 main.cpp:120] Starting Mesos slave
> I0417 15:45:44.332712 2879 slave.cpp:191] Slave started on
> 127.0.1.1:36966
> I0417 15:45:44.332756 2879 slave.cpp:192] Slave resources: cpus=4; mem=968
> I0417 15:45:44.334221 2879 slave.cpp:357] New master detected at
> master@192.168.1.130:5050
> I0417 15:45:44.345507 2883 webui_utils.cpp:45] Loading webui script at
> '/home/hadoop/mesos-0.9.0/src/**webui/slave/webui.py'
> I0417 15:45:51.909643 2880 slave.cpp:1104] Process exited: @0.0.0.0:0
> W0417 15:45:51.909715 2880 slave.cpp:1107] WARNING! Master disconnected!
> Waiting for a new master to be elected.
>
>
>
Re: Does Mesos support running a job from a slave node?
Posted by Xiaoying Zheng <zh...@sari.ac.cn>.
hi,
Without specifying IP at the slave node, the slave node itself kept
connecting and disconnecting to the master. Thanks.
1. On the master node (192.168.1.130), we ran "bin/mesos-master.sh --ip=192.168.1.130".
Log file created at: 2013/04/17 15:47:03
Running on machine: master
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0417 15:47:03.479331 4381 logging.cpp:72] Logging to logs
I0417 15:47:03.480342 4381 main.cpp:105] Build: 2013-01-22 20:32:32 by hadoop
I0417 15:47:03.480383 4381 main.cpp:106] Starting Mesos master
I0417 15:47:03.480571 4398 master.cpp:268] Master started on 192.168.1.130:5050
I0417 15:47:03.480655 4398 master.cpp:283] Master ID: 201304171547-2113820480-5050-4381
I0417 15:47:03.482028 4398 master.cpp:483] Elected as master!
I0417 15:47:03.493221 4400 webui_utils.cpp:45] Loading webui script at '/home/hadoop/mesos-0.9.0/src/webui/master/webui.py'
I0417 15:47:12.886644 4396 master.cpp:844] Attempting to register slave 201304171547-2113820480-5050-4381-0 at slave@127.0.1.1:36966
I0417 15:47:12.886725 4396 master.cpp:1097] Master now considering a slave at hdfs2:36966 as active
I0417 15:47:12.886754 4396 master.cpp:1633] Adding slave 201304171547-2113820480-5050-4381-0 at hdfs2 with cpus=4; mem=968
I0417 15:47:12.887498 4396 simple_allocator.cpp:69] Added slave 201304171547-2113820480-5050-4381-0 with cpus=4; mem=968
I0417 15:47:12.887603 4396 master.cpp:455] Slave 201304171547-2113820480-5050-4381-0 disconnected
I0417 15:47:12.887863 4396 simple_allocator.cpp:81] Removed slave 201304171547-2113820480-5050-4381-0
I0417 15:47:13.893245 4398 master.cpp:844] Attempting to register slave 201304171547-2113820480-5050-4381-1 at slave@127.0.1.1:36966
I0417 15:47:13.893322 4398 master.cpp:1097] Master now considering a slave at hdfs2:36966 as active
I0417 15:47:13.893344 4398 master.cpp:1633] Adding slave 201304171547-2113820480-5050-4381-1 at hdfs2 with cpus=4; mem=968
I0417 15:47:13.893545 4398 simple_allocator.cpp:69] Added slave 201304171547-2113820480-5050-4381-1 with cpus=4; mem=968
I0417 15:47:13.893630 4398 master.cpp:455] Slave 201304171547-2113820480-5050-4381-1 disconnected
I0417 15:47:13.893779 4398 simple_allocator.cpp:81] Removed slave 201304171547-2113820480-5050-4381-1
I0417 15:47:14.903282 4396 master.cpp:844] Attempting to register slave 201304171547-2113820480-5050-4381-2 at slave@127.0.1.1:36966
I0417 15:47:14.903359 4396 master.cpp:1097] Master now considering a slave at hdfs2:36966 as active
I0417 15:47:14.903381 4396 master.cpp:1633] Adding slave 201304171547-2113820480-5050-4381-2 at hdfs2 with cpus=4; mem=968
I0417 15:47:14.903586 4396 simple_allocator.cpp:69] Added slave 201304171547-2113820480-5050-4381-2 with cpus=4; mem=968
I0417 15:47:14.903662 4396 master.cpp:455] Slave 201304171547-2113820480-5050-4381-2 disconnected
I0417 15:47:14.903825 4396 simple_allocator.cpp:81] Removed slave 201304171547-2113820480-5050-4381-2
I0417 15:47:15.913488 4398 master.cpp:844] Attempting to register slave 201304171547-2113820480-5050-4381-3 at slave@127.0.1.1:36966
I0417 15:47:15.913547 4398 master.cpp:1097] Master now considering a slave at hdfs2:36966 as active
I0417 15:47:15.913568 4398 master.cpp:1633] Adding slave 201304171547-2113820480-5050-4381-3 at hdfs2 with cpus=4; mem=968
I0417 15:47:15.913749 4398 simple_allocator.cpp:69] Added slave 201304171547-2113820480-5050-4381-3 with cpus=4; mem=968
I0417 15:47:15.913833 4398 master.cpp:455] Slave 201304171547-2113820480-5050-4381-3 disconnected
I0417 15:47:15.914034 4398 simple_allocator.cpp:81] Removed slave 201304171547-2113820480-5050-4381-3
I0417 15:47:16.923637 4395 master.cpp:844] Attempting to register slave 201304171547-2113820480-5050-4381-4 at slave@127.0.1.1:36966
I0417 15:47:16.923703 4395 master.cpp:1097] Master now considering a slave at hdfs2:36966 as active
I0417 15:47:16.923727 4395 master.cpp:1633] Adding slave 201304171547-2113820480-5050-4381-4 at hdfs2 with cpus=4; mem=968
I0417 15:47:16.923910 4395 simple_allocator.cpp:69] Added slave 201304171547-2113820480-5050-4381-4 with cpus=4; mem=968
I0417 15:47:16.923984 4395 master.cpp:455] Slave 201304171547-2113820480-5050-4381-4 disconnected
I0417 15:47:16.924165 4395 simple_allocator.cpp:81] Removed slave 201304171547-2113820480-5050-4381-4
I0417 15:47:17.933886 4398 master.cpp:844] Attempting to register slave 201304171547-2113820480-5050-4381-5 at slave@127.0.1.1:36966
I0417 15:47:17.934022 4398 master.cpp:1097] Master now considering a slave at hdfs2:36966 as active
I0417 15:47:17.934849 4398 master.cpp:1633] Adding slave 201304171547-2113820480-5050-4381-5 at hdfs2 with cpus=4; mem=968
I0417 15:47:17.935056 4398 simple_allocator.cpp:69] Added slave 201304171547-2113820480-5050-4381-5 with cpus=4; mem=968
I0417 15:47:17.935143 4398 master.cpp:455] Slave 201304171547-2113820480-5050-4381-5 disconnected
I0417 15:47:17.935303 4398 simple_allocator.cpp:81] Removed slave 201304171547-2113820480-5050-4381-5
I0417 15:47:18.944039 4396 master.cpp:844] Attempting to register slave 201304171547-2113820480-5050-4381-6 at slave@127.0.1.1:36966
I0417 15:47:18.944144 4396 master.cpp:1097] Master now considering a slave at hdfs2:36966 as active
I0417 15:47:18.944172 4396 master.cpp:1633] Adding slave 201304171547-2113820480-5050-4381-6 at hdfs2 with cpus=4; mem=968
I0417 15:47:18.944496 4396 simple_allocator.cpp:69] Added slave 201304171547-2113820480-5050-4381-6 with cpus=4; mem=968
I0417 15:47:18.944571 4396 master.cpp:455] Slave 201304171547-2113820480-5050-4381-6 disconnected
I0417 15:47:18.944804 4396 simple_allocator.cpp:81] Removed slave 201304171547-2113820480-5050-4381-6
I0417 15:47:19.954175 4398 master.cpp:844] Attempting to register slave 201304171547-2113820480-5050-4381-7 at slave@127.0.1.1:36966
I0417 15:47:19.954265 4398 master.cpp:1097] Master now considering a slave at hdfs2:36966 as active
I0417 15:47:19.954294 4398 master.cpp:1633] Adding slave 201304171547-2113820480-5050-4381-7 at hdfs2 with cpus=4; mem=968
I0417 15:47:19.954597 4398 simple_allocator.cpp:69] Added slave 201304171547-2113820480-5050-4381-7 with cpus=4; mem=968
I0417 15:47:19.954680 4398 master.cpp:455] Slave 201304171547-2113820480-5050-4381-7 disconnected
I0417 15:47:19.954807 4398 simple_allocator.cpp:81] Removed slave 201304171547-2113820480-5050-4381-7
2. On the slave node (192.168.1.132), we ran "bin/mesos-master.sh --master=192.168.1.130:5050".
Log file created at: 2013/04/17 15:45:44
Running on machine: hdfs2
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0417 15:45:44.330966 2864 logging.cpp:72] Logging to logs
I0417 15:45:44.332208 2864 main.cpp:111] Creating "process" isolation module
I0417 15:45:44.332365 2864 main.cpp:119] Build: 2013-01-22 20:32:32 by hadoop
I0417 15:45:44.332392 2864 main.cpp:120] Starting Mesos slave
I0417 15:45:44.332712 2879 slave.cpp:191] Slave started on 127.0.1.1:36966
I0417 15:45:44.332756 2879 slave.cpp:192] Slave resources: cpus=4; mem=968
I0417 15:45:44.334221 2879 slave.cpp:357] New master detected at master@192.168.1.130:5050
I0417 15:45:44.345507 2883 webui_utils.cpp:45] Loading webui script at '/home/hadoop/mesos-0.9.0/src/webui/slave/webui.py'
I0417 15:45:51.909643 2880 slave.cpp:1104] Process exited: @0.0.0.0:0
W0417 15:45:51.909715 2880 slave.cpp:1107] WARNING! Master disconnected! Waiting for a new master to be elected.