You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@mesos.apache.org by Sammy Steele <sa...@stanford.edu> on 2014/07/03 20:29:12 UTC
Running test-executor
I am trying to figure out how to run the python test-executor given in the
mesos code base. Based on the documentation at:
http://mesos.apache.org/documentation/latest/app-framework-development-guide/,
I tried starting my slaves with the command: ./bin/mesos-slave.sh
--ip=10.79.6.72 --master=10.79.6.70:5050
--frameworks_home=../src/examples/python.
I know that I can't launch the test-executor directly (the mesos_slave_pid
is unspecified). Exactly what command should I be using to launch the
executor? Thanks!
Re: Running test-executor
Posted by Sammy Steele <sa...@stanford.edu>.
Thanks so much! I am really new to mesos and would never have figured that
out on my own!
On Thu, Jul 3, 2014 at 2:18 PM, Vinod Kone <vi...@gmail.com> wrote:
> What you have pasted here is the master's log not the slave's.
>
> More importantly, that "Starting executor" message from the executor will
> not be in slave's log either. Executor's output is redirected to "stdout"
> and "stderr" in the executor's sandbox directory.
>
> A typical location of the executor sandbox is like this:
> /tmp/mesos/slaves/<slave-id>/frameworks/<framework-id>/executors/<executor-id>/runs/latest/
>
> The exact sandbox path should be logged in the slave's log during the time
> of the launch.
>
> FWIW, the test-executor did run successfully, because the tasks wouldn't
> have reached TASK_FINISHED state (state 2) otherwise.
>
>
> On Thu, Jul 3, 2014 at 1:57 PM, Sammy Steele <sa...@stanford.edu>
> wrote:
>
>> Hi Vinod,
>>
>> Thanks for your advice. That is what I originally thought, and I was
>> originally trying to run the test-executor through the test-framework
>> provided in the same examples folder. For some reason the test-executor
>> doesn't appear to execute when I run the test-framework. The output of the
>> test-framework is:
>>
>> I0703 13:48:00.664995 17052 sched.cpp:126] Version: 0.19.0
>> I0703 13:48:00.667441 17086 sched.cpp:222] New master detected at
>> master@10.79.6.70:5050
>> I0703 13:48:00.667635 17086 sched.cpp:230] No credentials provided.
>> Attempting to register without authentication
>> I0703 13:48:00.668550 17086 sched.cpp:397] Framework registered with
>> 20140703-125251-1174818570-5050-14218-0013
>> Registered with framework ID 20140703-125251-1174818570-5050-14218-0013
>> Got 1 resource offers
>> Got resource offer 20140703-125251-1174818570-5050-14218-13
>> Accepting offer on hotbox-32.Stanford.EDU to start task 0
>> Task 0 is in state 1
>> Task 0 is in state 2
>> Received message: 'data with a \x00 byte'
>> Got 1 resource offers
>> Got resource offer 20140703-125251-1174818570-5050-14218-14
>> Accepting offer on hotbox-32.Stanford.EDU to start task 1
>> Task 1 is in state 1
>> Task 1 is in state 2
>> Received message: 'data with a \x00 byte'
>> Got 1 resource offers
>> Got resource offer 20140703-125251-1174818570-5050-14218-15
>> Accepting offer on hotbox-32.Stanford.EDU to start task 2
>> Task 2 is in state 1
>> Task 2 is in state 2
>> Received message: 'data with a \x00 byte'
>> Got 1 resource offers
>> Got resource offer 20140703-125251-1174818570-5050-14218-16
>> Accepting offer on hotbox-32.Stanford.EDU to start task 3
>> Task 3 is in state 1
>> Task 3 is in state 2
>> Received message: 'data with a \x00 byte'
>> Got 1 resource offers
>> Got resource offer 20140703-125251-1174818570-5050-14218-17
>> Accepting offer on hotbox-32.Stanford.EDU to start task 4
>> Task 4 is in state 1
>> Task 4 is in state 2
>> All tasks done, waiting for final framework message
>> Received message: 'data with a \x00 byte'
>> All tasks done, and all messages received, exiting.
>>
>>
>>
>> However, the test-executer never appears to run at all (e.g. "Starting
>> executor" is never printed). The output of the slave log is:
>>
>> tration request from scheduler(1)@10.79.6.70:45691
>> I0703 13:48:00.668162 14237 master.cpp:1059] Registering framework
>> 20140703-125251-1174818570-5050-14218-0013 at scheduler(1)@
>> 10.79.6.70:45691
>> I0703 13:48:00.668429 14235 hierarchical_allocator_process.hpp:331] Added
>> framework 20140703-125251-1174818570-5050-14218-0013
>> I0703 13:48:00.668756 14237 master.cpp:2933] Sending 1 offers to
>> framework 20140703-125251-1174818570-5050-14218-0013
>> I0703 13:48:00.670779 14235 master.cpp:1889] Processing reply for offers:
>> [ 20140703-125251-1174818570-5050-14218-13 ] on slave
>> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
>> hotbox-32.Stanford.EDU) for framework
>> 20140703-125251-1174818570-5050-14218-0013
>> I0703 13:48:00.670910 14235 master.hpp:655] Adding task 0 with resources
>> cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
>> hotbox-32.Stanford.EDU)
>> I0703 13:48:00.670954 14235 master.cpp:3111] Launching task 0 of
>> framework 20140703-125251-1174818570-5050-14218-0013 with resources
>> cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 at
>> slave(1)@10.79.6.72:5051 (hotbox-32.Stanford.EDU)
>> I0703 13:48:00.671262 14235 hierarchical_allocator_process.hpp:589]
>> Framework 20140703-125251-1174818570-5050-14218-0013 filtered slave
>> 20140703-110217-1174818570-5050-11997-0 for 5secs
>> I0703 13:48:01.690057 14235 master.cpp:2628] Status update TASK_RUNNING
>> (UUID: 5c59b904-17be-4a5a-96d9-eab3be8da71f) for task 0 of framework
>> 20140703-125251-1174818570-5050-14218-0013 from slave
>> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
>> hotbox-32.Stanford.EDU)
>> I0703 13:48:01.693547 14235 master.cpp:2628] Status update TASK_FINISHED
>> (UUID: 06866605-ff79-40ed-b8dc-063d79a3a65d) for task 0 of framework
>> 20140703-125251-1174818570-5050-14218-0013 from slave
>> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
>> hotbox-32.Stanford.EDU)
>> I0703 13:48:01.693624 14235 master.hpp:673] Removing task 0 with
>> resources cpus(*):1; mem(*):32 on slave
>> 20140703-110217-1174818570-5050-11997-0 (hotbox-32.Stanford.EDU)
>> I0703 13:48:01.693742 14235 hierarchical_allocator_process.hpp:636]
>> Recovered cpus(*):1; mem(*):32 (total allocatable: cpus(*):8; mem(*):15024;
>> disk(*):448079; ports(*):[31000-32000]) on slave
>> 20140703-110217-1174818570-5050-11997-0 from framework
>> 20140703-125251-1174818570-5050-14218-0013
>> I0703 13:48:01.973332 14233 master.cpp:2933] Sending 1 offers to
>> framework 20140703-125251-1174818570-5050-14218-0013
>> I0703 13:48:01.975445 14239 master.cpp:1889] Processing reply for offers:
>> [ 20140703-125251-1174818570-5050-14218-14 ] on slave
>> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
>> hotbox-32.Stanford.EDU) for framework
>> 20140703-125251-1174818570-5050-14218-0013
>> I0703 13:48:01.975563 14239 master.hpp:655] Adding task 1 with resources
>> cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
>> hotbox-32.Stanford.EDU)
>> I0703 13:48:01.975600 14239 master.cpp:3111] Launching task 1 of
>> framework 20140703-125251-1174818570-5050-14218-0013 with resources
>> cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 at
>> slave(1)@10.79.6.72:5051 (hotbox-32.Stanford.EDU)
>> I0703 13:48:01.975872 14239 hierarchical_allocator_process.hpp:589]
>> Framework 20140703-125251-1174818570-5050-14218-0013 filtered slave
>> 20140703-110217-1174818570-5050-11997-0 for 5secs
>> I0703 13:48:01.979724 14239 master.cpp:2628] Status update TASK_RUNNING
>> (UUID: eb0b86e9-6365-4e67-b1da-e918903abcf6) for task 1 of framework
>> 20140703-125251-1174818570-5050-14218-0013 from slave
>> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
>> hotbox-32.Stanford.EDU)
>> I0703 13:48:01.981361 14239 master.cpp:2628] Status update TASK_FINISHED
>> (UUID: 79f8ed55-a797-48b3-bee2-b223ff6d4634) for task 1 of framework
>> 20140703-125251-1174818570-5050-14218-0013 from slave
>> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
>> hotbox-32.Stanford.EDU)
>> I0703 13:48:01.981462 14239 master.hpp:673] Removing task 1 with
>> resources cpus(*):1; mem(*):32 on slave
>> 20140703-110217-1174818570-5050-11997-0 (hotbox-32.Stanford.EDU)
>> I0703 13:48:01.981650 14239 hierarchical_allocator_process.hpp:636]
>> Recovered cpus(*):1; mem(*):32 (total allocatable: cpus(*):8; mem(*):15024;
>> disk(*):448079; ports(*):[31000-32000]) on slave
>> 20140703-110217-1174818570-5050-11997-0 from framework
>> 20140703-125251-1174818570-5050-14218-0013
>> I0703 13:48:02.973732 14239 master.cpp:2933] Sending 1 offers to
>> framework 20140703-125251-1174818570-5050-14218-0013
>> I0703 13:48:02.976670 14239 master.cpp:1889] Processing reply for offers:
>> [ 20140703-125251-1174818570-5050-14218-15 ] on slave
>> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
>> hotbox-32.Stanford.EDU) for framework
>> 20140703-125251-1174818570-5050-14218-0013
>> I0703 13:48:02.976774 14239 master.hpp:655] Adding task 2 with resources
>> cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
>> hotbox-32.Stanford.EDU)
>> I0703 13:48:02.976807 14239 master.cpp:3111] Launching task 2 of
>> framework 20140703-125251-1174818570-5050-14218-0013 with resources
>> cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 at
>> slave(1)@10.79.6.72:5051 (hotbox-32.Stanford.EDU)
>> I0703 13:48:02.977133 14238 hierarchical_allocator_process.hpp:589]
>> Framework 20140703-125251-1174818570-5050-14218-0013 filtered slave
>> 20140703-110217-1174818570-5050-11997-0 for 5secs
>> I0703 13:48:02.981207 14236 master.cpp:2628] Status update TASK_RUNNING
>> (UUID: 704f7974-64bb-4657-b6de-14fd744b8a44) for task 2 of framework
>> 20140703-125251-1174818570-5050-14218-0013 from slave
>> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
>> hotbox-32.Stanford.EDU)
>> I0703 13:48:02.983667 14239 master.cpp:2628] Status update TASK_FINISHED
>> (UUID: 928f7a65-a313-4da5-a205-6c8bc2c860b2) for task 2 of framework
>> 20140703-125251-1174818570-5050-14218-0013 from slave
>> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
>> hotbox-32.Stanford.EDU)
>> I0703 13:48:02.983726 14239 master.hpp:673] Removing task 2 with
>> resources cpus(*):1; mem(*):32 on slave
>> 20140703-110217-1174818570-5050-11997-0 (hotbox-32.Stanford.EDU)
>> I0703 13:48:02.983829 14239 hierarchical_allocator_process.hpp:636]
>> Recovered cpus(*):1; mem(*):32 (total allocatable: cpus(*):8; mem(*):15024;
>> disk(*):448079; ports(*):[31000-32000]) on slave
>> 20140703-110217-1174818570-5050-11997-0 from framework
>> 20140703-125251-1174818570-5050-14218-0013
>> I0703 13:48:03.975867 14239 master.cpp:2933] Sending 1 offers to
>> framework 20140703-125251-1174818570-5050-14218-0013
>> I0703 13:48:03.979548 14239 master.cpp:1889] Processing reply for offers:
>> [ 20140703-125251-1174818570-5050-14218-16 ] on slave
>> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
>> hotbox-32.Stanford.EDU) for framework
>> 20140703-125251-1174818570-5050-14218-0013
>> I0703 13:48:03.979637 14239 master.hpp:655] Adding task 3 with resources
>> cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
>> hotbox-32.Stanford.EDU)
>> I0703 13:48:03.979672 14239 master.cpp:3111] Launching task 3 of
>> framework 20140703-125251-1174818570-5050-14218-0013 with resources
>> cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 at
>> slave(1)@10.79.6.72:5051 (hotbox-32.Stanford.EDU)
>> I0703 13:48:03.979946 14239 hierarchical_allocator_process.hpp:589]
>> Framework 20140703-125251-1174818570-5050-14218-0013 filtered slave
>> 20140703-110217-1174818570-5050-11997-0 for 5secs
>> I0703 13:48:03.983628 14239 master.cpp:2628] Status update TASK_RUNNING
>> (UUID: f97c758a-1e0c-4c46-ad8c-b72f08bd1058) for task 3 of framework
>> 20140703-125251-1174818570-5050-14218-0013 from slave
>> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
>> hotbox-32.Stanford.EDU)
>> I0703 13:48:03.984890 14238 master.cpp:2628] Status update TASK_FINISHED
>> (UUID: 0e13d45c-fa34-4cbc-b60a-d223d5a81c47) for task 3 of framework
>> 20140703-125251-1174818570-5050-14218-0013 from slave
>> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
>> hotbox-32.Stanford.EDU)
>> I0703 13:48:03.984940 14238 master.hpp:673] Removing task 3 with
>> resources cpus(*):1; mem(*):32 on slave
>> 20140703-110217-1174818570-5050-11997-0 (hotbox-32.Stanford.EDU)
>> I0703 13:48:03.985064 14237 hierarchical_allocator_process.hpp:636]
>> Recovered cpus(*):1; mem(*):32 (total allocatable: cpus(*):8; mem(*):15024;
>> disk(*):448079; ports(*):[31000-32000]) on slave
>> 20140703-110217-1174818570-5050-11997-0 from framework
>> 20140703-125251-1174818570-5050-14218-0013
>> I0703 13:48:04.576925 14238 http.cpp:452] HTTP request for
>> '/master/state.json'
>> I0703 13:48:04.976970 14238 master.cpp:2933] Sending 1 offers to
>> framework 20140703-125251-1174818570-5050-14218-0013
>> I0703 13:48:04.979996 14237 master.cpp:1889] Processing reply for offers:
>> [ 20140703-125251-1174818570-5050-14218-17 ] on slave
>> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
>> hotbox-32.Stanford.EDU) for framework
>> 20140703-125251-1174818570-5050-14218-0013
>> I0703 13:48:04.980115 14237 master.hpp:655] Adding task 4 with resources
>> cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
>> hotbox-32.Stanford.EDU)
>> I0703 13:48:04.980149 14237 master.cpp:3111] Launching task 4 of
>> framework 20140703-125251-1174818570-5050-14218-0013 with resources
>> cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 at
>> slave(1)@10.79.6.72:5051 (hotbox-32.Stanford.EDU)
>> I0703 13:48:04.980487 14235 hierarchical_allocator_process.hpp:589]
>> Framework 20140703-125251-1174818570-5050-14218-0013 filtered slave
>> 20140703-110217-1174818570-5050-11997-0 for 5secs
>> I0703 13:48:04.983796 14234 master.cpp:2628] Status update TASK_RUNNING
>> (UUID: bb9b7d42-0c7f-4bdd-8795-a27c8571e2e3) for task 4 of framework
>> 20140703-125251-1174818570-5050-14218-0013 from slave
>> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
>> hotbox-32.Stanford.EDU)
>> I0703 13:48:04.988442 14234 master.cpp:2628] Status update TASK_FINISHED
>> (UUID: 3c4f5255-388a-4770-bb5a-6b6dc2882ed0) for task 4 of framework
>> 20140703-125251-1174818570-5050-14218-0013 from slave
>> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
>> hotbox-32.Stanford.EDU)
>> I0703 13:48:04.988494 14234 master.hpp:673] Removing task 4 with
>> resources cpus(*):1; mem(*):32 on slave
>> 20140703-110217-1174818570-5050-11997-0 (hotbox-32.Stanford.EDU)
>> I0703 13:48:04.988618 14236 hierarchical_allocator_process.hpp:636]
>> Recovered cpus(*):1; mem(*):32 (total allocatable: cpus(*):8; mem(*):15024;
>> disk(*):448079; ports(*):[31000-32000]) on slave
>> 20140703-110217-1174818570-5050-11997-0 from framework
>> 20140703-125251-1174818570-5050-14218-0013
>> I0703 13:48:04.991214 14234 master.cpp:1272] Asked to unregister
>> framework 20140703-125251-1174818570-5050-14218-0013
>> I0703 13:48:04.991232 14234 master.cpp:3344] Removing framework
>> 20140703-125251-1174818570-5050-14218-0013
>> I0703 13:48:04.991336 14234 hierarchical_allocator_process.hpp:407]
>> Deactivated framework 20140703-125251-1174818570-5050-14218-0013
>> I0703 13:48:04.991369 14234 hierarchical_allocator_process.hpp:362]
>> Removed framework 20140703-125251-1174818570-5050-14218-0013
>> W0703 13:48:10.392684 14234 master.cpp:2718] Ignoring unknown exited
>> executor default on slave 20140703-110217-1174818570-5050-11997-0 at
>> slave(1)@10.79.6.72:5051 (hotbox-32.Stanford.EDU)
>>
>> Any ideas why that might be?
>>
>>
>>
>> On Thu, Jul 3, 2014 at 11:49 AM, Vinod Kone <vi...@gmail.com> wrote:
>>
>>> Sammy,
>>>
>>> You need to run a framework to be able to run an executor. See
>>> http://mesos.apache.org/gettingstarted/ to see how to run the example
>>> python framework.
>>>
>>>
>>> On Thu, Jul 3, 2014 at 11:29 AM, Sammy Steele <sammy_steele@stanford.edu
>>> > wrote:
>>>
>>>> I am trying to figure out how to run the python test-executor given in
>>>> the mesos code base. Based on the documentation at:
>>>> http://mesos.apache.org/documentation/latest/app-framework-development-guide/,
>>>> I tried starting my slaves with the command: ./bin/mesos-slave.sh
>>>> --ip=10.79.6.72 --master=10.79.6.70:5050
>>>> --frameworks_home=../src/examples/python.
>>>> I know that I can't launch the test-executor directly (the
>>>> mesos_slave_pid is unspecified). Exactly what command should I be using to
>>>> launch the executor? Thanks!
>>>>
>>>
>>>
>>
>
Re: Running test-executor
Posted by Vinod Kone <vi...@gmail.com>.
What you have pasted here is the master's log not the slave's.
More importantly, that "Starting executor" message from the executor will
not be in slave's log either. Executor's output is redirected to "stdout"
and "stderr" in the executor's sandbox directory.
A typical location of the executor sandbox is like this:
/tmp/mesos/slaves/<slave-id>/frameworks/<framework-id>/executors/<executor-id>/runs/latest/
The exact sandbox path should be logged in the slave's log during the time
of the launch.
FWIW, the test-executor did run successfully, because the tasks wouldn't
have reached TASK_FINISHED state (state 2) otherwise.
On Thu, Jul 3, 2014 at 1:57 PM, Sammy Steele <sa...@stanford.edu>
wrote:
> Hi Vinod,
>
> Thanks for your advice. That is what I originally thought, and I was
> originally trying to run the test-executor through the test-framework
> provided in the same examples folder. For some reason the test-executor
> doesn't appear to execute when I run the test-framework. The output of the
> test-framework is:
>
> I0703 13:48:00.664995 17052 sched.cpp:126] Version: 0.19.0
> I0703 13:48:00.667441 17086 sched.cpp:222] New master detected at
> master@10.79.6.70:5050
> I0703 13:48:00.667635 17086 sched.cpp:230] No credentials provided.
> Attempting to register without authentication
> I0703 13:48:00.668550 17086 sched.cpp:397] Framework registered with
> 20140703-125251-1174818570-5050-14218-0013
> Registered with framework ID 20140703-125251-1174818570-5050-14218-0013
> Got 1 resource offers
> Got resource offer 20140703-125251-1174818570-5050-14218-13
> Accepting offer on hotbox-32.Stanford.EDU to start task 0
> Task 0 is in state 1
> Task 0 is in state 2
> Received message: 'data with a \x00 byte'
> Got 1 resource offers
> Got resource offer 20140703-125251-1174818570-5050-14218-14
> Accepting offer on hotbox-32.Stanford.EDU to start task 1
> Task 1 is in state 1
> Task 1 is in state 2
> Received message: 'data with a \x00 byte'
> Got 1 resource offers
> Got resource offer 20140703-125251-1174818570-5050-14218-15
> Accepting offer on hotbox-32.Stanford.EDU to start task 2
> Task 2 is in state 1
> Task 2 is in state 2
> Received message: 'data with a \x00 byte'
> Got 1 resource offers
> Got resource offer 20140703-125251-1174818570-5050-14218-16
> Accepting offer on hotbox-32.Stanford.EDU to start task 3
> Task 3 is in state 1
> Task 3 is in state 2
> Received message: 'data with a \x00 byte'
> Got 1 resource offers
> Got resource offer 20140703-125251-1174818570-5050-14218-17
> Accepting offer on hotbox-32.Stanford.EDU to start task 4
> Task 4 is in state 1
> Task 4 is in state 2
> All tasks done, waiting for final framework message
> Received message: 'data with a \x00 byte'
> All tasks done, and all messages received, exiting.
>
>
>
> However, the test-executer never appears to run at all (e.g. "Starting
> executor" is never printed). The output of the slave log is:
>
> tration request from scheduler(1)@10.79.6.70:45691
> I0703 13:48:00.668162 14237 master.cpp:1059] Registering framework
> 20140703-125251-1174818570-5050-14218-0013 at scheduler(1)@
> 10.79.6.70:45691
> I0703 13:48:00.668429 14235 hierarchical_allocator_process.hpp:331] Added
> framework 20140703-125251-1174818570-5050-14218-0013
> I0703 13:48:00.668756 14237 master.cpp:2933] Sending 1 offers to framework
> 20140703-125251-1174818570-5050-14218-0013
> I0703 13:48:00.670779 14235 master.cpp:1889] Processing reply for offers:
> [ 20140703-125251-1174818570-5050-14218-13 ] on slave
> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
> hotbox-32.Stanford.EDU) for framework
> 20140703-125251-1174818570-5050-14218-0013
> I0703 13:48:00.670910 14235 master.hpp:655] Adding task 0 with resources
> cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
> hotbox-32.Stanford.EDU)
> I0703 13:48:00.670954 14235 master.cpp:3111] Launching task 0 of framework
> 20140703-125251-1174818570-5050-14218-0013 with resources cpus(*):1;
> mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 at slave(1)@
> 10.79.6.72:5051 (hotbox-32.Stanford.EDU)
> I0703 13:48:00.671262 14235 hierarchical_allocator_process.hpp:589]
> Framework 20140703-125251-1174818570-5050-14218-0013 filtered slave
> 20140703-110217-1174818570-5050-11997-0 for 5secs
> I0703 13:48:01.690057 14235 master.cpp:2628] Status update TASK_RUNNING
> (UUID: 5c59b904-17be-4a5a-96d9-eab3be8da71f) for task 0 of framework
> 20140703-125251-1174818570-5050-14218-0013 from slave
> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
> hotbox-32.Stanford.EDU)
> I0703 13:48:01.693547 14235 master.cpp:2628] Status update TASK_FINISHED
> (UUID: 06866605-ff79-40ed-b8dc-063d79a3a65d) for task 0 of framework
> 20140703-125251-1174818570-5050-14218-0013 from slave
> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
> hotbox-32.Stanford.EDU)
> I0703 13:48:01.693624 14235 master.hpp:673] Removing task 0 with resources
> cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
> hotbox-32.Stanford.EDU)
> I0703 13:48:01.693742 14235 hierarchical_allocator_process.hpp:636]
> Recovered cpus(*):1; mem(*):32 (total allocatable: cpus(*):8; mem(*):15024;
> disk(*):448079; ports(*):[31000-32000]) on slave
> 20140703-110217-1174818570-5050-11997-0 from framework
> 20140703-125251-1174818570-5050-14218-0013
> I0703 13:48:01.973332 14233 master.cpp:2933] Sending 1 offers to framework
> 20140703-125251-1174818570-5050-14218-0013
> I0703 13:48:01.975445 14239 master.cpp:1889] Processing reply for offers:
> [ 20140703-125251-1174818570-5050-14218-14 ] on slave
> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
> hotbox-32.Stanford.EDU) for framework
> 20140703-125251-1174818570-5050-14218-0013
> I0703 13:48:01.975563 14239 master.hpp:655] Adding task 1 with resources
> cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
> hotbox-32.Stanford.EDU)
> I0703 13:48:01.975600 14239 master.cpp:3111] Launching task 1 of framework
> 20140703-125251-1174818570-5050-14218-0013 with resources cpus(*):1;
> mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 at slave(1)@
> 10.79.6.72:5051 (hotbox-32.Stanford.EDU)
> I0703 13:48:01.975872 14239 hierarchical_allocator_process.hpp:589]
> Framework 20140703-125251-1174818570-5050-14218-0013 filtered slave
> 20140703-110217-1174818570-5050-11997-0 for 5secs
> I0703 13:48:01.979724 14239 master.cpp:2628] Status update TASK_RUNNING
> (UUID: eb0b86e9-6365-4e67-b1da-e918903abcf6) for task 1 of framework
> 20140703-125251-1174818570-5050-14218-0013 from slave
> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
> hotbox-32.Stanford.EDU)
> I0703 13:48:01.981361 14239 master.cpp:2628] Status update TASK_FINISHED
> (UUID: 79f8ed55-a797-48b3-bee2-b223ff6d4634) for task 1 of framework
> 20140703-125251-1174818570-5050-14218-0013 from slave
> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
> hotbox-32.Stanford.EDU)
> I0703 13:48:01.981462 14239 master.hpp:673] Removing task 1 with resources
> cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
> hotbox-32.Stanford.EDU)
> I0703 13:48:01.981650 14239 hierarchical_allocator_process.hpp:636]
> Recovered cpus(*):1; mem(*):32 (total allocatable: cpus(*):8; mem(*):15024;
> disk(*):448079; ports(*):[31000-32000]) on slave
> 20140703-110217-1174818570-5050-11997-0 from framework
> 20140703-125251-1174818570-5050-14218-0013
> I0703 13:48:02.973732 14239 master.cpp:2933] Sending 1 offers to framework
> 20140703-125251-1174818570-5050-14218-0013
> I0703 13:48:02.976670 14239 master.cpp:1889] Processing reply for offers:
> [ 20140703-125251-1174818570-5050-14218-15 ] on slave
> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
> hotbox-32.Stanford.EDU) for framework
> 20140703-125251-1174818570-5050-14218-0013
> I0703 13:48:02.976774 14239 master.hpp:655] Adding task 2 with resources
> cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
> hotbox-32.Stanford.EDU)
> I0703 13:48:02.976807 14239 master.cpp:3111] Launching task 2 of framework
> 20140703-125251-1174818570-5050-14218-0013 with resources cpus(*):1;
> mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 at slave(1)@
> 10.79.6.72:5051 (hotbox-32.Stanford.EDU)
> I0703 13:48:02.977133 14238 hierarchical_allocator_process.hpp:589]
> Framework 20140703-125251-1174818570-5050-14218-0013 filtered slave
> 20140703-110217-1174818570-5050-11997-0 for 5secs
> I0703 13:48:02.981207 14236 master.cpp:2628] Status update TASK_RUNNING
> (UUID: 704f7974-64bb-4657-b6de-14fd744b8a44) for task 2 of framework
> 20140703-125251-1174818570-5050-14218-0013 from slave
> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
> hotbox-32.Stanford.EDU)
> I0703 13:48:02.983667 14239 master.cpp:2628] Status update TASK_FINISHED
> (UUID: 928f7a65-a313-4da5-a205-6c8bc2c860b2) for task 2 of framework
> 20140703-125251-1174818570-5050-14218-0013 from slave
> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
> hotbox-32.Stanford.EDU)
> I0703 13:48:02.983726 14239 master.hpp:673] Removing task 2 with resources
> cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
> hotbox-32.Stanford.EDU)
> I0703 13:48:02.983829 14239 hierarchical_allocator_process.hpp:636]
> Recovered cpus(*):1; mem(*):32 (total allocatable: cpus(*):8; mem(*):15024;
> disk(*):448079; ports(*):[31000-32000]) on slave
> 20140703-110217-1174818570-5050-11997-0 from framework
> 20140703-125251-1174818570-5050-14218-0013
> I0703 13:48:03.975867 14239 master.cpp:2933] Sending 1 offers to framework
> 20140703-125251-1174818570-5050-14218-0013
> I0703 13:48:03.979548 14239 master.cpp:1889] Processing reply for offers:
> [ 20140703-125251-1174818570-5050-14218-16 ] on slave
> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
> hotbox-32.Stanford.EDU) for framework
> 20140703-125251-1174818570-5050-14218-0013
> I0703 13:48:03.979637 14239 master.hpp:655] Adding task 3 with resources
> cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
> hotbox-32.Stanford.EDU)
> I0703 13:48:03.979672 14239 master.cpp:3111] Launching task 3 of framework
> 20140703-125251-1174818570-5050-14218-0013 with resources cpus(*):1;
> mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 at slave(1)@
> 10.79.6.72:5051 (hotbox-32.Stanford.EDU)
> I0703 13:48:03.979946 14239 hierarchical_allocator_process.hpp:589]
> Framework 20140703-125251-1174818570-5050-14218-0013 filtered slave
> 20140703-110217-1174818570-5050-11997-0 for 5secs
> I0703 13:48:03.983628 14239 master.cpp:2628] Status update TASK_RUNNING
> (UUID: f97c758a-1e0c-4c46-ad8c-b72f08bd1058) for task 3 of framework
> 20140703-125251-1174818570-5050-14218-0013 from slave
> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
> hotbox-32.Stanford.EDU)
> I0703 13:48:03.984890 14238 master.cpp:2628] Status update TASK_FINISHED
> (UUID: 0e13d45c-fa34-4cbc-b60a-d223d5a81c47) for task 3 of framework
> 20140703-125251-1174818570-5050-14218-0013 from slave
> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
> hotbox-32.Stanford.EDU)
> I0703 13:48:03.984940 14238 master.hpp:673] Removing task 3 with resources
> cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
> hotbox-32.Stanford.EDU)
> I0703 13:48:03.985064 14237 hierarchical_allocator_process.hpp:636]
> Recovered cpus(*):1; mem(*):32 (total allocatable: cpus(*):8; mem(*):15024;
> disk(*):448079; ports(*):[31000-32000]) on slave
> 20140703-110217-1174818570-5050-11997-0 from framework
> 20140703-125251-1174818570-5050-14218-0013
> I0703 13:48:04.576925 14238 http.cpp:452] HTTP request for
> '/master/state.json'
> I0703 13:48:04.976970 14238 master.cpp:2933] Sending 1 offers to framework
> 20140703-125251-1174818570-5050-14218-0013
> I0703 13:48:04.979996 14237 master.cpp:1889] Processing reply for offers:
> [ 20140703-125251-1174818570-5050-14218-17 ] on slave
> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
> hotbox-32.Stanford.EDU) for framework
> 20140703-125251-1174818570-5050-14218-0013
> I0703 13:48:04.980115 14237 master.hpp:655] Adding task 4 with resources
> cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
> hotbox-32.Stanford.EDU)
> I0703 13:48:04.980149 14237 master.cpp:3111] Launching task 4 of framework
> 20140703-125251-1174818570-5050-14218-0013 with resources cpus(*):1;
> mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 at slave(1)@
> 10.79.6.72:5051 (hotbox-32.Stanford.EDU)
> I0703 13:48:04.980487 14235 hierarchical_allocator_process.hpp:589]
> Framework 20140703-125251-1174818570-5050-14218-0013 filtered slave
> 20140703-110217-1174818570-5050-11997-0 for 5secs
> I0703 13:48:04.983796 14234 master.cpp:2628] Status update TASK_RUNNING
> (UUID: bb9b7d42-0c7f-4bdd-8795-a27c8571e2e3) for task 4 of framework
> 20140703-125251-1174818570-5050-14218-0013 from slave
> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
> hotbox-32.Stanford.EDU)
> I0703 13:48:04.988442 14234 master.cpp:2628] Status update TASK_FINISHED
> (UUID: 3c4f5255-388a-4770-bb5a-6b6dc2882ed0) for task 4 of framework
> 20140703-125251-1174818570-5050-14218-0013 from slave
> 20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
> hotbox-32.Stanford.EDU)
> I0703 13:48:04.988494 14234 master.hpp:673] Removing task 4 with resources
> cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
> hotbox-32.Stanford.EDU)
> I0703 13:48:04.988618 14236 hierarchical_allocator_process.hpp:636]
> Recovered cpus(*):1; mem(*):32 (total allocatable: cpus(*):8; mem(*):15024;
> disk(*):448079; ports(*):[31000-32000]) on slave
> 20140703-110217-1174818570-5050-11997-0 from framework
> 20140703-125251-1174818570-5050-14218-0013
> I0703 13:48:04.991214 14234 master.cpp:1272] Asked to unregister framework
> 20140703-125251-1174818570-5050-14218-0013
> I0703 13:48:04.991232 14234 master.cpp:3344] Removing framework
> 20140703-125251-1174818570-5050-14218-0013
> I0703 13:48:04.991336 14234 hierarchical_allocator_process.hpp:407]
> Deactivated framework 20140703-125251-1174818570-5050-14218-0013
> I0703 13:48:04.991369 14234 hierarchical_allocator_process.hpp:362]
> Removed framework 20140703-125251-1174818570-5050-14218-0013
> W0703 13:48:10.392684 14234 master.cpp:2718] Ignoring unknown exited
> executor default on slave 20140703-110217-1174818570-5050-11997-0 at
> slave(1)@10.79.6.72:5051 (hotbox-32.Stanford.EDU)
>
> Any ideas why that might be?
>
>
>
> On Thu, Jul 3, 2014 at 11:49 AM, Vinod Kone <vi...@gmail.com> wrote:
>
>> Sammy,
>>
>> You need to run a framework to be able to run an executor. See
>> http://mesos.apache.org/gettingstarted/ to see how to run the example
>> python framework.
>>
>>
>> On Thu, Jul 3, 2014 at 11:29 AM, Sammy Steele <sa...@stanford.edu>
>> wrote:
>>
>>> I am trying to figure out how to run the python test-executor given in
>>> the mesos code base. Based on the documentation at:
>>> http://mesos.apache.org/documentation/latest/app-framework-development-guide/,
>>> I tried starting my slaves with the command: ./bin/mesos-slave.sh
>>> --ip=10.79.6.72 --master=10.79.6.70:5050
>>> --frameworks_home=../src/examples/python.
>>> I know that I can't launch the test-executor directly (the
>>> mesos_slave_pid is unspecified). Exactly what command should I be using to
>>> launch the executor? Thanks!
>>>
>>
>>
>
Re: Running test-executor
Posted by Sammy Steele <sa...@stanford.edu>.
Hi Vinod,
Thanks for your advice. That is what I originally thought, and I was
originally trying to run the test-executor through the test-framework
provided in the same examples folder. For some reason the test-executor
doesn't appear to execute when I run the test-framework. The output of the
test-framework is:
I0703 13:48:00.664995 17052 sched.cpp:126] Version: 0.19.0
I0703 13:48:00.667441 17086 sched.cpp:222] New master detected at
master@10.79.6.70:5050
I0703 13:48:00.667635 17086 sched.cpp:230] No credentials provided.
Attempting to register without authentication
I0703 13:48:00.668550 17086 sched.cpp:397] Framework registered with
20140703-125251-1174818570-5050-14218-0013
Registered with framework ID 20140703-125251-1174818570-5050-14218-0013
Got 1 resource offers
Got resource offer 20140703-125251-1174818570-5050-14218-13
Accepting offer on hotbox-32.Stanford.EDU to start task 0
Task 0 is in state 1
Task 0 is in state 2
Received message: 'data with a \x00 byte'
Got 1 resource offers
Got resource offer 20140703-125251-1174818570-5050-14218-14
Accepting offer on hotbox-32.Stanford.EDU to start task 1
Task 1 is in state 1
Task 1 is in state 2
Received message: 'data with a \x00 byte'
Got 1 resource offers
Got resource offer 20140703-125251-1174818570-5050-14218-15
Accepting offer on hotbox-32.Stanford.EDU to start task 2
Task 2 is in state 1
Task 2 is in state 2
Received message: 'data with a \x00 byte'
Got 1 resource offers
Got resource offer 20140703-125251-1174818570-5050-14218-16
Accepting offer on hotbox-32.Stanford.EDU to start task 3
Task 3 is in state 1
Task 3 is in state 2
Received message: 'data with a \x00 byte'
Got 1 resource offers
Got resource offer 20140703-125251-1174818570-5050-14218-17
Accepting offer on hotbox-32.Stanford.EDU to start task 4
Task 4 is in state 1
Task 4 is in state 2
All tasks done, waiting for final framework message
Received message: 'data with a \x00 byte'
All tasks done, and all messages received, exiting.
However, the test-executer never appears to run at all (e.g. "Starting
executor" is never printed). The output of the slave log is:
tration request from scheduler(1)@10.79.6.70:45691
I0703 13:48:00.668162 14237 master.cpp:1059] Registering framework
20140703-125251-1174818570-5050-14218-0013 at scheduler(1)@10.79.6.70:45691
I0703 13:48:00.668429 14235 hierarchical_allocator_process.hpp:331] Added
framework 20140703-125251-1174818570-5050-14218-0013
I0703 13:48:00.668756 14237 master.cpp:2933] Sending 1 offers to framework
20140703-125251-1174818570-5050-14218-0013
I0703 13:48:00.670779 14235 master.cpp:1889] Processing reply for offers: [
20140703-125251-1174818570-5050-14218-13 ] on slave
20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
hotbox-32.Stanford.EDU) for framework
20140703-125251-1174818570-5050-14218-0013
I0703 13:48:00.670910 14235 master.hpp:655] Adding task 0 with resources
cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
hotbox-32.Stanford.EDU)
I0703 13:48:00.670954 14235 master.cpp:3111] Launching task 0 of framework
20140703-125251-1174818570-5050-14218-0013 with resources cpus(*):1;
mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 at slave(1)@
10.79.6.72:5051 (hotbox-32.Stanford.EDU)
I0703 13:48:00.671262 14235 hierarchical_allocator_process.hpp:589]
Framework 20140703-125251-1174818570-5050-14218-0013 filtered slave
20140703-110217-1174818570-5050-11997-0 for 5secs
I0703 13:48:01.690057 14235 master.cpp:2628] Status update TASK_RUNNING
(UUID: 5c59b904-17be-4a5a-96d9-eab3be8da71f) for task 0 of framework
20140703-125251-1174818570-5050-14218-0013 from slave
20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
hotbox-32.Stanford.EDU)
I0703 13:48:01.693547 14235 master.cpp:2628] Status update TASK_FINISHED
(UUID: 06866605-ff79-40ed-b8dc-063d79a3a65d) for task 0 of framework
20140703-125251-1174818570-5050-14218-0013 from slave
20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
hotbox-32.Stanford.EDU)
I0703 13:48:01.693624 14235 master.hpp:673] Removing task 0 with resources
cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
hotbox-32.Stanford.EDU)
I0703 13:48:01.693742 14235 hierarchical_allocator_process.hpp:636]
Recovered cpus(*):1; mem(*):32 (total allocatable: cpus(*):8; mem(*):15024;
disk(*):448079; ports(*):[31000-32000]) on slave
20140703-110217-1174818570-5050-11997-0 from framework
20140703-125251-1174818570-5050-14218-0013
I0703 13:48:01.973332 14233 master.cpp:2933] Sending 1 offers to framework
20140703-125251-1174818570-5050-14218-0013
I0703 13:48:01.975445 14239 master.cpp:1889] Processing reply for offers: [
20140703-125251-1174818570-5050-14218-14 ] on slave
20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
hotbox-32.Stanford.EDU) for framework
20140703-125251-1174818570-5050-14218-0013
I0703 13:48:01.975563 14239 master.hpp:655] Adding task 1 with resources
cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
hotbox-32.Stanford.EDU)
I0703 13:48:01.975600 14239 master.cpp:3111] Launching task 1 of framework
20140703-125251-1174818570-5050-14218-0013 with resources cpus(*):1;
mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 at slave(1)@
10.79.6.72:5051 (hotbox-32.Stanford.EDU)
I0703 13:48:01.975872 14239 hierarchical_allocator_process.hpp:589]
Framework 20140703-125251-1174818570-5050-14218-0013 filtered slave
20140703-110217-1174818570-5050-11997-0 for 5secs
I0703 13:48:01.979724 14239 master.cpp:2628] Status update TASK_RUNNING
(UUID: eb0b86e9-6365-4e67-b1da-e918903abcf6) for task 1 of framework
20140703-125251-1174818570-5050-14218-0013 from slave
20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
hotbox-32.Stanford.EDU)
I0703 13:48:01.981361 14239 master.cpp:2628] Status update TASK_FINISHED
(UUID: 79f8ed55-a797-48b3-bee2-b223ff6d4634) for task 1 of framework
20140703-125251-1174818570-5050-14218-0013 from slave
20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
hotbox-32.Stanford.EDU)
I0703 13:48:01.981462 14239 master.hpp:673] Removing task 1 with resources
cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
hotbox-32.Stanford.EDU)
I0703 13:48:01.981650 14239 hierarchical_allocator_process.hpp:636]
Recovered cpus(*):1; mem(*):32 (total allocatable: cpus(*):8; mem(*):15024;
disk(*):448079; ports(*):[31000-32000]) on slave
20140703-110217-1174818570-5050-11997-0 from framework
20140703-125251-1174818570-5050-14218-0013
I0703 13:48:02.973732 14239 master.cpp:2933] Sending 1 offers to framework
20140703-125251-1174818570-5050-14218-0013
I0703 13:48:02.976670 14239 master.cpp:1889] Processing reply for offers: [
20140703-125251-1174818570-5050-14218-15 ] on slave
20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
hotbox-32.Stanford.EDU) for framework
20140703-125251-1174818570-5050-14218-0013
I0703 13:48:02.976774 14239 master.hpp:655] Adding task 2 with resources
cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
hotbox-32.Stanford.EDU)
I0703 13:48:02.976807 14239 master.cpp:3111] Launching task 2 of framework
20140703-125251-1174818570-5050-14218-0013 with resources cpus(*):1;
mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 at slave(1)@
10.79.6.72:5051 (hotbox-32.Stanford.EDU)
I0703 13:48:02.977133 14238 hierarchical_allocator_process.hpp:589]
Framework 20140703-125251-1174818570-5050-14218-0013 filtered slave
20140703-110217-1174818570-5050-11997-0 for 5secs
I0703 13:48:02.981207 14236 master.cpp:2628] Status update TASK_RUNNING
(UUID: 704f7974-64bb-4657-b6de-14fd744b8a44) for task 2 of framework
20140703-125251-1174818570-5050-14218-0013 from slave
20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
hotbox-32.Stanford.EDU)
I0703 13:48:02.983667 14239 master.cpp:2628] Status update TASK_FINISHED
(UUID: 928f7a65-a313-4da5-a205-6c8bc2c860b2) for task 2 of framework
20140703-125251-1174818570-5050-14218-0013 from slave
20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
hotbox-32.Stanford.EDU)
I0703 13:48:02.983726 14239 master.hpp:673] Removing task 2 with resources
cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
hotbox-32.Stanford.EDU)
I0703 13:48:02.983829 14239 hierarchical_allocator_process.hpp:636]
Recovered cpus(*):1; mem(*):32 (total allocatable: cpus(*):8; mem(*):15024;
disk(*):448079; ports(*):[31000-32000]) on slave
20140703-110217-1174818570-5050-11997-0 from framework
20140703-125251-1174818570-5050-14218-0013
I0703 13:48:03.975867 14239 master.cpp:2933] Sending 1 offers to framework
20140703-125251-1174818570-5050-14218-0013
I0703 13:48:03.979548 14239 master.cpp:1889] Processing reply for offers: [
20140703-125251-1174818570-5050-14218-16 ] on slave
20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
hotbox-32.Stanford.EDU) for framework
20140703-125251-1174818570-5050-14218-0013
I0703 13:48:03.979637 14239 master.hpp:655] Adding task 3 with resources
cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
hotbox-32.Stanford.EDU)
I0703 13:48:03.979672 14239 master.cpp:3111] Launching task 3 of framework
20140703-125251-1174818570-5050-14218-0013 with resources cpus(*):1;
mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 at slave(1)@
10.79.6.72:5051 (hotbox-32.Stanford.EDU)
I0703 13:48:03.979946 14239 hierarchical_allocator_process.hpp:589]
Framework 20140703-125251-1174818570-5050-14218-0013 filtered slave
20140703-110217-1174818570-5050-11997-0 for 5secs
I0703 13:48:03.983628 14239 master.cpp:2628] Status update TASK_RUNNING
(UUID: f97c758a-1e0c-4c46-ad8c-b72f08bd1058) for task 3 of framework
20140703-125251-1174818570-5050-14218-0013 from slave
20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
hotbox-32.Stanford.EDU)
I0703 13:48:03.984890 14238 master.cpp:2628] Status update TASK_FINISHED
(UUID: 0e13d45c-fa34-4cbc-b60a-d223d5a81c47) for task 3 of framework
20140703-125251-1174818570-5050-14218-0013 from slave
20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
hotbox-32.Stanford.EDU)
I0703 13:48:03.984940 14238 master.hpp:673] Removing task 3 with resources
cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
hotbox-32.Stanford.EDU)
I0703 13:48:03.985064 14237 hierarchical_allocator_process.hpp:636]
Recovered cpus(*):1; mem(*):32 (total allocatable: cpus(*):8; mem(*):15024;
disk(*):448079; ports(*):[31000-32000]) on slave
20140703-110217-1174818570-5050-11997-0 from framework
20140703-125251-1174818570-5050-14218-0013
I0703 13:48:04.576925 14238 http.cpp:452] HTTP request for
'/master/state.json'
I0703 13:48:04.976970 14238 master.cpp:2933] Sending 1 offers to framework
20140703-125251-1174818570-5050-14218-0013
I0703 13:48:04.979996 14237 master.cpp:1889] Processing reply for offers: [
20140703-125251-1174818570-5050-14218-17 ] on slave
20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
hotbox-32.Stanford.EDU) for framework
20140703-125251-1174818570-5050-14218-0013
I0703 13:48:04.980115 14237 master.hpp:655] Adding task 4 with resources
cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
hotbox-32.Stanford.EDU)
I0703 13:48:04.980149 14237 master.cpp:3111] Launching task 4 of framework
20140703-125251-1174818570-5050-14218-0013 with resources cpus(*):1;
mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 at slave(1)@
10.79.6.72:5051 (hotbox-32.Stanford.EDU)
I0703 13:48:04.980487 14235 hierarchical_allocator_process.hpp:589]
Framework 20140703-125251-1174818570-5050-14218-0013 filtered slave
20140703-110217-1174818570-5050-11997-0 for 5secs
I0703 13:48:04.983796 14234 master.cpp:2628] Status update TASK_RUNNING
(UUID: bb9b7d42-0c7f-4bdd-8795-a27c8571e2e3) for task 4 of framework
20140703-125251-1174818570-5050-14218-0013 from slave
20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
hotbox-32.Stanford.EDU)
I0703 13:48:04.988442 14234 master.cpp:2628] Status update TASK_FINISHED
(UUID: 3c4f5255-388a-4770-bb5a-6b6dc2882ed0) for task 4 of framework
20140703-125251-1174818570-5050-14218-0013 from slave
20140703-110217-1174818570-5050-11997-0 at slave(1)@10.79.6.72:5051 (
hotbox-32.Stanford.EDU)
I0703 13:48:04.988494 14234 master.hpp:673] Removing task 4 with resources
cpus(*):1; mem(*):32 on slave 20140703-110217-1174818570-5050-11997-0 (
hotbox-32.Stanford.EDU)
I0703 13:48:04.988618 14236 hierarchical_allocator_process.hpp:636]
Recovered cpus(*):1; mem(*):32 (total allocatable: cpus(*):8; mem(*):15024;
disk(*):448079; ports(*):[31000-32000]) on slave
20140703-110217-1174818570-5050-11997-0 from framework
20140703-125251-1174818570-5050-14218-0013
I0703 13:48:04.991214 14234 master.cpp:1272] Asked to unregister framework
20140703-125251-1174818570-5050-14218-0013
I0703 13:48:04.991232 14234 master.cpp:3344] Removing framework
20140703-125251-1174818570-5050-14218-0013
I0703 13:48:04.991336 14234 hierarchical_allocator_process.hpp:407]
Deactivated framework 20140703-125251-1174818570-5050-14218-0013
I0703 13:48:04.991369 14234 hierarchical_allocator_process.hpp:362] Removed
framework 20140703-125251-1174818570-5050-14218-0013
W0703 13:48:10.392684 14234 master.cpp:2718] Ignoring unknown exited
executor default on slave 20140703-110217-1174818570-5050-11997-0 at
slave(1)@10.79.6.72:5051 (hotbox-32.Stanford.EDU)
Any ideas why that might be?
On Thu, Jul 3, 2014 at 11:49 AM, Vinod Kone <vi...@gmail.com> wrote:
> Sammy,
>
> You need to run a framework to be able to run an executor. See
> http://mesos.apache.org/gettingstarted/ to see how to run the example
> python framework.
>
>
> On Thu, Jul 3, 2014 at 11:29 AM, Sammy Steele <sa...@stanford.edu>
> wrote:
>
>> I am trying to figure out how to run the python test-executor given in
>> the mesos code base. Based on the documentation at:
>> http://mesos.apache.org/documentation/latest/app-framework-development-guide/,
>> I tried starting my slaves with the command: ./bin/mesos-slave.sh
>> --ip=10.79.6.72 --master=10.79.6.70:5050
>> --frameworks_home=../src/examples/python.
>> I know that I can't launch the test-executor directly (the
>> mesos_slave_pid is unspecified). Exactly what command should I be using to
>> launch the executor? Thanks!
>>
>
>
Re: Running test-executor
Posted by Vinod Kone <vi...@gmail.com>.
Sammy,
You need to run a framework to be able to run an executor. See
http://mesos.apache.org/gettingstarted/ to see how to run the example
python framework.
On Thu, Jul 3, 2014 at 11:29 AM, Sammy Steele <sa...@stanford.edu>
wrote:
> I am trying to figure out how to run the python test-executor given in the
> mesos code base. Based on the documentation at:
> http://mesos.apache.org/documentation/latest/app-framework-development-guide/,
> I tried starting my slaves with the command: ./bin/mesos-slave.sh
> --ip=10.79.6.72 --master=10.79.6.70:5050
> --frameworks_home=../src/examples/python.
> I know that I can't launch the test-executor directly (the mesos_slave_pid
> is unspecified). Exactly what command should I be using to launch the
> executor? Thanks!
>