You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@mesos.apache.org by "Dvorkin-Contractor, Eugene (CORP)" <Eu...@ADP.com> on 2015/07/17 17:20:44 UTC
How to update mesos slave configuration
Hi,
I have a small cluster consisting of 3 masters( masters+zookeeper) and 3 slave nodes.
This cluster on AWS infrastructure. Originally I had 8GB of storage which was correctly advertised on mesos UI.
Now I added more storage, as a additional drive, and want to tell mesos to use this storage (60GB) mapped to another mount point.
How do I reconfigure my slaves now?
Also, I have created 2 new slaves, but they do not show up in mesos UI.
I created following files
/etc/mesos-master/hostname
vi /etc/marathon/conf/hostname
And restarted slave process, but changes was not reflected in mesos UI.
I can confirm that slave running ok.
How do I force mesos to to update list of slave nodes?
Thanks
mesos-execute --master=$MASTER --name="cluster-test" --command="sleep 5"
I0717 15:13:56.438535 2410 sched.cpp:157] Version: 0.22.1
I0717 15:13:56.440099 2418 sched.cpp:254] New master detected at master@172.31.50.60:5050
I0717 15:13:56.440201 2418 sched.cpp:264] No credentials provided. Attempting to register without authentication
I0717 15:13:56.443297 2414 sched.cpp:448] Framework registered with 20150706-201327-1009917868-5050-16293-0019
Framework registered with 20150706-201327-1009917868-5050-16293-0019
task cluster-test submitted to slave 20150706-201327-1009917868-5050-16293-S48
Received status update TASK_RUNNING for task cluster-test
Received status update TASK_FINISHED for task cluster-test
I0717 15:14:01.514215 2415 sched.cpp:1589] Asked to stop the driver
I0717 15:14:01.514241 2415 sched.cpp:831] Stopping framework '20150706-201327-1009917868-5050-16293-0019'
----------------------------------------------------------------------
This message and any attachments are intended only for the use of the addressee and may contain information that is privileged and confidential. If the reader of the message is not the intended recipient or an authorized representative of the intended recipient, you are hereby notified that any dissemination of this communication is strictly prohibited. If you have received this communication in error, notify the sender immediately by return email and delete the message and any attachments from your system.
Re: How to update mesos slave configuration
Posted by Adam Bordelon <ad...@mesosphere.io>.
Eugene,
If the new storage is on another drive, you will only be able to use one of
the devices for Mesos sandboxes. You can change the --work_dir to point to
the new storage and everything for Mesos will be stored there. This
includes the checkpointed slave state and every task's sandbox. You will
have to shutdown the slave and kill off all its tasks (do it automatically
by restarting with the flag --recover=cleanup). Then you can restart the
slave pointing to the new --work_dir and potentially provide new values for
the --resources flag, if you aren't satisfied with what Mesos auto-detects
on startup.
If, however, you are fine keeping the sandbox on the small drive, you could
mount the new drive into the host's filesystem at a known location, and
then use that directly in your task, or mount that location as a Docker
volume. Mesos will not be able to enforce disk quota limits on the
non-work_dir drive, so be careful not to let any tasks go crazy there.
For the future, keep an eye on:
https://issues.apache.org/jira/browse/MESOS-191
On Fri, Jul 17, 2015 at 8:20 AM, Dvorkin-Contractor, Eugene (CORP) <
Eugene.Dvorkin-Contractor@adp.com> wrote:
> Hi,
> I have a small cluster consisting of 3 masters( masters+zookeeper) and 3
> slave nodes.
> This cluster on AWS infrastructure. Originally I had 8GB of storage which
> was correctly advertised on mesos UI.
> Now I added more storage, as a additional drive, and want to tell mesos to
> use this storage (60GB) mapped to another mount point.
> How do I reconfigure my slaves now?
>
> Also, I have created 2 new slaves, but they do not show up in mesos UI.
> I created following files
> /etc/mesos-master/hostname
> vi /etc/marathon/conf/hostname
> And restarted slave process, but changes was not reflected in mesos UI.
> I can confirm that slave running ok.
> How do I force mesos to to update list of slave nodes?
>
> Thanks
>
> *mesos-execute --master=$MASTER --name="cluster-test" --command="sleep
> 5"*
> I0717 15:13:56.438535 2410 sched.cpp:157] Version: 0.22.1
> I0717 15:13:56.440099 2418 sched.cpp:254] New master detected at
> master@172.31.50.60:5050
> I0717 15:13:56.440201 2418 sched.cpp:264] No credentials provided.
> Attempting to register without authentication
> I0717 15:13:56.443297 2414 sched.cpp:448] Framework registered with
> 20150706-201327-1009917868-5050-16293-0019
> Framework registered with 20150706-201327-1009917868-5050-16293-0019
> task cluster-test submitted to slave
> 20150706-201327-1009917868-5050-16293-S48
> Received status update T*ASK_RUNNING f*or task cluster-test
> Received status update *TASK_FINISHED* for task cluster-test
> I0717 15:14:01.514215 2415 sched.cpp:1589] Asked to stop the driver
> I0717 15:14:01.514241 2415 sched.cpp:831] Stopping framework
> '20150706-201327-1009917868-5050-16293-0019'
>
> ------------------------------
> This message and any attachments are intended only for the use of the
> addressee and may contain information that is privileged and confidential.
> If the reader of the message is not the intended recipient or an authorized
> representative of the intended recipient, you are hereby notified that any
> dissemination of this communication is strictly prohibited. If you have
> received this communication in error, notify the sender immediately by
> return email and delete the message and any attachments from your system.
>
Re: How to update mesos slave configuration
Posted by Raghu Vadapalli <rv...@gmail.com>.
See below regarding the mesos slaves
_____________________________
From: Dvorkin-Contractor, Eugene (CORP) <eu...@adp.com>
Sent: Friday, July 17, 2015 11:21 AM
Subject: How to update mesos slave configuration
To: <us...@mesos.apache.org>
Hi, I have a small cluster consisting of 3 masters( masters+zookeeper) and 3 slave nodes. This cluster on AWS infrastructure. Originally I had 8GB of storage which was correctly advertised on mesos UI. Now I added more storage, as a additional drive, and want to tell mesos to use this storage (60GB) mapped to another mount point. How do I reconfigure my slaves now?
Also, I have created 2 new slaves, but they do not show up in mesos UI. I created following files /etc/mesos-master/hostname vi /etc/marathon/conf/hostname And restarted slave process, but changes was not reflected in mesos UI. I can confirm that slave running ok. How do I force mesos to to update list of slave nodes?
>> do you zookeeper configuration correct on slaves pointing to masters ? Thanks
mesos-execute --master=$MASTER --name="cluster-test" --command="sleep 5" I0717 15:13:56.438535 2410 sched.cpp:157] Version: 0.22.1 I0717 15:13:56.440099 2418 sched.cpp:254] New master detected at master@172.31.50.60:5050 I0717 15:13:56.440201 2418 sched.cpp:264] No credentials provided. Attempting to register without authentication I0717 15:13:56.443297 2414 sched.cpp:448] Framework registered with 20150706-201327-1009917868-5050-16293-0019 Framework registered with 20150706-201327-1009917868-5050-16293-0019 task cluster-test submitted to slave 20150706-201327-1009917868-5050-16293-S48 Received status update T ASK_RUNNING for task cluster-test Received status update TASK_FINISHED for task cluster-test I0717 15:14:01.514215 2415 sched.cpp:1589] Asked to stop the driver I0717 15:14:01.514241 2415 sched.cpp:831] Stopping framework '20150706-201327-1009917868-5050-16293-0019'
This message and any attachments are intended only for the use of the addressee and may contain information that is privileged and confidential. If the reader of the message is not the intended recipient or an authorized representative of the intended recipient, you are hereby notified that any dissemination of this communication is strictly prohibited. If you have received this communication in error, notify the sender immediately by return email and delete the message and any attachments from your system.