You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@mesos.apache.org by Gokula Krishnan <go...@gmail.com> on 2019/07/08 16:29:15 UTC
How to Use 2 physical machine resource at the same time
Dear All,
Thanks in advance and need your inputs for my requirement.
I have 2 nodes (physical machines)
There 20+ web servers running
2 nodes are in active and passive mode
Problem: At any point in time only one node is active and other node is
passive.
Solution: want to use the capacity of both the 2 nodes at the same time.
Will Mesos dcos use the resource of 2 nodes at the same time ?
How can i deploy webservers and use both the nodes resources.
Thank you in advance
--
Thanks and Regards,
Gokula
RE: How to Use 2 physical machine resource at the same time
Posted by Marc Roos <M....@f1-outsourcing.eu>.
Are you going to expand the amount of hosts? If not, stick with such
default failover setup.
If you want to go the mesos/containerized way (and get more servers to
prevent split brain issues). I would do it differently. First of all you
do not need a backup machine and one of them active.
With mesos you just use all hosts and if one fails, the tasks of the
failed node will migrate to the active nodes.
Eg. if you want to host websites you could hosts multiple apache tasks
having each their own external storage (better to spread iops). I am
using ceph for this. Lets say you have 300 websites. You can create 3
external block devices in ceph, create 3 apache tasks each serving a 100
websites. Mesos/marathon will deploy these apache processes in your
available nodes.
If one node fails, then probably one apache tasks is moved to the other
nodes.
PS. I am still researching mesos also ;)
-----Original Message-----
From: Gokula Krishnan [mailto:gokula.p.krishnan@gmail.com]
Sent: woensdag 10 juli 2019 11:17
To: user@mesos.apache.org
Subject: Re: How to Use 2 physical machine resource at the same time
Hi All,
can you please help me with solution that would fit my requirement.
With warm regards,
Gokula
On Tue, Jul 9, 2019 at 9:23 PM Vinod Kone <vi...@apache.org> wrote:
Yes, If I understand your use case correctly.
You can also reach out to us in slack
<http://mesos.apache.org/community/> if you want a more synchronous conversation about this.
On Tue, Jul 9, 2019 at 10:19 AM Gokula Krishnan
<go...@gmail.com> wrote:
Dear All,
Thank you so much for your response.
I am not using Mesos but I am exploring if Mesos can be used
for my requirement.
Current Setup/Environment
2 physical machines each has RAM16gb, 1CPU(4core), Linux OS
Both physical machine has same services running
· apache httpd
· 10+ web servers instances
· (rdbms) database
· rabbitmQ service
At any point of time, only one physical machine is active
(serves the request) and the other physical machine is in standby mode.
All the requests are served but the active physical machine while the
standby physical machine is unused.
When the active physical machine goes down (fails), the
standby machine become active and it servers the request.
so at any point in time, only one physical machine is
utilized.
Using Mesos, is there a way to use both the physical machine
resource at the same time.
Thank you in advance,
On Tue, Jul 9, 2019 at 1:29 AM Hans van den Bogert
<ha...@gmail.com> wrote:
I think gokula isn't using mesos at all atm and is
researching if there are better options than his current failover
environment.
Under the above assumption:
To answer gokula, yes mesos would allow you to use
resources of multiple machines, however I think the overhead of running
multiple mesos masters (for failover like you have now) isn't worth it
for two machines, though that ultimately depends on the 'beefyness' of
the hardware in question.
It also depends on how you expect a mesos cluster to
behave in comparison to your current cluster. Can you elaborate on your
current setup/environment?
Hans
--
Thanks and Regards,
Gokula
--
Thanks and Regards,
Gokula
Re: How to Use 2 physical machine resource at the same time
Posted by Gokula Krishnan <go...@gmail.com>.
Hi All,
can you please help me with solution that would fit my requirement.
With warm regards,
Gokula
On Tue, Jul 9, 2019 at 9:23 PM Vinod Kone <vi...@apache.org> wrote:
> Yes, If I understand your use case correctly.
>
> You can also reach out to us in slack <http://mesos.apache.org/community/> if
> you want a more synchronous conversation about this.
>
> On Tue, Jul 9, 2019 at 10:19 AM Gokula Krishnan <
> gokula.p.krishnan@gmail.com> wrote:
>
>> Dear All,
>>
>> Thank you so much for your response.
>>
>>
>>
>> I am not using Mesos but I am exploring if Mesos can be used for my
>> requirement.
>>
>>
>>
>> *Current Setup/Environment*
>>
>> 2 physical machines each has RAM16gb, 1CPU(4core), Linux OS
>>
>> Both physical machine has same services running
>>
>> · apache httpd
>>
>> · 10+ web servers instances
>>
>> · (rdbms) database
>>
>> · rabbitmQ service
>>
>>
>>
>> At any point of time, only one physical machine is active (serves the
>> request) and the other physical machine is in standby mode. All the
>> requests are served but the active physical machine while the standby
>> physical machine is unused.
>>
>> When the active physical machine goes down (fails), the standby machine
>> become active and it servers the request.
>>
>>
>>
>> so at any point in time, only one physical machine is utilized.
>>
>>
>>
>> Using Mesos, is there a way to use both the physical machine resource at
>> the same time.
>>
>>
>>
>> Thank you in advance,
>>
>> On Tue, Jul 9, 2019 at 1:29 AM Hans van den Bogert <ha...@gmail.com>
>> wrote:
>>
>>> I think gokula isn't using mesos at all atm and is researching if there
>>> are better options than his current failover environment.
>>>
>>> Under the above assumption:
>>>
>>> To answer gokula, yes mesos would allow you to use resources of multiple
>>> machines, however I think the overhead of running multiple mesos masters
>>> (for failover like you have now) isn't worth it for two machines, though
>>> that ultimately depends on the 'beefyness' of the hardware in question.
>>>
>>> It also depends on how you expect a mesos cluster to behave in
>>> comparison to your current cluster. Can you elaborate on your current
>>> setup/environment?
>>>
>>> Hans
>>>
>>
>>
>> --
>> Thanks and Regards,
>> Gokula
>>
>
--
Thanks and Regards,
Gokula
Re: How to Use 2 physical machine resource at the same time
Posted by Vinod Kone <vi...@apache.org>.
Yes, If I understand your use case correctly.
You can also reach out to us in slack <http://mesos.apache.org/community/> if
you want a more synchronous conversation about this.
On Tue, Jul 9, 2019 at 10:19 AM Gokula Krishnan <go...@gmail.com>
wrote:
> Dear All,
>
> Thank you so much for your response.
>
>
>
> I am not using Mesos but I am exploring if Mesos can be used for my
> requirement.
>
>
>
> *Current Setup/Environment*
>
> 2 physical machines each has RAM16gb, 1CPU(4core), Linux OS
>
> Both physical machine has same services running
>
> · apache httpd
>
> · 10+ web servers instances
>
> · (rdbms) database
>
> · rabbitmQ service
>
>
>
> At any point of time, only one physical machine is active (serves the
> request) and the other physical machine is in standby mode. All the
> requests are served but the active physical machine while the standby
> physical machine is unused.
>
> When the active physical machine goes down (fails), the standby machine
> become active and it servers the request.
>
>
>
> so at any point in time, only one physical machine is utilized.
>
>
>
> Using Mesos, is there a way to use both the physical machine resource at
> the same time.
>
>
>
> Thank you in advance,
>
> On Tue, Jul 9, 2019 at 1:29 AM Hans van den Bogert <ha...@gmail.com>
> wrote:
>
>> I think gokula isn't using mesos at all atm and is researching if there
>> are better options than his current failover environment.
>>
>> Under the above assumption:
>>
>> To answer gokula, yes mesos would allow you to use resources of multiple
>> machines, however I think the overhead of running multiple mesos masters
>> (for failover like you have now) isn't worth it for two machines, though
>> that ultimately depends on the 'beefyness' of the hardware in question.
>>
>> It also depends on how you expect a mesos cluster to behave in comparison
>> to your current cluster. Can you elaborate on your current
>> setup/environment?
>>
>> Hans
>>
>
>
> --
> Thanks and Regards,
> Gokula
>
Re: How to Use 2 physical machine resource at the same time
Posted by Gokula Krishnan <go...@gmail.com>.
Dear All,
Thank you so much for your response.
I am not using Mesos but I am exploring if Mesos can be used for my
requirement.
*Current Setup/Environment*
2 physical machines each has RAM16gb, 1CPU(4core), Linux OS
Both physical machine has same services running
· apache httpd
· 10+ web servers instances
· (rdbms) database
· rabbitmQ service
At any point of time, only one physical machine is active (serves the
request) and the other physical machine is in standby mode. All the
requests are served but the active physical machine while the standby
physical machine is unused.
When the active physical machine goes down (fails), the standby machine
become active and it servers the request.
so at any point in time, only one physical machine is utilized.
Using Mesos, is there a way to use both the physical machine resource at
the same time.
Thank you in advance,
On Tue, Jul 9, 2019 at 1:29 AM Hans van den Bogert <ha...@gmail.com>
wrote:
> I think gokula isn't using mesos at all atm and is researching if there
> are better options than his current failover environment.
>
> Under the above assumption:
>
> To answer gokula, yes mesos would allow you to use resources of multiple
> machines, however I think the overhead of running multiple mesos masters
> (for failover like you have now) isn't worth it for two machines, though
> that ultimately depends on the 'beefyness' of the hardware in question.
>
> It also depends on how you expect a mesos cluster to behave in comparison
> to your current cluster. Can you elaborate on your current
> setup/environment?
>
> Hans
>
--
Thanks and Regards,
Gokula
Re: How to Use 2 physical machine resource at the same time
Posted by Hans van den Bogert <ha...@gmail.com>.
I think gokula isn't using mesos at all atm and is researching if there are
better options than his current failover environment.
Under the above assumption:
To answer gokula, yes mesos would allow you to use resources of multiple
machines, however I think the overhead of running multiple mesos masters
(for failover like you have now) isn't worth it for two machines, though
that ultimately depends on the 'beefyness' of the hardware in question.
It also depends on how you expect a mesos cluster to behave in comparison
to your current cluster. Can you elaborate on your current
setup/environment?
Hans
Re: How to Use 2 physical machine resource at the same time
Posted by Abel Souza <ab...@cs.umu.se>.
* Just a misconception in my first sentence I'd like to fix:
By default, Mesos never creates an offer with resources coming from two
different physical nodes (hosts).
The rest I keep. Sorry for that.
Hopefully it is clearer now,
/Abel
On 7/8/19 9:02 PM, Abel Souza wrote:
>
> By default Mesos never offers resources from two different physical
> nodes. In order to do so, one has to create his/her own scheduler
> enabling the management of (perhaps many) different Mesos offers so to
> satisfy higher level framework constraints.
>
> People usually suggest using Marathon to overcome this, but the "Note"
> on the following link
> https://mesosphere.github.io/marathon/docs/waiting.html clearly
> states: "The required resources (such as CPU, Mem, Disk, and Ports)
> must all be available on a single host."
>
> Best,
>
> /Abel
>
> On 7/8/19 8:42 PM, Vinod Kone wrote:
>> Hi Gokula,
>>
>> Not sure I follow what you are asking here. What do you mean by one
>> node is active and other passive at any point in time? Are you saying
>> your framework (marathon?) is launching all your web-servers on a
>> single node whereas you want them to be distributed evenly across 2
>> nodes? If yes, you could look at using marathon constraints
>> <https://mesosphere.github.io/marathon/docs/constraints.html> to
>> balance them better.
>>
>> On Mon, Jul 8, 2019 at 11:29 AM Gokula Krishnan
>> <gokula.p.krishnan@gmail.com <ma...@gmail.com>> wrote:
>>
>> Dear All,
>> Thanks in advance and need your inputs for my requirement.
>>
>> I have 2 nodes (physical machines)
>> There 20+ web servers running
>> 2 nodes are in active and passive mode
>> Problem: At any point in time only one node is active and other
>> node is passive.
>>
>> Solution: want to use the capacity of both the 2 nodes at the
>> same time.
>>
>> Will Mesos dcos use the resource of 2 nodes at the same time ?
>> How can i deploy webservers and use both the nodes resources.
>>
>> Thank you in advance
>>
>>
>>
>> --
>> Thanks and Regards,
>> Gokula
>>
Re: How to Use 2 physical machine resource at the same time
Posted by Abel Souza <ab...@cs.umu.se>.
By default Mesos never offers resources from two different physical
nodes. In order to do so, one has to create his/her own scheduler
enabling the management of (perhaps many) different Mesos offers so to
satisfy higher level framework constraints.
People usually suggest using Marathon to overcome this, but the "Note"
on the following link
https://mesosphere.github.io/marathon/docs/waiting.html clearly states:
"The required resources (such as CPU, Mem, Disk, and Ports) must all be
available on a single host."
Best,
/Abel
On 7/8/19 8:42 PM, Vinod Kone wrote:
> Hi Gokula,
>
> Not sure I follow what you are asking here. What do you mean by one
> node is active and other passive at any point in time? Are you saying
> your framework (marathon?) is launching all your web-servers on a
> single node whereas you want them to be distributed evenly across 2
> nodes? If yes, you could look at using marathon constraints
> <https://mesosphere.github.io/marathon/docs/constraints.html> to
> balance them better.
>
> On Mon, Jul 8, 2019 at 11:29 AM Gokula Krishnan
> <gokula.p.krishnan@gmail.com <ma...@gmail.com>> wrote:
>
> Dear All,
> Thanks in advance and need your inputs for my requirement.
>
> I have 2 nodes (physical machines)
> There 20+ web servers running
> 2 nodes are in active and passive mode
> Problem: At any point in time only one node is active and other
> node is passive.
>
> Solution: want to use the capacity of both the 2 nodes at the same
> time.
>
> Will Mesos dcos use the resource of 2 nodes at the same time ?
> How can i deploy webservers and use both the nodes resources.
>
> Thank you in advance
>
>
>
> --
> Thanks and Regards,
> Gokula
>
Re: How to Use 2 physical machine resource at the same time
Posted by Vinod Kone <vi...@apache.org>.
Hi Gokula,
Not sure I follow what you are asking here. What do you mean by one node is
active and other passive at any point in time? Are you saying your
framework (marathon?) is launching all your web-servers on a single node
whereas you want them to be distributed evenly across 2 nodes? If yes, you
could look at using marathon constraints
<https://mesosphere.github.io/marathon/docs/constraints.html> to balance
them better.
On Mon, Jul 8, 2019 at 11:29 AM Gokula Krishnan <go...@gmail.com>
wrote:
> Dear All,
> Thanks in advance and need your inputs for my requirement.
>
> I have 2 nodes (physical machines)
> There 20+ web servers running
> 2 nodes are in active and passive mode
> Problem: At any point in time only one node is active and other node is
> passive.
>
> Solution: want to use the capacity of both the 2 nodes at the same time.
>
> Will Mesos dcos use the resource of 2 nodes at the same time ?
> How can i deploy webservers and use both the nodes resources.
>
> Thank you in advance
>
>
>
> --
> Thanks and Regards,
> Gokula
>
>