You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@mesos.apache.org by Rafael Capucho <ra...@gmail.com> on 2015/09/30 00:55:51 UTC
Detect Slave Memory Resources
Hello,
This slave is running in a 2gb ram VM (KVM), inside a docker, with other
dockers (zookeeper, mesos master and marathon) just it. All the elements
almost empty because it isn't production ready, just a test environment.
But the slave are recognized as 999 Mem, almost half of what it is.
Is it right?
The mesos-slave alocates others dockers, I dont understand if my mesos
slave should take all the available ram recognized and it will split this
ram in the dockers this mesos-slave will launch, or the ram that the slave
uses need to be lower than is available to live memery for the other
dockers, or what?
Thank you.
Some commands in the VM:
*root@localhost:~# free -mh *
total used free shared buffers cached
Mem: 2.0G 1.4G 606M 528K 40M 778M
-/+ buffers/cache: 573M 1.4G
Swap: 255M 64K 255M
*root@localhost:~# vmstat -s *
2047052 K total memory
1420544 K used memory
768100 K active memory
540012 K inactive memory
626508 K free memory
42284 K buffer memory
797820 K swap cache
262140 K total swap
64 K used swap
262076 K free swap
24227 non-nice user cpu ticks
0 nice user cpu ticks
16150 system cpu ticks
1860131 idle cpu ticks
3034 IO-wait cpu ticks
0 IRQ cpu ticks
669 softirq cpu ticks
373 stolen cpu ticks
1088477 pages paged in
300348 pages paged out
824 pages swapped in
872 pages swapped out
2518291 interrupts
7404399 CPU context switches
1443557461 boot time
9559 forks
*root@localhost:~# cat /proc/meminfo *
MemTotal: 2047052 kB
MemFree: 626532 kB
MemAvailable: 1471856 kB
Buffers: 42360 kB
Cached: 797860 kB
SwapCached: 64 kB
Active: 768112 kB
Inactive: 540036 kB
Active(anon): 441100 kB
Inactive(anon): 27152 kB
Active(file): 327012 kB
Inactive(file): 512884 kB
Unevictable: 0 kB
Mlocked: 0 kB
SwapTotal: 262140 kB
SwapFree: 262076 kB
Dirty: 92 kB
Writeback: 0 kB
AnonPages: 467752 kB
Mapped: 229020 kB
Shmem: 528 kB
Slab: 48448 kB
SReclaimable: 26836 kB
SUnreclaim: 21612 kB
KernelStack: 4528 kB
PageTables: 6052 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 1285664 kB
Committed_AS: 1534672 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 12828 kB
VmallocChunk: 34359702888 kB
DirectMap4k: 20352 kB
DirectMap2M: 2076672 kB
DirectMap1G: 0 kB
--
Rafael Capucho
Bachelor of Computer Science
Federal University of São Paulo
Institute of Science and Technology - ICT
PGP-Public Key: 2048R/7389A96F pgp.mit.edu
FP: EDB5 CDEE 8442 99CC C92D 9173 6B32 A5C9 7389 A96F
Re: Detect Slave Memory Resources
Posted by Vinod Kone <vi...@gmail.com>.
start mesos slave with "--resources" explicitly set to what you want it to
offer.
On Tue, Sep 29, 2015 at 5:12 PM, Rafael Capucho <ra...@gmail.com>
wrote:
> I solve the Warning by disabling swap memory, like that:
>
> --memory-swap=-1 \
> --memory="2G" \
>
> But in MESOS UI I still see 999mb of memory available, even using
> --memory="2g" to up mesos slave.
>
> Thanks
>
>
>
> On Tue, Sep 29, 2015 at 8:54 PM, Rafael Capucho <ra...@gmail.com>
> wrote:
>
>> I tried and ran mesos slave docker using --memory flag, like:
>>
>> --memory="2G"
>>
>> but it returns:
>>
>> WARNING: Your kernel does not support swap limit capabilities, memory
>> limited without swap.
>>
>> Finding for a solution, docker docs
>> <https://docs.docker.com/installation/ubuntulinux/#adjust-memory-and-swap-accounting>
>> says to alter /etc/default/grub but my VPS in Linode doesnt even have
>> grub installed, this files doesnt exist.
>>
>> Any Ideas? Thank you.
>>
>>
>>
>>
>>
>>
>> On Tue, Sep 29, 2015 at 7:55 PM, Rafael Capucho <rafael.capucho@gmail.com
>> > wrote:
>>
>>> Hello,
>>>
>>> This slave is running in a 2gb ram VM (KVM), inside a docker, with other
>>> dockers (zookeeper, mesos master and marathon) just it. All the elements
>>> almost empty because it isn't production ready, just a test environment.
>>>
>>> But the slave are recognized as 999 Mem, almost half of what it is.
>>>
>>> Is it right?
>>>
>>>
>>>
>>>
>>> The mesos-slave alocates others dockers, I dont understand if my mesos
>>> slave should take all the available ram recognized and it will split this
>>> ram in the dockers this mesos-slave will launch, or the ram that the slave
>>> uses need to be lower than is available to live memery for the other
>>> dockers, or what?
>>>
>>> Thank you.
>>>
>>> Some commands in the VM:
>>>
>>> *root@localhost:~# free -mh *
>>> total used free shared buffers cached
>>> Mem: 2.0G 1.4G 606M 528K 40M
>>> 778M
>>> -/+ buffers/cache: 573M 1.4G
>>> Swap: 255M 64K 255M
>>>
>>>
>>> *root@localhost:~# vmstat -s *
>>> 2047052 K total memory
>>> 1420544 K used memory
>>> 768100 K active memory
>>> 540012 K inactive memory
>>> 626508 K free memory
>>> 42284 K buffer memory
>>> 797820 K swap cache
>>> 262140 K total swap
>>> 64 K used swap
>>> 262076 K free swap
>>> 24227 non-nice user cpu ticks
>>> 0 nice user cpu ticks
>>> 16150 system cpu ticks
>>> 1860131 idle cpu ticks
>>> 3034 IO-wait cpu ticks
>>> 0 IRQ cpu ticks
>>> 669 softirq cpu ticks
>>> 373 stolen cpu ticks
>>> 1088477 pages paged in
>>> 300348 pages paged out
>>> 824 pages swapped in
>>> 872 pages swapped out
>>> 2518291 interrupts
>>> 7404399 CPU context switches
>>> 1443557461 boot time
>>> 9559 forks
>>>
>>> *root@localhost:~# cat /proc/meminfo *
>>> MemTotal: 2047052 kB
>>> MemFree: 626532 kB
>>> MemAvailable: 1471856 kB
>>> Buffers: 42360 kB
>>> Cached: 797860 kB
>>> SwapCached: 64 kB
>>> Active: 768112 kB
>>> Inactive: 540036 kB
>>> Active(anon): 441100 kB
>>> Inactive(anon): 27152 kB
>>> Active(file): 327012 kB
>>> Inactive(file): 512884 kB
>>> Unevictable: 0 kB
>>> Mlocked: 0 kB
>>> SwapTotal: 262140 kB
>>> SwapFree: 262076 kB
>>> Dirty: 92 kB
>>> Writeback: 0 kB
>>> AnonPages: 467752 kB
>>> Mapped: 229020 kB
>>> Shmem: 528 kB
>>> Slab: 48448 kB
>>> SReclaimable: 26836 kB
>>> SUnreclaim: 21612 kB
>>> KernelStack: 4528 kB
>>> PageTables: 6052 kB
>>> NFS_Unstable: 0 kB
>>> Bounce: 0 kB
>>> WritebackTmp: 0 kB
>>> CommitLimit: 1285664 kB
>>> Committed_AS: 1534672 kB
>>> VmallocTotal: 34359738367 kB
>>> VmallocUsed: 12828 kB
>>> VmallocChunk: 34359702888 kB
>>> DirectMap4k: 20352 kB
>>> DirectMap2M: 2076672 kB
>>> DirectMap1G: 0 kB
>>>
>>>
>>>
>>> --
>>> Rafael Capucho
>>>
>>> Bachelor of Computer Science
>>> Federal University of São Paulo
>>> Institute of Science and Technology - ICT
>>>
>>> PGP-Public Key: 2048R/7389A96F pgp.mit.edu
>>> FP: EDB5 CDEE 8442 99CC C92D 9173 6B32 A5C9 7389 A96F
>>>
>>
>>
>>
>> --
>> --
>> Rafael Capucho
>>
>> Bachelor of Computer Science
>> Federal University of São Paulo
>> Institute of Science and Technology - ICT
>>
>> PGP-Public Key: 2048R/7389A96F pgp.mit.edu
>> FP: EDB5 CDEE 8442 99CC C92D 9173 6B32 A5C9 7389 A96F
>>
>
>
>
> --
> --
> Rafael Capucho
>
> Bachelor of Computer Science
> Federal University of São Paulo
> Institute of Science and Technology - ICT
>
> PGP-Public Key: 2048R/7389A96F pgp.mit.edu
> FP: EDB5 CDEE 8442 99CC C92D 9173 6B32 A5C9 7389 A96F
>
Re: Detect Slave Memory Resources
Posted by Rafael Capucho <ra...@gmail.com>.
@tommy xiao
Thank you, I leave it with 1500M, being 500M to S.O. context
Thank you all
On Tue, Sep 29, 2015 at 10:33 PM, tommy xiao <xi...@gmail.com> wrote:
> @Rafael Capucho
>
> Even you can set the total memory, i suggest give some memory to system.
>
>
>
> 2015-09-30 8:35 GMT+08:00 Rafael Capucho <ra...@gmail.com>:
>
>> Solved by using:
>>
>> -e "MESOS_RESOURCES=cpus(*):2; mem(*):2000" \
>>
>> When start mesos slave container.
>>
>>
>> On Tue, Sep 29, 2015 at 9:12 PM, Rafael Capucho <rafael.capucho@gmail.com
>> > wrote:
>>
>>> I solve the Warning by disabling swap memory, like that:
>>>
>>> --memory-swap=-1 \
>>> --memory="2G" \
>>>
>>> But in MESOS UI I still see 999mb of memory available, even using
>>> --memory="2g" to up mesos slave.
>>>
>>> Thanks
>>>
>>>
>>>
>>> On Tue, Sep 29, 2015 at 8:54 PM, Rafael Capucho <
>>> rafael.capucho@gmail.com> wrote:
>>>
>>>> I tried and ran mesos slave docker using --memory flag, like:
>>>>
>>>> --memory="2G"
>>>>
>>>> but it returns:
>>>>
>>>> WARNING: Your kernel does not support swap limit capabilities, memory
>>>> limited without swap.
>>>>
>>>> Finding for a solution, docker docs
>>>> <https://docs.docker.com/installation/ubuntulinux/#adjust-memory-and-swap-accounting>
>>>> says to alter /etc/default/grub but my VPS in Linode doesnt even have
>>>> grub installed, this files doesnt exist.
>>>>
>>>> Any Ideas? Thank you.
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> On Tue, Sep 29, 2015 at 7:55 PM, Rafael Capucho <
>>>> rafael.capucho@gmail.com> wrote:
>>>>
>>>>> Hello,
>>>>>
>>>>> This slave is running in a 2gb ram VM (KVM), inside a docker, with
>>>>> other dockers (zookeeper, mesos master and marathon) just it. All the
>>>>> elements almost empty because it isn't production ready, just a test
>>>>> environment.
>>>>>
>>>>> But the slave are recognized as 999 Mem, almost half of what it is.
>>>>>
>>>>> Is it right?
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> The mesos-slave alocates others dockers, I dont understand if my mesos
>>>>> slave should take all the available ram recognized and it will split this
>>>>> ram in the dockers this mesos-slave will launch, or the ram that the slave
>>>>> uses need to be lower than is available to live memery for the other
>>>>> dockers, or what?
>>>>>
>>>>> Thank you.
>>>>>
>>>>> Some commands in the VM:
>>>>>
>>>>> *root@localhost:~# free -mh *
>>>>> total used free shared buffers
>>>>> cached
>>>>> Mem: 2.0G 1.4G 606M 528K 40M
>>>>> 778M
>>>>> -/+ buffers/cache: 573M 1.4G
>>>>> Swap: 255M 64K 255M
>>>>>
>>>>>
>>>>> *root@localhost:~# vmstat -s *
>>>>> 2047052 K total memory
>>>>> 1420544 K used memory
>>>>> 768100 K active memory
>>>>> 540012 K inactive memory
>>>>> 626508 K free memory
>>>>> 42284 K buffer memory
>>>>> 797820 K swap cache
>>>>> 262140 K total swap
>>>>> 64 K used swap
>>>>> 262076 K free swap
>>>>> 24227 non-nice user cpu ticks
>>>>> 0 nice user cpu ticks
>>>>> 16150 system cpu ticks
>>>>> 1860131 idle cpu ticks
>>>>> 3034 IO-wait cpu ticks
>>>>> 0 IRQ cpu ticks
>>>>> 669 softirq cpu ticks
>>>>> 373 stolen cpu ticks
>>>>> 1088477 pages paged in
>>>>> 300348 pages paged out
>>>>> 824 pages swapped in
>>>>> 872 pages swapped out
>>>>> 2518291 interrupts
>>>>> 7404399 CPU context switches
>>>>> 1443557461 boot time
>>>>> 9559 forks
>>>>>
>>>>> *root@localhost:~# cat /proc/meminfo *
>>>>> MemTotal: 2047052 kB
>>>>> MemFree: 626532 kB
>>>>> MemAvailable: 1471856 kB
>>>>> Buffers: 42360 kB
>>>>> Cached: 797860 kB
>>>>> SwapCached: 64 kB
>>>>> Active: 768112 kB
>>>>> Inactive: 540036 kB
>>>>> Active(anon): 441100 kB
>>>>> Inactive(anon): 27152 kB
>>>>> Active(file): 327012 kB
>>>>> Inactive(file): 512884 kB
>>>>> Unevictable: 0 kB
>>>>> Mlocked: 0 kB
>>>>> SwapTotal: 262140 kB
>>>>> SwapFree: 262076 kB
>>>>> Dirty: 92 kB
>>>>> Writeback: 0 kB
>>>>> AnonPages: 467752 kB
>>>>> Mapped: 229020 kB
>>>>> Shmem: 528 kB
>>>>> Slab: 48448 kB
>>>>> SReclaimable: 26836 kB
>>>>> SUnreclaim: 21612 kB
>>>>> KernelStack: 4528 kB
>>>>> PageTables: 6052 kB
>>>>> NFS_Unstable: 0 kB
>>>>> Bounce: 0 kB
>>>>> WritebackTmp: 0 kB
>>>>> CommitLimit: 1285664 kB
>>>>> Committed_AS: 1534672 kB
>>>>> VmallocTotal: 34359738367 kB
>>>>> VmallocUsed: 12828 kB
>>>>> VmallocChunk: 34359702888 kB
>>>>> DirectMap4k: 20352 kB
>>>>> DirectMap2M: 2076672 kB
>>>>> DirectMap1G: 0 kB
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Rafael Capucho
>>>>>
>>>>> Bachelor of Computer Science
>>>>> Federal University of São Paulo
>>>>> Institute of Science and Technology - ICT
>>>>>
>>>>> PGP-Public Key: 2048R/7389A96F pgp.mit.edu
>>>>> FP: EDB5 CDEE 8442 99CC C92D 9173 6B32 A5C9 7389 A96F
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> --
>>>> Rafael Capucho
>>>>
>>>> Bachelor of Computer Science
>>>> Federal University of São Paulo
>>>> Institute of Science and Technology - ICT
>>>>
>>>> PGP-Public Key: 2048R/7389A96F pgp.mit.edu
>>>> FP: EDB5 CDEE 8442 99CC C92D 9173 6B32 A5C9 7389 A96F
>>>>
>>>
>>>
>>>
>>> --
>>> --
>>> Rafael Capucho
>>>
>>> Bachelor of Computer Science
>>> Federal University of São Paulo
>>> Institute of Science and Technology - ICT
>>>
>>> PGP-Public Key: 2048R/7389A96F pgp.mit.edu
>>> FP: EDB5 CDEE 8442 99CC C92D 9173 6B32 A5C9 7389 A96F
>>>
>>
>>
>>
>> --
>> --
>> Rafael Capucho
>>
>> Bachelor of Computer Science
>> Federal University of São Paulo
>> Institute of Science and Technology - ICT
>>
>> PGP-Public Key: 2048R/7389A96F pgp.mit.edu
>> FP: EDB5 CDEE 8442 99CC C92D 9173 6B32 A5C9 7389 A96F
>>
>
>
>
> --
> Deshi Xiao
> Twitter: xds2000
> E-mail: xiaods(AT)gmail.com
>
--
--
Rafael Capucho
Bachelor of Computer Science
Federal University of São Paulo
Institute of Science and Technology - ICT
PGP-Public Key: 2048R/7389A96F pgp.mit.edu
FP: EDB5 CDEE 8442 99CC C92D 9173 6B32 A5C9 7389 A96F
Re: Detect Slave Memory Resources
Posted by tommy xiao <xi...@gmail.com>.
@Rafael Capucho
Even you can set the total memory, i suggest give some memory to system.
2015-09-30 8:35 GMT+08:00 Rafael Capucho <ra...@gmail.com>:
> Solved by using:
>
> -e "MESOS_RESOURCES=cpus(*):2; mem(*):2000" \
>
> When start mesos slave container.
>
>
> On Tue, Sep 29, 2015 at 9:12 PM, Rafael Capucho <ra...@gmail.com>
> wrote:
>
>> I solve the Warning by disabling swap memory, like that:
>>
>> --memory-swap=-1 \
>> --memory="2G" \
>>
>> But in MESOS UI I still see 999mb of memory available, even using
>> --memory="2g" to up mesos slave.
>>
>> Thanks
>>
>>
>>
>> On Tue, Sep 29, 2015 at 8:54 PM, Rafael Capucho <rafael.capucho@gmail.com
>> > wrote:
>>
>>> I tried and ran mesos slave docker using --memory flag, like:
>>>
>>> --memory="2G"
>>>
>>> but it returns:
>>>
>>> WARNING: Your kernel does not support swap limit capabilities, memory
>>> limited without swap.
>>>
>>> Finding for a solution, docker docs
>>> <https://docs.docker.com/installation/ubuntulinux/#adjust-memory-and-swap-accounting>
>>> says to alter /etc/default/grub but my VPS in Linode doesnt even have
>>> grub installed, this files doesnt exist.
>>>
>>> Any Ideas? Thank you.
>>>
>>>
>>>
>>>
>>>
>>>
>>> On Tue, Sep 29, 2015 at 7:55 PM, Rafael Capucho <
>>> rafael.capucho@gmail.com> wrote:
>>>
>>>> Hello,
>>>>
>>>> This slave is running in a 2gb ram VM (KVM), inside a docker, with
>>>> other dockers (zookeeper, mesos master and marathon) just it. All the
>>>> elements almost empty because it isn't production ready, just a test
>>>> environment.
>>>>
>>>> But the slave are recognized as 999 Mem, almost half of what it is.
>>>>
>>>> Is it right?
>>>>
>>>>
>>>>
>>>>
>>>> The mesos-slave alocates others dockers, I dont understand if my mesos
>>>> slave should take all the available ram recognized and it will split this
>>>> ram in the dockers this mesos-slave will launch, or the ram that the slave
>>>> uses need to be lower than is available to live memery for the other
>>>> dockers, or what?
>>>>
>>>> Thank you.
>>>>
>>>> Some commands in the VM:
>>>>
>>>> *root@localhost:~# free -mh *
>>>> total used free shared buffers
>>>> cached
>>>> Mem: 2.0G 1.4G 606M 528K 40M
>>>> 778M
>>>> -/+ buffers/cache: 573M 1.4G
>>>> Swap: 255M 64K 255M
>>>>
>>>>
>>>> *root@localhost:~# vmstat -s *
>>>> 2047052 K total memory
>>>> 1420544 K used memory
>>>> 768100 K active memory
>>>> 540012 K inactive memory
>>>> 626508 K free memory
>>>> 42284 K buffer memory
>>>> 797820 K swap cache
>>>> 262140 K total swap
>>>> 64 K used swap
>>>> 262076 K free swap
>>>> 24227 non-nice user cpu ticks
>>>> 0 nice user cpu ticks
>>>> 16150 system cpu ticks
>>>> 1860131 idle cpu ticks
>>>> 3034 IO-wait cpu ticks
>>>> 0 IRQ cpu ticks
>>>> 669 softirq cpu ticks
>>>> 373 stolen cpu ticks
>>>> 1088477 pages paged in
>>>> 300348 pages paged out
>>>> 824 pages swapped in
>>>> 872 pages swapped out
>>>> 2518291 interrupts
>>>> 7404399 CPU context switches
>>>> 1443557461 boot time
>>>> 9559 forks
>>>>
>>>> *root@localhost:~# cat /proc/meminfo *
>>>> MemTotal: 2047052 kB
>>>> MemFree: 626532 kB
>>>> MemAvailable: 1471856 kB
>>>> Buffers: 42360 kB
>>>> Cached: 797860 kB
>>>> SwapCached: 64 kB
>>>> Active: 768112 kB
>>>> Inactive: 540036 kB
>>>> Active(anon): 441100 kB
>>>> Inactive(anon): 27152 kB
>>>> Active(file): 327012 kB
>>>> Inactive(file): 512884 kB
>>>> Unevictable: 0 kB
>>>> Mlocked: 0 kB
>>>> SwapTotal: 262140 kB
>>>> SwapFree: 262076 kB
>>>> Dirty: 92 kB
>>>> Writeback: 0 kB
>>>> AnonPages: 467752 kB
>>>> Mapped: 229020 kB
>>>> Shmem: 528 kB
>>>> Slab: 48448 kB
>>>> SReclaimable: 26836 kB
>>>> SUnreclaim: 21612 kB
>>>> KernelStack: 4528 kB
>>>> PageTables: 6052 kB
>>>> NFS_Unstable: 0 kB
>>>> Bounce: 0 kB
>>>> WritebackTmp: 0 kB
>>>> CommitLimit: 1285664 kB
>>>> Committed_AS: 1534672 kB
>>>> VmallocTotal: 34359738367 kB
>>>> VmallocUsed: 12828 kB
>>>> VmallocChunk: 34359702888 kB
>>>> DirectMap4k: 20352 kB
>>>> DirectMap2M: 2076672 kB
>>>> DirectMap1G: 0 kB
>>>>
>>>>
>>>>
>>>> --
>>>> Rafael Capucho
>>>>
>>>> Bachelor of Computer Science
>>>> Federal University of São Paulo
>>>> Institute of Science and Technology - ICT
>>>>
>>>> PGP-Public Key: 2048R/7389A96F pgp.mit.edu
>>>> FP: EDB5 CDEE 8442 99CC C92D 9173 6B32 A5C9 7389 A96F
>>>>
>>>
>>>
>>>
>>> --
>>> --
>>> Rafael Capucho
>>>
>>> Bachelor of Computer Science
>>> Federal University of São Paulo
>>> Institute of Science and Technology - ICT
>>>
>>> PGP-Public Key: 2048R/7389A96F pgp.mit.edu
>>> FP: EDB5 CDEE 8442 99CC C92D 9173 6B32 A5C9 7389 A96F
>>>
>>
>>
>>
>> --
>> --
>> Rafael Capucho
>>
>> Bachelor of Computer Science
>> Federal University of São Paulo
>> Institute of Science and Technology - ICT
>>
>> PGP-Public Key: 2048R/7389A96F pgp.mit.edu
>> FP: EDB5 CDEE 8442 99CC C92D 9173 6B32 A5C9 7389 A96F
>>
>
>
>
> --
> --
> Rafael Capucho
>
> Bachelor of Computer Science
> Federal University of São Paulo
> Institute of Science and Technology - ICT
>
> PGP-Public Key: 2048R/7389A96F pgp.mit.edu
> FP: EDB5 CDEE 8442 99CC C92D 9173 6B32 A5C9 7389 A96F
>
--
Deshi Xiao
Twitter: xds2000
E-mail: xiaods(AT)gmail.com
Re: Detect Slave Memory Resources
Posted by Rafael Capucho <ra...@gmail.com>.
Solved by using:
-e "MESOS_RESOURCES=cpus(*):2; mem(*):2000" \
When start mesos slave container.
On Tue, Sep 29, 2015 at 9:12 PM, Rafael Capucho <ra...@gmail.com>
wrote:
> I solve the Warning by disabling swap memory, like that:
>
> --memory-swap=-1 \
> --memory="2G" \
>
> But in MESOS UI I still see 999mb of memory available, even using
> --memory="2g" to up mesos slave.
>
> Thanks
>
>
>
> On Tue, Sep 29, 2015 at 8:54 PM, Rafael Capucho <ra...@gmail.com>
> wrote:
>
>> I tried and ran mesos slave docker using --memory flag, like:
>>
>> --memory="2G"
>>
>> but it returns:
>>
>> WARNING: Your kernel does not support swap limit capabilities, memory
>> limited without swap.
>>
>> Finding for a solution, docker docs
>> <https://docs.docker.com/installation/ubuntulinux/#adjust-memory-and-swap-accounting>
>> says to alter /etc/default/grub but my VPS in Linode doesnt even have
>> grub installed, this files doesnt exist.
>>
>> Any Ideas? Thank you.
>>
>>
>>
>>
>>
>>
>> On Tue, Sep 29, 2015 at 7:55 PM, Rafael Capucho <rafael.capucho@gmail.com
>> > wrote:
>>
>>> Hello,
>>>
>>> This slave is running in a 2gb ram VM (KVM), inside a docker, with other
>>> dockers (zookeeper, mesos master and marathon) just it. All the elements
>>> almost empty because it isn't production ready, just a test environment.
>>>
>>> But the slave are recognized as 999 Mem, almost half of what it is.
>>>
>>> Is it right?
>>>
>>>
>>>
>>>
>>> The mesos-slave alocates others dockers, I dont understand if my mesos
>>> slave should take all the available ram recognized and it will split this
>>> ram in the dockers this mesos-slave will launch, or the ram that the slave
>>> uses need to be lower than is available to live memery for the other
>>> dockers, or what?
>>>
>>> Thank you.
>>>
>>> Some commands in the VM:
>>>
>>> *root@localhost:~# free -mh *
>>> total used free shared buffers cached
>>> Mem: 2.0G 1.4G 606M 528K 40M
>>> 778M
>>> -/+ buffers/cache: 573M 1.4G
>>> Swap: 255M 64K 255M
>>>
>>>
>>> *root@localhost:~# vmstat -s *
>>> 2047052 K total memory
>>> 1420544 K used memory
>>> 768100 K active memory
>>> 540012 K inactive memory
>>> 626508 K free memory
>>> 42284 K buffer memory
>>> 797820 K swap cache
>>> 262140 K total swap
>>> 64 K used swap
>>> 262076 K free swap
>>> 24227 non-nice user cpu ticks
>>> 0 nice user cpu ticks
>>> 16150 system cpu ticks
>>> 1860131 idle cpu ticks
>>> 3034 IO-wait cpu ticks
>>> 0 IRQ cpu ticks
>>> 669 softirq cpu ticks
>>> 373 stolen cpu ticks
>>> 1088477 pages paged in
>>> 300348 pages paged out
>>> 824 pages swapped in
>>> 872 pages swapped out
>>> 2518291 interrupts
>>> 7404399 CPU context switches
>>> 1443557461 boot time
>>> 9559 forks
>>>
>>> *root@localhost:~# cat /proc/meminfo *
>>> MemTotal: 2047052 kB
>>> MemFree: 626532 kB
>>> MemAvailable: 1471856 kB
>>> Buffers: 42360 kB
>>> Cached: 797860 kB
>>> SwapCached: 64 kB
>>> Active: 768112 kB
>>> Inactive: 540036 kB
>>> Active(anon): 441100 kB
>>> Inactive(anon): 27152 kB
>>> Active(file): 327012 kB
>>> Inactive(file): 512884 kB
>>> Unevictable: 0 kB
>>> Mlocked: 0 kB
>>> SwapTotal: 262140 kB
>>> SwapFree: 262076 kB
>>> Dirty: 92 kB
>>> Writeback: 0 kB
>>> AnonPages: 467752 kB
>>> Mapped: 229020 kB
>>> Shmem: 528 kB
>>> Slab: 48448 kB
>>> SReclaimable: 26836 kB
>>> SUnreclaim: 21612 kB
>>> KernelStack: 4528 kB
>>> PageTables: 6052 kB
>>> NFS_Unstable: 0 kB
>>> Bounce: 0 kB
>>> WritebackTmp: 0 kB
>>> CommitLimit: 1285664 kB
>>> Committed_AS: 1534672 kB
>>> VmallocTotal: 34359738367 kB
>>> VmallocUsed: 12828 kB
>>> VmallocChunk: 34359702888 kB
>>> DirectMap4k: 20352 kB
>>> DirectMap2M: 2076672 kB
>>> DirectMap1G: 0 kB
>>>
>>>
>>>
>>> --
>>> Rafael Capucho
>>>
>>> Bachelor of Computer Science
>>> Federal University of São Paulo
>>> Institute of Science and Technology - ICT
>>>
>>> PGP-Public Key: 2048R/7389A96F pgp.mit.edu
>>> FP: EDB5 CDEE 8442 99CC C92D 9173 6B32 A5C9 7389 A96F
>>>
>>
>>
>>
>> --
>> --
>> Rafael Capucho
>>
>> Bachelor of Computer Science
>> Federal University of São Paulo
>> Institute of Science and Technology - ICT
>>
>> PGP-Public Key: 2048R/7389A96F pgp.mit.edu
>> FP: EDB5 CDEE 8442 99CC C92D 9173 6B32 A5C9 7389 A96F
>>
>
>
>
> --
> --
> Rafael Capucho
>
> Bachelor of Computer Science
> Federal University of São Paulo
> Institute of Science and Technology - ICT
>
> PGP-Public Key: 2048R/7389A96F pgp.mit.edu
> FP: EDB5 CDEE 8442 99CC C92D 9173 6B32 A5C9 7389 A96F
>
--
--
Rafael Capucho
Bachelor of Computer Science
Federal University of São Paulo
Institute of Science and Technology - ICT
PGP-Public Key: 2048R/7389A96F pgp.mit.edu
FP: EDB5 CDEE 8442 99CC C92D 9173 6B32 A5C9 7389 A96F
Re: Detect Slave Memory Resources
Posted by Rafael Capucho <ra...@gmail.com>.
I solve the Warning by disabling swap memory, like that:
--memory-swap=-1 \
--memory="2G" \
But in MESOS UI I still see 999mb of memory available, even using
--memory="2g" to up mesos slave.
Thanks
On Tue, Sep 29, 2015 at 8:54 PM, Rafael Capucho <ra...@gmail.com>
wrote:
> I tried and ran mesos slave docker using --memory flag, like:
>
> --memory="2G"
>
> but it returns:
>
> WARNING: Your kernel does not support swap limit capabilities, memory
> limited without swap.
>
> Finding for a solution, docker docs
> <https://docs.docker.com/installation/ubuntulinux/#adjust-memory-and-swap-accounting>
> says to alter /etc/default/grub but my VPS in Linode doesnt even have
> grub installed, this files doesnt exist.
>
> Any Ideas? Thank you.
>
>
>
>
>
>
> On Tue, Sep 29, 2015 at 7:55 PM, Rafael Capucho <ra...@gmail.com>
> wrote:
>
>> Hello,
>>
>> This slave is running in a 2gb ram VM (KVM), inside a docker, with other
>> dockers (zookeeper, mesos master and marathon) just it. All the elements
>> almost empty because it isn't production ready, just a test environment.
>>
>> But the slave are recognized as 999 Mem, almost half of what it is.
>>
>> Is it right?
>>
>>
>>
>>
>> The mesos-slave alocates others dockers, I dont understand if my mesos
>> slave should take all the available ram recognized and it will split this
>> ram in the dockers this mesos-slave will launch, or the ram that the slave
>> uses need to be lower than is available to live memery for the other
>> dockers, or what?
>>
>> Thank you.
>>
>> Some commands in the VM:
>>
>> *root@localhost:~# free -mh *
>> total used free shared buffers cached
>> Mem: 2.0G 1.4G 606M 528K 40M 778M
>> -/+ buffers/cache: 573M 1.4G
>> Swap: 255M 64K 255M
>>
>>
>> *root@localhost:~# vmstat -s *
>> 2047052 K total memory
>> 1420544 K used memory
>> 768100 K active memory
>> 540012 K inactive memory
>> 626508 K free memory
>> 42284 K buffer memory
>> 797820 K swap cache
>> 262140 K total swap
>> 64 K used swap
>> 262076 K free swap
>> 24227 non-nice user cpu ticks
>> 0 nice user cpu ticks
>> 16150 system cpu ticks
>> 1860131 idle cpu ticks
>> 3034 IO-wait cpu ticks
>> 0 IRQ cpu ticks
>> 669 softirq cpu ticks
>> 373 stolen cpu ticks
>> 1088477 pages paged in
>> 300348 pages paged out
>> 824 pages swapped in
>> 872 pages swapped out
>> 2518291 interrupts
>> 7404399 CPU context switches
>> 1443557461 boot time
>> 9559 forks
>>
>> *root@localhost:~# cat /proc/meminfo *
>> MemTotal: 2047052 kB
>> MemFree: 626532 kB
>> MemAvailable: 1471856 kB
>> Buffers: 42360 kB
>> Cached: 797860 kB
>> SwapCached: 64 kB
>> Active: 768112 kB
>> Inactive: 540036 kB
>> Active(anon): 441100 kB
>> Inactive(anon): 27152 kB
>> Active(file): 327012 kB
>> Inactive(file): 512884 kB
>> Unevictable: 0 kB
>> Mlocked: 0 kB
>> SwapTotal: 262140 kB
>> SwapFree: 262076 kB
>> Dirty: 92 kB
>> Writeback: 0 kB
>> AnonPages: 467752 kB
>> Mapped: 229020 kB
>> Shmem: 528 kB
>> Slab: 48448 kB
>> SReclaimable: 26836 kB
>> SUnreclaim: 21612 kB
>> KernelStack: 4528 kB
>> PageTables: 6052 kB
>> NFS_Unstable: 0 kB
>> Bounce: 0 kB
>> WritebackTmp: 0 kB
>> CommitLimit: 1285664 kB
>> Committed_AS: 1534672 kB
>> VmallocTotal: 34359738367 kB
>> VmallocUsed: 12828 kB
>> VmallocChunk: 34359702888 kB
>> DirectMap4k: 20352 kB
>> DirectMap2M: 2076672 kB
>> DirectMap1G: 0 kB
>>
>>
>>
>> --
>> Rafael Capucho
>>
>> Bachelor of Computer Science
>> Federal University of São Paulo
>> Institute of Science and Technology - ICT
>>
>> PGP-Public Key: 2048R/7389A96F pgp.mit.edu
>> FP: EDB5 CDEE 8442 99CC C92D 9173 6B32 A5C9 7389 A96F
>>
>
>
>
> --
> --
> Rafael Capucho
>
> Bachelor of Computer Science
> Federal University of São Paulo
> Institute of Science and Technology - ICT
>
> PGP-Public Key: 2048R/7389A96F pgp.mit.edu
> FP: EDB5 CDEE 8442 99CC C92D 9173 6B32 A5C9 7389 A96F
>
--
--
Rafael Capucho
Bachelor of Computer Science
Federal University of São Paulo
Institute of Science and Technology - ICT
PGP-Public Key: 2048R/7389A96F pgp.mit.edu
FP: EDB5 CDEE 8442 99CC C92D 9173 6B32 A5C9 7389 A96F
Re: Detect Slave Memory Resources
Posted by Rafael Capucho <ra...@gmail.com>.
I tried and ran mesos slave docker using --memory flag, like:
--memory="2G"
but it returns:
WARNING: Your kernel does not support swap limit capabilities, memory
limited without swap.
Finding for a solution, docker docs
<https://docs.docker.com/installation/ubuntulinux/#adjust-memory-and-swap-accounting>
says to alter /etc/default/grub but my VPS in Linode doesnt even have grub
installed, this files doesnt exist.
Any Ideas? Thank you.
On Tue, Sep 29, 2015 at 7:55 PM, Rafael Capucho <ra...@gmail.com>
wrote:
> Hello,
>
> This slave is running in a 2gb ram VM (KVM), inside a docker, with other
> dockers (zookeeper, mesos master and marathon) just it. All the elements
> almost empty because it isn't production ready, just a test environment.
>
> But the slave are recognized as 999 Mem, almost half of what it is.
>
> Is it right?
>
>
>
>
> The mesos-slave alocates others dockers, I dont understand if my mesos
> slave should take all the available ram recognized and it will split this
> ram in the dockers this mesos-slave will launch, or the ram that the slave
> uses need to be lower than is available to live memery for the other
> dockers, or what?
>
> Thank you.
>
> Some commands in the VM:
>
> *root@localhost:~# free -mh *
> total used free shared buffers cached
> Mem: 2.0G 1.4G 606M 528K 40M 778M
> -/+ buffers/cache: 573M 1.4G
> Swap: 255M 64K 255M
>
>
> *root@localhost:~# vmstat -s *
> 2047052 K total memory
> 1420544 K used memory
> 768100 K active memory
> 540012 K inactive memory
> 626508 K free memory
> 42284 K buffer memory
> 797820 K swap cache
> 262140 K total swap
> 64 K used swap
> 262076 K free swap
> 24227 non-nice user cpu ticks
> 0 nice user cpu ticks
> 16150 system cpu ticks
> 1860131 idle cpu ticks
> 3034 IO-wait cpu ticks
> 0 IRQ cpu ticks
> 669 softirq cpu ticks
> 373 stolen cpu ticks
> 1088477 pages paged in
> 300348 pages paged out
> 824 pages swapped in
> 872 pages swapped out
> 2518291 interrupts
> 7404399 CPU context switches
> 1443557461 boot time
> 9559 forks
>
> *root@localhost:~# cat /proc/meminfo *
> MemTotal: 2047052 kB
> MemFree: 626532 kB
> MemAvailable: 1471856 kB
> Buffers: 42360 kB
> Cached: 797860 kB
> SwapCached: 64 kB
> Active: 768112 kB
> Inactive: 540036 kB
> Active(anon): 441100 kB
> Inactive(anon): 27152 kB
> Active(file): 327012 kB
> Inactive(file): 512884 kB
> Unevictable: 0 kB
> Mlocked: 0 kB
> SwapTotal: 262140 kB
> SwapFree: 262076 kB
> Dirty: 92 kB
> Writeback: 0 kB
> AnonPages: 467752 kB
> Mapped: 229020 kB
> Shmem: 528 kB
> Slab: 48448 kB
> SReclaimable: 26836 kB
> SUnreclaim: 21612 kB
> KernelStack: 4528 kB
> PageTables: 6052 kB
> NFS_Unstable: 0 kB
> Bounce: 0 kB
> WritebackTmp: 0 kB
> CommitLimit: 1285664 kB
> Committed_AS: 1534672 kB
> VmallocTotal: 34359738367 kB
> VmallocUsed: 12828 kB
> VmallocChunk: 34359702888 kB
> DirectMap4k: 20352 kB
> DirectMap2M: 2076672 kB
> DirectMap1G: 0 kB
>
>
>
> --
> Rafael Capucho
>
> Bachelor of Computer Science
> Federal University of São Paulo
> Institute of Science and Technology - ICT
>
> PGP-Public Key: 2048R/7389A96F pgp.mit.edu
> FP: EDB5 CDEE 8442 99CC C92D 9173 6B32 A5C9 7389 A96F
>
--
--
Rafael Capucho
Bachelor of Computer Science
Federal University of São Paulo
Institute of Science and Technology - ICT
PGP-Public Key: 2048R/7389A96F pgp.mit.edu
FP: EDB5 CDEE 8442 99CC C92D 9173 6B32 A5C9 7389 A96F