You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Omid Aladini <om...@gmail.com> on 2012/04/05 21:01:07 UTC
Resident size growth
Hi,
I'm experiencing a steady growth in resident size of JVM running
Cassandra 1.0.7. I disabled JNA and off-heap row cache, tested with
and without mlockall disabling paging, and upgraded to JRE 1.6.0_31 to
prevent this bug [1] to leak memory. Still JVM's resident set size
grows steadily. A process with Xmx=2048M has grown to 6GB resident
size and one with Xmx=8192M to 16GB in a few hours and increasing. Has
anyone experienced this? Any idea how to deal with this issue?
Thanks,
Omid
[1] http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7066129
Re: Resident size growth
Posted by Jonathan Ellis <jb...@gmail.com>.
On Wed, Apr 18, 2012 at 12:44 PM, Rob Coli <rc...@palominodb.com> wrote:
> On Tue, Apr 10, 2012 at 8:40 AM, ruslan usifov <ru...@gmail.com> wrote:
>> mmap doesn't depend on jna
>
> FWIW, this confusion is as a result of the use of *mlockall*, which is
> used to prevent mmapped files from being swapped, which does depend on
> JNA.
mlockall does depend on JNA, but we only lock the JVM itself in
memory. The OS is free to page data files in and out as needed.
--
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of DataStax, the source for professional Cassandra support
http://www.datastax.com
Re: Resident size growth
Posted by Rob Coli <rc...@palominodb.com>.
On Tue, Apr 10, 2012 at 8:40 AM, ruslan usifov <ru...@gmail.com> wrote:
> mmap doesn't depend on jna
FWIW, this confusion is as a result of the use of *mlockall*, which is
used to prevent mmapped files from being swapped, which does depend on
JNA.
=Rob
--
=Robert Coli
AIM>ALK - rcoli@palominodb.com
YAHOO - rcoli.palominob
SKYPE - rcoli_palominodb
Re: Resident size growth
Posted by ruslan usifov <ru...@gmail.com>.
mmap doesn't depend on jna
2012/4/9 Jeremiah Jordan <JE...@morningstar.com>
> He says he disabled JNA. You can't mmap without JNA can you?
>
> On Apr 9, 2012, at 4:52 AM, aaron morton wrote:
>
> see http://wiki.apache.org/cassandra/FAQ#mmap
>
> Cheers
>
> -----------------
> Aaron Morton
> Freelance Developer
> @aaronmorton
> http://www.thelastpickle.com
>
> On 9/04/2012, at 5:09 AM, ruslan usifov wrote:
>
> mmap sstables? It's normal
>
> 2012/4/5 Omid Aladini <om...@gmail.com>
>
>> Hi,
>>
>> I'm experiencing a steady growth in resident size of JVM running
>> Cassandra 1.0.7. I disabled JNA and off-heap row cache, tested with
>> and without mlockall disabling paging, and upgraded to JRE 1.6.0_31 to
>> prevent this bug [1] to leak memory. Still JVM's resident set size
>> grows steadily. A process with Xmx=2048M has grown to 6GB resident
>> size and one with Xmx=8192M to 16GB in a few hours and increasing. Has
>> anyone experienced this? Any idea how to deal with this issue?
>>
>> Thanks,
>> Omid
>>
>> [1] http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7066129
>>
>
>
>
>
Re: Resident size growth
Posted by ruslan usifov <ru...@gmail.com>.
also i suggest to setup disk_access_mode: mmap_index_only
2012/4/9 Omid Aladini <om...@gmail.com>
> Thanks. Yes it's due to mmappd SSTables pages that count as resident size.
>
> Jeremiah: mmap isn't through JNA, it's via java.nio.MappedByteBuffer I
> think.
>
> -- Omid
>
> On Mon, Apr 9, 2012 at 4:15 PM, Jeremiah Jordan
> <JE...@morningstar.com> wrote:
> > He says he disabled JNA. You can't mmap without JNA can you?
> >
> > On Apr 9, 2012, at 4:52 AM, aaron morton wrote:
> >
> > see http://wiki.apache.org/cassandra/FAQ#mmap
> >
> > Cheers
> >
> > -----------------
> > Aaron Morton
> > Freelance Developer
> > @aaronmorton
> > http://www.thelastpickle.com
> >
> > On 9/04/2012, at 5:09 AM, ruslan usifov wrote:
> >
> > mmap sstables? It's normal
> >
> > 2012/4/5 Omid Aladini <om...@gmail.com>
> >>
> >> Hi,
> >>
> >> I'm experiencing a steady growth in resident size of JVM running
> >> Cassandra 1.0.7. I disabled JNA and off-heap row cache, tested with
> >> and without mlockall disabling paging, and upgraded to JRE 1.6.0_31 to
> >> prevent this bug [1] to leak memory. Still JVM's resident set size
> >> grows steadily. A process with Xmx=2048M has grown to 6GB resident
> >> size and one with Xmx=8192M to 16GB in a few hours and increasing. Has
> >> anyone experienced this? Any idea how to deal with this issue?
> >>
> >> Thanks,
> >> Omid
> >>
> >> [1] http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7066129
> >
> >
> >
> >
>
Re: Resident size growth
Posted by Omid Aladini <om...@gmail.com>.
Thanks. Yes it's due to mmappd SSTables pages that count as resident size.
Jeremiah: mmap isn't through JNA, it's via java.nio.MappedByteBuffer I think.
-- Omid
On Mon, Apr 9, 2012 at 4:15 PM, Jeremiah Jordan
<JE...@morningstar.com> wrote:
> He says he disabled JNA. You can't mmap without JNA can you?
>
> On Apr 9, 2012, at 4:52 AM, aaron morton wrote:
>
> see http://wiki.apache.org/cassandra/FAQ#mmap
>
> Cheers
>
> -----------------
> Aaron Morton
> Freelance Developer
> @aaronmorton
> http://www.thelastpickle.com
>
> On 9/04/2012, at 5:09 AM, ruslan usifov wrote:
>
> mmap sstables? It's normal
>
> 2012/4/5 Omid Aladini <om...@gmail.com>
>>
>> Hi,
>>
>> I'm experiencing a steady growth in resident size of JVM running
>> Cassandra 1.0.7. I disabled JNA and off-heap row cache, tested with
>> and without mlockall disabling paging, and upgraded to JRE 1.6.0_31 to
>> prevent this bug [1] to leak memory. Still JVM's resident set size
>> grows steadily. A process with Xmx=2048M has grown to 6GB resident
>> size and one with Xmx=8192M to 16GB in a few hours and increasing. Has
>> anyone experienced this? Any idea how to deal with this issue?
>>
>> Thanks,
>> Omid
>>
>> [1] http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7066129
>
>
>
>
Re: Resident size growth
Posted by Jeremiah Jordan <JE...@morningstar.com>.
He says he disabled JNA. You can't mmap without JNA can you?
On Apr 9, 2012, at 4:52 AM, aaron morton wrote:
see http://wiki.apache.org/cassandra/FAQ#mmap
Cheers
-----------------
Aaron Morton
Freelance Developer
@aaronmorton
http://www.thelastpickle.com<http://www.thelastpickle.com/>
On 9/04/2012, at 5:09 AM, ruslan usifov wrote:
mmap sstables? It's normal
2012/4/5 Omid Aladini <om...@gmail.com>>
Hi,
I'm experiencing a steady growth in resident size of JVM running
Cassandra 1.0.7. I disabled JNA and off-heap row cache, tested with
and without mlockall disabling paging, and upgraded to JRE 1.6.0_31 to
prevent this bug [1] to leak memory. Still JVM's resident set size
grows steadily. A process with Xmx=2048M has grown to 6GB resident
size and one with Xmx=8192M to 16GB in a few hours and increasing. Has
anyone experienced this? Any idea how to deal with this issue?
Thanks,
Omid
[1] http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7066129
Re: Resident size growth
Posted by aaron morton <aa...@thelastpickle.com>.
see http://wiki.apache.org/cassandra/FAQ#mmap
Cheers
-----------------
Aaron Morton
Freelance Developer
@aaronmorton
http://www.thelastpickle.com
On 9/04/2012, at 5:09 AM, ruslan usifov wrote:
> mmap sstables? It's normal
>
> 2012/4/5 Omid Aladini <om...@gmail.com>
> Hi,
>
> I'm experiencing a steady growth in resident size of JVM running
> Cassandra 1.0.7. I disabled JNA and off-heap row cache, tested with
> and without mlockall disabling paging, and upgraded to JRE 1.6.0_31 to
> prevent this bug [1] to leak memory. Still JVM's resident set size
> grows steadily. A process with Xmx=2048M has grown to 6GB resident
> size and one with Xmx=8192M to 16GB in a few hours and increasing. Has
> anyone experienced this? Any idea how to deal with this issue?
>
> Thanks,
> Omid
>
> [1] http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7066129
>
Re: Resident size growth
Posted by ruslan usifov <ru...@gmail.com>.
mmap sstables? It's normal
2012/4/5 Omid Aladini <om...@gmail.com>
> Hi,
>
> I'm experiencing a steady growth in resident size of JVM running
> Cassandra 1.0.7. I disabled JNA and off-heap row cache, tested with
> and without mlockall disabling paging, and upgraded to JRE 1.6.0_31 to
> prevent this bug [1] to leak memory. Still JVM's resident set size
> grows steadily. A process with Xmx=2048M has grown to 6GB resident
> size and one with Xmx=8192M to 16GB in a few hours and increasing. Has
> anyone experienced this? Any idea how to deal with this issue?
>
> Thanks,
> Omid
>
> [1] http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7066129
>