You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Jonathan Ellis (Created) (JIRA)" <ji...@apache.org> on 2011/10/03 07:13:34 UTC
[jira] [Created] (CASSANDRA-3295) reduce default heap size
reduce default heap size
------------------------
Key: CASSANDRA-3295
URL: https://issues.apache.org/jira/browse/CASSANDRA-3295
Project: Cassandra
Issue Type: Improvement
Affects Versions: 1.0.0
Reporter: Jonathan Ellis
Assignee: Brandon Williams
Priority: Minor
Fix For: 1.0.0
With off-heap caching now the default and with auto-flushed memtables demonstrated to do a good job with smaller heaps, I think it's time to reduce heap sizes to decrease GC pause times.
How does this sound?
- half the ram, up to 512MB, or
- 1/4 the ram, up to 4 GB
i.e.:
max(min(1/2 ram, 512MB), min(1/4 ram, 4GB))
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3295) reduce default heap size
Posted by "Radim Kolar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13120173#comment-13120173 ]
Radim Kolar commented on CASSANDRA-3295:
----------------------------------------
It crashes on 512m if you have to do compaction with about 20 tables. If you have to do major compaction on 400 tables in crashes even on 1G.
Cassandra 1.0 is way better on memory use than 0.8 but still 512m is not enough for stable production operation.
> reduce default heap size
> ------------------------
>
> Key: CASSANDRA-3295
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3295
> Project: Cassandra
> Issue Type: Improvement
> Affects Versions: 1.0.0
> Reporter: Jonathan Ellis
> Assignee: satish babu krishnamoorthy
> Priority: Minor
> Fix For: 1.0.0
>
> Attachments: 3295.patch
>
>
> With off-heap caching now the default and with auto-flushed memtables demonstrated to do a good job with smaller heaps, I think it's time to reduce heap sizes to decrease GC pause times.
> How does this sound?
> - half the ram, up to 512MB, or
> - 1/4 the ram, up to 4 GB
> i.e.:
> max(min(1/2 ram, 512MB), min(1/4 ram, 4GB))
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3295) reduce default heap size
Posted by "Jonathan Ellis (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-3295:
--------------------------------------
Reviewer: brandon.williams
> reduce default heap size
> ------------------------
>
> Key: CASSANDRA-3295
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3295
> Project: Cassandra
> Issue Type: Improvement
> Affects Versions: 1.0.0
> Reporter: Jonathan Ellis
> Assignee: satish babu krishnamoorthy
> Priority: Minor
> Fix For: 1.0.0
>
> Attachments: 3295.patch
>
>
> With off-heap caching now the default and with auto-flushed memtables demonstrated to do a good job with smaller heaps, I think it's time to reduce heap sizes to decrease GC pause times.
> How does this sound?
> - half the ram, up to 512MB, or
> - 1/4 the ram, up to 4 GB
> i.e.:
> max(min(1/2 ram, 512MB), min(1/4 ram, 4GB))
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3295) reduce default heap size
Posted by "Brandon Williams (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13120165#comment-13120165 ]
Brandon Williams commented on CASSANDRA-3295:
---------------------------------------------
I think it would make more sense to make the minimum cap 1G instead of 512M. You _can_ run with 512M, but our 'norm' has always been 1G and things do run much better that way.
> reduce default heap size
> ------------------------
>
> Key: CASSANDRA-3295
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3295
> Project: Cassandra
> Issue Type: Improvement
> Affects Versions: 1.0.0
> Reporter: Jonathan Ellis
> Assignee: satish babu krishnamoorthy
> Priority: Minor
> Fix For: 1.0.0
>
> Attachments: 3295.patch
>
>
> With off-heap caching now the default and with auto-flushed memtables demonstrated to do a good job with smaller heaps, I think it's time to reduce heap sizes to decrease GC pause times.
> How does this sound?
> - half the ram, up to 512MB, or
> - 1/4 the ram, up to 4 GB
> i.e.:
> max(min(1/2 ram, 512MB), min(1/4 ram, 4GB))
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3295) reduce default heap size
Posted by "Radim Kolar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13120204#comment-13120204 ]
Radim Kolar commented on CASSANDRA-3295:
----------------------------------------
actually i run cassandra for development inside 512MB virtual machine without crashes, but you just cant write too fast or too much there. writing typical development data set with about 20 records is fine.
> reduce default heap size
> ------------------------
>
> Key: CASSANDRA-3295
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3295
> Project: Cassandra
> Issue Type: Improvement
> Affects Versions: 1.0.0
> Reporter: Jonathan Ellis
> Assignee: satish babu krishnamoorthy
> Priority: Minor
> Fix For: 1.0.0
>
> Attachments: 3295.patch
>
>
> With off-heap caching now the default and with auto-flushed memtables demonstrated to do a good job with smaller heaps, I think it's time to reduce heap sizes to decrease GC pause times.
> How does this sound?
> - half the ram, up to 512MB, or
> - 1/4 the ram, up to 4 GB
> i.e.:
> max(min(1/2 ram, 512MB), min(1/4 ram, 4GB))
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3295) reduce default heap size
Posted by "satish babu krishnamoorthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
satish babu krishnamoorthy updated CASSANDRA-3295:
--------------------------------------------------
Attachment: 3295.patch
> reduce default heap size
> ------------------------
>
> Key: CASSANDRA-3295
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3295
> Project: Cassandra
> Issue Type: Improvement
> Affects Versions: 1.0.0
> Reporter: Jonathan Ellis
> Assignee: satish babu krishnamoorthy
> Priority: Minor
> Fix For: 1.0.0
>
> Attachments: 3295.patch
>
>
> With off-heap caching now the default and with auto-flushed memtables demonstrated to do a good job with smaller heaps, I think it's time to reduce heap sizes to decrease GC pause times.
> How does this sound?
> - half the ram, up to 512MB, or
> - 1/4 the ram, up to 4 GB
> i.e.:
> max(min(1/2 ram, 512MB), min(1/4 ram, 4GB))
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3295) reduce default heap size
Posted by "Jonathan Ellis (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13120194#comment-13120194 ]
Jonathan Ellis commented on CASSANDRA-3295:
-------------------------------------------
(I think the point that my original numbers are on the small side is correct, though. 1GB, 8GB is probably better.
> reduce default heap size
> ------------------------
>
> Key: CASSANDRA-3295
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3295
> Project: Cassandra
> Issue Type: Improvement
> Affects Versions: 1.0.0
> Reporter: Jonathan Ellis
> Assignee: satish babu krishnamoorthy
> Priority: Minor
> Fix For: 1.0.0
>
> Attachments: 3295.patch
>
>
> With off-heap caching now the default and with auto-flushed memtables demonstrated to do a good job with smaller heaps, I think it's time to reduce heap sizes to decrease GC pause times.
> How does this sound?
> - half the ram, up to 512MB, or
> - 1/4 the ram, up to 4 GB
> i.e.:
> max(min(1/2 ram, 512MB), min(1/4 ram, 4GB))
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3295) reduce default heap size
Posted by "Jonathan Ellis (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13120191#comment-13120191 ]
Jonathan Ellis commented on CASSANDRA-3295:
-------------------------------------------
But if you only have a 1GB machine there's not a whole lot we can do. :)
> reduce default heap size
> ------------------------
>
> Key: CASSANDRA-3295
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3295
> Project: Cassandra
> Issue Type: Improvement
> Affects Versions: 1.0.0
> Reporter: Jonathan Ellis
> Assignee: satish babu krishnamoorthy
> Priority: Minor
> Fix For: 1.0.0
>
> Attachments: 3295.patch
>
>
> With off-heap caching now the default and with auto-flushed memtables demonstrated to do a good job with smaller heaps, I think it's time to reduce heap sizes to decrease GC pause times.
> How does this sound?
> - half the ram, up to 512MB, or
> - 1/4 the ram, up to 4 GB
> i.e.:
> max(min(1/2 ram, 512MB), min(1/4 ram, 4GB))
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira