You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Radim Kolar (Created) (JIRA)" <ji...@apache.org> on 2011/11/21 08:22:51 UTC
[jira] [Created] (CASSANDRA-3511) Key caches are not saved
Key caches are not saved
------------------------
Key: CASSANDRA-3511
URL: https://issues.apache.org/jira/browse/CASSANDRA-3511
Project: Cassandra
Issue Type: Bug
Affects Versions: 1.0.2, 1.0.3
Reporter: Radim Kolar
Priority: Minor
cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved.
This one works:
create column family query2
with column_type = 'Standard'
and comparator = 'AsciiType'
and default_validation_class = 'BytesType'
and key_validation_class = 'UTF8Type'
and rows_cached = 500.0
and row_cache_save_period = 0
and row_cache_keys_to_save = 2147483647
and keys_cached = 200000.0
and key_cache_save_period = 14400
and read_repair_chance = 1.0
and gc_grace = 864000
and min_compaction_threshold = 5
and max_compaction_threshold = 10
and replicate_on_write = false
and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
This does not
create column family dkb13
with column_type = 'Super'
and comparator = 'LongType'
and subcomparator = 'AsciiType'
and default_validation_class = 'BytesType'
and key_validation_class = 'UTF8Type'
and rows_cached = 600.0
and row_cache_save_period = 0
and row_cache_keys_to_save = 2147483647
and keys_cached = 200000.0
and key_cache_save_period = 14400
and read_repair_chance = 1.0
and gc_grace = 864000
and min_compaction_threshold = 5
and max_compaction_threshold = 10
and replicate_on_write = false
and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not.
create column family test1
with column_type = 'Standard'
and comparator = 'BytesType'
and default_validation_class = 'BytesType'
and key_validation_class = 'BytesType'
and rows_cached = 0.0
and row_cache_save_period = 0
and row_cache_keys_to_save = 2147483647
and keys_cached = 200000.0
and key_cache_save_period = 30
and read_repair_chance = 1.0
and gc_grace = 864000
and min_compaction_threshold = 4
and max_compaction_threshold = 32
and replicate_on_write = true
and row_cache_provider = 'SerializingCacheProvider'
and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
create column family test2
with column_type = 'Standard'
and comparator = 'BytesType'
and default_validation_class = 'BytesType'
and key_validation_class = 'BytesType'
and rows_cached = 0.0
and row_cache_save_period = 0
and row_cache_keys_to_save = 2147483647
and keys_cached = 200000.0
and key_cache_save_period = 30
and read_repair_chance = 1.0
and gc_grace = 864000
and min_compaction_threshold = 4
and max_compaction_threshold = 32
and replicate_on_write = true
and row_cache_provider = 'SerializingCacheProvider'
and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3511) Key caches are not saved
Posted by "Radim Kolar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13154992#comment-13154992 ]
Radim Kolar commented on CASSANDRA-3511:
----------------------------------------
Result of more detailed testing.
1. If key_cache_save_period < 60 seconds, cache is not saved at all. This should be probably documented.
2. CF where saving cache do not works is supper column family. It works on all other normal CF i tried if i set cache save period to 60 seoonds or more.
3. There are no exceptions in log and super column key cache saved in 0.8 is loaded by 1.0 fine.
> Key caches are not saved
> ------------------------
>
> Key: CASSANDRA-3511
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3511
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.0.2, 1.0.3
> Reporter: Radim Kolar
> Priority: Minor
>
> cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved.
> This one works:
> create column family query2
> with column_type = 'Standard'
> and comparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 500.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> This does not
> create column family dkb13
> with column_type = 'Super'
> and comparator = 'LongType'
> and subcomparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 600.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not.
> create column family test1
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> create column family test2
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3511) Supercolumn key caches are not
saved
Posted by "Jonathan Ellis (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13166967#comment-13166967 ]
Jonathan Ellis commented on CASSANDRA-3511:
-------------------------------------------
Note that this is not a cache saving issue, but a cache population one.
> Supercolumn key caches are not saved
> ------------------------------------
>
> Key: CASSANDRA-3511
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3511
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.2, 1.0.3
> Reporter: Radim Kolar
> Priority: Minor
> Labels: supercolumns
>
> cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved.
> This one works:
> create column family query2
> with column_type = 'Standard'
> and comparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 500.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> This does not
> create column family dkb13
> with column_type = 'Super'
> and comparator = 'LongType'
> and subcomparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 600.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not.
> create column family test1
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> create column family test2
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3511) Supercolumn key caches are not
saved
Posted by "Radim Kolar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168480#comment-13168480 ]
Radim Kolar commented on CASSANDRA-3511:
----------------------------------------
This is also cache save issue because i seen case where after loading cache saved by 1.0.5 cache is not saved anymore. I will attach another demonstration file.
Problems are 2:
1. cache can be saved in incorrect format (maybe truncated?). Save to -tmp and rename later?
2. loading incorrect cache save image will cause that cache is not saved anymore. Incorrect image is not overwritten by a good one. Add some kind of error/checksum to cache for detecting and rejecting incorrect cache save images during load.
> Supercolumn key caches are not saved
> ------------------------------------
>
> Key: CASSANDRA-3511
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3511
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.2, 1.0.3
> Reporter: Radim Kolar
> Priority: Minor
> Labels: supercolumns
> Attachments: rapidshare-resultcache-KeyCache
>
>
> cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved.
> This one works:
> create column family query2
> with column_type = 'Standard'
> and comparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 500.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> This does not
> create column family dkb13
> with column_type = 'Super'
> and comparator = 'LongType'
> and subcomparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 600.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not.
> create column family test1
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> create column family test2
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3511) Supercolumn key caches are not
saved
Posted by "Jonathan Ellis (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis updated CASSANDRA-3511:
--------------------------------------
Component/s: Core
Labels: supercolumns (was: )
Summary: Supercolumn key caches are not saved (was: Key caches are not saved)
> Supercolumn key caches are not saved
> ------------------------------------
>
> Key: CASSANDRA-3511
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3511
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.2, 1.0.3
> Reporter: Radim Kolar
> Priority: Minor
> Labels: supercolumns
>
> cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved.
> This one works:
> create column family query2
> with column_type = 'Standard'
> and comparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 500.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> This does not
> create column family dkb13
> with column_type = 'Super'
> and comparator = 'LongType'
> and subcomparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 600.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not.
> create column family test1
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> create column family test2
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3511) Supercolumn key caches are not
saved
Posted by "Radim Kolar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13210903#comment-13210903 ]
Radim Kolar commented on CASSANDRA-3511:
----------------------------------------
i can not reproduce this problem any more at 1.0.7
> Supercolumn key caches are not saved
> ------------------------------------
>
> Key: CASSANDRA-3511
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3511
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.2, 1.0.3
> Reporter: Radim Kolar
> Priority: Minor
> Labels: supercolumns
> Attachments: failed-to-save-after-load-KeyCache, rapidshare-resultcache-KeyCache
>
>
> cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved.
> This one works:
> create column family query2
> with column_type = 'Standard'
> and comparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 500.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> This does not
> create column family dkb13
> with column_type = 'Super'
> and comparator = 'LongType'
> and subcomparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 600.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not.
> create column family test1
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> create column family test2
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3511) Supercolumn key caches are not
saved
Posted by "Radim Kolar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13173899#comment-13173899 ]
Radim Kolar commented on CASSANDRA-3511:
----------------------------------------
Cache from test is still populated but was never saved.
Column Family: Super1
SSTable count: 4
Space used (live): 101785086
Space used (total): 101785086
Number of Keys (estimate): 292500
Memtable Columns Count: 0
Memtable Data Size: 0
Memtable Switch Count: 12
Read Count: 292110
Read Latency: NaN ms.
Write Count: 291682
Write Latency: NaN ms.
Pending Tasks: 0
Bloom Filter False Postives: 628
Bloom Filter False Ratio: 0.00000
Bloom Filter Space Used: 553840
Key cache capacity: 200000
Key cache size: 109093
Key cache hit rate: NaN
Row cache capacity: 600
Row cache size: 600
Row cache hit rate: NaN
Compacted row minimum size: 311
Compacted row maximum size: 372
Compacted row mean size: 372
> Supercolumn key caches are not saved
> ------------------------------------
>
> Key: CASSANDRA-3511
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3511
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.2, 1.0.3
> Reporter: Radim Kolar
> Priority: Minor
> Labels: supercolumns
> Attachments: failed-to-save-after-load-KeyCache, rapidshare-resultcache-KeyCache
>
>
> cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved.
> This one works:
> create column family query2
> with column_type = 'Standard'
> and comparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 500.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> This does not
> create column family dkb13
> with column_type = 'Super'
> and comparator = 'LongType'
> and subcomparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 600.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not.
> create column family test1
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> create column family test2
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3511) Supercolumn key caches are not
saved
Posted by "Radim Kolar (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Radim Kolar updated CASSANDRA-3511:
-----------------------------------
Attachment: failed-to-save-after-load-KeyCache
> Supercolumn key caches are not saved
> ------------------------------------
>
> Key: CASSANDRA-3511
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3511
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.2, 1.0.3
> Reporter: Radim Kolar
> Priority: Minor
> Labels: supercolumns
> Attachments: failed-to-save-after-load-KeyCache, rapidshare-resultcache-KeyCache
>
>
> cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved.
> This one works:
> create column family query2
> with column_type = 'Standard'
> and comparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 500.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> This does not
> create column family dkb13
> with column_type = 'Super'
> and comparator = 'LongType'
> and subcomparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 600.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not.
> create column family test1
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> create column family test2
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3511) Supercolumn key caches are not
saved
Posted by "Radim Kolar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13173338#comment-13173338 ]
Radim Kolar commented on CASSANDRA-3511:
----------------------------------------
ponto:(filezco)~/cassandra>sh cass-test
[default@unknown] drop keyspace Keyspace1;
3c8015f0-2b2f-11e1-0000-d14dd490cdfc
Waiting for schema agreement...
... schemas agree across the cluster
[default@unknown] Connected to: "Prod" on localhost/9160
Unable to create stress keyspace: Keyspace names must be case-insensitively unique ("Keyspace1" conflicts with "Keyspace1")
total,interval_op_rate,interval_key_rate,avg_latency,elapsed_time
116911,11691,11691,0.003197124308234469,10
216552,9964,9964,0.0021934344296022723,20
361227,14467,14467,0.004738966649386556,30
436233,7500,7500,0.006396488280937525,40
500000,6376,6376,0.0019556510420750545,43
END
total,interval_op_rate,interval_key_rate,avg_latency,elapsed_time
51781,5178,5178,0.008967517042930804,10
198084,14630,14630,0.003021592175143367,20
365241,16715,16715,0.002720592018282214,30
500000,13475,13475,0.002616522829644031,38
END
Key cache size: 109093
Row cache size: 600
I will wait if keycache will be saved
> Supercolumn key caches are not saved
> ------------------------------------
>
> Key: CASSANDRA-3511
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3511
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.2, 1.0.3
> Reporter: Radim Kolar
> Priority: Minor
> Labels: supercolumns
> Attachments: failed-to-save-after-load-KeyCache, rapidshare-resultcache-KeyCache
>
>
> cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved.
> This one works:
> create column family query2
> with column_type = 'Standard'
> and comparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 500.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> This does not
> create column family dkb13
> with column_type = 'Super'
> and comparator = 'LongType'
> and subcomparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 600.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not.
> create column family test1
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> create column family test2
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (CASSANDRA-3511) Supercolumn key caches are not
saved
Posted by "Jonathan Ellis (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis resolved CASSANDRA-3511.
---------------------------------------
Resolution: Cannot Reproduce
> Supercolumn key caches are not saved
> ------------------------------------
>
> Key: CASSANDRA-3511
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3511
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.2, 1.0.3
> Reporter: Radim Kolar
> Priority: Minor
> Labels: supercolumns
> Attachments: failed-to-save-after-load-KeyCache, rapidshare-resultcache-KeyCache
>
>
> cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved.
> This one works:
> create column family query2
> with column_type = 'Standard'
> and comparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 500.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> This does not
> create column family dkb13
> with column_type = 'Super'
> and comparator = 'LongType'
> and subcomparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 600.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not.
> create column family test1
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> create column family test2
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3511) Supercolumn key caches are not
saved
Posted by "Radim Kolar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13156976#comment-13156976 ]
Radim Kolar commented on CASSANDRA-3511:
----------------------------------------
I removed saved cache for this CF and restarted node. After restart it seems to work fine now.
> Supercolumn key caches are not saved
> ------------------------------------
>
> Key: CASSANDRA-3511
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3511
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.2, 1.0.3
> Reporter: Radim Kolar
> Priority: Minor
> Labels: supercolumns
>
> cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved.
> This one works:
> create column family query2
> with column_type = 'Standard'
> and comparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 500.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> This does not
> create column family dkb13
> with column_type = 'Super'
> and comparator = 'LongType'
> and subcomparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 600.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not.
> create column family test1
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> create column family test2
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3511) Supercolumn key caches are not
saved
Posted by "Radim Kolar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13167377#comment-13167377 ]
Radim Kolar commented on CASSANDRA-3511:
----------------------------------------
Problem with cache loading is still present in 1.0.5. For some reason one of KeyCaches saved by 1.0.3 is loaded without error message but never saved back.
> Supercolumn key caches are not saved
> ------------------------------------
>
> Key: CASSANDRA-3511
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3511
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.2, 1.0.3
> Reporter: Radim Kolar
> Priority: Minor
> Labels: supercolumns
>
> cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved.
> This one works:
> create column family query2
> with column_type = 'Standard'
> and comparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 500.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> This does not
> create column family dkb13
> with column_type = 'Super'
> and comparator = 'LongType'
> and subcomparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 600.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not.
> create column family test1
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> create column family test2
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3511) Supercolumn key caches are not
saved
Posted by "Joaquin Casares (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13172807#comment-13172807 ]
Joaquin Casares commented on CASSANDRA-3511:
--------------------------------------------
http://aep.appspot.com/display/YS0VCvsOzFbkE-72IFOqBm8-URg/
I tried this multiple times and switching the super column family creation order and still saw all the cache fill up.
On Cassandra 1.0.5.
> Supercolumn key caches are not saved
> ------------------------------------
>
> Key: CASSANDRA-3511
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3511
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.2, 1.0.3
> Reporter: Radim Kolar
> Priority: Minor
> Labels: supercolumns
> Attachments: failed-to-save-after-load-KeyCache, rapidshare-resultcache-KeyCache
>
>
> cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved.
> This one works:
> create column family query2
> with column_type = 'Standard'
> and comparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 500.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> This does not
> create column family dkb13
> with column_type = 'Super'
> and comparator = 'LongType'
> and subcomparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 600.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not.
> create column family test1
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> create column family test2
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3511) Supercolumn key caches are not
saved
Posted by "Jonathan Ellis (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170790#comment-13170790 ]
Jonathan Ellis commented on CASSANDRA-3511:
-------------------------------------------
bq. Note that this is not a cache saving issue, but a cache population one.
Of course if you don't write enough to cause a flush, no sstable positions will be cached. When I do cause flushes then the cache gets populated as expected.
I still can't reproduce caches not saving.
> Supercolumn key caches are not saved
> ------------------------------------
>
> Key: CASSANDRA-3511
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3511
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.2, 1.0.3
> Reporter: Radim Kolar
> Priority: Minor
> Labels: supercolumns
> Attachments: failed-to-save-after-load-KeyCache, rapidshare-resultcache-KeyCache
>
>
> cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved.
> This one works:
> create column family query2
> with column_type = 'Standard'
> and comparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 500.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> This does not
> create column family dkb13
> with column_type = 'Super'
> and comparator = 'LongType'
> and subcomparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 600.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not.
> create column family test1
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> create column family test2
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (CASSANDRA-3511) Supercolumn key caches are not
saved
Posted by "Jonathan Ellis (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis resolved CASSANDRA-3511.
---------------------------------------
Resolution: Fixed
Joaquin's script works for me on current 1.0 branch.
> Supercolumn key caches are not saved
> ------------------------------------
>
> Key: CASSANDRA-3511
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3511
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.2, 1.0.3
> Reporter: Radim Kolar
> Priority: Minor
> Labels: supercolumns
>
> cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved.
> This one works:
> create column family query2
> with column_type = 'Standard'
> and comparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 500.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> This does not
> create column family dkb13
> with column_type = 'Super'
> and comparator = 'LongType'
> and subcomparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 600.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not.
> create column family test1
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> create column family test2
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3511) Supercolumn key caches are not
saved
Posted by "Radim Kolar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13156585#comment-13156585 ]
Radim Kolar commented on CASSANDRA-3511:
----------------------------------------
In my case super CF not saving cache looks like this:
Key cache capacity: 22825
Key cache size: 22825
Key cache hit rate: 0.1851423197945676
Row cache capacity: 480
Row cache size: 480
Row cache hit rate: 0.18145943635108028
Cache is full but it is not saved, only loaded at startup.
> Supercolumn key caches are not saved
> ------------------------------------
>
> Key: CASSANDRA-3511
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3511
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.2, 1.0.3
> Reporter: Radim Kolar
> Priority: Minor
> Labels: supercolumns
>
> cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved.
> This one works:
> create column family query2
> with column_type = 'Standard'
> and comparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 500.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> This does not
> create column family dkb13
> with column_type = 'Super'
> and comparator = 'LongType'
> and subcomparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 600.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not.
> create column family test1
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> create column family test2
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3511) Key caches are not saved
Posted by "Jonathan Ellis (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13154220#comment-13154220 ]
Jonathan Ellis commented on CASSANDRA-3511:
-------------------------------------------
What is the difference between the CF where saving works and the one where it does not? Is the non-saving behavior reproducible? Are there any exceptions in the log? Is anything logged on startup about the cache that didn't load?
> Key caches are not saved
> ------------------------
>
> Key: CASSANDRA-3511
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3511
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.0.2, 1.0.3
> Reporter: Radim Kolar
> Priority: Minor
>
> cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved.
> This one works:
> create column family query2
> with column_type = 'Standard'
> and comparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 500.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> This does not
> create column family dkb13
> with column_type = 'Super'
> and comparator = 'LongType'
> and subcomparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 600.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not.
> create column family test1
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> create column family test2
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Reopened] (CASSANDRA-3511) Supercolumn key caches are not
saved
Posted by "Jonathan Ellis (Reopened) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis reopened CASSANDRA-3511:
---------------------------------------
On closer look only row cache is being populated, not key cache.
> Supercolumn key caches are not saved
> ------------------------------------
>
> Key: CASSANDRA-3511
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3511
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.2, 1.0.3
> Reporter: Radim Kolar
> Priority: Minor
> Labels: supercolumns
>
> cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved.
> This one works:
> create column family query2
> with column_type = 'Standard'
> and comparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 500.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> This does not
> create column family dkb13
> with column_type = 'Super'
> and comparator = 'LongType'
> and subcomparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 600.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not.
> create column family test1
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> create column family test2
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3511) Supercolumn key caches are not
saved
Posted by "Radim Kolar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170811#comment-13170811 ]
Radim Kolar commented on CASSANDRA-3511:
----------------------------------------
I currently have key cache saving problem again on all nodes in this Super CF. I removed saved cache for this CF and restarted nodes, but it didnt helped at this time.
Column Family: resultcache
SSTable count: 14
Space used (live): 6344039402
Space used (total): 6344039402
Number of Keys (estimate): 826540
Memtable Columns Count: 25420
Memtable Data Size: 26342659
Memtable Switch Count: 19
Read Count: 19899
Read Latency: 22.298 ms.
Write Count: 48841
Write Latency: 0.309 ms.
Pending Tasks: 0
Bloom Filter False Postives: 31
Bloom Filter False Ratio: 0.00161
Bloom Filter Space Used: 2348824
Key cache capacity: 200000
Key cache size: 19505
Key cache hit rate: 0.07171145685997171
Row cache capacity: 600
Row cache size: 600
Row cache hit rate: 0.21192019699482387
Compacted row minimum size: 51
Compacted row maximum size: 1131752
Compacted row mean size: 7542
create column family resultcache
with column_type = 'Super'
and comparator = 'LongType'
and subcomparator = 'AsciiType'
and default_validation_class = 'BytesType'
and key_validation_class = 'UTF8Type'
and rows_cached = 600.0
and row_cache_save_period = 0
and row_cache_keys_to_save = 2147483647
and keys_cached = 200000.0
and key_cache_save_period = 14400
and read_repair_chance = 1.0
and gc_grace = 864000
and min_compaction_threshold = 5
and max_compaction_threshold = 10
and replicate_on_write = false
and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
and column_metadata = [
{column_name : 'crc32',
validation_class : LongType},
{column_name : 'id',
validation_class : LongType},
{column_name : 'name',
validation_class : AsciiType},
{column_name : 'size',
validation_class : LongType}];
> Supercolumn key caches are not saved
> ------------------------------------
>
> Key: CASSANDRA-3511
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3511
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.2, 1.0.3
> Reporter: Radim Kolar
> Priority: Minor
> Labels: supercolumns
> Attachments: failed-to-save-after-load-KeyCache, rapidshare-resultcache-KeyCache
>
>
> cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved.
> This one works:
> create column family query2
> with column_type = 'Standard'
> and comparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 500.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> This does not
> create column family dkb13
> with column_type = 'Super'
> and comparator = 'LongType'
> and subcomparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 600.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not.
> create column family test1
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> create column family test2
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3511) Supercolumn key caches are not
saved
Posted by "Radim Kolar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168496#comment-13168496 ]
Radim Kolar commented on CASSANDRA-3511:
----------------------------------------
it applies to normal (not super) CF also
> Supercolumn key caches are not saved
> ------------------------------------
>
> Key: CASSANDRA-3511
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3511
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.2, 1.0.3
> Reporter: Radim Kolar
> Priority: Minor
> Labels: supercolumns
> Attachments: failed-to-save-after-load-KeyCache, rapidshare-resultcache-KeyCache
>
>
> cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved.
> This one works:
> create column family query2
> with column_type = 'Standard'
> and comparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 500.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> This does not
> create column family dkb13
> with column_type = 'Super'
> and comparator = 'LongType'
> and subcomparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 600.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not.
> create column family test1
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> create column family test2
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-3511) Supercolumn key caches are not
saved
Posted by "Joaquin Casares (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13156469#comment-13156469 ]
Joaquin Casares commented on CASSANDRA-3511:
--------------------------------------------
I ran these scripts on 1.0.2 and 1.0.3.
On 1.0.2
========
I didn't spot the error on either case.
On 1.0.3
========
First Case
----------
I spotted it on the SuperColumns of the first case.
Second Case
------------
When I created Standard1 _after_ Standard2, Standard1 would have a 'Key cache size' of 0, otherwise it rose normally.
After further testing doing the case above no longer causes a 'Key cache size' of 0. What happened between both tests was me changing key_cache_save_period to 60, which stopped 'Key cache size' staying at 0. Note: Each time I ran the test, I dropped the keyspace.
First Case
http://aep.appspot.com/display/rg4UvMF2vIjo6JfDMmWz9UVNmP0/
Second Case
http://aep.appspot.com/display/-dkHdKy45e1sdRsjjEQBrZFpEyI/
> Supercolumn key caches are not saved
> ------------------------------------
>
> Key: CASSANDRA-3511
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3511
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.2, 1.0.3
> Reporter: Radim Kolar
> Priority: Minor
> Labels: supercolumns
>
> cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved.
> This one works:
> create column family query2
> with column_type = 'Standard'
> and comparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 500.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> This does not
> create column family dkb13
> with column_type = 'Super'
> and comparator = 'LongType'
> and subcomparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 600.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not.
> create column family test1
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> create column family test2
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-3511) Supercolumn key caches are not
saved
Posted by "Radim Kolar (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Radim Kolar updated CASSANDRA-3511:
-----------------------------------
Attachment: rapidshare-resultcache-KeyCache
Corrupted(?) saved cache demonstrating problem.
> Supercolumn key caches are not saved
> ------------------------------------
>
> Key: CASSANDRA-3511
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3511
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.2, 1.0.3
> Reporter: Radim Kolar
> Priority: Minor
> Labels: supercolumns
> Attachments: rapidshare-resultcache-KeyCache
>
>
> cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved.
> This one works:
> create column family query2
> with column_type = 'Standard'
> and comparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 500.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> This does not
> create column family dkb13
> with column_type = 'Super'
> and comparator = 'LongType'
> and subcomparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 600.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not.
> create column family test1
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> create column family test2
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (CASSANDRA-3511) Supercolumn key
caches are not saved
Posted by "Joaquin Casares (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13172807#comment-13172807 ]
Joaquin Casares edited comment on CASSANDRA-3511 at 12/20/11 12:58 AM:
-----------------------------------------------------------------------
http://aep.appspot.com/display/YS0VCvsOzFbkE-72IFOqBm8-URg/
I tried this multiple times and switching the super column family creation order and still saw all the cache fill up.
On Cassandra 1.0.5.
What happens when you run these scripts on your machine? NOTE: This will drop all of your Keyspace1 data, you may have to edit that line.
was (Author: j.casares):
http://aep.appspot.com/display/YS0VCvsOzFbkE-72IFOqBm8-URg/
I tried this multiple times and switching the super column family creation order and still saw all the cache fill up.
On Cassandra 1.0.5.
> Supercolumn key caches are not saved
> ------------------------------------
>
> Key: CASSANDRA-3511
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3511
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Affects Versions: 1.0.2, 1.0.3
> Reporter: Radim Kolar
> Priority: Minor
> Labels: supercolumns
> Attachments: failed-to-save-after-load-KeyCache, rapidshare-resultcache-KeyCache
>
>
> cache saving seems to be broken in 1.0.2 and 1.0.3 i have 2 CF in keyspace with enabled cache saving and only one gets its key cache saved. It worked perfectly in 0.8, both were saved.
> This one works:
> create column family query2
> with column_type = 'Standard'
> and comparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 500.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> This does not
> create column family dkb13
> with column_type = 'Super'
> and comparator = 'LongType'
> and subcomparator = 'AsciiType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'UTF8Type'
> and rows_cached = 600.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 14400
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 5
> and max_compaction_threshold = 10
> and replicate_on_write = false
> and row_cache_provider = 'ConcurrentLinkedHashCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'
> in second test system i created these 2 column families and none of them got single cache key saved. Both have save period 30 seoonds - their cache should save often. Its not that standard column family works while super does not.
> create column family test1
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> create column family test2
> with column_type = 'Standard'
> and comparator = 'BytesType'
> and default_validation_class = 'BytesType'
> and key_validation_class = 'BytesType'
> and rows_cached = 0.0
> and row_cache_save_period = 0
> and row_cache_keys_to_save = 2147483647
> and keys_cached = 200000.0
> and key_cache_save_period = 30
> and read_repair_chance = 1.0
> and gc_grace = 864000
> and min_compaction_threshold = 4
> and max_compaction_threshold = 32
> and replicate_on_write = true
> and row_cache_provider = 'SerializingCacheProvider'
> and compaction_strategy = 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy';
> If this is done on purpose for example cassandra 1.0 is doing some heuristic decision if cache should be saved or not then it should be removed. Saving cache is fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira