You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Jonathan Ellis (JIRA)" <ji...@apache.org> on 2011/03/08 22:56:01 UTC

[jira] Created: (CASSANDRA-2294) secondary index CFs should use parent CF flush thresholds

secondary index CFs should use parent CF flush thresholds
---------------------------------------------------------

                 Key: CASSANDRA-2294
                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2294
             Project: Cassandra
          Issue Type: Improvement
          Components: Core
    Affects Versions: 0.7.0
            Reporter: Jonathan Ellis
            Assignee: Jonathan Ellis
            Priority: Minor
             Fix For: 0.7.4




--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Updated: (CASSANDRA-2294) secondary index CFs should use parent CF flush thresholds

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-2294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis updated CASSANDRA-2294:
--------------------------------------

    Remaining Estimate: 4h
     Original Estimate: 4h

> secondary index CFs should use parent CF flush thresholds
> ---------------------------------------------------------
>
>                 Key: CASSANDRA-2294
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2294
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Core
>    Affects Versions: 0.7.0
>            Reporter: Jonathan Ellis
>            Assignee: Jonathan Ellis
>            Priority: Minor
>             Fix For: 0.7.4
>
>         Attachments: 2294-v2.txt, 2294.txt
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Commented: (CASSANDRA-2294) secondary index CFs should use parent CF flush thresholds

Posted by "Sylvain Lebresne (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-2294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13005776#comment-13005776 ] 

Sylvain Lebresne commented on CASSANDRA-2294:
---------------------------------------------

+1 on v2

> secondary index CFs should use parent CF flush thresholds
> ---------------------------------------------------------
>
>                 Key: CASSANDRA-2294
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2294
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Core
>    Affects Versions: 0.7.0
>            Reporter: Jonathan Ellis
>            Assignee: Jonathan Ellis
>            Priority: Minor
>             Fix For: 0.7.4
>
>         Attachments: 2294-v2.txt, 2294.txt
>
>


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Commented: (CASSANDRA-2294) secondary index CFs should use parent CF flush thresholds

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-2294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13005886#comment-13005886 ] 

Hudson commented on CASSANDRA-2294:
-----------------------------------

Integrated in Cassandra-0.7 #375 (See [https://hudson.apache.org/hudson/job/Cassandra-0.7/375/])
    make2ary indexes use parentCF flush thresholds during initial build
patch by jbellis; reviewed by slebresne for CASSANDRA-2294


> secondary index CFs should use parent CF flush thresholds
> ---------------------------------------------------------
>
>                 Key: CASSANDRA-2294
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2294
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Core
>    Affects Versions: 0.7.0
>            Reporter: Jonathan Ellis
>            Assignee: Jonathan Ellis
>            Priority: Minor
>             Fix For: 0.7.4
>
>         Attachments: 2294-v2.txt, 2294.txt
>
>


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Updated: (CASSANDRA-2294) secondary index CFs should use parent CF flush thresholds

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-2294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis updated CASSANDRA-2294:
--------------------------------------

    Attachment: 2294.txt

> secondary index CFs should use parent CF flush thresholds
> ---------------------------------------------------------
>
>                 Key: CASSANDRA-2294
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2294
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Core
>    Affects Versions: 0.7.0
>            Reporter: Jonathan Ellis
>            Assignee: Jonathan Ellis
>            Priority: Minor
>             Fix For: 0.7.4
>
>         Attachments: 2294.txt
>
>


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Commented: (CASSANDRA-2294) secondary index CFs should use parent CF flush thresholds

Posted by "Matt Conway (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-2294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13005046#comment-13005046 ] 

Matt Conway commented on CASSANDRA-2294:
----------------------------------------

Looking at jmx, the memtable settings for the index CF seem the same as for the parent (switch count is the only one that is different), so its not that they aren't getting set correctly.



> secondary index CFs should use parent CF flush thresholds
> ---------------------------------------------------------
>
>                 Key: CASSANDRA-2294
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2294
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Core
>    Affects Versions: 0.7.0
>            Reporter: Jonathan Ellis
>            Assignee: Jonathan Ellis
>            Priority: Minor
>             Fix For: 0.7.4
>
>         Attachments: 2294.txt
>
>


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Commented: (CASSANDRA-2294) secondary index CFs should use parent CF flush thresholds

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-2294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13004951#comment-13004951 ] 

Jonathan Ellis commented on CASSANDRA-2294:
-------------------------------------------

This patch doesn't work; on a test system it got up to 842555951 bytes, 11238839 ops before memory presure flushed it (CASSANDRA-2295) but settings were to flush at 383MB/1.8M ops.

> secondary index CFs should use parent CF flush thresholds
> ---------------------------------------------------------
>
>                 Key: CASSANDRA-2294
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2294
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Core
>    Affects Versions: 0.7.0
>            Reporter: Jonathan Ellis
>            Assignee: Jonathan Ellis
>            Priority: Minor
>             Fix For: 0.7.4
>
>         Attachments: 2294.txt
>
>


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Updated: (CASSANDRA-2294) secondary index CFs should use parent CF flush thresholds

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-2294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis updated CASSANDRA-2294:
--------------------------------------

    Attachment: 2294-v2.txt

New patch applies flush thresholds changed via "update column family" to indexes as well (rather than waiting until next restart).

I created 1M rows with stress.java, ran "update column family standard1 with memtable_operations=0.0001", created an index, and the index started building with flushes every 100 rows.  I changed it to "memtable_operations=0.01" and it started flushing every 10000 rows.

> secondary index CFs should use parent CF flush thresholds
> ---------------------------------------------------------
>
>                 Key: CASSANDRA-2294
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2294
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Core
>    Affects Versions: 0.7.0
>            Reporter: Jonathan Ellis
>            Assignee: Jonathan Ellis
>            Priority: Minor
>             Fix For: 0.7.4
>
>         Attachments: 2294-v2.txt, 2294.txt
>
>


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira