You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Jonathan Ellis (JIRA)" <ji...@apache.org> on 2011/01/05 20:32:48 UTC

[jira] Created: (CASSANDRA-1941) Add distributed test doing reads during bootstrap of additional node

Add distributed test doing reads during bootstrap of additional node
--------------------------------------------------------------------

                 Key: CASSANDRA-1941
                 URL: https://issues.apache.org/jira/browse/CASSANDRA-1941
             Project: Cassandra
          Issue Type: New Feature
          Components: Core
            Reporter: Jonathan Ellis
            Priority: Minor
             Fix For: 0.8


Following introduction of the distributed test framework in CASSANDRA-1859, we should extend that to test reads while bootstrap happens (this is a scenario that has had regressions in the past).

See test/distributed/README.txt for intro.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Issue Comment Edited: (CASSANDRA-1941) Add distributed test doing reads during MovementTest

Posted by "Stu Hood (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12989048#comment-12989048 ] 

Stu Hood edited comment on CASSANDRA-1941 at 2/1/11 5:28 AM:
-------------------------------------------------------------

MovementTest performs a loadbalance, which is almost a full roundtrip.

It should be possible to test bootstrap by:
# decommissioning the node via nodetool
# killing the process
# wiping its state
# starting it again

----

These commands exist in the Whirr scripts now.

      was (Author: stuhood):
    MovementTest performs a loadbalance, which almost a full roundtrip.

It should be possible to test bootstrap by:
# decommissioning the node via nodetool
# killing the process
# wiping its state
# starting it again

----

These commands exist in the Whirr scripts now.
  
> Add distributed test doing reads during MovementTest
> ----------------------------------------------------
>
>                 Key: CASSANDRA-1941
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-1941
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Core
>            Reporter: Jonathan Ellis
>            Assignee: Brandon Williams
>            Priority: Minor
>             Fix For: 0.8
>
>
> Following introduction of the distributed test framework in CASSANDRA-1859, we should extend that to test reads while bootstrap happens (this is a scenario that has had regressions in the past).
> See test/distributed/README.txt for intro.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (CASSANDRA-1941) Add distributed test doing reads during bootstrap of additional node

Posted by "Brandon Williams (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12984942#action_12984942 ] 

Brandon Williams commented on CASSANDRA-1941:
---------------------------------------------

I think the way to do this is to have something that utilizes CassandraServiceController.createClient in another thread to do the reads while the bootstrap is happening.

> Add distributed test doing reads during bootstrap of additional node
> --------------------------------------------------------------------
>
>                 Key: CASSANDRA-1941
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-1941
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Core
>            Reporter: Jonathan Ellis
>            Assignee: Brandon Williams
>            Priority: Minor
>             Fix For: 0.8
>
>
> Following introduction of the distributed test framework in CASSANDRA-1859, we should extend that to test reads while bootstrap happens (this is a scenario that has had regressions in the past).
> See test/distributed/README.txt for intro.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] [Updated] (CASSANDRA-1941) Add distributed test doing reads during MovementTest

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis updated CASSANDRA-1941:
--------------------------------------

    Reviewer: mallen  (was: jbellis)

> Add distributed test doing reads during MovementTest
> ----------------------------------------------------
>
>                 Key: CASSANDRA-1941
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-1941
>             Project: Cassandra
>          Issue Type: Test
>          Components: Core
>            Reporter: Jonathan Ellis
>            Assignee: Pavel Yaskevich
>            Priority: Minor
>             Fix For: 0.8.1
>
>         Attachments: CASSANDRA-1941.patch
>
>   Original Estimate: 8h
>  Remaining Estimate: 8h
>
> Following introduction of the distributed test framework in CASSANDRA-1859, we should extend that to test reads while bootstrap happens (this is a scenario that has had regressions in the past).
> See test/distributed/README.txt for intro.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Commented: (CASSANDRA-1941) Add distributed test doing reads during bootstrap of additional node

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979766#action_12979766 ] 

Jonathan Ellis commented on CASSANDRA-1941:
-------------------------------------------

bq. Also, we should do reads during decommission

i'm fine leaving that for a followup ticket

> Add distributed test doing reads during bootstrap of additional node
> --------------------------------------------------------------------
>
>                 Key: CASSANDRA-1941
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-1941
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Core
>            Reporter: Jonathan Ellis
>            Assignee: Brandon Williams
>            Priority: Minor
>             Fix For: 0.8
>
>
> Following introduction of the distributed test framework in CASSANDRA-1859, we should extend that to test reads while bootstrap happens (this is a scenario that has had regressions in the past).
> See test/distributed/README.txt for intro.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (CASSANDRA-1941) Add distributed test doing reads during MovementTest

Posted by "Stu Hood (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12989048#comment-12989048 ] 

Stu Hood commented on CASSANDRA-1941:
-------------------------------------

MovementTest performs a loadbalance, which almost a full roundtrip.

It should be possible to test bootstrap by:
# decommissioning the node via nodetool
# killing the process
# wiping its state
# starting it again

----

These commands exist in the Whirr scripts now.

> Add distributed test doing reads during MovementTest
> ----------------------------------------------------
>
>                 Key: CASSANDRA-1941
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-1941
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Core
>            Reporter: Jonathan Ellis
>            Assignee: Brandon Williams
>            Priority: Minor
>             Fix For: 0.8
>
>
> Following introduction of the distributed test framework in CASSANDRA-1859, we should extend that to test reads while bootstrap happens (this is a scenario that has had regressions in the past).
> See test/distributed/README.txt for intro.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Assigned: (CASSANDRA-1941) Add distributed test doing reads during MovementTest

Posted by "Pavel Yaskevich (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Pavel Yaskevich reassigned CASSANDRA-1941:
------------------------------------------

    Assignee: Pavel Yaskevich  (was: Brandon Williams)

> Add distributed test doing reads during MovementTest
> ----------------------------------------------------
>
>                 Key: CASSANDRA-1941
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-1941
>             Project: Cassandra
>          Issue Type: Test
>          Components: Core
>            Reporter: Jonathan Ellis
>            Assignee: Pavel Yaskevich
>            Priority: Minor
>             Fix For: 0.8
>
>
> Following introduction of the distributed test framework in CASSANDRA-1859, we should extend that to test reads while bootstrap happens (this is a scenario that has had regressions in the past).
> See test/distributed/README.txt for intro.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (CASSANDRA-1941) Add distributed test doing reads during MovementTest

Posted by "Brandon Williams (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Brandon Williams updated CASSANDRA-1941:
----------------------------------------

    Summary: Add distributed test doing reads during MovementTest  (was: Add distributed test doing reads during bootstrap of additional node)

> Add distributed test doing reads during MovementTest
> ----------------------------------------------------
>
>                 Key: CASSANDRA-1941
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-1941
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Core
>            Reporter: Jonathan Ellis
>            Assignee: Brandon Williams
>            Priority: Minor
>             Fix For: 0.8
>
>
> Following introduction of the distributed test framework in CASSANDRA-1859, we should extend that to test reads while bootstrap happens (this is a scenario that has had regressions in the past).
> See test/distributed/README.txt for intro.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (CASSANDRA-1941) Add distributed test doing reads during bootstrap of additional node

Posted by "Brandon Williams (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979763#action_12979763 ] 

Brandon Williams commented on CASSANDRA-1941:
---------------------------------------------

CASSANDRA-1534 is an example of this sort of regression.  Also, we should do reads during decommission.

> Add distributed test doing reads during bootstrap of additional node
> --------------------------------------------------------------------
>
>                 Key: CASSANDRA-1941
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-1941
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Core
>            Reporter: Jonathan Ellis
>            Assignee: Brandon Williams
>            Priority: Minor
>             Fix For: 0.8
>
>
> Following introduction of the distributed test framework in CASSANDRA-1859, we should extend that to test reads while bootstrap happens (this is a scenario that has had regressions in the past).
> See test/distributed/README.txt for intro.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (CASSANDRA-1941) Add distributed test doing reads during MovementTest

Posted by "Stu Hood (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Stu Hood updated CASSANDRA-1941:
--------------------------------

    Issue Type: Test  (was: New Feature)

> Add distributed test doing reads during MovementTest
> ----------------------------------------------------
>
>                 Key: CASSANDRA-1941
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-1941
>             Project: Cassandra
>          Issue Type: Test
>          Components: Core
>            Reporter: Jonathan Ellis
>            Assignee: Brandon Williams
>            Priority: Minor
>             Fix For: 0.8
>
>
> Following introduction of the distributed test framework in CASSANDRA-1859, we should extend that to test reads while bootstrap happens (this is a scenario that has had regressions in the past).
> See test/distributed/README.txt for intro.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (CASSANDRA-1941) Add distributed test doing reads during MovementTest

Posted by "Pavel Yaskevich (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13023172#comment-13023172 ] 

Pavel Yaskevich commented on CASSANDRA-1941:
--------------------------------------------

Stu Hood: sure, I will take a look at CASSANDRA-2464!

> Add distributed test doing reads during MovementTest
> ----------------------------------------------------
>
>                 Key: CASSANDRA-1941
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-1941
>             Project: Cassandra
>          Issue Type: Test
>          Components: Core
>            Reporter: Jonathan Ellis
>            Assignee: Pavel Yaskevich
>            Priority: Minor
>             Fix For: 0.8.1
>
>         Attachments: CASSANDRA-1941.patch
>
>   Original Estimate: 8h
>  Remaining Estimate: 8h
>
> Following introduction of the distributed test framework in CASSANDRA-1859, we should extend that to test reads while bootstrap happens (this is a scenario that has had regressions in the past).
> See test/distributed/README.txt for intro.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Updated: (CASSANDRA-1941) Add distributed test doing reads during MovementTest

Posted by "Brandon Williams (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Brandon Williams updated CASSANDRA-1941:
----------------------------------------


Properly performing a bootstrap doesn't currently seem possible with whirr.  Let's just add reads to MovementTest for now.

> Add distributed test doing reads during MovementTest
> ----------------------------------------------------
>
>                 Key: CASSANDRA-1941
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-1941
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Core
>            Reporter: Jonathan Ellis
>            Assignee: Brandon Williams
>            Priority: Minor
>             Fix For: 0.8
>
>
> Following introduction of the distributed test framework in CASSANDRA-1859, we should extend that to test reads while bootstrap happens (this is a scenario that has had regressions in the past).
> See test/distributed/README.txt for intro.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (CASSANDRA-1941) Add distributed test doing reads during bootstrap of additional node

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979762#action_12979762 ] 

Jonathan Ellis commented on CASSANDRA-1941:
-------------------------------------------

bq. this is a scenario that has had regressions in the past

E.g. CASSANDRA-692, CASSANDRA-1534

> Add distributed test doing reads during bootstrap of additional node
> --------------------------------------------------------------------
>
>                 Key: CASSANDRA-1941
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-1941
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Core
>            Reporter: Jonathan Ellis
>            Assignee: Brandon Williams
>            Priority: Minor
>             Fix For: 0.8
>
>
> Following introduction of the distributed test framework in CASSANDRA-1859, we should extend that to test reads while bootstrap happens (this is a scenario that has had regressions in the past).
> See test/distributed/README.txt for intro.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (CASSANDRA-1941) Add distributed test doing reads during bootstrap of additional node

Posted by "Brandon Williams (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Brandon Williams reassigned CASSANDRA-1941:
-------------------------------------------

    Assignee: Brandon Williams

> Add distributed test doing reads during bootstrap of additional node
> --------------------------------------------------------------------
>
>                 Key: CASSANDRA-1941
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-1941
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Core
>            Reporter: Jonathan Ellis
>            Assignee: Brandon Williams
>            Priority: Minor
>             Fix For: 0.8
>
>
> Following introduction of the distributed test framework in CASSANDRA-1859, we should extend that to test reads while bootstrap happens (this is a scenario that has had regressions in the past).
> See test/distributed/README.txt for intro.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (CASSANDRA-1941) Add distributed test doing reads during MovementTest

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis updated CASSANDRA-1941:
--------------------------------------

    Remaining Estimate: 8h
     Original Estimate: 8h

> Add distributed test doing reads during MovementTest
> ----------------------------------------------------
>
>                 Key: CASSANDRA-1941
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-1941
>             Project: Cassandra
>          Issue Type: Test
>          Components: Core
>            Reporter: Jonathan Ellis
>            Assignee: Pavel Yaskevich
>            Priority: Minor
>             Fix For: 0.8
>
>   Original Estimate: 8h
>  Remaining Estimate: 8h
>
> Following introduction of the distributed test framework in CASSANDRA-1859, we should extend that to test reads while bootstrap happens (this is a scenario that has had regressions in the past).
> See test/distributed/README.txt for intro.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (CASSANDRA-1941) Add distributed test doing reads during MovementTest

Posted by "Stu Hood (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13023137#comment-13023137 ] 

Stu Hood commented on CASSANDRA-1941:
-------------------------------------

This is awesome: thank you Pavel. I'll try and take a look this weekend. In exchange, would you mind taking a look at CASSANDRA-2464?

Also, is CASSANDRA-2523 just my imagination? You seem to be successfully using runurl-based-script-execution, but I haven't had luck recently.

Thanks again!

> Add distributed test doing reads during MovementTest
> ----------------------------------------------------
>
>                 Key: CASSANDRA-1941
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-1941
>             Project: Cassandra
>          Issue Type: Test
>          Components: Core
>            Reporter: Jonathan Ellis
>            Assignee: Pavel Yaskevich
>            Priority: Minor
>             Fix For: 0.8.1
>
>         Attachments: CASSANDRA-1941.patch
>
>   Original Estimate: 8h
>  Remaining Estimate: 8h
>
> Following introduction of the distributed test framework in CASSANDRA-1859, we should extend that to test reads while bootstrap happens (this is a scenario that has had regressions in the past).
> See test/distributed/README.txt for intro.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Issue Comment Edited: (CASSANDRA-1941) Add distributed test doing reads during bootstrap of additional node

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979762#action_12979762 ] 

Jonathan Ellis edited comment on CASSANDRA-1941 at 1/10/11 4:12 PM:
--------------------------------------------------------------------

bq. this is a scenario that has had regressions in the past

E.g. CASSANDRA-696, CASSANDRA-1534

      was (Author: jbellis):
    bq. this is a scenario that has had regressions in the past

E.g. CASSANDRA-692, CASSANDRA-1534
  
> Add distributed test doing reads during bootstrap of additional node
> --------------------------------------------------------------------
>
>                 Key: CASSANDRA-1941
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-1941
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Core
>            Reporter: Jonathan Ellis
>            Assignee: Brandon Williams
>            Priority: Minor
>             Fix For: 0.8
>
>
> Following introduction of the distributed test framework in CASSANDRA-1859, we should extend that to test reads while bootstrap happens (this is a scenario that has had regressions in the past).
> See test/distributed/README.txt for intro.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] [Updated] (CASSANDRA-1941) Add distributed test doing reads during MovementTest

Posted by "Pavel Yaskevich (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Pavel Yaskevich updated CASSANDRA-1941:
---------------------------------------

    Attachment: CASSANDRA-1941.patch

DataStreamingTest added which does the following:

1). insert 100 rows to the cluster with RF=ringSize-1
2). decommission of the last node
3). stop/wipe-state on the last node
4). start reading data in the separate thread while last node is not fully started
5). start of the last node (clean after wipe-state)

> Add distributed test doing reads during MovementTest
> ----------------------------------------------------
>
>                 Key: CASSANDRA-1941
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-1941
>             Project: Cassandra
>          Issue Type: Test
>          Components: Core
>            Reporter: Jonathan Ellis
>            Assignee: Pavel Yaskevich
>            Priority: Minor
>             Fix For: 0.8.1
>
>         Attachments: CASSANDRA-1941.patch
>
>   Original Estimate: 8h
>  Remaining Estimate: 8h
>
> Following introduction of the distributed test framework in CASSANDRA-1859, we should extend that to test reads while bootstrap happens (this is a scenario that has had regressions in the past).
> See test/distributed/README.txt for intro.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira