[jira] [Comment Edited] (KAFKA-2003) Add upgrade tests

["Ashish K Singh (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347804#comment-14347804 ] 

Ashish K Singh edited comment on KAFKA-2003 at 3/4/15 11:57 PM:
----------------------------------------------------------------

[~gwenshap] does the following outline make sense?

$> some_tool <from_version> <m_instances> <to_version> <n_instances>
1. Compile jars into <from_version>_target
2. Compile jars into <to_version>_target
3. Bring up n <to_version> brokers
4. Run tests producer consumer tests with clients from <from_version>_target
5. Bring up m <from_version> brokers
6. Run tests producer consumer tests with clients from <from_version>_target
7. Run tests producer consumer tests with clients from <to_version>_target
8. 
{noformat}
foreach(broker: brokers)
        Bump up the interbroker.protocol.version
        Run tests producer consumer tests with clients from <from_version>_target
        Run tests producer consumer tests with clients from <to_version>_target
{noformat}
9. Cleanup


was (Author: singhashish):
[~gwenshap] does the following outline make sense?

$> some_tool <from_version> <m_instances> <to_version> <n_instances>
1. Compile jars into <from_version>_target
2. Compile jars into <to_version>_target
3. Bring up n <to_version> brokers
4. Run tests producer consumer tests with clients from <from_version>_target
5. Bring up m <from_version> brokers
6. Run tests producer consumer tests with clients from <from_version>_target
7. Run tests producer consumer tests with clients from <to_version>_target
8. 
{noformat}
foreach(broker: brokers)
        Bump up the interbroker.protocol.version
        Run tests producer consumer tests with clients from <from_version>_target
        Run tests producer consumer tests with clients from <to_version>_target
{noformat}

> Add upgrade tests
> -----------------
>
>                 Key: KAFKA-2003
>                 URL: https://issues.apache.org/jira/browse/KAFKA-2003
>             Project: Kafka
>          Issue Type: Improvement
>            Reporter: Gwen Shapira
>            Assignee: Ashish K Singh
>
> To test protocol changes, compatibility and upgrade process, we need a good way to test different versions of the product together and to test end-to-end upgrade process.
> For example, for 0.8.2 to 0.8.3 test we want to check:
> * Can we start a cluster with a mix of 0.8.2 and 0.8.3 brokers?
> * Can a cluster of 0.8.3 brokers bump the protocol level one broker at a time?
> * Can 0.8.2 clients run against a cluster of 0.8.3 brokers?
> There are probably more questions. But an automated framework that can test those and report results will be a good start.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)