[jira] [Updated] (KAFKA-2171) System Test for Quotas

["Dong Lin (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KAFKA-2171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dong Lin updated KAFKA-2171:
----------------------------
    Description: 
Initial setup and configuration:
In all scenarios, we create the following entities and topic:
- 1 kafka brokers
- 1 topic with replication factor = 1, ackNum = -1, and parition = 6
- 1 producer performance
- 2 console consumers
- 3 jmx tools, one for each of the producer and consumers
- we consider two rates are approximately the same if they differ by at most 10%.

Scenario 1: validate the effectiveness of default producer and consumer quota

1) Let default_producer_quota = default_consumer_quota = 20000 Bytes/sec
2) Produce 2000 messages of 20000 bytes each (with clientId = producer_performance)
3) Wait until producer stops
4) Two consumers consume from the topic (with clientId = group1 and group2 respectively )
5) verify that actual rate is within 10% of expected rate (quota)

Scenario 2: validate the effectiveness of producer and consumer quota override

1) Let default_producer_quota = default_consumer_quota = 20000 Bytes/sec
    Override quota of producer_performance and group1 to be 15000 Bytes/sec
2) Produce 2000 messages of 20000 bytes each (with clientId = producer_performance)
3) Wait until producer stops
4) Two consumers consume from the topic (with clientId = group1 and group2 respectively )
5) verify that actual rate is within 10% of expected rate (quota)

Scenario 3: validate the effectiveness of quota sharing

1) Let default_producer_quota = default_consumer_quota = 20000 Bytes/sec
    Override quota of producer_performance and group1 to be 15000 Bytes/sec
2) Produce 2000 messages of 20000 bytes each (with clientId = producer_performance)
3) Wait until producer stops
4) Two consumers consume from the topic (with clientId = group1 for both consumers)
5) verify that actual rate is within 10% of expected rate (quota)


  was:
Initial setup and configuration:
In all scenarios, we create the following entities and topic:
- 4 kafka brokers
- 1 topic with replication factor = 2, ackNum = -1, and parition = 6
- 1 producer performance
- 2 console consumers
- 3 jmx tools, one for each of the producer and consumers
- we consider two rates are approximately the same if they differ by at most 10%.

Scenario 1: validate the effectiveness of default producer and consumer quota

1) Let default_producer_quota = default_consumer_quota = 20000 Bytes/sec
2) Produce 2000 messages of 20000 bytes each (with clientId = producer_performance)
3) Wait until producer stops
4) Two consumers consume from the topic (with clientId = group1 and group2 respectively )
5) verify that the data consumed is identical to the data produced
6) verify that actual rate is within 10% of expected rate (quota)

Scenario 2: validate the effectiveness of producer and consumer quota override

1) Let default_producer_quota = default_consumer_quota = 20000 Bytes/sec
    Override quota of producer_performance and group1 to be 15000 Bytes/sec
2) Produce 2000 messages of 20000 bytes each (with clientId = producer_performance)
3) Wait until producer stops
4) Two consumers consume from the topic (with clientId = group1 and group2 respectively )
5) verify that the data consumed is identical to the data produced
6) verify that actual rate is within 10% of expected rate (quota)



> System Test for Quotas
> ----------------------
>
>                 Key: KAFKA-2171
>                 URL: https://issues.apache.org/jira/browse/KAFKA-2171
>             Project: Kafka
>          Issue Type: Sub-task
>            Reporter: Dong Lin
>            Assignee: Dong Lin
>         Attachments: KAFKA-2171.patch
>
>   Original Estimate: 336h
>  Remaining Estimate: 336h
>
> Initial setup and configuration:
> In all scenarios, we create the following entities and topic:
> - 1 kafka brokers
> - 1 topic with replication factor = 1, ackNum = -1, and parition = 6
> - 1 producer performance
> - 2 console consumers
> - 3 jmx tools, one for each of the producer and consumers
> - we consider two rates are approximately the same if they differ by at most 10%.
> Scenario 1: validate the effectiveness of default producer and consumer quota
> 1) Let default_producer_quota = default_consumer_quota = 20000 Bytes/sec
> 2) Produce 2000 messages of 20000 bytes each (with clientId = producer_performance)
> 3) Wait until producer stops
> 4) Two consumers consume from the topic (with clientId = group1 and group2 respectively )
> 5) verify that actual rate is within 10% of expected rate (quota)
> Scenario 2: validate the effectiveness of producer and consumer quota override
> 1) Let default_producer_quota = default_consumer_quota = 20000 Bytes/sec
>     Override quota of producer_performance and group1 to be 15000 Bytes/sec
> 2) Produce 2000 messages of 20000 bytes each (with clientId = producer_performance)
> 3) Wait until producer stops
> 4) Two consumers consume from the topic (with clientId = group1 and group2 respectively )
> 5) verify that actual rate is within 10% of expected rate (quota)
> Scenario 3: validate the effectiveness of quota sharing
> 1) Let default_producer_quota = default_consumer_quota = 20000 Bytes/sec
>     Override quota of producer_performance and group1 to be 15000 Bytes/sec
> 2) Produce 2000 messages of 20000 bytes each (with clientId = producer_performance)
> 3) Wait until producer stops
> 4) Two consumers consume from the topic (with clientId = group1 for both consumers)
> 5) verify that actual rate is within 10% of expected rate (quota)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)