You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/02/01 12:48:51 UTC

[jira] [Commented] (KAFKA-4702) Parametrize streams benchmarks to run at scale

    [ https://issues.apache.org/jira/browse/KAFKA-4702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15848335#comment-15848335 ] 

ASF GitHub Bot commented on KAFKA-4702:
---------------------------------------

GitHub user enothereska opened a pull request:

    https://github.com/apache/kafka/pull/2478

    KAFKA-4702: Parametrize streams benchmarks to run at scale

    

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/enothereska/kafka minor-benchmark-args

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/kafka/pull/2478.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #2478
    
----
commit 1831792880425893a9c6b4de17a66776422c819b
Author: Eno Thereska <en...@gmail.com>
Date:   2017-01-26T12:21:12Z

    Checkpoint

commit 134df74f469aa2db65ea7941db45a7ef61b8248d
Author: Eno Thereska <en...@gmail.com>
Date:   2017-01-27T10:40:32Z

    Checkpoint, runs on local

commit 0494d5bc47aac9e091142e2224d9000dbbd3e51e
Author: Ubuntu <ub...@ip-172-31-22-146.us-west-2.compute.internal>
Date:   2017-01-29T20:02:50Z

    Adjusted import

commit f02ff62f672a5f68cdb71f1c29f9687039db13be
Author: Eno Thereska <en...@gmail.com>
Date:   2017-01-29T20:36:41Z

    Revert log4j file

commit 84c716d233f161d3e5aa344e718ad3cbf70b99bf
Author: Eno Thereska <en...@gmail.com>
Date:   2017-01-30T09:52:20Z

    Fixed ending logic

commit 51552d97d389b7f01b882ced775b286b8c3f02d1
Author: Eno Thereska <en...@gmail.com>
Date:   2017-01-30T17:33:58Z

    Default for nightly

commit 191b1eccdded07703a92ff33b7039670081dcfa8
Author: Ubuntu <ub...@ip-172-31-22-146.us-west-2.compute.internal>
Date:   2017-01-30T17:36:13Z

    3 tests

commit 1d3ab26243893f0b2ae9a193237a8c1c36a22eec
Author: Eno Thereska <en...@gmail.com>
Date:   2017-01-30T17:45:13Z

    Merge remote-tracking branch 'origin/trunk' into minor-benchmark-args

commit ee6a6a48f00a200939a2dd6d3bec6f6bfafb3f29
Author: Eno Thereska <en...@gmail.com>
Date:   2017-01-30T19:41:24Z

    Merge with trunk

commit b889b80eaa9c864d713214f02e6ecd7e8ff8e432
Author: Eno Thereska <en...@gmail.com>
Date:   2017-01-30T19:42:30Z

    Merged with branch

commit 1d9e5bd637831a7c1307eeddb9edf71b3f94d5fe
Author: Eno Thereska <en...@gmail.com>
Date:   2017-01-31T15:58:05Z

    Reduce number of latch countdowns

commit 88759344338659c27c88d7c7aa10cc3cb917c69a
Author: Eno Thereska <en...@gmail.com>
Date:   2017-02-01T12:45:55Z

    Adjusted num nodes for nightly

----


> Parametrize streams benchmarks to run at scale
> ----------------------------------------------
>
>                 Key: KAFKA-4702
>                 URL: https://issues.apache.org/jira/browse/KAFKA-4702
>             Project: Kafka
>          Issue Type: Improvement
>          Components: streams
>    Affects Versions: 0.10.3.0
>            Reporter: Eno Thereska
>            Assignee: Eno Thereska
>
> The streams benchmarks (in SimpleBenchmark.java and triggered through kafka/tests/kafkatest/benchmarks/streams/streams_simple_benchmark_test.py) run as single-instance, with a simple 1 broker Kafka cluster. 
> We need to parametrize the tests so they can run at scale, e.g., with 10-100 KafkaStreams instances and similar number of brokers.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)