You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "vamossagar12 (via GitHub)" <gi...@apache.org> on 2023/02/12 09:32:55 UTC
[GitHub] [kafka] vamossagar12 commented on pull request #13095: KAFKA-14580: Moving EndToEndLatency from core to tools module
vamossagar12 commented on PR #13095:
URL: https://github.com/apache/kafka/pull/13095#issuecomment-1426985065
@fvaleri , @mimaison here's a sample run from my local setup :
```
(ducktape) sarao@C02GG1KCML7H kafka % TC_PATHS="tests/kafkatest/benchmarks/core/benchmark_test.py::Benchmark.test_end_to_end_latency" bash tests/docker/run_tests.sh
> Configure project :
Starting build with version 3.5.0-SNAPSHOT (commit id 4ecc30e0) using Gradle 7.6, Java 1.8 and Scala 2.13.10
Build properties: maxParallelForks=8, maxScalacThreads=8, maxTestRetries=0
BUILD SUCCESSFUL in 10s
170 actionable tasks: 170 up-to-date
docker exec ducker01 bash -c "cd /opt/kafka-dev && ducktape --cluster-file /opt/kafka-dev/tests/docker/build/cluster.json ./tests/kafkatest/benchmarks/core/benchmark_test.py::Benchmark.test_end_to_end_latency "
/usr/local/lib/python3.9/dist-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated
"class": algorithms.Blowfish,
[INFO:2023-02-12 00:59:22,204]: starting test run with session id 2023-02-12--002...
[INFO:2023-02-12 00:59:22,206]: running 10 tests...
[INFO:2023-02-12 00:59:22,208]: Triggering test 1 of 10...
[INFO:2023-02-12 00:59:22,271]: RunnerClient: Loading test {'directory': '/opt/kafka-dev/tests/kafkatest/benchmarks/core', 'file_name': 'benchmark_test.py', 'cls_name': 'Benchmark', 'method_name': 'test_end_to_end_latency', 'injected_args': {'security_protocol': 'SASL_PLAINTEXT', 'compression_type': 'none'}}
[INFO:2023-02-12 00:59:22,300]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_PLAINTEXT.compression_type=none: on run 1/1
[INFO:2023-02-12 00:59:22,321]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_PLAINTEXT.compression_type=none: Setting up...
[INFO:2023-02-12 00:59:27,898]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_PLAINTEXT.compression_type=none: Running...
[INFO:2023-02-12 01:03:02,248]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_PLAINTEXT.compression_type=none: Tearing down...
[INFO:2023-02-12 01:03:34,257]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_PLAINTEXT.compression_type=none: PASS
[INFO:2023-02-12 01:03:34,263]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_PLAINTEXT.compression_type=none: Data: {'latency_50th_ms': 7.0, 'latency_99th_ms': 47.0, 'latency_999th_ms': 169.0}
[INFO:2023-02-12 01:03:34,347]: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[INFO:2023-02-12 01:03:34,350]: Triggering test 2 of 10...
[INFO:2023-02-12 01:03:34,399]: RunnerClient: Loading test {'directory': '/opt/kafka-dev/tests/kafkatest/benchmarks/core', 'file_name': 'benchmark_test.py', 'cls_name': 'Benchmark', 'method_name': 'test_end_to_end_latency', 'injected_args': {'security_protocol': 'SASL_PLAINTEXT', 'compression_type': 'snappy'}}
[INFO:2023-02-12 01:03:34,434]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_PLAINTEXT.compression_type=snappy: on run 1/1
[INFO:2023-02-12 01:03:34,446]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_PLAINTEXT.compression_type=snappy: Setting up...
[INFO:2023-02-12 01:03:47,646]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_PLAINTEXT.compression_type=snappy: Running...
[INFO:2023-02-12 01:07:06,578]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_PLAINTEXT.compression_type=snappy: Tearing down...
[INFO:2023-02-12 01:07:34,367]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_PLAINTEXT.compression_type=snappy: PASS
[INFO:2023-02-12 01:07:34,372]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_PLAINTEXT.compression_type=snappy: Data: {'latency_50th_ms': 9.0, 'latency_99th_ms': 50.0, 'latency_999th_ms': 131.0}
[INFO:2023-02-12 01:07:34,442]: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[INFO:2023-02-12 01:07:34,445]: Triggering test 3 of 10...
[INFO:2023-02-12 01:07:34,485]: RunnerClient: Loading test {'directory': '/opt/kafka-dev/tests/kafkatest/benchmarks/core', 'file_name': 'benchmark_test.py', 'cls_name': 'Benchmark', 'method_name': 'test_end_to_end_latency', 'injected_args': {'security_protocol': 'SASL_SSL', 'compression_type': 'none'}}
[INFO:2023-02-12 01:07:34,506]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_SSL.compression_type=none: on run 1/1
[INFO:2023-02-12 01:07:34,520]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_SSL.compression_type=none: Setting up...
[INFO:2023-02-12 01:07:38,538]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_SSL.compression_type=none: Running...
[INFO:2023-02-12 01:11:25,549]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_SSL.compression_type=none: Tearing down...
[INFO:2023-02-12 01:11:49,491]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_SSL.compression_type=none: PASS
[INFO:2023-02-12 01:11:49,495]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_SSL.compression_type=none: Data: {'latency_50th_ms': 9.0, 'latency_99th_ms': 114.0, 'latency_999th_ms': 390.0}
[INFO:2023-02-12 01:11:49,554]: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[INFO:2023-02-12 01:11:49,556]: Triggering test 4 of 10...
[INFO:2023-02-12 01:11:49,608]: RunnerClient: Loading test {'directory': '/opt/kafka-dev/tests/kafkatest/benchmarks/core', 'file_name': 'benchmark_test.py', 'cls_name': 'Benchmark', 'method_name': 'test_end_to_end_latency', 'injected_args': {'security_protocol': 'SASL_SSL', 'compression_type': 'snappy'}}
[INFO:2023-02-12 01:11:49,638]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_SSL.compression_type=snappy: on run 1/1
[INFO:2023-02-12 01:11:49,651]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_SSL.compression_type=snappy: Setting up...
[INFO:2023-02-12 01:11:53,742]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_SSL.compression_type=snappy: Running...
[INFO:2023-02-12 01:15:14,809]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_SSL.compression_type=snappy: Tearing down...
[INFO:2023-02-12 01:15:46,057]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_SSL.compression_type=snappy: PASS
[INFO:2023-02-12 01:15:46,061]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=SASL_SSL.compression_type=snappy: Data: {'latency_50th_ms': 8.0, 'latency_99th_ms': 62.0, 'latency_999th_ms': 125.0}
[INFO:2023-02-12 01:15:46,131]: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[INFO:2023-02-12 01:15:46,136]: Triggering test 5 of 10...
[INFO:2023-02-12 01:15:46,190]: RunnerClient: Loading test {'directory': '/opt/kafka-dev/tests/kafkatest/benchmarks/core', 'file_name': 'benchmark_test.py', 'cls_name': 'Benchmark', 'method_name': 'test_end_to_end_latency', 'injected_args': {'security_protocol': 'PLAINTEXT', 'compression_type': 'none'}}
[INFO:2023-02-12 01:15:46,228]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=PLAINTEXT.compression_type=none: on run 1/1
[INFO:2023-02-12 01:15:46,319]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=PLAINTEXT.compression_type=none: Setting up...
[INFO:2023-02-12 01:15:50,523]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=PLAINTEXT.compression_type=none: Running...
[INFO:2023-02-12 01:17:00,744]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=PLAINTEXT.compression_type=none: Tearing down...
[INFO:2023-02-12 01:17:30,336]: RunnerClient: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=PLAINTEXT.compression_type=none: FAIL: TimeoutError("Kafka servers didn't register at ZK within 30 seconds")
```
I stopped after #5 as there was some flakiness.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org