You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by GitBox <gi...@apache.org> on 2021/05/29 01:43:20 UTC
[GitHub] [kafka] ijuma commented on pull request #9229: MINOR: Reduce allocations in requests via buffer caching
ijuma commented on pull request #9229:
URL: https://github.com/apache/kafka/pull/9229#issuecomment-850747419
This PR:
> ================================================================================
> SESSION REPORT (ALL TESTS)
> ducktape version: 0.8.1
> session_id: 2021-05-28--005
> run time: 16 minutes 56.024 seconds
> tests run: 18
> passed: 18
> failed: 0
> ignored: 0
> ================================================================================
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_consumer_throughput.security_protocol=PLAINTEXT.compression_type=lz4
> status: PASS
> run time: 1 minute 16.243 seconds
> {"records_per_sec": 2044571.6622, "mb_per_sec": 194.9855}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_consumer_throughput.security_protocol=PLAINTEXT.compression_type=zstd
> status: PASS
> run time: 1 minute 19.227 seconds
> {"records_per_sec": 1779992.88, "mb_per_sec": 169.7533}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_and_consumer.security_protocol=PLAINTEXT.compression_type=lz4
> status: PASS
> run time: 1 minute 13.064 seconds
> {"producer": {"records_per_sec": 402868.423173, "mb_per_sec": 38.42}, "consumer": {"records_per_sec": 408363.28, "mb_per_sec": 38.9446}}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_and_consumer.security_protocol=PLAINTEXT.compression_type=zstd
> status: PASS
> run time: 1 minute 12.112 seconds
> {"producer": {"records_per_sec": 347886.588972, "mb_per_sec": 33.18}, "consumer": {"records_per_sec": 352534.7247, "mb_per_sec": 33.6203}}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=PLAINTEXT.compression_type=lz4
> status: PASS
> run time: 51.120 seconds
> {"latency_50th_ms": 0.0, "latency_99th_ms": 3.0, "latency_999th_ms": 8.0}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=PLAINTEXT.compression_type=zstd
> status: PASS
> run time: 45.992 seconds
> {"latency_50th_ms": 0.0, "latency_99th_ms": 3.0, "latency_999th_ms": 9.0}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_long_term_producer_throughput.security_protocol=PLAINTEXT.compression_type=lz4
> status: PASS
> run time: 1 minute 11.957 seconds
> {"0": {"records_per_sec": 400994.466276, "mb_per_sec": 38.24}}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_long_term_producer_throughput.security_protocol=PLAINTEXT.compression_type=zstd
> status: PASS
> run time: 1 minute 12.859 seconds
> {"0": {"records_per_sec": 366716.784627, "mb_per_sec": 34.97}}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_throughput.acks=1.topic=topic-replication-factor-three.security_protocol=PLAINTEXT.compression_type=lz4.message_size=10
> status: PASS
> run time: 55.828 seconds
> {"records_per_sec": 1101318.782309, "mb_per_sec": 10.5}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_throughput.acks=1.topic=topic-replication-factor-three.security_protocol=PLAINTEXT.compression_type=lz4.message_size=100
> status: PASS
> run time: 44.917 seconds
> {"records_per_sec": 373345.479833, "mb_per_sec": 35.6}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_throughput.acks=1.topic=topic-replication-factor-three.security_protocol=PLAINTEXT.compression_type=lz4.message_size=1000
> status: PASS
> run time: 45.609 seconds
> {"records_per_sec": 63912.857143, "mb_per_sec": 60.95}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_throughput.acks=1.topic=topic-replication-factor-three.security_protocol=PLAINTEXT.compression_type=lz4.message_size=10000
> status: PASS
> run time: 45.665 seconds
> {"records_per_sec": 8099.57755, "mb_per_sec": 77.24}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_throughput.acks=1.topic=topic-replication-factor-three.security_protocol=PLAINTEXT.compression_type=lz4.message_size=100000
> status: PASS
> run time: 42.768 seconds
> {"records_per_sec": 1127.731092, "mb_per_sec": 107.55}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_throughput.acks=1.topic=topic-replication-factor-three.security_protocol=PLAINTEXT.compression_type=zstd.message_size=10
> status: PASS
> run time: 55.771 seconds
> {"records_per_sec": 1051286.284953, "mb_per_sec": 10.03}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_throughput.acks=1.topic=topic-replication-factor-three.security_protocol=PLAINTEXT.compression_type=zstd.message_size=100
> status: PASS
> run time: 48.832 seconds
> {"records_per_sec": 331319.921007, "mb_per_sec": 31.6}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_throughput.acks=1.topic=topic-replication-factor-three.security_protocol=PLAINTEXT.compression_type=zstd.message_size=1000
> status: PASS
> run time: 46.853 seconds
> {"records_per_sec": 67615.617128, "mb_per_sec": 64.48}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_throughput.acks=1.topic=topic-replication-factor-three.security_protocol=PLAINTEXT.compression_type=zstd.message_size=10000
> status: PASS
> run time: 43.870 seconds
> {"records_per_sec": 7647.293447, "mb_per_sec": 72.93}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_throughput.acks=1.topic=topic-replication-factor-three.security_protocol=PLAINTEXT.compression_type=zstd.message_size=100000
> status: PASS
> run time: 43.045 seconds
> {"records_per_sec": 1222.222222, "mb_per_sec": 116.56}
> --------------------------------------------------------------------------------
trunk:
> ================================================================================
> SESSION REPORT (ALL TESTS)
> ducktape version: 0.8.1
> session_id: 2021-05-28--007
> run time: 16 minutes 49.452 seconds
> tests run: 18
> passed: 18
> failed: 0
> ignored: 0
> ================================================================================
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_consumer_throughput.security_protocol=PLAINTEXT.compression_type=lz4
> status: PASS
> run time: 1 minute 20.214 seconds
> {"records_per_sec": 1927153.5941, "mb_per_sec": 183.7877}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_consumer_throughput.security_protocol=PLAINTEXT.compression_type=zstd
> status: PASS
> run time: 1 minute 16.091 seconds
> {"records_per_sec": 1754693.8059, "mb_per_sec": 167.3406}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_and_consumer.security_protocol=PLAINTEXT.compression_type=lz4
> status: PASS
> run time: 1 minute 3.464 seconds
> {"producer": {"records_per_sec": 472009.817804, "mb_per_sec": 45.01}, "consumer": {"records_per_sec": 480676.7929, "mb_per_sec": 45.8409}}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_and_consumer.security_protocol=PLAINTEXT.compression_type=zstd
> status: PASS
> run time: 1 minute 12.971 seconds
> {"producer": {"records_per_sec": 346392.323946, "mb_per_sec": 33.03}, "consumer": {"records_per_sec": 350741.8189, "mb_per_sec": 33.4493}}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=PLAINTEXT.compression_type=lz4
> status: PASS
> run time: 48.883 seconds
> {"latency_999th_ms": 9.0, "latency_99th_ms": 3.0, "latency_50th_ms": 0.0}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_end_to_end_latency.security_protocol=PLAINTEXT.compression_type=zstd
> status: PASS
> run time: 47.810 seconds
> {"latency_999th_ms": 9.0, "latency_99th_ms": 3.0, "latency_50th_ms": 0.0}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_long_term_producer_throughput.security_protocol=PLAINTEXT.compression_type=lz4
> status: PASS
> run time: 1 minute 6.919 seconds
> {"0": {"records_per_sec": 426894.34365, "mb_per_sec": 40.71}}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_long_term_producer_throughput.security_protocol=PLAINTEXT.compression_type=zstd
> status: PASS
> run time: 1 minute 8.106 seconds
> {"0": {"records_per_sec": 369617.445943, "mb_per_sec": 35.25}}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_throughput.acks=1.compression_type=lz4.security_protocol=PLAINTEXT.topic=topic-replication-factor-three.message_size=10
> status: PASS
> run time: 54.631 seconds
> {"records_per_sec": 1138306.504961, "mb_per_sec": 10.86}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_throughput.acks=1.compression_type=lz4.security_protocol=PLAINTEXT.topic=topic-replication-factor-three.message_size=100
> status: PASS
> run time: 49.852 seconds
> {"records_per_sec": 429909.352979, "mb_per_sec": 41.0}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_throughput.acks=1.compression_type=lz4.security_protocol=PLAINTEXT.topic=topic-replication-factor-three.message_size=1000
> status: PASS
> run time: 46.940 seconds
> {"records_per_sec": 67276.691729, "mb_per_sec": 64.16}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_throughput.acks=1.compression_type=lz4.security_protocol=PLAINTEXT.topic=topic-replication-factor-three.message_size=10000
> status: PASS
> run time: 44.910 seconds
> {"records_per_sec": 8114.26844, "mb_per_sec": 77.38}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_throughput.acks=1.compression_type=lz4.security_protocol=PLAINTEXT.topic=topic-replication-factor-three.message_size=100000
> status: PASS
> run time: 45.013 seconds
> {"records_per_sec": 1166.956522, "mb_per_sec": 111.29}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_throughput.acks=1.compression_type=zstd.security_protocol=PLAINTEXT.topic=topic-replication-factor-three.message_size=10
> status: PASS
> run time: 55.821 seconds
> {"records_per_sec": 1123630.975303, "mb_per_sec": 10.72}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_throughput.acks=1.compression_type=zstd.security_protocol=PLAINTEXT.topic=topic-replication-factor-three.message_size=100
> status: PASS
> run time: 46.809 seconds
> {"records_per_sec": 342043.068298, "mb_per_sec": 32.62}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_throughput.acks=1.compression_type=zstd.security_protocol=PLAINTEXT.topic=topic-replication-factor-three.message_size=1000
> status: PASS
> run time: 44.890 seconds
> {"records_per_sec": 63012.676056, "mb_per_sec": 60.09}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_throughput.acks=1.compression_type=zstd.security_protocol=PLAINTEXT.topic=topic-replication-factor-three.message_size=10000
> status: PASS
> run time: 48.846 seconds
> {"records_per_sec": 7501.9564, "mb_per_sec": 71.54}
> --------------------------------------------------------------------------------
> test_id: kafkatest.benchmarks.core.benchmark_test.Benchmark.test_producer_throughput.acks=1.compression_type=zstd.security_protocol=PLAINTEXT.topic=topic-replication-factor-three.message_size=100000
> status: PASS
> run time: 46.991 seconds
> {"records_per_sec": 1142.12766, "mb_per_sec": 108.92}
> --------------------------------------------------------------------------------
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org