[GitHub] [kafka] ijuma edited a comment on pull request #8830: KAFKA-10116: GraalVM native-image prototype

[GitBox <gi...@apache.org>]

ijuma edited a comment on pull request #8830:
URL: https://github.com/apache/kafka/pull/8830#issuecomment-787580589


   The generated binary is ~62 MB:
   
   > [ijuma@desktop]~/src/kafka% ls -al core/kafka.kafka 
   > -rwxr-xr-x. 1 ijuma ijuma 65329368 Feb 28 15:55 core/kafka.kafka
   
   Resident memory starts at about 460 MB:
   > ijuma     917472 73.2  0.7 5954368 472220 pts/0  Sl+  17:48   0:15 ./core/kafka.kafka config/server.properties
   
   Producer perf achieves 330 MB/s:
   > [ijuma@desktop]~/src/kafka% ./bin/kafka-producer-perf-test.sh --producer.config config/producer.properties --topic=test-topic-16-partitions --num-records=20000000 --record-size=1000 --throughput=1000000000 --print-metrics
   > 1492565 records sent, 298513.0 records/sec (284.68 MB/sec), 103.5 ms avg latency, 222.0 ms max latency.
   > 1612080 records sent, 322416.0 records/sec (307.48 MB/sec), 101.5 ms avg latency, 223.0 ms max latency.
   > 1651531 records sent, 330306.2 records/sec (315.00 MB/sec), 99.0 ms avg latency, 236.0 ms max latency.
   > 1700573 records sent, 340114.6 records/sec (324.36 MB/sec), 96.3 ms avg latency, 250.0 ms max latency.
   > 1740014 records sent, 348002.8 records/sec (331.88 MB/sec), 94.0 ms avg latency, 285.0 ms max latency.
   > 1750641 records sent, 350128.2 records/sec (333.91 MB/sec), 93.3 ms avg latency, 267.0 ms max latency.
   > 1759611 records sent, 351922.2 records/sec (335.62 MB/sec), 93.2 ms avg latency, 262.0 ms max latency.
   > 1764414 records sent, 352882.8 records/sec (336.54 MB/sec), 92.8 ms avg latency, 266.0 ms max latency.
   
   consumer-perf achieves 1 GB/s:
   > [ijuma@desktop]~/src/kafka% ./bin/kafka-consumer-perf-test.sh --topic test-topic-16-partitions --consumer.config config/consumer.properties --messages 10000000 --broker-list localhost:9092 --show-detailed-stats                 
   > time, threadId, data.consumed.in.MB, MB.sec, data.consumed.in.nMsg, nMsg.sec, rebalance.time.ms, fetch.time.ms, fetch.MB.sec, fetch.nMsg.sec
   > 2021-02-28 17:00:20:066, 0, 5082.0122, 1016.4024, 5328876, 1065775.2000, 357, 4643, 1094.5536, 1147722.5932
   
   The kafka process resident memory is ~500 MB at the end of it:
   > ijuma     888772  1.7  0.7 5743068 512008 pts/0  Sl+  16:58   0:46 ./core/kafka.kafka config/server.properties


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org