You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "squah-confluent (via GitHub)" <gi...@apache.org> on 2026/10/19 16:32:33 UTC
[PR] MINOR: Break down TargetAssignmentBuilderBenchmark by builder [kafka]
squah-confluent opened a new pull request, #23868:
URL: https://github.com/apache/kafka/pull/23868
Split the benchmark into separate benchmarks for building the group
spec, the target assignment and the target assignment records. The
group spec is benchmarked both with and without assignor offload,
because offloading copies the group's members and target assignment
so that the assignor can run off the coordinator thread.
Populate a ConsumerGroup and read the members, target assignment and
inverted target assignment from it, instead of plain HashMaps. This
makes the benchmarks iterate over and copy the same TimelineHashMaps
as GroupMetadataManager, which matters most for the offload group spec
benchmark.
Co-Authored-By: Claude Opus 5.5 <no...@anthropic.com>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] MINOR: Break down TargetAssignmentBuilderBenchmark by builder [kafka]
Posted by "squah-confluent (via GitHub)" <gi...@apache.org>.
squah-confluent merged PR #23868:
URL: https://github.com/apache/kafka/pull/23868
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] MINOR: Break down TargetAssignmentBuilderBenchmark by builder [kafka]
Posted by "squah-confluent (via GitHub)" <gi...@apache.org>.
squah-confluent commented on PR #23868:
URL: https://github.com/apache/kafka/pull/23868#issuecomment-6272545664
Some results
### With HashMaps
`uniform` assignor, `partitionsToMemberRatio=50`, `topicCount=100`, 2 warmup and 2 measurement iterations of 5s, ms/op, plain `HashMap`s.
| memberCount | subscriptionType | buildGroupSpecWithoutOffload | buildGroupSpecWithOffload | buildAssignment | buildAssignmentRecords | build |
|---|---|---|---|---|---|---|
| 5000 | HOMOGENEOUS | 0.132 | 2.462 | 1.526 | 0.120 | 2.025 |
| 5000 | HETEROGENEOUS | 0.121 | 3.285 | 9.658 | 0.149 | 9.984 |
| 10000 | HOMOGENEOUS | 0.256 | 4.984 | 3.027 | 0.211 | 4.833 |
| 10000 | HETEROGENEOUS | 0.251 | 8.481 | 22.822 | 0.247 | 26.894 |
### With TimelineHashMaps
`uniform` assignor, `partitionsToMemberRatio=50`, `topicCount=100`, 2 warmup and 2 measurement iterations of 5s, ms/op.
| memberCount | subscriptionType | buildGroupSpecWithoutOffload | buildGroupSpecWithOffload | buildAssignment | buildAssignmentRecords | build |
|---|---|---|---|---|---|---|
| 5000 | HOMOGENEOUS | 0.340 | 4.406 | 5.074 | 0.253 | 6.054 |
| 5000 | HETEROGENEOUS | 0.328 | 5.498 | 9.154 | 0.285 | 12.626 |
| 10000 | HOMOGENEOUS | 0.658 | 10.725 | 11.946 | 0.529 | 14.608 |
| 10000 | HETEROGENEOUS | 0.670 | 13.850 | 22.892 | 0.626 | 34.972 |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org