You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "David Capwell (Jira)" <ji...@apache.org> on 2025/07/11 03:20:00 UTC
[jira] [Commented] (CASSANDRA-20715) Accord: Topology serializer has a lot of repeated data, can dedup to shrink the cost
[ https://issues.apache.org/jira/browse/CASSANDRA-20715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18004595#comment-18004595 ]
David Capwell commented on CASSANDRA-20715:
-------------------------------------------
||Repo||Branch||Parent Branch||SHA||Status||
|https://github.com/dcapwell/cassandra.git|trunk|trunk|30054fd2f339daddc0bf35024155c92c09061217|Unstable
Failed Builds:
||Build||Result||Reason||
| checkstyle | fail | |
| jvm-dtest-simulator | fail | Test org.apache.cassandra.simulator.test.ShortAccordSimulationTest::simulationTest-_jdk11 had an err |
| jvm-upgrade-dtests | fail | Test org.apache.cassandra.distributed.upgrade.MixedModeMessageForwardTest::checkWritesForwardedToOth |
| jvm11-dtests | fail | Error parsing jvm11-dtests/unitTestReports/TESTS-TestSuites.xml 'message' |
| jvm17-dtests | fail | Error parsing jvm17-dtests/unitTestReports/TESTS-TestSuites.xml 'message' |
| python-dtests | fail | Test gossip_test.TestGossip::gossip_test.py::TestGossip::test_2dc_parallel_startup failed,Test gossi |
| python-upgrade-dtests | fail | Test upgrade_tests.upgrade_through_versions_test.TestUpgrade_current_5_0_x_To_indev_trunk::upgrade_t |
| python-upgrade-dtests-large | fail | Test upgrade_tests.upgrade_through_versions_test.TestProtoV3Upgrade_AllVersions_EndsAt_Trunk_HEAD::u |
> Accord: Topology serializer has a lot of repeated data, can dedup to shrink the cost
> ------------------------------------------------------------------------------------
>
> Key: CASSANDRA-20715
> URL: https://issues.apache.org/jira/browse/CASSANDRA-20715
> Project: Apache Cassandra
> Issue Type: Improvement
> Components: Accord
> Reporter: David Capwell
> Assignee: David Capwell
> Priority: Normal
> Fix For: NA
>
> Attachments: ci_summary-trunk-30054fd2f339daddc0bf35024155c92c09061217.html, result_details-trunk-30054fd2f339daddc0bf35024155c92c09061217.tar.gz
>
> Time Spent: 2h
> Remaining Estimate: 0h
>
> Topology object represents all tables -> ranges -> nodes that accord needs to care about, but there is a big problem; there is a lot of duplication.
> Each TokenRange repeats TableId
> Tables with the same replication factor have the same ranges
> Shard has views for fast path and joining nodes
> All these duplicate values add up bloating the serialization format
> In testing these are the results I am seeing
> {code}
> min: tables=2, ranges=927 By 43.47%, partitioner: Murmur3Partitioner
> max: tables=10, ranges=48 By 67.16%, partitioner: RandomPartitioner
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org