You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@skywalking.apache.org by li...@apache.org on 2025/07/28 05:54:28 UTC
(skywalking-banyandb) branch gossip-propagation-protocol updated (281f9761 -> 9b6de297)
This is an automated email from the ASF dual-hosted git repository.
liuhan pushed a change to branch gossip-propagation-protocol
in repository https://gitbox.apache.org/repos/asf/skywalking-banyandb.git
from 281f9761 fix issue
add 4e1d43b6 Add chunked data sync to improve memory efficiency and performance during data transfer operations (#711)
add 9b6de297 Merge branch 'main' into gossip-propagation-protocol
No new revisions were added by this update.
Summary of changes:
CHANGES.md | 1 +
api/proto/banyandb/cluster/v1/rpc.proto | 91 ++++
banyand/measure/flusher.go | 5 +-
banyand/measure/part.go | 17 +-
banyand/measure/svc_data.go | 7 +-
banyand/measure/svc_standalone.go | 2 +
banyand/measure/syncer.go | 141 +++--
banyand/measure/wqueue_test.go | 28 +
banyand/measure/write_data.go | 250 ++++-----
banyand/measure/{write_data.go => write_index.go} | 85 ---
banyand/queue/local.go | 27 +
banyand/queue/pub/chunked_sync.go | 416 +++++++++++++++
banyand/queue/pub/chunked_sync_test.go | 242 +++++++++
banyand/queue/pub/pub.go | 41 ++
banyand/queue/queue.go | 99 ++++
banyand/queue/sub/chunked_sync.go | 458 +++++++++++++++++
banyand/queue/sub/chunked_sync_test.go | 570 +++++++++++++++++++++
banyand/queue/sub/server.go | 111 +++-
banyand/queue/test/chunked_sync_basic_test.go | 132 +++++
banyand/queue/test/chunked_sync_common.go | 387 ++++++++++++++
banyand/queue/test/chunked_sync_metadata_test.go | 280 ++++++++++
.../queue/test/chunked_sync_performance_test.go | 464 +++++++++++++++++
banyand/stream/block_writer.go | 27 +
banyand/stream/part.go | 14 +-
banyand/stream/svc_liaison.go | 4 +
banyand/stream/svc_standalone.go | 6 +-
banyand/stream/syncer.go | 141 +++--
banyand/stream/wqueue_test.go | 28 +
banyand/stream/write_data.go | 304 +++--------
banyand/stream/{write_data.go => write_index.go} | 85 ---
docs/api-reference.md | 189 +++++++
31 files changed, 4005 insertions(+), 647 deletions(-)
copy banyand/measure/{write_data.go => write_index.go} (61%)
create mode 100644 banyand/queue/pub/chunked_sync.go
create mode 100644 banyand/queue/pub/chunked_sync_test.go
create mode 100644 banyand/queue/sub/chunked_sync.go
create mode 100644 banyand/queue/sub/chunked_sync_test.go
create mode 100644 banyand/queue/test/chunked_sync_basic_test.go
create mode 100644 banyand/queue/test/chunked_sync_common.go
create mode 100644 banyand/queue/test/chunked_sync_metadata_test.go
create mode 100644 banyand/queue/test/chunked_sync_performance_test.go
copy banyand/stream/{write_data.go => write_index.go} (72%)