You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@iggy.apache.org by "Shekharrajak (via GitHub)" <gi...@apache.org> on 2026/07/10 18:38:01 UTC
[Discuss] First-class Queue Semantics on top of the log
GitHub user Shekharrajak created a discussion: [Discuss] First-class Queue Semantics on top of the log
Today Iggy gives us queue-like behavior through consumer groups: multiple clients join one group and partitions get load-balanced across them. That works, but it's distribution at
partition granularity, so parallelism is capped by partition count and there's no per-message ack.
Let's learn from Kafka and make sure we are building iggy for both Log and Queues.
GitHub link: https://github.com/apache/iggy/discussions/3648
----
This is an automatically sent email for dev@iggy.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@iggy.apache.org
Re: [Discuss] First-class Queue Semantics on top of the log
Posted by "hubcio (via GitHub)" <gi...@apache.org>.
GitHub user hubcio added a comment to the discussion: [Discuss] First-class Queue Semantics on top of the log
could you please be more concrete?
GitHub link: https://github.com/apache/iggy/discussions/3648#discussioncomment-17664864
----
This is an automatically sent email for dev@iggy.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@iggy.apache.org
Re: [Discuss] First-class Queue Semantics on top of the log
Posted by "Shekharrajak (via GitHub)" <gi...@apache.org>.
GitHub user Shekharrajak added a comment to the discussion: [Discuss] First-class Queue Semantics on top of the log
We should probably work on current roadmap - keeping queue semantics in mind, at least for record commits. The offset approach needs to be flexible enough to track record states accurately ,so that it is easy to extend later. Kafka struggled for Queue Semantics and still community is working on improving the throughput.
I don't have a solid design yet, but I'll flesh it out and share a Google Doc soon.
GitHub link: https://github.com/apache/iggy/discussions/3648#discussioncomment-17664767
----
This is an automatically sent email for dev@iggy.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@iggy.apache.org
Re: [Discuss] First-class Queue Semantics on top of the log
Posted by "spetz (via GitHub)" <gi...@apache.org>.
GitHub user spetz added a comment to the discussion: [Discuss] First-class Queue Semantics on top of the log
Hey,
Queue semantics are much different than an append-only log, and in general, implementing the message broker is a total infrastructure rewrite (there's no more immutability, replayability, etc.). TBH, I don't think that's something we would like to incorporate in the near future. Do you have any proposals for how the overall design and implementation could look?
GitHub link: https://github.com/apache/iggy/discussions/3648#discussioncomment-17623147
----
This is an automatically sent email for dev@iggy.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@iggy.apache.org