You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iggy.apache.org by "krishvishal (via GitHub)" <gi...@apache.org> on 2026/10/06 07:19:36 UTC
[I] HTTP client treats a consumer group as a plain consumer [iggy]
krishvishal opened a new issue, #4408:
URL: https://github.com/apache/iggy/issues/4408
### Bug description
The REST API cannot name a consumer kind. `Consumer.kind` is `#[serde(skip)]`, and the server builds a plain consumer (`Consumer::new`) from an HTTP request. An HTTP client can pass `Consumer::group(..)` to `store_consumer_offset`, `get_consumer_offset`, `delete_consumer_offset` or `poll_messages`. The call then acts on the plain consumer with the group's id, and no error tells the caller. Join and leave already return `FeatureUnavailable` over HTTP, so a group cannot work there.
Expected: the HTTP client refuses every kind except `ConsumerKind::Consumer` with `FeatureUnavailable`, as #4392 does for `ConsumerKind::ExternalGroup` (`refuse_external_group` in `core/sdk/src/http/consumer_offsets.rs`). This changes behavior for an HTTP caller that passes a group today. Raised in the review of #4392.
### Affected area / component
Rust SDK, Iggy server
### Reproduction
1. Build an `IggyClient` with the HTTP transport.
2. Send 10 messages to partition 0 of a topic.
3. Store offset 5 with `Consumer::group(Identifier::numeric(1)?)` on partition 0.
4. Read the offset with `Consumer::new(Identifier::numeric(1)?)`. It returns 5.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] HTTP client treats a consumer group as a plain consumer [iggy]
Posted by "hubcio (via GitHub)" <gi...@apache.org>.
hubcio commented on issue #4408:
URL: https://github.com/apache/iggy/issues/4408#issuecomment-6192599860
assiigned, but please make sure that bug still exists on current `origin/master` HEAD
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] HTTP client treats a consumer group as a plain consumer [iggy]
Posted by "daschinmoy21 (via GitHub)" <gi...@apache.org>.
daschinmoy21 commented on issue #4408:
URL: https://github.com/apache/iggy/issues/4408#issuecomment-6195922148
cool works for me i am staying to the Rust side
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] HTTP client treats a consumer group as a plain consumer [iggy]
Posted by "haubur (via GitHub)" <gi...@apache.org>.
haubur commented on issue #4408:
URL: https://github.com/apache/iggy/issues/4408#issuecomment-6196320296
@daschinmoy21 as @hubcio mentioned this was in another context fixed in #4348.
FYI @krishvishal as I was working on it I saw that ExternalGroups were added in context of your work on the Kafka Gateway.
Now, only ConsumerGroups are blocked, because the partitions are assigned by the server, but ExternalGroups pass (except for poll).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] HTTP client treats a consumer group as a plain consumer [iggy]
Posted by "daschinmoy21 (via GitHub)" <gi...@apache.org>.
daschinmoy21 commented on issue #4408:
URL: https://github.com/apache/iggy/issues/4408#issuecomment-6012159257
hi,would like to work on this.can you assign it to me if no one else is working on it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] HTTP client treats a consumer group as a plain consumer [iggy]
Posted by "hubcio (via GitHub)" <gi...@apache.org>.
hubcio commented on issue #4408:
URL: https://github.com/apache/iggy/issues/4408#issuecomment-6059071504
same bug from the cli. server 0.9.1-edge.1 and cli 0.14.1-edge.1 run the code of master `43fb44364`, and the paths did not change on `af706e68e`. group `g` exists, has no members, and topic `t` has 10 messages:
```sh
iggy --transport http consumer-offset set g s t 0 8 -k consumer-group # succeeds
iggy consumer-offset get g s t 0 -k consumer-group # tcp: not found
iggy consumer-offset get g s t 0 -k consumer # tcp: stored offset 8
iggy --transport http consumer-offset get g s t 0 -k consumer-group # stored offset 8
```
over tcp, the same `set` from a client that is not a member fails with `ConsumerGroupPartitionNotOwned` (`core/server/src/namespace.rs:280`). over http, `set` also succeeds for a group that does not exist.
the java and c# http clients do not refuse a group consumer either (`ConsumerOffsetsHttpClient.java`, `HttpMessageStream.cs`). they write the same plain consumer offset.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] HTTP client treats a consumer group as a plain consumer [iggy]
Posted by "mohitduhan19 (via GitHub)" <gi...@apache.org>.
mohitduhan19 commented on issue #4408:
URL: https://github.com/apache/iggy/issues/4408#issuecomment-6192563151
I'd like to take the Java SDK part hubcio mentioned: make `ConsumerOffsetsHttpClient` (and the HTTP poll path) refuse a consumer-group `Consumer` with a clear error instead of writing a plain consumer offset, with tests. The Rust side stays with @daschinmoy21 if they're on it. OK to assign me?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org