You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iggy.apache.org by "krishvishal (via GitHub)" <gi...@apache.org> on 2026/10/06 07:19:36 UTC

[I] HTTP client treats a consumer group as a plain consumer [iggy]

krishvishal opened a new issue, #4408:
URL: https://github.com/apache/iggy/issues/4408

   ### Bug description
   
   The REST API cannot name a consumer kind. `Consumer.kind` is `#[serde(skip)]`, and the server builds a plain consumer (`Consumer::new`) from an HTTP request. An HTTP client can pass `Consumer::group(..)` to `store_consumer_offset`, `get_consumer_offset`, `delete_consumer_offset` or `poll_messages`. The call then acts on the plain consumer with the group's id, and no error tells the caller. Join and leave already return `FeatureUnavailable` over HTTP, so a group cannot work there.
   
   Expected: the HTTP client refuses every kind except `ConsumerKind::Consumer` with `FeatureUnavailable`, as #4392 does for `ConsumerKind::ExternalGroup` (`refuse_external_group` in `core/sdk/src/http/consumer_offsets.rs`). This changes behavior for an HTTP caller that passes a group today. Raised in the review of #4392.
   
   ### Affected area / component
   
   Rust SDK, Iggy server
   
   ### Reproduction
   
   1. Build an `IggyClient` with the HTTP transport.
   2. Send 10 messages to partition 0 of a topic.
   3. Store offset 5 with `Consumer::group(Identifier::numeric(1)?)` on partition 0.
   4. Read the offset with `Consumer::new(Identifier::numeric(1)?)`. It returns 5.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] HTTP client treats a consumer group as a plain consumer [iggy]

Posted by "hubcio (via GitHub)" <gi...@apache.org>.
hubcio commented on issue #4408:
URL: https://github.com/apache/iggy/issues/4408#issuecomment-6192599860

   assiigned, but please make sure that bug still exists on current `origin/master` HEAD


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] HTTP client treats a consumer group as a plain consumer [iggy]

Posted by "daschinmoy21 (via GitHub)" <gi...@apache.org>.
daschinmoy21 commented on issue #4408:
URL: https://github.com/apache/iggy/issues/4408#issuecomment-6195922148

   cool works for me i am staying to the Rust side 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] HTTP client treats a consumer group as a plain consumer [iggy]

Posted by "haubur (via GitHub)" <gi...@apache.org>.
haubur commented on issue #4408:
URL: https://github.com/apache/iggy/issues/4408#issuecomment-6196320296

   @daschinmoy21 as @hubcio mentioned this was in another context fixed in #4348.
   FYI @krishvishal as I was working on it I saw that ExternalGroups were added in context of your work on the Kafka Gateway.
   Now, only ConsumerGroups are blocked, because the partitions are assigned by the server, but ExternalGroups pass (except for poll).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] HTTP client treats a consumer group as a plain consumer [iggy]

Posted by "daschinmoy21 (via GitHub)" <gi...@apache.org>.
daschinmoy21 commented on issue #4408:
URL: https://github.com/apache/iggy/issues/4408#issuecomment-6012159257

   hi,would like to work on this.can you assign it to me if no one else is working on it


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] HTTP client treats a consumer group as a plain consumer [iggy]

Posted by "hubcio (via GitHub)" <gi...@apache.org>.
hubcio commented on issue #4408:
URL: https://github.com/apache/iggy/issues/4408#issuecomment-6059071504

   same bug from the cli. server 0.9.1-edge.1 and cli 0.14.1-edge.1 run the code of master `43fb44364`, and the paths did not change on `af706e68e`. group `g` exists, has no members, and topic `t` has 10 messages:
   
   ```sh
   iggy --transport http consumer-offset set g s t 0 8 -k consumer-group   # succeeds
   iggy consumer-offset get g s t 0 -k consumer-group                      # tcp: not found
   iggy consumer-offset get g s t 0 -k consumer                            # tcp: stored offset 8
   iggy --transport http consumer-offset get g s t 0 -k consumer-group     # stored offset 8
   ```
   
   over tcp, the same `set` from a client that is not a member fails with `ConsumerGroupPartitionNotOwned` (`core/server/src/namespace.rs:280`). over http, `set` also succeeds for a group that does not exist.
   
   the java and c# http clients do not refuse a group consumer either (`ConsumerOffsetsHttpClient.java`, `HttpMessageStream.cs`). they write the same plain consumer offset.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] HTTP client treats a consumer group as a plain consumer [iggy]

Posted by "mohitduhan19 (via GitHub)" <gi...@apache.org>.
mohitduhan19 commented on issue #4408:
URL: https://github.com/apache/iggy/issues/4408#issuecomment-6192563151

   I'd like to take the Java SDK part hubcio mentioned: make `ConsumerOffsetsHttpClient` (and the HTTP poll path) refuse a consumer-group `Consumer` with a clear error instead of writing a plain consumer offset, with tests. The Rust side stays with @daschinmoy21 if they're on it. OK to assign me?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org