You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iggy.apache.org by "krishvishal (via GitHub)" <gi...@apache.org> on 2026/10/27 12:42:53 UTC

[PR] feat(gateways): list every Kafka gateway and dial other Iggy nodes [iggy]

krishvishal opened a new pull request, #4662:
URL: https://github.com/apache/iggy/pull/4662

   ## Which issue does this PR address?
   
   Relates to #4515
   
   ## Rationale
   
   A gateway runs beside each Iggy node, but two things stop the gateways from covering for each other.
   
   Metadata names one broker, the gateway that answers. A Kafka client learns no other gateway from it. When that gateway stops, its clients stop too.
   
   The gateway also opens a new Iggy client for each producer session, each SASL login, and each read or offset client that a timeout dropped. Until it signs in and reads the roster, a new client knows only `IGGY_KAFKA_IGGY_ADDR`. Beside a stopped node, that address is down. New producers and logins then fail, and the other nodes still serve.
   
   #4657 tried to fix the second part with an address list in the SDK, and it is closed. hubcio asked why the SDK needs one. A connected client already links to every node. A list also lets a wrong entry move new clients to another cluster without an error. This PR does that part inside the gateway, with the roster that the cluster itself reports.
   
   ## What changed?
   
   `IGGY_KAFKA_NODE_ID` sets the gateway's broker id, and `IGGY_KAFKA_BROKERS` lists every gateway as `id@host:port`, or `id@PROTOCOL://host:port` for each listener. Metadata and DescribeCluster now list every gateway and name the one that answers as the leader of each partition. FindCoordinator names the gateway with the lowest node id for every group, so a group never splits over two gateways. The other gateways answer ListGroups with no groups. The producer id instance follows the node id, and a manual replica assignment must name this gateway's node id.
   
   The bridge reads the roster at connect, and once a minute after that. Each new client, the SASL check included, dials `IGGY_KAFKA_IGGY_ADDR` first and then each node of that roster. A node that does not answer a dial goes to the back of the order for 30 s.
   
   Without `IGGY_KAFKA_BROKERS`, a gateway answers as before, as node 1.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] feat(gateways): list every Kafka gateway and dial other Iggy nodes [iggy]

Posted by "hubcio (via GitHub)" <gi...@apache.org>.
hubcio merged PR #4662:
URL: https://github.com/apache/iggy/pull/4662


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] feat(gateways): list every Kafka gateway and dial other Iggy nodes [iggy]

Posted by "codecov[bot] (via GitHub)" <gi...@apache.org>.
codecov[bot] commented on PR #4662:
URL: https://github.com/apache/iggy/pull/4662#issuecomment-6442760189

   ## [Codecov](https://app.codecov.io/gh/apache/iggy/pull/4662?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
   :white_check_mark: All modified and coverable lines are covered by tests.
   :white_check_mark: Project coverage is 80.94%. Comparing base ([`f8dab5c`](https://app.codecov.io/gh/apache/iggy/commit/f8dab5c9330f54eda09a92563346b4087150c439?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`1ce35e9`](https://app.codecov.io/gh/apache/iggy/commit/1ce35e940a961c3ea92a7c951ca74effbd6d9e54?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
   
   <details><summary>Additional details and impacted files</summary>
   
   
   
   ```diff
   @@             Coverage Diff              @@
   ##             master    #4662      +/-   ##
   ============================================
   + Coverage     80.89%   80.94%   +0.04%     
     Complexity     3107     3107              
   ============================================
     Files          1465     1465              
     Lines        356197   356194       -3     
     Branches     300421   300418       -3     
   ============================================
   + Hits         288147   288309     +162     
   + Misses        61215    61124      -91     
   + Partials       6835     6761      -74     
   ```
   
   | [Components](https://app.codecov.io/gh/apache/iggy/pull/4662/components?src=pr&el=components&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
   |---|---|---|
   | [Rust Core](https://app.codecov.io/gh/apache/iggy/pull/4662/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `80.22% <ø> (+0.05%)` | :arrow_up: |
   | [Java SDK](https://app.codecov.io/gh/apache/iggy/pull/4662/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `78.15% <ø> (ø)` | |
   | [C# SDK](https://app.codecov.io/gh/apache/iggy/pull/4662/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `83.60% <ø> (ø)` | |
   | [Python SDK](https://app.codecov.io/gh/apache/iggy/pull/4662/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `85.67% <ø> (ø)` | |
   | [PHP SDK](https://app.codecov.io/gh/apache/iggy/pull/4662/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `90.67% <ø> (ø)` | |
   | [Node SDK](https://app.codecov.io/gh/apache/iggy/pull/4662/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `96.44% <ø> (ø)` | |
   | [Go SDK](https://app.codecov.io/gh/apache/iggy/pull/4662/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `69.84% <ø> (ø)` | |
   | [C++ SDK](https://app.codecov.io/gh/apache/iggy/pull/4662/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `85.51% <ø> (ø)` | |
   [see 477 files with indirect coverage changes](https://app.codecov.io/gh/apache/iggy/pull/4662/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
   </details>
   <details><summary> :rocket: New features to boost your workflow: </summary>
   
   - :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
   - :package: [JS Bundle Analysis](https://docs.codecov.com/docs/javascript-bundle-analysis): Save yourself from yourself by tracking and limiting bundle sizes in JS merges.
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org