You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iggy.apache.org by "krishvishal (via GitHub)" <gi...@apache.org> on 2026/10/27 12:42:53 UTC
[PR] feat(gateways): list every Kafka gateway and dial other Iggy nodes [iggy]
krishvishal opened a new pull request, #4662:
URL: https://github.com/apache/iggy/pull/4662
## Which issue does this PR address?
Relates to #4515
## Rationale
A gateway runs beside each Iggy node, but two things stop the gateways from covering for each other.
Metadata names one broker, the gateway that answers. A Kafka client learns no other gateway from it. When that gateway stops, its clients stop too.
The gateway also opens a new Iggy client for each producer session, each SASL login, and each read or offset client that a timeout dropped. Until it signs in and reads the roster, a new client knows only `IGGY_KAFKA_IGGY_ADDR`. Beside a stopped node, that address is down. New producers and logins then fail, and the other nodes still serve.
#4657 tried to fix the second part with an address list in the SDK, and it is closed. hubcio asked why the SDK needs one. A connected client already links to every node. A list also lets a wrong entry move new clients to another cluster without an error. This PR does that part inside the gateway, with the roster that the cluster itself reports.
## What changed?
`IGGY_KAFKA_NODE_ID` sets the gateway's broker id, and `IGGY_KAFKA_BROKERS` lists every gateway as `id@host:port`, or `id@PROTOCOL://host:port` for each listener. Metadata and DescribeCluster now list every gateway and name the one that answers as the leader of each partition. FindCoordinator names the gateway with the lowest node id for every group, so a group never splits over two gateways. The other gateways answer ListGroups with no groups. The producer id instance follows the node id, and a manual replica assignment must name this gateway's node id.
The bridge reads the roster at connect, and once a minute after that. Each new client, the SASL check included, dials `IGGY_KAFKA_IGGY_ADDR` first and then each node of that roster. A node that does not answer a dial goes to the back of the order for 30 s.
Without `IGGY_KAFKA_BROKERS`, a gateway answers as before, as node 1.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(gateways): list every Kafka gateway and dial other Iggy nodes [iggy]
Posted by "hubcio (via GitHub)" <gi...@apache.org>.
hubcio merged PR #4662:
URL: https://github.com/apache/iggy/pull/4662
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(gateways): list every Kafka gateway and dial other Iggy nodes [iggy]
Posted by "codecov[bot] (via GitHub)" <gi...@apache.org>.
codecov[bot] commented on PR #4662:
URL: https://github.com/apache/iggy/pull/4662#issuecomment-6442760189
## [Codecov](https://app.codecov.io/gh/apache/iggy/pull/4662?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:white_check_mark: All modified and coverable lines are covered by tests.
:white_check_mark: Project coverage is 80.94%. Comparing base ([`f8dab5c`](https://app.codecov.io/gh/apache/iggy/commit/f8dab5c9330f54eda09a92563346b4087150c439?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`1ce35e9`](https://app.codecov.io/gh/apache/iggy/commit/1ce35e940a961c3ea92a7c951ca74effbd6d9e54?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #4662 +/- ##
============================================
+ Coverage 80.89% 80.94% +0.04%
Complexity 3107 3107
============================================
Files 1465 1465
Lines 356197 356194 -3
Branches 300421 300418 -3
============================================
+ Hits 288147 288309 +162
+ Misses 61215 61124 -91
+ Partials 6835 6761 -74
```
| [Components](https://app.codecov.io/gh/apache/iggy/pull/4662/components?src=pr&el=components&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [Rust Core](https://app.codecov.io/gh/apache/iggy/pull/4662/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `80.22% <ø> (+0.05%)` | :arrow_up: |
| [Java SDK](https://app.codecov.io/gh/apache/iggy/pull/4662/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `78.15% <ø> (ø)` | |
| [C# SDK](https://app.codecov.io/gh/apache/iggy/pull/4662/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `83.60% <ø> (ø)` | |
| [Python SDK](https://app.codecov.io/gh/apache/iggy/pull/4662/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `85.67% <ø> (ø)` | |
| [PHP SDK](https://app.codecov.io/gh/apache/iggy/pull/4662/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `90.67% <ø> (ø)` | |
| [Node SDK](https://app.codecov.io/gh/apache/iggy/pull/4662/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `96.44% <ø> (ø)` | |
| [Go SDK](https://app.codecov.io/gh/apache/iggy/pull/4662/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `69.84% <ø> (ø)` | |
| [C++ SDK](https://app.codecov.io/gh/apache/iggy/pull/4662/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `85.51% <ø> (ø)` | |
[see 477 files with indirect coverage changes](https://app.codecov.io/gh/apache/iggy/pull/4662/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
- :package: [JS Bundle Analysis](https://docs.codecov.com/docs/javascript-bundle-analysis): Save yourself from yourself by tracking and limiting bundle sizes in JS merges.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org