You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "avantgardnerio (via GitHub)" <gi...@apache.org> on 2026/08/06 21:49:25 UTC
[PR] docs(kubernetes): two-Service pattern for scheduler bootstrap [datafusion-ballista]
avantgardnerio opened a new pull request, #2245:
URL: https://github.com/apache/datafusion-ballista/pull/2245
## Summary
The example `cluster.yaml` in `docs/source/user-guide/deployment/kubernetes.md` pairs a single ClusterIP Service with the scheduler's default `--min-ready-executors=1` /readyz gate. On a fresh deploy this is chicken-and-egg:
- ClusterIP only routes to Ready pods.
- The scheduler is not Ready until 1 executor registers.
- Executors resolve the scheduler through the ClusterIP.
- → executors can't reach the scheduler → scheduler never flips green → cluster never converges.
Discovered bringing the example up verbatim on a real k8s cluster.
## Fix
Add a second Service, `ballista-scheduler-registration`, with `publishNotReadyAddresses: true`, alongside the existing one:
- `ballista-scheduler` (unchanged) — **clients** dial this. The /readyz gate still protects clients during rolling scheduler upgrades: a new scheduler with 0 executors won't receive query traffic until it's Ready.
- `ballista-scheduler-registration` — **executors** dial this. Bootstrap registration works before /readyz flips green.
Both Services target the same pod via `selector: { app: ballista-scheduler }`; they only differ in the readiness-gating behavior.
Pure yaml/docs change — no code, no proto, no config.
## Test plan
- [x] `cargo doc` unaffected (docs source is under `docs/`, not `///`).
- [x] Verified on a real k8s cluster: with the two-Service pattern, fresh deploys converge without operator intervention.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] docs(kubernetes): two-Service pattern for scheduler bootstrap [datafusion-ballista]
Posted by "avantgardnerio (via GitHub)" <gi...@apache.org>.
avantgardnerio commented on PR #2245:
URL: https://github.com/apache/datafusion-ballista/pull/2245#issuecomment-5209360250
Hi @akshaychitneni @phillipleblanc — small docs-only PR I hit while bringing up the example `cluster.yaml` verbatim. Doesn't block #2244 (the chaos manifests don't set a `readinessProbe`, so the chicken-and-egg doesn't fire there); this is really for anyone copying the example yaml with the default /readyz gate. Whenever you have a moment.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] docs(kubernetes): two-Service pattern for scheduler bootstrap [datafusion-ballista]
Posted by "avantgardnerio (via GitHub)" <gi...@apache.org>.
avantgardnerio merged PR #2245:
URL: https://github.com/apache/datafusion-ballista/pull/2245
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org