You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "zyst1988 (via GitHub)" <gi...@apache.org> on 2025/07/15 16:53:58 UTC
[I] Missing webserver-secret-key-secret [airflow]
zyst1988 opened a new issue, #53375:
URL: https://github.com/apache/airflow/issues/53375
### Official Helm Chart version
1.18.0 (latest released)
### Apache Airflow version
2.10.5
### Kubernetes Version
Latest
### Helm Chart configuration
Hi,
In my setup I deploy workers to a separate name space to better control their resource provisioning and management.
In the new version of helm charts deploying worker pods alone doesn't seem to create one of the secrets which then stops the worker pods from starting. The missing secret is 'webserver-secret-key-secret'.
I tried manually adding it back in by overriding the values yaml but with no luck. Would it be possible to please check why this particular secret is not being created when deploying just workers?
Thanks
Mark
### Docker Image customizations
I'm deploying workers to a separate name space.
### What happened
_No response_
### What you think should happen instead
_No response_
### How to reproduce
Deploy just the worker pods
### Anything else
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Missing webserver-secret-key-secret [airflow]
Posted by "boring-cyborg[bot] (via GitHub)" <gi...@apache.org>.
boring-cyborg[bot] commented on issue #53375:
URL: https://github.com/apache/airflow/issues/53375#issuecomment-3074413950
Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Missing webserver-secret-key-secret [airflow]
Posted by "prakass1 (via GitHub)" <gi...@apache.org>.
prakass1 commented on issue #53375:
URL: https://github.com/apache/airflow/issues/53375#issuecomment-3104751909
What you could be using is to create [webserverSecretKeySecretName(https://github.com/apache/airflow/blob/main/chart/values.yaml#L572) pointing to a secret you create using kubernetes containing key as webserverSecretKey and value as the output from `python3 -c 'import secrets; print(secrets.token_hex(16))'`
You can create the secret in the namespaces for both worker and other services. Example below:
```yaml
apiVersion: v1
kind: Secret
metadata:
name:airflow-webserver-secret-key
type: Opaque
stringData:
webserverSecretKey:output from `python3 -c 'import secrets; print(secrets.token_hex(16))'`
```
To be able to provide more specific answer, you might have to provide more information for one to replicate it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Missing webserver-secret-key-secret [airflow]
Posted by "albundy83 (via GitHub)" <gi...@apache.org>.
albundy83 commented on issue #53375:
URL: https://github.com/apache/airflow/issues/53375#issuecomment-3075836149
Hello, you should post all the parameters you used to deploy your helm chart
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Missing webserver-secret-key-secret [airflow]
Posted by "romsharon98 (via GitHub)" <gi...@apache.org>.
romsharon98 closed issue #53375: Missing webserver-secret-key-secret
URL: https://github.com/apache/airflow/issues/53375
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Missing webserver-secret-key-secret [airflow]
Posted by "zyst1988 (via GitHub)" <gi...@apache.org>.
zyst1988 commented on issue #53375:
URL: https://github.com/apache/airflow/issues/53375#issuecomment-3120434755
Hard disagree:
1) Disabling the webserver did not cause any issues with secrets / global variables like the webserver key until version 3.0.
2) It makes no sense for global secrets / variables to stop working if one of the services get disabled. No other global secrets appear to have been affected like this.
3) Creating a separate key just for the worker is a terrible idea since the key needs to be shared with the webserver service.
This is clearly a bug and a global secret like the webserver key should not have been tied to webserver or any other single service which it was not until the version 3.0 where something happened to it.
Creating separate worker instances is a valid design pattern so this should be fully supported without having to resort to any workarounds.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Missing webserver-secret-key-secret [airflow]
Posted by "zyst1988 (via GitHub)" <gi...@apache.org>.
zyst1988 commented on issue #53375:
URL: https://github.com/apache/airflow/issues/53375#issuecomment-3120247997
Hey thanks for all your replies. I believe the issue is with the in-built `AIRFLOW__WEBSERVER__SECRET_KEY` under `enableBuiltInSecretEnvVars:` which does not appear to be used unless the webserver pod is created. To check this you can try deploying the worker service/pod on it's own to see that the webserver secret is missing.
I have tried manually setting the key in the helm chart but unless I do a full deployment the webserver key secret doesn't seem to be created. You can test this on your end by deploying only the worker pods. The webserver secret seems to have some kind of dependency on one of the other services/pods - I would imagine it's most likely the webserver service itself, however I haven't tested it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Missing webserver-secret-key-secret [airflow]
Posted by "albundy83 (via GitHub)" <gi...@apache.org>.
albundy83 commented on issue #53375:
URL: https://github.com/apache/airflow/issues/53375#issuecomment-3120293920
Yes exactly, I think you have disabled webserver to achieve your setup with a namespace with only workers deployed.
But disabling webserver prevent webserver secret from being created.
Here the [line](https://github.com/apache/airflow/blob/64e7408cd35cce3ae8a90b2cf17b154e0d1fde67/chart/templates/secrets/webserver-secret-key-secret.yaml#L23)
As @prakass1 write you, you must manually create the missing secret in your workers only namespace
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org