You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "jedcunningham (via GitHub)" <gi...@apache.org> on 2025/07/03 22:45:36 UTC
[I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
jedcunningham opened a new issue, #52837:
URL: https://github.com/apache/airflow/issues/52837
### Body
We are kindly requesting that contributors to [Apache Airflow Helm Chart 1.18.0rc1](https://dist.apache.org/repos/dist/dev/airflow/helm-chart/1.18.0rc1) hel
p test the RC.
Please let us know by commenting if the issue is addressed in the latest RC.
- [ ] [Change default executor in pod template to support executor parameter in task (re-uploaded) (#49433)](https://github.com/apache/airflow/pull/49433):
@ihnokim
- [ ] [fix: allow configmap and secret references in the apiServer.env field (#51191)](https://github.com/apache/airflow/pull/51191): @romsharon98 @LucasRoe
sler
Linked issues:
- [incorrect helm chart validation for apiServer.env field (#51190)](https://github.com/apache/airflow/issues/51190)
- [ ] [Use merged to render airflow.cfg and include computed defaults (#51828)](https://github.com/apache/airflow/pull/51828): @bdsoha
- [ ] [Update service name for port-forward of Airflow GUI (#51945)](https://github.com/apache/airflow/pull/51945): @gsingh935
- [ ] [Update Helm Chart docs with 3.0 support (#52132)](https://github.com/apache/airflow/pull/52132): @kaxil
- [ ] [Helm: add custom annotations to jwt secret (#52166)](https://github.com/apache/airflow/pull/52166): @Aakcht
- [ ] [Use api-server instead of webserver in chart NOTES.txt for Airflow 3.0+. (#52194)](https://github.com/apache/airflow/pull/52194): @simi
- [ ] [fix: correct JWT secret name to match deployment environment (#52268)](https://github.com/apache/airflow/pull/52268): @junminahn
- [ ] [Use api secret_key for airflow 3.0+ instead of webserver secret_key (#52269)](https://github.com/apache/airflow/pull/52269): @albundy83
- [ ] [Helm chart 1.18.0 release notes (#52823)](https://github.com/apache/airflow/pull/52823): @jedcunningham
Thanks to all who contributed to the release (probably not a complete list!):
@simi @Aakcht @eladkal @bdsoha @romsharon98 @ihnokim @junminahn @jedcunningham @LucasRoesler @jscheffl @kaxil @albundy83 @gsingh935
### Committer
- [x] I acknowledge that I am a maintainer/committer of the Apache Airflow project.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "prakass1 (via GitHub)" <gi...@apache.org>.
prakass1 commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3048282298
@albundy83 shall I retest this scenario then? Apart from that, I think I have pretty much tested the rest of them. I have read through the documentation changes which seems fine, but I did not test them or serve them locally.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc2 [airflow]
Posted by "albundy83 (via GitHub)" <gi...@apache.org>.
albundy83 commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3062098602
> My change is not included in the release, it was merged just two days ago (9th July).
>
> * [ ] [fix: allow valuesFrom in `gitSync.env` #50228](https://github.com/apache/airflow/pull/50228): [@mo-rieger](https://github.com/mo-rieger)
Hello,
it's included as the original post from @jedcunningham has been edited and your commit has been added to 1.18.0rc2 (original post was for 1.18.0rc1)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "albundy83 (via GitHub)" <gi...@apache.org>.
albundy83 commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3044947289
I have open this [pull request](https://github.com/apache/airflow/pull/52977) to fix my mess :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "albundy83 (via GitHub)" <gi...@apache.org>.
albundy83 commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3036972285
Ok sorry, I find the trick, url is https://dist.apache.org/repos/dist/dev/airflow/helm-chart/1.18.0rc1 and version is 1.18.0 not 1.18.0rc1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "jedcunningham (via GitHub)" <gi...@apache.org>.
jedcunningham commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3041334615
@albundy83 we should be using `airflow.fullname`. I wonder if we are missing some test coverage to make sure we are actually. Some prior art here: #31066
One thing to be mindful of is our helm pre-install hooks, we can't really rename those.
I don't feel this is a blocker for 1.18.0 though.
Does the double b64 for jwt secret cause any issues? My immediate thought is we can fix that in the next release.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc2 [airflow]
Posted by "mo-rieger (via GitHub)" <gi...@apache.org>.
mo-rieger commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3062058738
My change is not included in the release, it was merged just two days ago (9th July).
- [ ] https://github.com/apache/airflow/pull/50228: @mo-rieger
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "jedcunningham (via GitHub)" <gi...@apache.org>.
jedcunningham commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3046557671
No problem @albundy83, glad we noticed now. I'll cut an rc2 once we get that fix merged.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "prakass1 (via GitHub)" <gi...@apache.org>.
prakass1 commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3042920135
@jedcunningham I would like to vote my confirmation of the helm release. Should I do it here by replying https://lists.apache.org/thread/wkdqcy9k1jztnhgd8jp3f0xk059qv5rs to the post?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "albundy83 (via GitHub)" <gi...@apache.org>.
albundy83 commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3048781594
Hello,
I don't know, I hope :)
Maybe @jedcunningham could answer to this
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc2 [airflow]
Posted by "jedcunningham (via GitHub)" <gi...@apache.org>.
jedcunningham commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3063056463
> the link still points to RC1 hence the confusion
Oops, sorry, fixed!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "simi (via GitHub)" <gi...@apache.org>.
simi commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3035036773
- [x] #52194
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "albundy83 (via GitHub)" <gi...@apache.org>.
albundy83 commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3036966610
Can someone help me to deploy this release ?
How should I install it on my env ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "prakass1 (via GitHub)" <gi...@apache.org>.
prakass1 commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3042548762
I have noticed an issue with the default Fernet key and error with:
### How to Replicate:
- Run airflow on kubernetes:
```
helm repo add apache-airflow-dev https://dist.apache.org/repos/dist/dev/airflow/helm-chart/1.18.0rc1/
helm repo update
helm install airflow apache-airflow-dev/airflow --namespace airflow-dev-test
```
- port forward the api-server: `kubectl port-forward svc/airflow-api-server 8080:8080 --namespace airflow-dev-test` to access the UI.
- Add a Variable and see 500 Internal Server Error:
<img width="1503" height="579" alt="Image" src="https://github.com/user-attachments/assets/cbc2b05d-56d6-44e1-9185-675c4192ec9e" />
### Error Message:
File "/home/airflow/.local/lib/python3.12/site-packages/anyio/_backends/_asyncio.py", line 967, in run
result = context.run(func, *args)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/airflow/.local/lib/python3.12/site-packages/airflow/api_fastapi/core_api/routes/public/variables.py", line 187, in post_variable
Variable.set(**post_body.model_dump(), session=session)
File "/home/airflow/.local/lib/python3.12/site-packages/airflow/models/variable.py", line 235, in set
session.add(Variable(key=key, val=stored_value, description=description))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "<string>", line 4, in __init__
File "/home/airflow/.local/lib/python3.12/site-packages/sqlalchemy/orm/state.py", line 481, in _initialize_instance
with util.safe_reraise():
^^^^^^^^^^^^^^^^^^^
File "/home/airflow/.local/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__
compat.raise_(
File "/home/airflow/.local/lib/python3.12/site-packages/sqlalchemy/util/compat.py", line 211, in raise_
raise exception
File "/home/airflow/.local/lib/python3.12/site-packages/sqlalchemy/orm/state.py", line 479, in _initialize_instance
return manager.original_init(*mixed[1:], **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/airflow/.local/lib/python3.12/site-packages/airflow/models/variable.py", line 61, in __init__
self.val = val
^^^^^^^^
File "<string>", line 1, in __set__
File "/home/airflow/.local/lib/python3.12/site-packages/airflow/models/variable.py", line 93, in set_val
fernet = get_fernet()
^^^^^^^^^^^^
File "/home/airflow/.local/lib/python3.12/site-packages/airflow/models/crypto.py", line 90, in get_fernet
raise AirflowException(f"Could not create Fernet object: {value_error}")
airflow.exceptions.AirflowException: Could not create Fernet object: Fernet key must be 32 url-safe base64-encoded _bytes.___
Are there any solutions already thought for this?, also probably overriding the fernetKey using values.yaml may be a workaround I suppose.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "LucasRoesler (via GitHub)" <gi...@apache.org>.
LucasRoesler commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3035797940
- [x] https://github.com/apache/airflow/pull/51191
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "bdsoha (via GitHub)" <gi...@apache.org>.
bdsoha commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3034999469
- [x] #51828
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc2 [airflow]
Posted by "jedcunningham (via GitHub)" <gi...@apache.org>.
jedcunningham closed issue #52837: Status of testing of Apache Airflow Helm Chart 1.18.0rc2
URL: https://github.com/apache/airflow/issues/52837
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc2 [airflow]
Posted by "albundy83 (via GitHub)" <gi...@apache.org>.
albundy83 commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3069229520
> [@jedcunningham](https://github.com/jedcunningham) sorry that this page doesn't work
>
> https://airflow.apache.org/docs/helm-chart/1.18.0/manage-dags-files.html
You need to remove the s to dag, correct link is https://airflow.apache.org/docs/helm-chart/1.18.0/manage-dag-files.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "albundy83 (via GitHub)" <gi...@apache.org>.
albundy83 commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3038599501
I have a question about this one https://github.com/apache/airflow/pull/52268
I really think that all Secrets (git, jwt, kerberos etc...) should have been renamed with the `airflow.fullname` inside like all the others Secrets.
And also jwt Secret has the bug b64enc twice, we must also fix this
I can prepare pull requests for next release.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "albundy83 (via GitHub)" <gi...@apache.org>.
albundy83 commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3047389778
I think the fix is ok now
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "prakass1 (via GitHub)" <gi...@apache.org>.
prakass1 commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3042683998
> I have noticed an issue with the default Fernet key and erroring when testing the chart:
>
> ### How to Replicate:
> * Run airflow on kubernetes:
>
> ```
> helm repo add apache-airflow-dev https://dist.apache.org/repos/dist/dev/airflow/helm-chart/1.18.0rc1/
> helm repo update
> helm install airflow apache-airflow-dev/airflow --namespace airflow-dev-test
> ```
>
> * port forward the api-server: `kubectl port-forward svc/airflow-api-server 8080:8080 --namespace airflow-dev-test` to access the UI.
> * Add a Variable and see 500 Internal Server Error:
>
> <img alt="Image" width="1503" height="579" src="https://private-user-images.githubusercontent.com/6094960/462961523-cbc2b05d-56d6-44e1-9185-675c4192ec9e.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NTE4Mzc0NDgsIm5iZiI6MTc1MTgzNzE0OCwicGF0aCI6Ii82MDk0OTYwLzQ2Mjk2MTUyMy1jYmMyYjA1ZC01NmQ2LTQ0ZTEtOTE4NS02NzVjNDE5MmVjOWUucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI1MDcwNiUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNTA3MDZUMjEyNTQ4WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9YWZlMGI4OWViMmI2N2RhMTVmMmY4MDY2ZTYwNWQxMzBlMDdkZGM0ZmMxODVjZDc1YzM0NTRiNTUzZTAxNDk5OSZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.u0AB4njKmq2OVgZrnE3IJmD4XLapb_mmwbPmrfLrfr0">
> ### Operating System:
> MacOS
>
> ### Error Message:
> File "/home/airflow/.local/lib/python3.12/site-packages/anyio/_backends/_asyncio.py", line 967, in run result = context.run(func, *args) ^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/airflow/.local/lib/python3.12/site-packages/airflow/api_fastapi/core_api/routes/public/variables.py", line 187, in post_variable Variable.set(**post_body.model_dump(), session=session) File "/home/airflow/.local/lib/python3.12/site-packages/airflow/models/variable.py", line 235, in set session.add(Variable(key=key, val=stored_value, description=description)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "", line 4, in **init** File "/home/airflow/.local/lib/python3.12/site-packages/sqlalchemy/orm/state.py", line 481, in _initialize_instance with util.safe_reraise(): ^^^^^^^^^^^^^^^^^^^ File "/home/airflow/.local/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 70, in **exit** compat.raise_( File "/home/airflow/.local/lib/python3.12/site-packages/sqlalchemy/util/compat.py
", line 211, in raise_ raise exception File "/home/airflow/.local/lib/python3.12/site-packages/sqlalchemy/orm/state.py", line 479, in _initialize_instance return manager.original_init(*mixed[1:], **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/airflow/.local/lib/python3.12/site-packages/airflow/models/variable.py", line 61, in **init** self.val = val ^^^^^^^^ File "", line 1, in **set** File "/home/airflow/.local/lib/python3.12/site-packages/airflow/models/variable.py", line 93, in set_val fernet = get_fernet() ^^^^^^^^^^^^ File "/home/airflow/.local/lib/python3.12/site-packages/airflow/models/crypto.py", line 90, in get_fernet raise AirflowException(f"Could not create Fernet object: {value_error}") airflow.exceptions.AirflowException: Could not create Fernet object: Fernet key must be 32 url-safe base64-encoded _bytes.___
>
> Are there any solutions already thought for this?, also probably providing the fernetKey in the values.yaml may be a workaround I suppose.
I can confirm that adding override.yaml and providing the fernetKey as per https://airflow.apache.org/docs/apache-airflow/stable/security/secrets/fernet.html#generating-fernet-key works.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "jedcunningham (via GitHub)" <gi...@apache.org>.
jedcunningham commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3043484032
> [@jedcunningham](https://github.com/jedcunningham) I would like to vote my confirmation of testing the helm release. Should I do it here by replying https://lists.apache.org/thread/wkdqcy9k1jztnhgd8jp3f0xk059qv5rs to the post?
Yep, you can reply there with your vote. Thanks for testing!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "prakass1 (via GitHub)" <gi...@apache.org>.
prakass1 commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3042534190
- [X] [https://github.com/apache/airflow/pull/51945: @gsingh935](https://github.com/apache/airflow/pull/51945)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "prakass1 (via GitHub)" <gi...@apache.org>.
prakass1 commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3042899876
Tested KubernetesExecutor as per https://github.com/apache/airflow/pull/49433:
@ihnokim
### Test Steps:
- added the executor as KubernetesExecutor in the override.yaml
- Start the Kubernetes setup of airflow.
- Created the dag as the PR which uses the executor under the BashOperator
```
hello_task = BashOperator(
task_id='print_hello',
executor='KubernetesExecutor', # Warning!
bash_command='echo "Hello, World from KubernetesExecutor!"'
)
```
Note: Had to change the schedule_interval to schedule.
- Tested it and it was able to create a pod meaning was using the pod-template:
<img width="1250" height="664" alt="Image" src="https://github.com/user-attachments/assets/ac08c72d-59f7-49bc-b1b7-67e87d30c227" />
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "prakass1 (via GitHub)" <gi...@apache.org>.
prakass1 commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3042925688
> Ok sorry, I find the trick, url is https://dist.apache.org/repos/dist/dev/airflow/helm-chart/1.18.0rc1 and version is 1.18.0 not 1.18.0rc1
For anyone else:
```
helm repo add apache-airflow-dev https://dist.apache.org/repos/dist/dev/airflow/helm-chart/1.18.0rc1/
helm repo update
helm install airflow apache-airflow-dev/airflow --namespace <<your_ns>>
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "albundy83 (via GitHub)" <gi...@apache.org>.
albundy83 commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3036981436
* [x] [Use api secret_key for airflow 3.0+ instead of webserver secret_key (#52269)](https://github.com/apache/airflow/pull/52269)
And fix https://github.com/apache/airflow/issues/52267
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "Aakcht (via GitHub)" <gi...@apache.org>.
Aakcht commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3035194106
* [x] https://github.com/apache/airflow/pull/52166
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "albundy83 (via GitHub)" <gi...@apache.org>.
albundy83 commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3044490519
Hello,
I have introduced an issue actually about the fernet key [here](https://github.com/apache/airflow/pull/52269/files#diff-965b2d96a204fa7782854164bcf95427412f055c43282add9e42651bec284fb4)
It was the only one that value need to be base64 encoded error message from @prakass1 and official fernet [spec](https://github.com/fernet/spec/blob/master/Readme#L11) are clear.
Even airflow [doc](https://airflow.apache.org/docs/apache-airflow/stable/security/secrets/fernet.html).
Others were bad copy / paste.
I'm sorry for this, @jedcunningham what should I do ?
fernet-key Secret was correct, we can maybe add a comment for the futur:
```yaml
{{/*
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.
*/}}
################################
## Airflow Fernet Key Secret
#################################
{{- if not .Values.fernetKeySecretName }}
# Fernet key value must be b64enc
{{- $generated_fernet_key := (randAlphaNum 32 | b64enc) }}
apiVersion: v1
kind: Secret
metadata:
name: {{ .Release.Name }}-fernet-key
labels:
tier: airflow
release: {{ .Release.Name }}
chart: "{{ .Chart.Name }}-{{ .Chart.Version }}"
heritage: {{ .Release.Service }}
{{- with .Values.labels }}
{{- toYaml . | nindent 4 }}
{{- end }}
annotations:
"helm.sh/hook": "pre-install"
"helm.sh/hook-delete-policy": "before-hook-creation"
"helm.sh/hook-weight": "0"
{{- with .Values.fernetKeySecretAnnotations }}
{{- toYaml . | nindent 4 }}
{{- end }}
type: Opaque
data:
fernet-key: {{ (default $generated_fernet_key .Values.fernetKey) | b64enc | quote }}
{{- end }}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc2 [airflow]
Posted by "albundy83 (via GitHub)" <gi...@apache.org>.
albundy83 commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3062339626
All my tests are corrects.
* [x] [Use api secret_key for airflow 3.0+ instead of webserver secret_key (#52269)](https://github.com/apache/airflow/pull/52269)
And fix https://github.com/apache/airflow/issues/52267
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc2 [airflow]
Posted by "jedcunningham (via GitHub)" <gi...@apache.org>.
jedcunningham commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3058331065
@prakass1 (and others) rc2 was cut last night. Details on the devlist.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc2 [airflow]
Posted by "jedcunningham (via GitHub)" <gi...@apache.org>.
jedcunningham commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3067113556
Thanks for testing the RC @bdsoha @simi @Aakcht @LucasRoesler @albundy83 @mo-rieger @prakass1 . The release is underway!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc2 [airflow]
Posted by "obarisk (via GitHub)" <gi...@apache.org>.
obarisk commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3069202754
@jedcunningham sorry that this page doesn't work
https://airflow.apache.org/docs/helm-chart/1.18.0/manage-dags-files.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "albundy83 (via GitHub)" <gi...@apache.org>.
albundy83 commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3041391698
It's not a blocker either maybe we could look into it for the next release, to keep things consistent.
As for the double b64, that's not a blocker either, the content is not important as long as the word is long and hard to guess :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc2 [airflow]
Posted by "albundy83 (via GitHub)" <gi...@apache.org>.
albundy83 commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3058559734
The release of maturity :)
Just tried and I can create variables or connections, test from @prakass1 that was failing due to bad fernetkey.
I continue my tests
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc2 [airflow]
Posted by "mo-rieger (via GitHub)" <gi...@apache.org>.
mo-rieger commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3062138829
Thanks for the hint, the link in still points to RC1 hence the confusion. But anyway, 1.18.0rc2 includes my change and its working.
- [x] https://github.com/apache/airflow/pull/50228: @mo-rieger
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc2 [airflow]
Posted by "prakass1 (via GitHub)" <gi...@apache.org>.
prakass1 commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3058851301
> The release of maturity :) Just tried and I can create variables or connections, test from [@prakass1](https://github.com/prakass1) that was failing due to bad fernetkey. I continue my tests
I second this. The functionality for creating variables works again. Also, rest of the functionality seems okay as well.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "prakass1 (via GitHub)" <gi...@apache.org>.
prakass1 commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3051478097
> Yep, I'm going to cut an rc2 with the fernet key fix in it, and it'd be great to get that tested once it's available. Thanks.
Perfect! Let me know when the dist is uploaded. I could add that as helm repo and test it again :) Looking forward for the release of this soon.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing of Apache Airflow Helm Chart 1.18.0rc1 [airflow]
Posted by "jedcunningham (via GitHub)" <gi...@apache.org>.
jedcunningham commented on issue #52837:
URL: https://github.com/apache/airflow/issues/52837#issuecomment-3051073483
Yep, I'm going to cut an rc2 with the fernet key fix in it, and it'd be great to get that tested once it's available. Thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org