You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "eladkal (via GitHub)" <gi...@apache.org> on 2024/06/07 09:49:24 UTC
[I] Status of testing Providers that were prepared on June 07, 2024 [airflow]
eladkal opened a new issue, #40115:
URL: https://github.com/apache/airflow/issues/40115
### Body
I have a kind request for all the contributors to the latest provider packages release.
Could you please help us to test the RC versions of the providers?
The guidelines on how to test providers can be found in
[Verify providers by contributors](https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md#verify-the-release-candidate-by-contributors)
Let us know in the comment, whether the issue is addressed.
Those are providers that require testing as there were some substantial changes introduced:
## Provider [amazon: 8.24.0rc2](https://pypi.org/project/apache-airflow-providers-amazon/8.24.0rc2)
- [ ] [ECS Overrides for AWS Batch submit_job (#39903)](https://github.com/apache/airflow/pull/39903): @yehoshuadimarsky
- [ ] [feat: implement amazon s3 to dynamodb transfer operator (#39654)](https://github.com/apache/airflow/pull/39654): @dondaum
Linked issues:
- [ ] [Linked Issue #39377](https://github.com/apache/airflow/issues/39377): @eladkal
- [ ] [Adding Glue Data Quality Rule Recommendation Run (#40014)](https://github.com/apache/airflow/pull/40014): @gopidesupavan
- [ ] [Allow user-specified object attributes to be used in check_fn for S3KeySensor (#39950)](https://github.com/apache/airflow/pull/39950): @ellisms
Linked issues:
- [ ] [Linked Issue #39898](https://github.com/apache/airflow/issues/39898): @eladkal
- [ ] [Adding Amazon Glue Data Quality Service (#39923)](https://github.com/apache/airflow/pull/39923): @gopidesupavan
- [ ] [Deduplicate model name in SageMakerTransformOperator (#39956)](https://github.com/apache/airflow/pull/39956): @mateuslatrova
Linked issues:
- [ ] [Linked Issue #39502](https://github.com/apache/airflow/issues/39502): @mxuan0
- [ ] [fix: DynamoDBToS3Operator - remove process_func from templated_fields (#39948)](https://github.com/apache/airflow/pull/39948): @raphaelauv
- [ ] [Fix aws assume role session creation when deferrable (#40051)](https://github.com/apache/airflow/pull/40051): @gopidesupavan
Linked issues:
- [ ] [Linked Issue #39970](https://github.com/apache/airflow/issues/39970): @arollet-decathlon
- [ ] [Resolving ECS fargate deprecated warnings (#39834)](https://github.com/apache/airflow/pull/39834): @dirrao
- [ ] [Resolving EMR notebook deprecated warnings (#39829)](https://github.com/apache/airflow/pull/39829): @dirrao
- [ ] [Bump boto min versions (#40052)](https://github.com/apache/airflow/pull/40052): @ferruzzi
- [ ] [Implement per-provider tests with lowest-direct dependency resolution (#39946)](https://github.com/apache/airflow/pull/39946): @potiuk
- [ ] [Resolve aws emr deprecations in tests (#40020)](https://github.com/apache/airflow/pull/40020): @dirrao
## Provider [celery: 3.7.2rc1](https://pypi.org/project/apache-airflow-providers-celery/3.7.2rc1)
- [ ] [Fixing exception types to include TypeError, which is what is raised in (#40012)](https://github.com/apache/airflow/pull/40012): @leakec
Linked issues:
- [ ] [Linked Issue #40011](https://github.com/apache/airflow/issues/40011): @leakec
- [ ] [catch sentry flush if exception happens in _execute_in_fork finally block (#40060)](https://github.com/apache/airflow/pull/40060): @Lee-W
- [ ] [add PID and return code to _execute_in_fork logging (#40058)](https://github.com/apache/airflow/pull/40058): @Lee-W
## Provider [cncf.kubernetes: 8.3.1rc1](https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/8.3.1rc1)
- [ ] [Fixes K8s trigger failing running pods with timeout (#40019)](https://github.com/apache/airflow/pull/40019): @Usiel
- [ ] [Refresh properties on KubernetesPodOperator on token expiration also when logging (#39789)](https://github.com/apache/airflow/pull/39789): @paolo-moriello
- [ ] [Fix Pod Number Exception in the sync mode if reattach_on_restart parameter is False (#39329)](https://github.com/apache/airflow/pull/39329): @e-galan
- [ ] [Avoid resetting adopted task instances when retrying for kubernetes executor (#39406)](https://github.com/apache/airflow/pull/39406): @tanvn
- [ ] [Include fatal reason for pod pending events (#39924)](https://github.com/apache/airflow/pull/39924): @wolfier
<!--
NOTE TO RELEASE MANAGER:
You can move here the providers that have doc-only changes or for which changes are trivial, and
you could assess that they are OK.
-->
All users involved in the PRs:
@potiuk @mateuslatrova @ferruzzi @gopidesupavan @dirrao @leakec @tanvn @paolo-moriello @wolfier @raphaelauv @ellisms @Usiel @yehoshuadimarsky @e-galan @dondaum @Lee-W
### Committer
- [X] I acknowledge that I am a maintainer/committer of the Apache Airflow project.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]
Posted by "arollet-decathlon (via GitHub)" <gi...@apache.org>.
arollet-decathlon commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2155006252
Tested #40051 it fixed #39970 ! Huge thanks @gopidesupavan
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]
Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2154552159
> WDYT @eladkal, maybe we should yank the 3.7.1 of celery provider already - to avoid people to install it accidentally ?
Agreed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]
Posted by "dondaum (via GitHub)" <gi...@apache.org>.
dondaum commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2154570689
Tested #39654, works as expected.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]
Posted by "leakec (via GitHub)" <gi...@apache.org>.
leakec commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2155170930
Tested `celery: 3.7.2rc1` and verified it implements #40012 and that it fixes #40011.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2154564543
Yenked 3.7.1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2154529846
My changes were just in tests but I tested that indeed the new celery provider fixes the problem with celery executor reported in #40011 (Impacting also previous versions of airflow). WDYT @eladkal, maybe we should yank the 5.4.0 of celery provider already - to avoid people to install it accidentally ? It's pretty bad when you install 5.4.0 for all previous Airlfow version that use celery provider.

--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]
Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2156423952
Thank you everyone. Providers are released.
I invite everyone to help improve providers for the next release, a list of open issues can be found [here](https://github.com/apache/airflow/issues?q=is%3Aopen+is%3Aissue+label%3Aarea%3Aproviders).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]
Posted by "gopidesupavan (via GitHub)" <gi...@apache.org>.
gopidesupavan commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2155395154
Tested both #40014 and #39923 working fine.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]
Posted by "dirrao (via GitHub)" <gi...@apache.org>.
dirrao commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2155794504
Tested #39834, #39829 and #40020. They looks good to me.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]
Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal closed issue #40115: Status of testing Providers that were prepared on June 07, 2024
URL: https://github.com/apache/airflow/issues/40115
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]
Posted by "tanvn (via GitHub)" <gi...@apache.org>.
tanvn commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2154775211
Tested https://github.com/apache/airflow/pull/39406 by installing [cncf.kubernetes: 8.3.1rc1](https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/8.3.1rc1) upon my Airflow 2.8.4, confirmed it is working as expected.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]
Posted by "gopidesupavan (via GitHub)" <gi...@apache.org>.
gopidesupavan commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2155396462
Thanks @arollet-decathlon for testing #40051
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]
Posted by "fdemiane (via GitHub)" <gi...@apache.org>.
fdemiane commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2154739211
No issues from my side
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]
Posted by "yehoshuadimarsky (via GitHub)" <gi...@apache.org>.
yehoshuadimarsky commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2155160571
Tested Amazon provider, works for me
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]
Posted by "Usiel (via GitHub)" <gi...@apache.org>.
Usiel commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2156339542
Tested #40019 with Airflow 2.9.1, all good 👍
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org