You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "eladkal (via GitHub)" <gi...@apache.org> on 2024/06/07 09:49:24 UTC

[I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

eladkal opened a new issue, #40115:
URL: https://github.com/apache/airflow/issues/40115

   ### Body
   
   I have a kind request for all the contributors to the latest provider packages release.
   Could you please help us to test the RC versions of the providers?
   
   The guidelines on how to test providers can be found in
   
   [Verify providers by contributors](https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md#verify-the-release-candidate-by-contributors)
   
   Let us know in the comment, whether the issue is addressed.
   
   Those are providers that require testing as there were some substantial changes introduced:
   
   
   ## Provider [amazon: 8.24.0rc2](https://pypi.org/project/apache-airflow-providers-amazon/8.24.0rc2)
      - [ ] [ECS Overrides for AWS Batch submit_job (#39903)](https://github.com/apache/airflow/pull/39903): @yehoshuadimarsky
      - [ ] [feat: implement amazon s3 to dynamodb transfer operator (#39654)](https://github.com/apache/airflow/pull/39654): @dondaum
        Linked issues:
          - [ ] [Linked Issue #39377](https://github.com/apache/airflow/issues/39377): @eladkal
      - [ ] [Adding Glue Data Quality Rule Recommendation Run  (#40014)](https://github.com/apache/airflow/pull/40014): @gopidesupavan
      - [ ] [Allow user-specified object attributes to be used in check_fn for S3KeySensor (#39950)](https://github.com/apache/airflow/pull/39950): @ellisms
        Linked issues:
          - [ ] [Linked Issue #39898](https://github.com/apache/airflow/issues/39898): @eladkal
      - [ ] [Adding Amazon Glue Data Quality Service (#39923)](https://github.com/apache/airflow/pull/39923): @gopidesupavan
      - [ ] [Deduplicate model name in SageMakerTransformOperator (#39956)](https://github.com/apache/airflow/pull/39956): @mateuslatrova
        Linked issues:
          - [ ] [Linked Issue #39502](https://github.com/apache/airflow/issues/39502): @mxuan0
      - [ ] [fix: DynamoDBToS3Operator - remove process_func from templated_fields (#39948)](https://github.com/apache/airflow/pull/39948): @raphaelauv
      - [ ] [Fix aws assume role session creation when deferrable (#40051)](https://github.com/apache/airflow/pull/40051): @gopidesupavan
        Linked issues:
          - [ ] [Linked Issue #39970](https://github.com/apache/airflow/issues/39970): @arollet-decathlon
      - [ ] [Resolving ECS fargate deprecated warnings (#39834)](https://github.com/apache/airflow/pull/39834): @dirrao
      - [ ] [Resolving EMR notebook deprecated warnings (#39829)](https://github.com/apache/airflow/pull/39829): @dirrao
      - [ ] [Bump boto min versions (#40052)](https://github.com/apache/airflow/pull/40052): @ferruzzi
      - [ ] [Implement per-provider tests with lowest-direct dependency resolution (#39946)](https://github.com/apache/airflow/pull/39946): @potiuk
      - [ ] [Resolve aws emr deprecations in tests (#40020)](https://github.com/apache/airflow/pull/40020): @dirrao
   ## Provider [celery: 3.7.2rc1](https://pypi.org/project/apache-airflow-providers-celery/3.7.2rc1)
      - [ ] [Fixing exception types to include TypeError, which is what is raised in (#40012)](https://github.com/apache/airflow/pull/40012): @leakec
        Linked issues:
          - [ ] [Linked Issue #40011](https://github.com/apache/airflow/issues/40011): @leakec
      - [ ] [catch sentry flush if exception happens in _execute_in_fork finally block (#40060)](https://github.com/apache/airflow/pull/40060): @Lee-W
      - [ ] [add PID and return code to _execute_in_fork logging (#40058)](https://github.com/apache/airflow/pull/40058): @Lee-W
   ## Provider [cncf.kubernetes: 8.3.1rc1](https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/8.3.1rc1)
      - [ ] [Fixes K8s trigger failing running pods with timeout (#40019)](https://github.com/apache/airflow/pull/40019): @Usiel
      - [ ] [Refresh properties on KubernetesPodOperator on token expiration also when logging (#39789)](https://github.com/apache/airflow/pull/39789): @paolo-moriello
      - [ ] [Fix Pod Number Exception in the sync mode if reattach_on_restart parameter is False (#39329)](https://github.com/apache/airflow/pull/39329): @e-galan
      - [ ] [Avoid resetting adopted task instances when retrying for kubernetes executor (#39406)](https://github.com/apache/airflow/pull/39406): @tanvn
      - [ ] [Include fatal reason for pod pending events (#39924)](https://github.com/apache/airflow/pull/39924): @wolfier
   
   <!--
   
   NOTE TO RELEASE MANAGER:
   
   You can move here the providers that have doc-only changes or for which changes are trivial, and
   you could assess that they are OK.
   
   -->
   All users involved in the PRs:
   @potiuk @mateuslatrova @ferruzzi @gopidesupavan @dirrao @leakec @tanvn @paolo-moriello @wolfier @raphaelauv @ellisms @Usiel @yehoshuadimarsky @e-galan @dondaum @Lee-W
   
   ### Committer
   
   - [X] I acknowledge that I am a maintainer/committer of the Apache Airflow project.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

Posted by "arollet-decathlon (via GitHub)" <gi...@apache.org>.
arollet-decathlon commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2155006252

   Tested #40051 it fixed #39970  ! Huge thanks @gopidesupavan 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2154552159

   > WDYT @eladkal, maybe we should yank the 3.7.1 of celery provider already - to avoid people to install it accidentally ?
   
   Agreed


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

Posted by "dondaum (via GitHub)" <gi...@apache.org>.
dondaum commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2154570689

   Tested #39654, works as expected.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

Posted by "leakec (via GitHub)" <gi...@apache.org>.
leakec commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2155170930

   Tested `celery: 3.7.2rc1` and verified it implements #40012 and that it fixes #40011.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2154564543

   Yenked 3.7.1


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2154529846

   My changes were just in tests but I tested that indeed the new celery provider fixes the problem with celery executor reported in #40011 (Impacting also previous versions of airflow). WDYT @eladkal, maybe we should yank the 5.4.0 of celery provider already - to avoid people to install it accidentally ? It's pretty bad when you install 5.4.0 for all previous Airlfow version that use celery provider.
   
   ![image](https://github.com/apache/airflow/assets/595491/dc60e160-5625-4bda-8e7c-8124f2693177)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2156423952

   Thank you everyone. Providers are released.
   
   I invite everyone to help improve providers for the next release, a list of open issues can be found [here](https://github.com/apache/airflow/issues?q=is%3Aopen+is%3Aissue+label%3Aarea%3Aproviders).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

Posted by "gopidesupavan (via GitHub)" <gi...@apache.org>.
gopidesupavan commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2155395154

   Tested both #40014 and #39923 working fine. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

Posted by "dirrao (via GitHub)" <gi...@apache.org>.
dirrao commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2155794504

   Tested #39834, #39829 and #40020. They looks good to me. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal closed issue #40115: Status of testing Providers that were prepared on June 07, 2024
URL: https://github.com/apache/airflow/issues/40115


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

Posted by "tanvn (via GitHub)" <gi...@apache.org>.
tanvn commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2154775211

   Tested https://github.com/apache/airflow/pull/39406 by installing [cncf.kubernetes: 8.3.1rc1](https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/8.3.1rc1) upon my Airflow 2.8.4, confirmed it is working as expected.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

Posted by "gopidesupavan (via GitHub)" <gi...@apache.org>.
gopidesupavan commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2155396462

   Thanks @arollet-decathlon for testing #40051 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

Posted by "fdemiane (via GitHub)" <gi...@apache.org>.
fdemiane commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2154739211

   No issues from my side


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

Posted by "yehoshuadimarsky (via GitHub)" <gi...@apache.org>.
yehoshuadimarsky commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2155160571

   Tested Amazon provider, works for me


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

Posted by "Usiel (via GitHub)" <gi...@apache.org>.
Usiel commented on issue #40115:
URL: https://github.com/apache/airflow/issues/40115#issuecomment-2156339542

   Tested #40019 with Airflow 2.9.1, all good 👍 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org