You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/09/30 13:25:32 UTC
[GitHub] [airflow] potiuk opened a new issue #18638: Status of testing Providers that were prepared on September 30, 2021
potiuk opened a new issue #18638:
URL: https://github.com/apache/airflow/issues/18638
### Body
I have a kind request for all the contributors to the latest provider packages release.
Could you help us to test the RC versions of the providers and let us know in the comment,
if the issue is addressed there.
## Providers that need testing
Those are providers that require testing as there were some substantial changes introduced:
### Provider [amazon: 2.3.0rc1](https://pypi.org/project/apache-airflow-providers-amazon/2.3.0rc1)
- [ ] [Add IAM Role Credentials to S3ToRedshiftTransfer and RedshiftToS3Transfer (#18156)](https://github.com/apache/airflow/pull/18156): @john-jac
- [ ] [Adding missing `replace` param directive in docstring of SalesforceToS3Operator (#18241)](https://github.com/apache/airflow/pull/18241): @josh-fell
- [ ] [Added upsert method on S3ToRedshift operator (#18027)](https://github.com/apache/airflow/pull/18027): @mariotaddeucci
- [ ] [Add Spark to the EMR cluster for the job flow examples (#17563)](https://github.com/apache/airflow/pull/17563): @snolan-amount
- [ ] [Update s3_list.py (#18561)](https://github.com/apache/airflow/pull/18561): @Xilorole
- [ ] [ECSOperator realtime logging (#17626)](https://github.com/apache/airflow/pull/17626): @codenamestif
- [ ] [Deprecate default pod name in EKSPodOperator (#18036)](https://github.com/apache/airflow/pull/18036): @mik-laj
- [ ] [Aws secrets manager backend (#17448)](https://github.com/apache/airflow/pull/17448): @JavierLopezT
- [ ] [sftp_to_s3 stream file option (#17609)](https://github.com/apache/airflow/pull/17609): @john-jac
- [ ] [AwsBaseHook make `client_type` & `resource_type` optional params for `get_client_type` & `get_resource_type` (#17987)](https://github.com/apache/airflow/pull/17987): @eladkal
- [ ] [Delete unnecessary parameters in EKSPodOperator (#17960)](https://github.com/apache/airflow/pull/17960): @mik-laj
- [ ] [ECSOperator returns last logs when ECS task fails (#17209)](https://github.com/apache/airflow/pull/17209): @pmalafosse
- [ ] [Refresh credentials for long-running pods on EKS (#17951)](https://github.com/apache/airflow/pull/17951): @mik-laj
### Provider [apache.cassandra: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-apache-cassandra/2.1.0rc1)
- [ ] [Adding a default conn ID value for Apache Cassandra sensors (#18620)](https://github.com/apache/airflow/pull/18620): @josh-fell
### Provider [apache.hdfs: 2.1.1rc1](https://pypi.org/project/apache-airflow-providers-apache-hdfs/2.1.1rc1)
- [ ] [hdfs provider: fix deprecation warning in WebHDFSHook (#18331)](https://github.com/apache/airflow/pull/18331): @Aakcht
### Provider [apache.hive: 2.0.2rc1](https://pypi.org/project/apache-airflow-providers-apache-hive/2.0.2rc1)
- [ ] [HiveHook fix get_pandas_df() failure when it tries to read an empty table (#17777)](https://github.com/apache/airflow/pull/17777): @iblaine
### Provider [apache.livy: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-apache-livy/2.1.0rc1)
- [ ] [Fetching and logging Livy session logs for LivyOperator (#17393)](https://github.com/apache/airflow/pull/17393): @sreenath-kamath
### Provider [asana: 1.1.0rc1](https://pypi.org/project/apache-airflow-providers-asana/1.1.0rc1)
- [ ] [Use built-in ``cached_property`` on Python 3.8 for Asana provider (#17597)](https://github.com/apache/airflow/pull/17597): @kaxil
### Provider [cncf.kubernetes: 2.0.3rc1](https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/2.0.3rc1)
- [ ] [Fix KubernetesPodOperator reattach when not deleting pods (#18070)](https://github.com/apache/airflow/pull/18070): @jedcunningham
- [ ] [Make Kubernetes job description fit on one log line (#18377)](https://github.com/apache/airflow/pull/18377): @collinmcnulty
- [ ] [Do not fail KubernetesPodOperator tasks if log following fails (#17649)](https://github.com/apache/airflow/pull/17649): @baryluk
### Provider [databricks: 2.0.2rc1](https://pypi.org/project/apache-airflow-providers-databricks/2.0.2rc1)
- [ ] [Move DB call out of ``DatabricksHook.__init__`` (#18339)](https://github.com/apache/airflow/pull/18339): @kaxil
### Provider [docker: 2.2.0rc1](https://pypi.org/project/apache-airflow-providers-docker/2.2.0rc1)
- [ ] [Add a Docker Taskflow decorator (#15330)](https://github.com/apache/airflow/pull/15330): @dimberman
### Provider [elasticsearch: 2.0.3rc1](https://pypi.org/project/apache-airflow-providers-elasticsearch/2.0.3rc1)
- [ ] [Fix Invalid log order in ElasticsearchTaskHandler (#17551)](https://github.com/apache/airflow/pull/17551): @suhanovv
- [ ] [Adds secret backend and logging information to provider yaml (#17625)](https://github.com/apache/airflow/pull/17625): @potiuk
### Provider [exasol: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-exasol/2.0.1rc1)
- [ ] [ExasolHook get_pandas_df does not return pandas dataframe but None (#17850)](https://github.com/apache/airflow/pull/17850): @Goodkat
### Provider [google: 6.0.0rc1](https://pypi.org/project/apache-airflow-providers-google/6.0.0rc1)
- [ ] [Migrate Google Cloud Build from Discovery API to Python SDK (#18184)](https://github.com/apache/airflow/pull/18184): @ryanyuan
- [ ] [Add index to the dataset name to have separate dataset for each DAG (#18459)](https://github.com/apache/airflow/pull/18459): @deedmitrij
- [ ] [Add missing __init__.py files for some test packages (#18142)](https://github.com/apache/airflow/pull/18142): @potiuk
- [ ] [Add possibility to run DAGs from system tests and see DAGs logs (#17868)](https://github.com/apache/airflow/pull/17868): @deedmitrij
- [ ] [Rename AzureDataLakeStorage to ADLS (#18493)](https://github.com/apache/airflow/pull/18493): @eladkal
- [ ] [Make next_dagrun_info take a data interval (#18088)](https://github.com/apache/airflow/pull/18088): @uranusjr
- [ ] [Use parameters instead of params (#18143)](https://github.com/apache/airflow/pull/18143): @msumit
- [ ] [New google operator: SQLToGoogleSheetsOperator (#17887)](https://github.com/apache/airflow/pull/17887): @mariotaddeucci
- [ ] [Fix part of Google system tests (#18494)](https://github.com/apache/airflow/pull/18494): @mnojek
- [ ] [Fix kubernetes engine system test (#18548)](https://github.com/apache/airflow/pull/18548): @deedmitrij
- [ ] [Fix BigQuery system test (#18373)](https://github.com/apache/airflow/pull/18373): @deedmitrij
- [ ] [Fix error when create external table using table resource (#17998)](https://github.com/apache/airflow/pull/17998): @tnyz
- [ ] [Fix BigQuery data extraction in BigQueryToMySqlOperator (#18073)](https://github.com/apache/airflow/pull/18073): @wolfier
- [ ] [Fix providers tests in main branch with eager upgrades (#18040)](https://github.com/apache/airflow/pull/18040): @potiuk
- [ ] [fix(CloudSqlProxyRunner): don't query connections from Airflow DB (#18006)](https://github.com/apache/airflow/pull/18006): @m1racoli
- [ ] [Remove check for at least one schema in GCSToBigquery (#18150)](https://github.com/apache/airflow/pull/18150): @c-nuro
- [ ] [deduplicate running jobs on BigQueryInsertJobOperator (#17496)](https://github.com/apache/airflow/pull/17496): @blcksrx
### Provider [hashicorp: 2.1.1rc1](https://pypi.org/project/apache-airflow-providers-hashicorp/2.1.1rc1)
- [ ] [Fixing Vault AppRole authentication with CONN_URI (#18064)](https://github.com/apache/airflow/pull/18064): @nathadfield
### Provider [jdbc: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-jdbc/2.0.1rc1)
- [ ] [Fix type annotations in OracleOperator, JdbcOperator, SqliteOperator (#17406)](https://github.com/apache/airflow/pull/17406): @shadrus
### Provider [microsoft.azure: 3.2.0rc1](https://pypi.org/project/apache-airflow-providers-microsoft-azure/3.2.0rc1)
- [ ] [Rename AzureDataLakeStorage to ADLS (#18493)](https://github.com/apache/airflow/pull/18493): @eladkal
- [ ] [Creating ADF pipeline run operator, sensor + ADF custom conn fields (#17885)](https://github.com/apache/airflow/pull/17885): @josh-fell
- [ ] [Rename LocalToAzureDataLakeStorageOperator to LocalFilesystemToADLSOperator (#18168)](https://github.com/apache/airflow/pull/18168): @eladkal
- [ ] [Rename FileToWasbOperator to LocalFilesystemToWasbOperator (#18109)](https://github.com/apache/airflow/pull/18109): @eladkal
- [ ] [Fixed wasb hook attempting to create container when getting a blob client (#18287)](https://github.com/apache/airflow/pull/18287): @ignaski
- [ ] [Removing redundant relabeling of ADX conn field (#18386)](https://github.com/apache/airflow/pull/18386): @josh-fell
- [ ] [Proper handling of Account URL custom conn field in AzureBatchHook (#18456)](https://github.com/apache/airflow/pull/18456): @josh-fell
### Provider [microsoft.psrp: 1.0.1rc1](https://pypi.org/project/apache-airflow-providers-microsoft-psrp/1.0.1rc1)
- [ ] [Fix unexpected bug in exiting PSRPHook.client context manager (#18014)](https://github.com/apache/airflow/pull/18014): @malthe
### Provider [mongo: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-mongo/2.1.0rc1)
- [ ] [Add Mongo projections to hook and transfer (#17379)](https://github.com/apache/airflow/pull/17379): @JavierLopezT
- [ ] [Import Hooks lazily individually in providers manager (#17682)](https://github.com/apache/airflow/pull/17682): @potiuk
### Provider [neo4j: 2.0.2rc1](https://pypi.org/project/apache-airflow-providers-neo4j/2.0.2rc1)
- [ ] [fix Neo4jHook to get the query response (#18007)](https://github.com/apache/airflow/pull/18007): @minu7
### Provider [openfaas: 2.0.0rc1](https://pypi.org/project/apache-airflow-providers-openfaas/2.0.0rc1)
- [ ] [Auto-apply apply_default decorator (#15667)](https://github.com/apache/airflow/pull/15667): @ashb
### Provider [papermill: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-papermill/2.1.0rc1)
- [ ] [Add support for templated fields in PapermillOperator (#18357)](https://github.com/apache/airflow/pull/18357): @eladkal
- [ ] [Fix usage of ``range(len())`` to ``enumerate`` (#18174)](https://github.com/apache/airflow/pull/18174): @kaxil
### Provider [postgres: 2.3.0rc1](https://pypi.org/project/apache-airflow-providers-postgres/2.3.0rc1)
- [ ] [Added upsert method on S3ToRedshift operator (#18027)](https://github.com/apache/airflow/pull/18027): @mariotaddeucci
- [ ] [Fix example dag of PostgresOperator (#18236)](https://github.com/apache/airflow/pull/18236): @eladkal
### Provider [salesforce: 3.2.0rc1](https://pypi.org/project/apache-airflow-providers-salesforce/3.2.0rc1)
- [ ] [Adding JWT, IP filtering, and direct session login support for SalesforceHook (#17399)](https://github.com/apache/airflow/pull/17399): @josh-fell
### Provider [samba: 3.0.0rc1](https://pypi.org/project/apache-airflow-providers-samba/3.0.0rc1)
- [ ] [Switch to 'smbprotocol' library (#17273)](https://github.com/apache/airflow/pull/17273): @malthe
### Provider [slack: 4.1.0rc1](https://pypi.org/project/apache-airflow-providers-slack/4.1.0rc1)
- [ ] [Restore 'filename' to template_fields of SlackAPIFileOperator (#18466)](https://github.com/apache/airflow/pull/18466): @SayTen
### Provider [snowflake: 2.2.0rc1](https://pypi.org/project/apache-airflow-providers-snowflake/2.2.0rc1)
- [ ] [Add Snowflake DQ Operators (#17741)](https://github.com/apache/airflow/pull/17741): @denimalpaca
### Provider [sqlite: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-sqlite/2.0.1rc1)
- [ ] [Fix sqlite hook - insert and replace functions (#17695)](https://github.com/apache/airflow/pull/17695): @subkanthi
### Provider [ssh: 2.2.0rc1](https://pypi.org/project/apache-airflow-providers-ssh/2.2.0rc1)
- [ ] [[Airflow 16364] Add conn_timeout and cmd_timeout params to SSHOperator; add conn_timeout param to SSHHook (#17236)](https://github.com/apache/airflow/pull/17236): @fatmumuhomer
### Provider [yandex: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-yandex/2.1.0rc1)
- [ ] [Add autoscaling subcluster support and remove defaults (#17033)](https://github.com/apache/airflow/pull/17033): @peter-volkov
## Providers that do not need testing
We have a number of providers that had doc-only changes so they are not released.
### Committer
- [X] I acknowledge that I am a maintainer/committer of the Apache Airflow project.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] deedmitrij commented on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
deedmitrij commented on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-932226100
The same from my side. I also only made some changes to stabilize Google
system tests.
Best regards,
Dmytro Khimich
пт, 1 окт. 2021 г., 16:16 Jarek Potiuk ***@***.***>:
> Hi @potiuk <https://github.com/potiuk> What is it that you expect us to
> do, actually? My changes are only related to System Tests and they made
> them a bit more stable, so I'm curious what else should I do to assure that
> the quality hasn't dropped. Please explain, and I will try to act
> accordingly 😃
>
> That's enough to get the comment :) . No need to test that particular one.
>
> —
> You are receiving this because you were mentioned.
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/airflow/issues/18638#issuecomment-932219153>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AGAJVRIDQMS5HIC2GL3SWETUEWYBNANCNFSM5FCKXUEA>
> .
> Triage notifications on the go with GitHub Mobile for iOS
> <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675>
> or Android
> <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.
>
>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] tnyz commented on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
tnyz commented on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-931587178
tested #17998
```
task = BigQueryCreateExternalTableOperator(
task_id="test",
table_resource=table_resource,
dag=dag,
bucket=None,
source_objects=None
)
```
we have to specify the required parameters (bucket, source_objects) to None which is ugly but works
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] codenamestif commented on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
codenamestif commented on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-932281393
#17626 works fine
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mariotaddeucci commented on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
mariotaddeucci commented on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-932286249
#17887 and #18027 works fine.
Actually for PR #18027 has a duplicated code that is removed on PR #18671
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-932991719
[NOTE TO SELF] -> we need to update the Changelog to include Redshift Amazon Provider dependency on 2.3.0 Postgres provider version (see https://github.com/apache/airflow/pull/18671#issuecomment-932989966)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] john-jac commented on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
john-jac commented on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-934571359
#17609 works as expected
From: Jarek Potiuk ***@***.***>
Reply-To: apache/airflow ***@***.***>
Date: Thursday, September 30, 2021 at 6:26 AM
To: apache/airflow ***@***.***>
Cc: "Jackson, John" ***@***.***>, Mention ***@***.***>
Subject: [apache/airflow] Status of testing Providers that were prepared on September 30, 2021 (#18638)
Body
I have a kind request for all the contributors to the latest provider packages release.
Could you help us to test the RC versions of the providers and let us know in the comment,
if the issue is addressed there.
Providers that need testing
Those are providers that require testing as there were some substantial changes introduced:
Provider amazon: 2.3.0rc1<https://pypi.org/project/apache-airflow-providers-amazon/2.3.0rc1>
* Add IAM Role Credentials to S3ToRedshiftTransfer and RedshiftToS3Transfer (#18156)<https://github.com/apache/airflow/pull/18156>: @john-jac<https://github.com/john-jac>
* Adding missing replace param directive in docstring of SalesforceToS3Operator (#18241)<https://github.com/apache/airflow/pull/18241>: @josh-fell<https://github.com/josh-fell>
* Added upsert method on S3ToRedshift operator (#18027)<https://github.com/apache/airflow/pull/18027>: @mariotaddeucci<https://github.com/mariotaddeucci>
* Add Spark to the EMR cluster for the job flow examples (#17563)<https://github.com/apache/airflow/pull/17563>: @snolan-amount<https://github.com/snolan-amount>
* Update s3_list.py (#18561)<https://github.com/apache/airflow/pull/18561>: @Xilorole<https://github.com/Xilorole>
* ECSOperator realtime logging (#17626)<https://github.com/apache/airflow/pull/17626>: @codenamestif<https://github.com/codenamestif>
* Deprecate default pod name in EKSPodOperator (#18036)<https://github.com/apache/airflow/pull/18036>: @mik-laj<https://github.com/mik-laj>
* Aws secrets manager backend (#17448)<https://github.com/apache/airflow/pull/17448>: @JavierLopezT<https://github.com/JavierLopezT>
* sftp_to_s3 stream file option (#17609)<https://github.com/apache/airflow/pull/17609>: @john-jac<https://github.com/john-jac>
* AwsBaseHook make client_type & resource_type optional params for get_client_type & get_resource_type (#17987)<https://github.com/apache/airflow/pull/17987>: @eladkal<https://github.com/eladkal>
* Delete unnecessary parameters in EKSPodOperator (#17960)<https://github.com/apache/airflow/pull/17960>: @mik-laj<https://github.com/mik-laj>
* ECSOperator returns last logs when ECS task fails (#17209)<https://github.com/apache/airflow/pull/17209>: @pmalafosse<https://github.com/pmalafosse>
* Refresh credentials for long-running pods on EKS (#17951)<https://github.com/apache/airflow/pull/17951>: @mik-laj<https://github.com/mik-laj>
Provider apache.cassandra: 2.1.0rc1<https://pypi.org/project/apache-airflow-providers-apache-cassandra/2.1.0rc1>
* Adding a default conn ID value for Apache Cassandra sensors (#18620)<https://github.com/apache/airflow/pull/18620>: @josh-fell<https://github.com/josh-fell>
Provider apache.hdfs: 2.1.1rc1<https://pypi.org/project/apache-airflow-providers-apache-hdfs/2.1.1rc1>
* hdfs provider: fix deprecation warning in WebHDFSHook (#18331)<https://github.com/apache/airflow/pull/18331>: @Aakcht<https://github.com/Aakcht>
Provider apache.hive: 2.0.2rc1<https://pypi.org/project/apache-airflow-providers-apache-hive/2.0.2rc1>
* HiveHook fix get_pandas_df() failure when it tries to read an empty table (#17777)<https://github.com/apache/airflow/pull/17777>: @iblaine<https://github.com/iblaine>
Provider apache.livy: 2.1.0rc1<https://pypi.org/project/apache-airflow-providers-apache-livy/2.1.0rc1>
* Fetching and logging Livy session logs for LivyOperator (#17393)<https://github.com/apache/airflow/pull/17393>: @sreenath-kamath<https://github.com/sreenath-kamath>
Provider asana: 1.1.0rc1<https://pypi.org/project/apache-airflow-providers-asana/1.1.0rc1>
* Use built-in cached_property on Python 3.8 for Asana provider (#17597)<https://github.com/apache/airflow/pull/17597>: @kaxil<https://github.com/kaxil>
Provider cncf.kubernetes: 2.0.3rc1<https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/2.0.3rc1>
* Fix KubernetesPodOperator reattach when not deleting pods (#18070)<https://github.com/apache/airflow/pull/18070>: @jedcunningham<https://github.com/jedcunningham>
* Make Kubernetes job description fit on one log line (#18377)<https://github.com/apache/airflow/pull/18377>: @collinmcnulty<https://github.com/collinmcnulty>
* Do not fail KubernetesPodOperator tasks if log following fails (#17649)<https://github.com/apache/airflow/pull/17649>: @baryluk<https://github.com/baryluk>
Provider databricks: 2.0.2rc1<https://pypi.org/project/apache-airflow-providers-databricks/2.0.2rc1>
* Move DB call out of DatabricksHook.__init__ (#18339)<https://github.com/apache/airflow/pull/18339>: @kaxil<https://github.com/kaxil>
Provider docker: 2.2.0rc1<https://pypi.org/project/apache-airflow-providers-docker/2.2.0rc1>
* Add a Docker Taskflow decorator (#15330)<https://github.com/apache/airflow/pull/15330>: @dimberman<https://github.com/dimberman>
Provider elasticsearch: 2.0.3rc1<https://pypi.org/project/apache-airflow-providers-elasticsearch/2.0.3rc1>
* Fix Invalid log order in ElasticsearchTaskHandler (#17551)<https://github.com/apache/airflow/pull/17551>: @suhanovv<https://github.com/suhanovv>
* Adds secret backend and logging information to provider yaml (#17625)<https://github.com/apache/airflow/pull/17625>: @potiuk<https://github.com/potiuk>
Provider exasol: 2.0.1rc1<https://pypi.org/project/apache-airflow-providers-exasol/2.0.1rc1>
* ExasolHook get_pandas_df does not return pandas dataframe but None (#17850)<https://github.com/apache/airflow/pull/17850>: @Goodkat<https://github.com/Goodkat>
Provider google: 6.0.0rc1<https://pypi.org/project/apache-airflow-providers-google/6.0.0rc1>
* Migrate Google Cloud Build from Discovery API to Python SDK (#18184)<https://github.com/apache/airflow/pull/18184>: @ryanyuan<https://github.com/ryanyuan>
* Add index to the dataset name to have separate dataset for each DAG (#18459)<https://github.com/apache/airflow/pull/18459>: @deedmitrij<https://github.com/deedmitrij>
* Add missing init.py files for some test packages (#18142)<https://github.com/apache/airflow/pull/18142>: @potiuk<https://github.com/potiuk>
* Add possibility to run DAGs from system tests and see DAGs logs (#17868)<https://github.com/apache/airflow/pull/17868>: @deedmitrij<https://github.com/deedmitrij>
* Rename AzureDataLakeStorage to ADLS (#18493)<https://github.com/apache/airflow/pull/18493>: @eladkal<https://github.com/eladkal>
* Make next_dagrun_info take a data interval (#18088)<https://github.com/apache/airflow/pull/18088>: @uranusjr<https://github.com/uranusjr>
* Use parameters instead of params (#18143)<https://github.com/apache/airflow/pull/18143>: @msumit<https://github.com/msumit>
* New google operator: SQLToGoogleSheetsOperator (#17887)<https://github.com/apache/airflow/pull/17887>: @mariotaddeucci<https://github.com/mariotaddeucci>
* Fix part of Google system tests (#18494)<https://github.com/apache/airflow/pull/18494>: @mnojek<https://github.com/mnojek>
* Fix kubernetes engine system test (#18548)<https://github.com/apache/airflow/pull/18548>: @deedmitrij<https://github.com/deedmitrij>
* Fix BigQuery system test (#18373)<https://github.com/apache/airflow/pull/18373>: @deedmitrij<https://github.com/deedmitrij>
* Fix error when create external table using table resource (#17998)<https://github.com/apache/airflow/pull/17998>: @tnyz<https://github.com/tnyz>
* Fix BigQuery data extraction in BigQueryToMySqlOperator (#18073)<https://github.com/apache/airflow/pull/18073>: @wolfier<https://github.com/wolfier>
* Fix providers tests in main branch with eager upgrades (#18040)<https://github.com/apache/airflow/pull/18040>: @potiuk<https://github.com/potiuk>
* fix(CloudSqlProxyRunner): don't query connections from Airflow DB (#18006)<https://github.com/apache/airflow/pull/18006>: @m1racoli<https://github.com/m1racoli>
* Remove check for at least one schema in GCSToBigquery (#18150)<https://github.com/apache/airflow/pull/18150>: @c-nuro<https://github.com/c-nuro>
* deduplicate running jobs on BigQueryInsertJobOperator (#17496)<https://github.com/apache/airflow/pull/17496>: @blcksrx<https://github.com/blcksrx>
Provider hashicorp: 2.1.1rc1<https://pypi.org/project/apache-airflow-providers-hashicorp/2.1.1rc1>
* Fixing Vault AppRole authentication with CONN_URI (#18064)<https://github.com/apache/airflow/pull/18064>: @nathadfield<https://github.com/nathadfield>
Provider jdbc: 2.0.1rc1<https://pypi.org/project/apache-airflow-providers-jdbc/2.0.1rc1>
* Fix type annotations in OracleOperator, JdbcOperator, SqliteOperator (#17406)<https://github.com/apache/airflow/pull/17406>: @shadrus<https://github.com/shadrus>
Provider microsoft.azure: 3.2.0rc1<https://pypi.org/project/apache-airflow-providers-microsoft-azure/3.2.0rc1>
* Rename AzureDataLakeStorage to ADLS (#18493)<https://github.com/apache/airflow/pull/18493>: @eladkal<https://github.com/eladkal>
* Creating ADF pipeline run operator, sensor + ADF custom conn fields (#17885)<https://github.com/apache/airflow/pull/17885>: @josh-fell<https://github.com/josh-fell>
* Rename LocalToAzureDataLakeStorageOperator to LocalFilesystemToADLSOperator (#18168)<https://github.com/apache/airflow/pull/18168>: @eladkal<https://github.com/eladkal>
* Rename FileToWasbOperator to LocalFilesystemToWasbOperator (#18109)<https://github.com/apache/airflow/pull/18109>: @eladkal<https://github.com/eladkal>
* Fixed wasb hook attempting to create container when getting a blob client (#18287)<https://github.com/apache/airflow/pull/18287>: @ignaski<https://github.com/ignaski>
* Removing redundant relabeling of ADX conn field (#18386)<https://github.com/apache/airflow/pull/18386>: @josh-fell<https://github.com/josh-fell>
* Proper handling of Account URL custom conn field in AzureBatchHook (#18456)<https://github.com/apache/airflow/pull/18456>: @josh-fell<https://github.com/josh-fell>
Provider microsoft.psrp: 1.0.1rc1<https://pypi.org/project/apache-airflow-providers-microsoft-psrp/1.0.1rc1>
* Fix unexpected bug in exiting PSRPHook.client context manager (#18014)<https://github.com/apache/airflow/pull/18014>: @malthe<https://github.com/malthe>
Provider mongo: 2.1.0rc1<https://pypi.org/project/apache-airflow-providers-mongo/2.1.0rc1>
* Add Mongo projections to hook and transfer (#17379)<https://github.com/apache/airflow/pull/17379>: @JavierLopezT<https://github.com/JavierLopezT>
* Import Hooks lazily individually in providers manager (#17682)<https://github.com/apache/airflow/pull/17682>: @potiuk<https://github.com/potiuk>
Provider neo4j: 2.0.2rc1<https://pypi.org/project/apache-airflow-providers-neo4j/2.0.2rc1>
* fix Neo4jHook to get the query response (#18007)<https://github.com/apache/airflow/pull/18007>: @minu7<https://github.com/minu7>
Provider openfaas: 2.0.0rc1<https://pypi.org/project/apache-airflow-providers-openfaas/2.0.0rc1>
* Auto-apply apply_default decorator (#15667)<https://github.com/apache/airflow/pull/15667>: @ashb<https://github.com/ashb>
Provider papermill: 2.1.0rc1<https://pypi.org/project/apache-airflow-providers-papermill/2.1.0rc1>
* Add support for templated fields in PapermillOperator (#18357)<https://github.com/apache/airflow/pull/18357>: @eladkal<https://github.com/eladkal>
* Fix usage of range(len()) to enumerate (#18174)<https://github.com/apache/airflow/pull/18174>: @kaxil<https://github.com/kaxil>
Provider postgres: 2.3.0rc1<https://pypi.org/project/apache-airflow-providers-postgres/2.3.0rc1>
* Added upsert method on S3ToRedshift operator (#18027)<https://github.com/apache/airflow/pull/18027>: @mariotaddeucci<https://github.com/mariotaddeucci>
* Fix example dag of PostgresOperator (#18236)<https://github.com/apache/airflow/pull/18236>: @eladkal<https://github.com/eladkal>
Provider salesforce: 3.2.0rc1<https://pypi.org/project/apache-airflow-providers-salesforce/3.2.0rc1>
* Adding JWT, IP filtering, and direct session login support for SalesforceHook (#17399)<https://github.com/apache/airflow/pull/17399>: @josh-fell<https://github.com/josh-fell>
Provider samba: 3.0.0rc1<https://pypi.org/project/apache-airflow-providers-samba/3.0.0rc1>
* Switch to 'smbprotocol' library (#17273)<https://github.com/apache/airflow/pull/17273>: @malthe<https://github.com/malthe>
Provider slack: 4.1.0rc1<https://pypi.org/project/apache-airflow-providers-slack/4.1.0rc1>
* Restore 'filename' to template_fields of SlackAPIFileOperator (#18466)<https://github.com/apache/airflow/pull/18466>: @SayTen<https://github.com/SayTen>
Provider snowflake: 2.2.0rc1<https://pypi.org/project/apache-airflow-providers-snowflake/2.2.0rc1>
* Add Snowflake DQ Operators (#17741)<https://github.com/apache/airflow/pull/17741>: @denimalpaca<https://github.com/denimalpaca>
Provider sqlite: 2.0.1rc1<https://pypi.org/project/apache-airflow-providers-sqlite/2.0.1rc1>
* Fix sqlite hook - insert and replace functions (#17695)<https://github.com/apache/airflow/pull/17695>: @subkanthi<https://github.com/subkanthi>
Provider ssh: 2.2.0rc1<https://pypi.org/project/apache-airflow-providers-ssh/2.2.0rc1>
* [Airflow 16364] Add conn_timeout and cmd_timeout params to SSHOperator; add conn_timeout param to SSHHook (#17236)<https://github.com/apache/airflow/pull/17236>: @fatmumuhomer<https://github.com/fatmumuhomer>
Provider yandex: 2.1.0rc1<https://pypi.org/project/apache-airflow-providers-yandex/2.1.0rc1>
* Add autoscaling subcluster support and remove defaults (#17033)<https://github.com/apache/airflow/pull/17033>: @peter-volkov<https://github.com/peter-volkov>
Providers that do not need testing
We have a number of providers that had doc-only changes so they are not released.
Committer
* I acknowledge that I am a maintainer/committer of the Apache Airflow project.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub<https://github.com/apache/airflow/issues/18638>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AR7SQOMM3YGGUHNSX5ZPBM3UERQOBANCNFSM5FCKXUEA>.
Triage notifications on the go with GitHub Mobile for iOS<https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android<https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] Aakcht commented on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
Aakcht commented on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-931411585
Tested #18331 - all good, no more deprecation warning.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk closed issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk closed issue #18638:
URL: https://github.com/apache/airflow/issues/18638
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mariotaddeucci edited a comment on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
mariotaddeucci edited a comment on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-932286249
#17887 and #18027 works fine.
Actually the #18027 has a duplicated code that is removed on PR #18671
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-932991258
> Woof that is a horrible commit message so totally understandable. I mistakenly thought that the PR title was always used as the commit message but doesn't seem to be the case when there is only 1 commit in the PR. Thanks for clarifying!
Mistake was mine, as I should have noticed that while merging (but I likely clicked "merge" too fast).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] JavierLopezT commented on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
JavierLopezT commented on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-934134258
#17448 Has at least one important bug, so can't be included in this release
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mnojek commented on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
mnojek commented on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-932212130
Hi @potiuk
What is it that you expect us to do, actually?
My changes are only related to System Tests and they made them a bit more stable, so I'm curious what else should I do to assure that the quality hasn't dropped. Please explain, and I will try to act accordingly 😃
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] josh-fell commented on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
josh-fell commented on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-932424170
Tested and verified #18241, #18620, #17885, #18386, and #18456 👍
@potiuk I noticed #18386 is listed under the Microsoft Azure provider but this fix was built on top of #18203. Just wondering if it’s worth calling out the latter PR change in the Azure provider changelog as well?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] jedcunningham commented on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
jedcunningham commented on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-933732930
Tested #18070 and #18377 👍
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-932991369
We are progressing quite well :). I would appreciate some moret testing tomorrow, so that we can have higher confidence when voting on it !
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-932448916
> @potiuk I noticed #18386 is listed under the Microsoft Azure provider but this fix was built on top of #18203. Just wondering if it’s worth calling out the latter PR change in the Azure provider changelog as well?
Yeah. I know why I have not included it. It is merged as ``Initial commit (#18203)`` :). I will update it in the docs (I cannot do it in the packages that we are voting on, but the docs can be updated later - and future releses will get it corrected.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] tnyz commented on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
tnyz commented on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-931503728
@potiuk is there a public-accessible test environment with the rc installed or do we need to test them in our own environment?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] josh-fell commented on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
josh-fell commented on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-932452786
> > @potiuk I noticed #18386 is listed under the Microsoft Azure provider but this fix was built on top of #18203. Just wondering if it’s worth calling out the latter PR change in the Azure provider changelog as well?
>
> Yeah. I know why I have not included it. It is merged as `Initial commit (#18203)` :). I will update it in the docs (I cannot do it in the packages that we are voting on, but the docs can be updated later - and future releses will get it corrected.
Woof that is a horrible commit message so totally understandable. I mistakenly thought that the PR title was always used as the commit message but doesn't seem to be the case when there is only 1 commit in the PR. Thanks for clarifying!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-934595743
Thanks everyone for testing. Providers relased (except amazon which waits for the fix for Secret Manager - I will release and RC2 when it 's ready with "incremental" testing needs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-932219153
> Hi @potiuk What is it that you expect us to do, actually? My changes are only related to System Tests and they made them a bit more stable, so I'm curious what else should I do to assure that the quality hasn't dropped. Please explain, and I will try to act accordingly 😃
That's enough to get the comment :) . No need to test that particular one.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] nathadfield commented on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
nathadfield commented on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-932230139
All good on #18064 as far as I can tell.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] john-jac commented on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
john-jac commented on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-933795327
#18156 works as expected
From: Jarek Potiuk ***@***.***>
Reply-To: apache/airflow ***@***.***>
Date: Thursday, September 30, 2021 at 6:26 AM
To: apache/airflow ***@***.***>
Cc: "Jackson, John" ***@***.***>, Mention ***@***.***>
Subject: [apache/airflow] Status of testing Providers that were prepared on September 30, 2021 (#18638)
Body
I have a kind request for all the contributors to the latest provider packages release.
Could you help us to test the RC versions of the providers and let us know in the comment,
if the issue is addressed there.
Providers that need testing
Those are providers that require testing as there were some substantial changes introduced:
Provider amazon: 2.3.0rc1<https://pypi.org/project/apache-airflow-providers-amazon/2.3.0rc1>
* Add IAM Role Credentials to S3ToRedshiftTransfer and RedshiftToS3Transfer (#18156)<https://github.com/apache/airflow/pull/18156>: @john-jac<https://github.com/john-jac>
* Adding missing replace param directive in docstring of SalesforceToS3Operator (#18241)<https://github.com/apache/airflow/pull/18241>: @josh-fell<https://github.com/josh-fell>
* Added upsert method on S3ToRedshift operator (#18027)<https://github.com/apache/airflow/pull/18027>: @mariotaddeucci<https://github.com/mariotaddeucci>
* Add Spark to the EMR cluster for the job flow examples (#17563)<https://github.com/apache/airflow/pull/17563>: @snolan-amount<https://github.com/snolan-amount>
* Update s3_list.py (#18561)<https://github.com/apache/airflow/pull/18561>: @Xilorole<https://github.com/Xilorole>
* ECSOperator realtime logging (#17626)<https://github.com/apache/airflow/pull/17626>: @codenamestif<https://github.com/codenamestif>
* Deprecate default pod name in EKSPodOperator (#18036)<https://github.com/apache/airflow/pull/18036>: @mik-laj<https://github.com/mik-laj>
* Aws secrets manager backend (#17448)<https://github.com/apache/airflow/pull/17448>: @JavierLopezT<https://github.com/JavierLopezT>
* sftp_to_s3 stream file option (#17609)<https://github.com/apache/airflow/pull/17609>: @john-jac<https://github.com/john-jac>
* AwsBaseHook make client_type & resource_type optional params for get_client_type & get_resource_type (#17987)<https://github.com/apache/airflow/pull/17987>: @eladkal<https://github.com/eladkal>
* Delete unnecessary parameters in EKSPodOperator (#17960)<https://github.com/apache/airflow/pull/17960>: @mik-laj<https://github.com/mik-laj>
* ECSOperator returns last logs when ECS task fails (#17209)<https://github.com/apache/airflow/pull/17209>: @pmalafosse<https://github.com/pmalafosse>
* Refresh credentials for long-running pods on EKS (#17951)<https://github.com/apache/airflow/pull/17951>: @mik-laj<https://github.com/mik-laj>
Provider apache.cassandra: 2.1.0rc1<https://pypi.org/project/apache-airflow-providers-apache-cassandra/2.1.0rc1>
* Adding a default conn ID value for Apache Cassandra sensors (#18620)<https://github.com/apache/airflow/pull/18620>: @josh-fell<https://github.com/josh-fell>
Provider apache.hdfs: 2.1.1rc1<https://pypi.org/project/apache-airflow-providers-apache-hdfs/2.1.1rc1>
* hdfs provider: fix deprecation warning in WebHDFSHook (#18331)<https://github.com/apache/airflow/pull/18331>: @Aakcht<https://github.com/Aakcht>
Provider apache.hive: 2.0.2rc1<https://pypi.org/project/apache-airflow-providers-apache-hive/2.0.2rc1>
* HiveHook fix get_pandas_df() failure when it tries to read an empty table (#17777)<https://github.com/apache/airflow/pull/17777>: @iblaine<https://github.com/iblaine>
Provider apache.livy: 2.1.0rc1<https://pypi.org/project/apache-airflow-providers-apache-livy/2.1.0rc1>
* Fetching and logging Livy session logs for LivyOperator (#17393)<https://github.com/apache/airflow/pull/17393>: @sreenath-kamath<https://github.com/sreenath-kamath>
Provider asana: 1.1.0rc1<https://pypi.org/project/apache-airflow-providers-asana/1.1.0rc1>
* Use built-in cached_property on Python 3.8 for Asana provider (#17597)<https://github.com/apache/airflow/pull/17597>: @kaxil<https://github.com/kaxil>
Provider cncf.kubernetes: 2.0.3rc1<https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/2.0.3rc1>
* Fix KubernetesPodOperator reattach when not deleting pods (#18070)<https://github.com/apache/airflow/pull/18070>: @jedcunningham<https://github.com/jedcunningham>
* Make Kubernetes job description fit on one log line (#18377)<https://github.com/apache/airflow/pull/18377>: @collinmcnulty<https://github.com/collinmcnulty>
* Do not fail KubernetesPodOperator tasks if log following fails (#17649)<https://github.com/apache/airflow/pull/17649>: @baryluk<https://github.com/baryluk>
Provider databricks: 2.0.2rc1<https://pypi.org/project/apache-airflow-providers-databricks/2.0.2rc1>
* Move DB call out of DatabricksHook.__init__ (#18339)<https://github.com/apache/airflow/pull/18339>: @kaxil<https://github.com/kaxil>
Provider docker: 2.2.0rc1<https://pypi.org/project/apache-airflow-providers-docker/2.2.0rc1>
* Add a Docker Taskflow decorator (#15330)<https://github.com/apache/airflow/pull/15330>: @dimberman<https://github.com/dimberman>
Provider elasticsearch: 2.0.3rc1<https://pypi.org/project/apache-airflow-providers-elasticsearch/2.0.3rc1>
* Fix Invalid log order in ElasticsearchTaskHandler (#17551)<https://github.com/apache/airflow/pull/17551>: @suhanovv<https://github.com/suhanovv>
* Adds secret backend and logging information to provider yaml (#17625)<https://github.com/apache/airflow/pull/17625>: @potiuk<https://github.com/potiuk>
Provider exasol: 2.0.1rc1<https://pypi.org/project/apache-airflow-providers-exasol/2.0.1rc1>
* ExasolHook get_pandas_df does not return pandas dataframe but None (#17850)<https://github.com/apache/airflow/pull/17850>: @Goodkat<https://github.com/Goodkat>
Provider google: 6.0.0rc1<https://pypi.org/project/apache-airflow-providers-google/6.0.0rc1>
* Migrate Google Cloud Build from Discovery API to Python SDK (#18184)<https://github.com/apache/airflow/pull/18184>: @ryanyuan<https://github.com/ryanyuan>
* Add index to the dataset name to have separate dataset for each DAG (#18459)<https://github.com/apache/airflow/pull/18459>: @deedmitrij<https://github.com/deedmitrij>
* Add missing init.py files for some test packages (#18142)<https://github.com/apache/airflow/pull/18142>: @potiuk<https://github.com/potiuk>
* Add possibility to run DAGs from system tests and see DAGs logs (#17868)<https://github.com/apache/airflow/pull/17868>: @deedmitrij<https://github.com/deedmitrij>
* Rename AzureDataLakeStorage to ADLS (#18493)<https://github.com/apache/airflow/pull/18493>: @eladkal<https://github.com/eladkal>
* Make next_dagrun_info take a data interval (#18088)<https://github.com/apache/airflow/pull/18088>: @uranusjr<https://github.com/uranusjr>
* Use parameters instead of params (#18143)<https://github.com/apache/airflow/pull/18143>: @msumit<https://github.com/msumit>
* New google operator: SQLToGoogleSheetsOperator (#17887)<https://github.com/apache/airflow/pull/17887>: @mariotaddeucci<https://github.com/mariotaddeucci>
* Fix part of Google system tests (#18494)<https://github.com/apache/airflow/pull/18494>: @mnojek<https://github.com/mnojek>
* Fix kubernetes engine system test (#18548)<https://github.com/apache/airflow/pull/18548>: @deedmitrij<https://github.com/deedmitrij>
* Fix BigQuery system test (#18373)<https://github.com/apache/airflow/pull/18373>: @deedmitrij<https://github.com/deedmitrij>
* Fix error when create external table using table resource (#17998)<https://github.com/apache/airflow/pull/17998>: @tnyz<https://github.com/tnyz>
* Fix BigQuery data extraction in BigQueryToMySqlOperator (#18073)<https://github.com/apache/airflow/pull/18073>: @wolfier<https://github.com/wolfier>
* Fix providers tests in main branch with eager upgrades (#18040)<https://github.com/apache/airflow/pull/18040>: @potiuk<https://github.com/potiuk>
* fix(CloudSqlProxyRunner): don't query connections from Airflow DB (#18006)<https://github.com/apache/airflow/pull/18006>: @m1racoli<https://github.com/m1racoli>
* Remove check for at least one schema in GCSToBigquery (#18150)<https://github.com/apache/airflow/pull/18150>: @c-nuro<https://github.com/c-nuro>
* deduplicate running jobs on BigQueryInsertJobOperator (#17496)<https://github.com/apache/airflow/pull/17496>: @blcksrx<https://github.com/blcksrx>
Provider hashicorp: 2.1.1rc1<https://pypi.org/project/apache-airflow-providers-hashicorp/2.1.1rc1>
* Fixing Vault AppRole authentication with CONN_URI (#18064)<https://github.com/apache/airflow/pull/18064>: @nathadfield<https://github.com/nathadfield>
Provider jdbc: 2.0.1rc1<https://pypi.org/project/apache-airflow-providers-jdbc/2.0.1rc1>
* Fix type annotations in OracleOperator, JdbcOperator, SqliteOperator (#17406)<https://github.com/apache/airflow/pull/17406>: @shadrus<https://github.com/shadrus>
Provider microsoft.azure: 3.2.0rc1<https://pypi.org/project/apache-airflow-providers-microsoft-azure/3.2.0rc1>
* Rename AzureDataLakeStorage to ADLS (#18493)<https://github.com/apache/airflow/pull/18493>: @eladkal<https://github.com/eladkal>
* Creating ADF pipeline run operator, sensor + ADF custom conn fields (#17885)<https://github.com/apache/airflow/pull/17885>: @josh-fell<https://github.com/josh-fell>
* Rename LocalToAzureDataLakeStorageOperator to LocalFilesystemToADLSOperator (#18168)<https://github.com/apache/airflow/pull/18168>: @eladkal<https://github.com/eladkal>
* Rename FileToWasbOperator to LocalFilesystemToWasbOperator (#18109)<https://github.com/apache/airflow/pull/18109>: @eladkal<https://github.com/eladkal>
* Fixed wasb hook attempting to create container when getting a blob client (#18287)<https://github.com/apache/airflow/pull/18287>: @ignaski<https://github.com/ignaski>
* Removing redundant relabeling of ADX conn field (#18386)<https://github.com/apache/airflow/pull/18386>: @josh-fell<https://github.com/josh-fell>
* Proper handling of Account URL custom conn field in AzureBatchHook (#18456)<https://github.com/apache/airflow/pull/18456>: @josh-fell<https://github.com/josh-fell>
Provider microsoft.psrp: 1.0.1rc1<https://pypi.org/project/apache-airflow-providers-microsoft-psrp/1.0.1rc1>
* Fix unexpected bug in exiting PSRPHook.client context manager (#18014)<https://github.com/apache/airflow/pull/18014>: @malthe<https://github.com/malthe>
Provider mongo: 2.1.0rc1<https://pypi.org/project/apache-airflow-providers-mongo/2.1.0rc1>
* Add Mongo projections to hook and transfer (#17379)<https://github.com/apache/airflow/pull/17379>: @JavierLopezT<https://github.com/JavierLopezT>
* Import Hooks lazily individually in providers manager (#17682)<https://github.com/apache/airflow/pull/17682>: @potiuk<https://github.com/potiuk>
Provider neo4j: 2.0.2rc1<https://pypi.org/project/apache-airflow-providers-neo4j/2.0.2rc1>
* fix Neo4jHook to get the query response (#18007)<https://github.com/apache/airflow/pull/18007>: @minu7<https://github.com/minu7>
Provider openfaas: 2.0.0rc1<https://pypi.org/project/apache-airflow-providers-openfaas/2.0.0rc1>
* Auto-apply apply_default decorator (#15667)<https://github.com/apache/airflow/pull/15667>: @ashb<https://github.com/ashb>
Provider papermill: 2.1.0rc1<https://pypi.org/project/apache-airflow-providers-papermill/2.1.0rc1>
* Add support for templated fields in PapermillOperator (#18357)<https://github.com/apache/airflow/pull/18357>: @eladkal<https://github.com/eladkal>
* Fix usage of range(len()) to enumerate (#18174)<https://github.com/apache/airflow/pull/18174>: @kaxil<https://github.com/kaxil>
Provider postgres: 2.3.0rc1<https://pypi.org/project/apache-airflow-providers-postgres/2.3.0rc1>
* Added upsert method on S3ToRedshift operator (#18027)<https://github.com/apache/airflow/pull/18027>: @mariotaddeucci<https://github.com/mariotaddeucci>
* Fix example dag of PostgresOperator (#18236)<https://github.com/apache/airflow/pull/18236>: @eladkal<https://github.com/eladkal>
Provider salesforce: 3.2.0rc1<https://pypi.org/project/apache-airflow-providers-salesforce/3.2.0rc1>
* Adding JWT, IP filtering, and direct session login support for SalesforceHook (#17399)<https://github.com/apache/airflow/pull/17399>: @josh-fell<https://github.com/josh-fell>
Provider samba: 3.0.0rc1<https://pypi.org/project/apache-airflow-providers-samba/3.0.0rc1>
* Switch to 'smbprotocol' library (#17273)<https://github.com/apache/airflow/pull/17273>: @malthe<https://github.com/malthe>
Provider slack: 4.1.0rc1<https://pypi.org/project/apache-airflow-providers-slack/4.1.0rc1>
* Restore 'filename' to template_fields of SlackAPIFileOperator (#18466)<https://github.com/apache/airflow/pull/18466>: @SayTen<https://github.com/SayTen>
Provider snowflake: 2.2.0rc1<https://pypi.org/project/apache-airflow-providers-snowflake/2.2.0rc1>
* Add Snowflake DQ Operators (#17741)<https://github.com/apache/airflow/pull/17741>: @denimalpaca<https://github.com/denimalpaca>
Provider sqlite: 2.0.1rc1<https://pypi.org/project/apache-airflow-providers-sqlite/2.0.1rc1>
* Fix sqlite hook - insert and replace functions (#17695)<https://github.com/apache/airflow/pull/17695>: @subkanthi<https://github.com/subkanthi>
Provider ssh: 2.2.0rc1<https://pypi.org/project/apache-airflow-providers-ssh/2.2.0rc1>
* [Airflow 16364] Add conn_timeout and cmd_timeout params to SSHOperator; add conn_timeout param to SSHHook (#17236)<https://github.com/apache/airflow/pull/17236>: @fatmumuhomer<https://github.com/fatmumuhomer>
Provider yandex: 2.1.0rc1<https://pypi.org/project/apache-airflow-providers-yandex/2.1.0rc1>
* Add autoscaling subcluster support and remove defaults (#17033)<https://github.com/apache/airflow/pull/17033>: @peter-volkov<https://github.com/peter-volkov>
Providers that do not need testing
We have a number of providers that had doc-only changes so they are not released.
Committer
* I acknowledge that I am a maintainer/committer of the Apache Airflow project.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub<https://github.com/apache/airflow/issues/18638>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AR7SQOMM3YGGUHNSX5ZPBM3UERQOBANCNFSM5FCKXUEA>.
Triage notifications on the go with GitHub Mobile for iOS<https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android<https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk closed issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk closed issue #18638:
URL: https://github.com/apache/airflow/issues/18638
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] denimalpaca commented on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
denimalpaca commented on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-933663115
I've tested 17741 running tests and seeing the operators work in a breeze
environment and Snowflake backend.
-Benji
On Thu, Sep 30, 2021 at 9:25 AM Jarek Potiuk ***@***.***>
wrote:
> Body
>
> I have a kind request for all the contributors to the latest provider
> packages release.
> Could you help us to test the RC versions of the providers and let us know
> in the comment,
> if the issue is addressed there.
> Providers that need testing
>
> Those are providers that require testing as there were some substantial
> changes introduced:
> Provider amazon: 2.3.0rc1
> <https://pypi.org/project/apache-airflow-providers-amazon/2.3.0rc1>
>
> - Add IAM Role Credentials to S3ToRedshiftTransfer and
> RedshiftToS3Transfer (#18156)
> <https://github.com/apache/airflow/pull/18156>: @john-jac
> <https://github.com/john-jac>
> - Adding missing replace param directive in docstring of
> SalesforceToS3Operator (#18241)
> <https://github.com/apache/airflow/pull/18241>: @josh-fell
> <https://github.com/josh-fell>
> - Added upsert method on S3ToRedshift operator (#18027)
> <https://github.com/apache/airflow/pull/18027>: @mariotaddeucci
> <https://github.com/mariotaddeucci>
> - Add Spark to the EMR cluster for the job flow examples (#17563)
> <https://github.com/apache/airflow/pull/17563>: @snolan-amount
> <https://github.com/snolan-amount>
> - Update s3_list.py (#18561)
> <https://github.com/apache/airflow/pull/18561>: @Xilorole
> <https://github.com/Xilorole>
> - ECSOperator realtime logging (#17626)
> <https://github.com/apache/airflow/pull/17626>: @codenamestif
> <https://github.com/codenamestif>
> - Deprecate default pod name in EKSPodOperator (#18036)
> <https://github.com/apache/airflow/pull/18036>: @mik-laj
> <https://github.com/mik-laj>
> - Aws secrets manager backend (#17448)
> <https://github.com/apache/airflow/pull/17448>: @JavierLopezT
> <https://github.com/JavierLopezT>
> - sftp_to_s3 stream file option (#17609)
> <https://github.com/apache/airflow/pull/17609>: @john-jac
> <https://github.com/john-jac>
> - AwsBaseHook make client_type & resource_type optional params for
> get_client_type & get_resource_type (#17987)
> <https://github.com/apache/airflow/pull/17987>: @eladkal
> <https://github.com/eladkal>
> - Delete unnecessary parameters in EKSPodOperator (#17960)
> <https://github.com/apache/airflow/pull/17960>: @mik-laj
> <https://github.com/mik-laj>
> - ECSOperator returns last logs when ECS task fails (#17209)
> <https://github.com/apache/airflow/pull/17209>: @pmalafosse
> <https://github.com/pmalafosse>
> - Refresh credentials for long-running pods on EKS (#17951)
> <https://github.com/apache/airflow/pull/17951>: @mik-laj
> <https://github.com/mik-laj>
>
> Provider apache.cassandra: 2.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-apache-cassandra/2.1.0rc1>
>
> - Adding a default conn ID value for Apache Cassandra sensors (#18620)
> <https://github.com/apache/airflow/pull/18620>: @josh-fell
> <https://github.com/josh-fell>
>
> Provider apache.hdfs: 2.1.1rc1
> <https://pypi.org/project/apache-airflow-providers-apache-hdfs/2.1.1rc1>
>
> - hdfs provider: fix deprecation warning in WebHDFSHook (#18331)
> <https://github.com/apache/airflow/pull/18331>: @Aakcht
> <https://github.com/Aakcht>
>
> Provider apache.hive: 2.0.2rc1
> <https://pypi.org/project/apache-airflow-providers-apache-hive/2.0.2rc1>
>
> - HiveHook fix get_pandas_df() failure when it tries to read an empty
> table (#17777) <https://github.com/apache/airflow/pull/17777>: @iblaine
> <https://github.com/iblaine>
>
> Provider apache.livy: 2.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-apache-livy/2.1.0rc1>
>
> - Fetching and logging Livy session logs for LivyOperator (#17393)
> <https://github.com/apache/airflow/pull/17393>: @sreenath-kamath
> <https://github.com/sreenath-kamath>
>
> Provider asana: 1.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-asana/1.1.0rc1>
>
> - Use built-in cached_property on Python 3.8 for Asana provider
> (#17597) <https://github.com/apache/airflow/pull/17597>: @kaxil
> <https://github.com/kaxil>
>
> Provider cncf.kubernetes: 2.0.3rc1
> <https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/2.0.3rc1>
>
> - Fix KubernetesPodOperator reattach when not deleting pods (#18070)
> <https://github.com/apache/airflow/pull/18070>: @jedcunningham
> <https://github.com/jedcunningham>
> - Make Kubernetes job description fit on one log line (#18377)
> <https://github.com/apache/airflow/pull/18377>: @collinmcnulty
> <https://github.com/collinmcnulty>
> - Do not fail KubernetesPodOperator tasks if log following fails
> (#17649) <https://github.com/apache/airflow/pull/17649>: @baryluk
> <https://github.com/baryluk>
>
> Provider databricks: 2.0.2rc1
> <https://pypi.org/project/apache-airflow-providers-databricks/2.0.2rc1>
>
> - Move DB call out of DatabricksHook.__init__ (#18339)
> <https://github.com/apache/airflow/pull/18339>: @kaxil
> <https://github.com/kaxil>
>
> Provider docker: 2.2.0rc1
> <https://pypi.org/project/apache-airflow-providers-docker/2.2.0rc1>
>
> - Add a Docker Taskflow decorator (#15330)
> <https://github.com/apache/airflow/pull/15330>: @dimberman
> <https://github.com/dimberman>
>
> Provider elasticsearch: 2.0.3rc1
> <https://pypi.org/project/apache-airflow-providers-elasticsearch/2.0.3rc1>
>
> - Fix Invalid log order in ElasticsearchTaskHandler (#17551)
> <https://github.com/apache/airflow/pull/17551>: @suhanovv
> <https://github.com/suhanovv>
> - Adds secret backend and logging information to provider yaml (#17625)
> <https://github.com/apache/airflow/pull/17625>: @potiuk
> <https://github.com/potiuk>
>
> Provider exasol: 2.0.1rc1
> <https://pypi.org/project/apache-airflow-providers-exasol/2.0.1rc1>
>
> - ExasolHook get_pandas_df does not return pandas dataframe but None
> (#17850) <https://github.com/apache/airflow/pull/17850>: @Goodkat
> <https://github.com/Goodkat>
>
> Provider google: 6.0.0rc1
> <https://pypi.org/project/apache-airflow-providers-google/6.0.0rc1>
>
> - Migrate Google Cloud Build from Discovery API to Python SDK (#18184)
> <https://github.com/apache/airflow/pull/18184>: @ryanyuan
> <https://github.com/ryanyuan>
> - Add index to the dataset name to have separate dataset for each DAG
> (#18459) <https://github.com/apache/airflow/pull/18459>: @deedmitrij
> <https://github.com/deedmitrij>
> - Add missing *init*.py files for some test packages (#18142)
> <https://github.com/apache/airflow/pull/18142>: @potiuk
> <https://github.com/potiuk>
> - Add possibility to run DAGs from system tests and see DAGs logs
> (#17868) <https://github.com/apache/airflow/pull/17868>: @deedmitrij
> <https://github.com/deedmitrij>
> - Rename AzureDataLakeStorage to ADLS (#18493)
> <https://github.com/apache/airflow/pull/18493>: @eladkal
> <https://github.com/eladkal>
> - Make next_dagrun_info take a data interval (#18088)
> <https://github.com/apache/airflow/pull/18088>: @uranusjr
> <https://github.com/uranusjr>
> - Use parameters instead of params (#18143)
> <https://github.com/apache/airflow/pull/18143>: @msumit
> <https://github.com/msumit>
> - New google operator: SQLToGoogleSheetsOperator (#17887)
> <https://github.com/apache/airflow/pull/17887>: @mariotaddeucci
> <https://github.com/mariotaddeucci>
> - Fix part of Google system tests (#18494)
> <https://github.com/apache/airflow/pull/18494>: @mnojek
> <https://github.com/mnojek>
> - Fix kubernetes engine system test (#18548)
> <https://github.com/apache/airflow/pull/18548>: @deedmitrij
> <https://github.com/deedmitrij>
> - Fix BigQuery system test (#18373)
> <https://github.com/apache/airflow/pull/18373>: @deedmitrij
> <https://github.com/deedmitrij>
> - Fix error when create external table using table resource (#17998)
> <https://github.com/apache/airflow/pull/17998>: @tnyz
> <https://github.com/tnyz>
> - Fix BigQuery data extraction in BigQueryToMySqlOperator (#18073)
> <https://github.com/apache/airflow/pull/18073>: @wolfier
> <https://github.com/wolfier>
> - Fix providers tests in main branch with eager upgrades (#18040)
> <https://github.com/apache/airflow/pull/18040>: @potiuk
> <https://github.com/potiuk>
> - fix(CloudSqlProxyRunner): don't query connections from Airflow DB
> (#18006) <https://github.com/apache/airflow/pull/18006>: @m1racoli
> <https://github.com/m1racoli>
> - Remove check for at least one schema in GCSToBigquery (#18150)
> <https://github.com/apache/airflow/pull/18150>: @c-nuro
> <https://github.com/c-nuro>
> - deduplicate running jobs on BigQueryInsertJobOperator (#17496)
> <https://github.com/apache/airflow/pull/17496>: @blcksrx
> <https://github.com/blcksrx>
>
> Provider hashicorp: 2.1.1rc1
> <https://pypi.org/project/apache-airflow-providers-hashicorp/2.1.1rc1>
>
> - Fixing Vault AppRole authentication with CONN_URI (#18064)
> <https://github.com/apache/airflow/pull/18064>: @nathadfield
> <https://github.com/nathadfield>
>
> Provider jdbc: 2.0.1rc1
> <https://pypi.org/project/apache-airflow-providers-jdbc/2.0.1rc1>
>
> - Fix type annotations in OracleOperator, JdbcOperator, SqliteOperator
> (#17406) <https://github.com/apache/airflow/pull/17406>: @shadrus
> <https://github.com/shadrus>
>
> Provider microsoft.azure: 3.2.0rc1
> <https://pypi.org/project/apache-airflow-providers-microsoft-azure/3.2.0rc1>
>
> - Rename AzureDataLakeStorage to ADLS (#18493)
> <https://github.com/apache/airflow/pull/18493>: @eladkal
> <https://github.com/eladkal>
> - Creating ADF pipeline run operator, sensor + ADF custom conn fields
> (#17885) <https://github.com/apache/airflow/pull/17885>: @josh-fell
> <https://github.com/josh-fell>
> - Rename LocalToAzureDataLakeStorageOperator to
> LocalFilesystemToADLSOperator (#18168)
> <https://github.com/apache/airflow/pull/18168>: @eladkal
> <https://github.com/eladkal>
> - Rename FileToWasbOperator to LocalFilesystemToWasbOperator (#18109)
> <https://github.com/apache/airflow/pull/18109>: @eladkal
> <https://github.com/eladkal>
> - Fixed wasb hook attempting to create container when getting a blob
> client (#18287) <https://github.com/apache/airflow/pull/18287>:
> @ignaski <https://github.com/ignaski>
> - Removing redundant relabeling of ADX conn field (#18386)
> <https://github.com/apache/airflow/pull/18386>: @josh-fell
> <https://github.com/josh-fell>
> - Proper handling of Account URL custom conn field in AzureBatchHook
> (#18456) <https://github.com/apache/airflow/pull/18456>: @josh-fell
> <https://github.com/josh-fell>
>
> Provider microsoft.psrp: 1.0.1rc1
> <https://pypi.org/project/apache-airflow-providers-microsoft-psrp/1.0.1rc1>
>
> - Fix unexpected bug in exiting PSRPHook.client context manager
> (#18014) <https://github.com/apache/airflow/pull/18014>: @malthe
> <https://github.com/malthe>
>
> Provider mongo: 2.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-mongo/2.1.0rc1>
>
> - Add Mongo projections to hook and transfer (#17379)
> <https://github.com/apache/airflow/pull/17379>: @JavierLopezT
> <https://github.com/JavierLopezT>
> - Import Hooks lazily individually in providers manager (#17682)
> <https://github.com/apache/airflow/pull/17682>: @potiuk
> <https://github.com/potiuk>
>
> Provider neo4j: 2.0.2rc1
> <https://pypi.org/project/apache-airflow-providers-neo4j/2.0.2rc1>
>
> - fix Neo4jHook to get the query response (#18007)
> <https://github.com/apache/airflow/pull/18007>: @minu7
> <https://github.com/minu7>
>
> Provider openfaas: 2.0.0rc1
> <https://pypi.org/project/apache-airflow-providers-openfaas/2.0.0rc1>
>
> - Auto-apply apply_default decorator (#15667)
> <https://github.com/apache/airflow/pull/15667>: @ashb
> <https://github.com/ashb>
>
> Provider papermill: 2.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-papermill/2.1.0rc1>
>
> - Add support for templated fields in PapermillOperator (#18357)
> <https://github.com/apache/airflow/pull/18357>: @eladkal
> <https://github.com/eladkal>
> - Fix usage of range(len()) to enumerate (#18174)
> <https://github.com/apache/airflow/pull/18174>: @kaxil
> <https://github.com/kaxil>
>
> Provider postgres: 2.3.0rc1
> <https://pypi.org/project/apache-airflow-providers-postgres/2.3.0rc1>
>
> - Added upsert method on S3ToRedshift operator (#18027)
> <https://github.com/apache/airflow/pull/18027>: @mariotaddeucci
> <https://github.com/mariotaddeucci>
> - Fix example dag of PostgresOperator (#18236)
> <https://github.com/apache/airflow/pull/18236>: @eladkal
> <https://github.com/eladkal>
>
> Provider salesforce: 3.2.0rc1
> <https://pypi.org/project/apache-airflow-providers-salesforce/3.2.0rc1>
>
> - Adding JWT, IP filtering, and direct session login support for
> SalesforceHook (#17399) <https://github.com/apache/airflow/pull/17399>:
> @josh-fell <https://github.com/josh-fell>
>
> Provider samba: 3.0.0rc1
> <https://pypi.org/project/apache-airflow-providers-samba/3.0.0rc1>
>
> - Switch to 'smbprotocol' library (#17273)
> <https://github.com/apache/airflow/pull/17273>: @malthe
> <https://github.com/malthe>
>
> Provider slack: 4.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-slack/4.1.0rc1>
>
> - Restore 'filename' to template_fields of SlackAPIFileOperator
> (#18466) <https://github.com/apache/airflow/pull/18466>: @SayTen
> <https://github.com/SayTen>
>
> Provider snowflake: 2.2.0rc1
> <https://pypi.org/project/apache-airflow-providers-snowflake/2.2.0rc1>
>
> - Add Snowflake DQ Operators (#17741)
> <https://github.com/apache/airflow/pull/17741>: @denimalpaca
> <https://github.com/denimalpaca>
>
> Provider sqlite: 2.0.1rc1
> <https://pypi.org/project/apache-airflow-providers-sqlite/2.0.1rc1>
>
> - Fix sqlite hook - insert and replace functions (#17695)
> <https://github.com/apache/airflow/pull/17695>: @subkanthi
> <https://github.com/subkanthi>
>
> Provider ssh: 2.2.0rc1
> <https://pypi.org/project/apache-airflow-providers-ssh/2.2.0rc1>
>
> - [Airflow 16364] Add conn_timeout and cmd_timeout params to
> SSHOperator; add conn_timeout param to SSHHook (#17236)
> <https://github.com/apache/airflow/pull/17236>: @fatmumuhomer
> <https://github.com/fatmumuhomer>
>
> Provider yandex: 2.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-yandex/2.1.0rc1>
>
> - Add autoscaling subcluster support and remove defaults (#17033)
> <https://github.com/apache/airflow/pull/17033>: @peter-volkov
> <https://github.com/peter-volkov>
>
> Providers that do not need testing
>
> We have a number of providers that had doc-only changes so they are not
> released.
> Committer
>
> - I acknowledge that I am a maintainer/committer of the Apache Airflow
> project.
>
> —
> You are receiving this because you were mentioned.
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/airflow/issues/18638>, or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AAUH2372VWWXUZNIXO6C2TDUERQNRANCNFSM5FCKXUEA>
> .
> Triage notifications on the go with GitHub Mobile for iOS
> <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675>
> or Android
> <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.
>
>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mik-laj commented on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
mik-laj commented on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-931519797
@tnyz We don't have a public environment, but you can use docker-compose. See: http://airflow.apache.org/docs/apache-airflow/stable/start/docker.html
To update packages, you should add ``_PIP_ADDITIONAL_REQUIREMENTS`` environment variable to `.env` file.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] m1racoli commented on issue #18638: Status of testing Providers that were prepared on September 30, 2021
Posted by GitBox <gi...@apache.org>.
m1racoli commented on issue #18638:
URL: https://github.com/apache/airflow/issues/18638#issuecomment-933652472
https://github.com/apache/airflow/pull/18006 works as expected 👍🏼
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org