You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/07/13 21:28:22 UTC
[GitHub] [airflow] potiuk opened a new issue, #25037: Status of testing Providers that were prepared on July 13, 2022
potiuk opened a new issue, #25037:
URL: https://github.com/apache/airflow/issues/25037
### Body
I have a kind request for all the contributors to the latest provider packages release.
Could you please help us to test the RC versions of the providers?
Let us know in the comment, whether the issue is addressed.
Those are providers that require testing as there were some substantial changes introduced:
## Provider [airbyte: 3.1.0rc1](https://pypi.org/project/apache-airflow-providers-airbyte/3.1.0rc1)
- [ ] [`AirbyteHook` add cancel job option (#24593)](https://github.com/apache/airflow/pull/24593): @sivankumar86
## Provider [alibaba: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-alibaba/2.0.1rc1)
- [ ] [Update providers to use functools compat for ``cached_property`` (#24582)](https://github.com/apache/airflow/pull/24582): @josh-fell
## Provider [amazon: 4.1.0rc1](https://pypi.org/project/apache-airflow-providers-amazon/4.1.0rc1)
- [ ] [Add test_connection method to AWS hook (#24662)](https://github.com/apache/airflow/pull/24662): @Taragolis
- [ ] [Add AWS operators to create and delete RDS Database (#24099)](https://github.com/apache/airflow/pull/24099): @eskarimov
- [ ] [Add batch option to `SqsSensor` (#24554)](https://github.com/apache/airflow/pull/24554): @LaPetiteSouris
- [ ] [Add AWS Batch & AWS CloudWatch Extra Links (#24406)](https://github.com/apache/airflow/pull/24406): @Taragolis
- [ ] [Refactoring EmrClusterLink and add it for other AWS EMR Operators (#24294)](https://github.com/apache/airflow/pull/24294): @Taragolis
- [ ] [Move all SQL classes to common-sql provider (#24836)](https://github.com/apache/airflow/pull/24836): @potiuk
- [ ] [Amazon appflow (#24057)](https://github.com/apache/airflow/pull/24057): @igorborgest
- [ ] [Make extra_args in S3Hook immutable between calls (#24527)](https://github.com/apache/airflow/pull/24527): @Taragolis
- [ ] [Refactor and fix AWS secret manager invalid exception (#24898)](https://github.com/apache/airflow/pull/24898): @gitstart-airflow
- [ ] [fix: RedshiftDataHook and RdsHook not use cached connection (#24387)](https://github.com/apache/airflow/pull/24387): @Taragolis
- [ ] [Fix links to sources for examples (#24386)](https://github.com/apache/airflow/pull/24386): @potiuk
- [ ] [Fix S3KeySensor (#24378)](https://github.com/apache/airflow/pull/24378): @vincbeck
- [ ] [Fix: `emr_conn_id` should be optional in `EmrCreateJobFlowOperator` (#24306)](https://github.com/apache/airflow/pull/24306): @pankajastro
- [ ] [Update providers to use functools compat for ``cached_property`` (#24582)](https://github.com/apache/airflow/pull/24582): @josh-fell
## Provider [apache.drill: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-apache-drill/2.1.0rc1)
- [ ] [Move all SQL classes to common-sql provider (#24836)](https://github.com/apache/airflow/pull/24836): @potiuk
## Provider [apache.druid: 3.1.0rc1](https://pypi.org/project/apache-airflow-providers-apache-druid/3.1.0rc1)
- [ ] [Move all SQL classes to common-sql provider (#24836)](https://github.com/apache/airflow/pull/24836): @potiuk
## Provider [apache.hdfs: 3.0.1rc1](https://pypi.org/project/apache-airflow-providers-apache-hdfs/3.0.1rc1)
- [ ] [`WebHDFSHook` Bugfix/optional port (#24550)](https://github.com/apache/airflow/pull/24550): @ankurbajaj9
## Provider [apache.hive: 3.1.0rc1](https://pypi.org/project/apache-airflow-providers-apache-hive/3.1.0rc1)
- [ ] [Move all SQL classes to common-sql provider (#24836)](https://github.com/apache/airflow/pull/24836): @potiuk
- [ ] [fix connection extra parameter `auth_mechanism` in `HiveMetastoreHook` and `HiveServer2Hook` (#24713)](https://github.com/apache/airflow/pull/24713): @eladkal
## Provider [apache.pinot: 3.1.0rc1](https://pypi.org/project/apache-airflow-providers-apache-pinot/3.1.0rc1)
- [ ] [Move all SQL classes to common-sql provider (#24836)](https://github.com/apache/airflow/pull/24836): @potiuk
## Provider [asana: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-asana/2.0.1rc1)
- [ ] [Update providers to use functools compat for ``cached_property`` (#24582)](https://github.com/apache/airflow/pull/24582): @josh-fell
## Provider [cncf.kubernetes: 4.2.0rc1](https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/4.2.0rc1)
- [ ] [Add `airflow_kpo_in_cluster` label to KPO pods (#24658)](https://github.com/apache/airflow/pull/24658): @jedcunningham
- [ ] [Find Pod Before Cleanup In KubernetesPodOperator Execution (#22092)](https://github.com/apache/airflow/pull/22092): @michaelmicheal
- [ ] [Revert "Fix await_container_completion condition (#23883)" (#24474)](https://github.com/apache/airflow/pull/24474): @jedcunningham
- [ ] [Update providers to use functools compat for ``cached_property`` (#24582)](https://github.com/apache/airflow/pull/24582): @josh-fell
## Provider [databricks: 3.1.0rc1](https://pypi.org/project/apache-airflow-providers-databricks/3.1.0rc1)
- [ ] [Added databricks_conn_id as templated field (#24945)](https://github.com/apache/airflow/pull/24945): @skadyan
- [ ] [Add test_connection method to Databricks hook (#24617)](https://github.com/apache/airflow/pull/24617): @phanikumv
- [ ] [Move all SQL classes to common-sql provider (#24836)](https://github.com/apache/airflow/pull/24836): @potiuk
- [ ] [Update providers to use functools compat for ``cached_property`` (#24582)](https://github.com/apache/airflow/pull/24582): @josh-fell
## Provider [dbt.cloud: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-dbt-cloud/2.0.1rc1)
- [ ] [Update providers to use functools compat for ``cached_property`` (#24582)](https://github.com/apache/airflow/pull/24582): @josh-fell
## Provider [docker: 3.1.0rc1](https://pypi.org/project/apache-airflow-providers-docker/3.1.0rc1)
- [ ] [Force-remove container after DockerOperator execution (#23160)](https://github.com/apache/airflow/pull/23160): @zengbotang
- [ ] [`DockerOperator` fix cli.logs giving character array instead of string (#24726)](https://github.com/apache/airflow/pull/24726): @pasalkarsachin1
## Provider [elasticsearch: 4.1.0rc1](https://pypi.org/project/apache-airflow-providers-elasticsearch/4.1.0rc1)
- [ ] [Adding ElasticserachPythonHook - ES Hook With The Python Client (#24895)](https://github.com/apache/airflow/pull/24895): @alexkruc
- [ ] [Move all SQL classes to common-sql provider (#24836)](https://github.com/apache/airflow/pull/24836): @potiuk
- [ ] [Move fallible ti.task.dag assignment back inside try/except block (#24533) (#24592)](https://github.com/apache/airflow/pull/24592): @ejk43
## Provider [exasol: 3.1.0rc1](https://pypi.org/project/apache-airflow-providers-exasol/3.1.0rc1)
- [ ] [Move all SQL classes to common-sql provider (#24836)](https://github.com/apache/airflow/pull/24836): @potiuk
## Provider [facebook: 3.0.1rc1](https://pypi.org/project/apache-airflow-providers-facebook/3.0.1rc1)
- [ ] [Update providers to use functools compat for ``cached_property`` (#24582)](https://github.com/apache/airflow/pull/24582): @josh-fell
## Provider [ftp: 3.1.0rc1](https://pypi.org/project/apache-airflow-providers-ftp/3.1.0rc1)
- [ ] [Add blocksize arg for ftp hook (#24860)](https://github.com/apache/airflow/pull/24860): @kevgeo
## Provider [github: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-github/2.1.0rc1)
- [ ] [Add test connection functionality to `GithubHook` (#24903)](https://github.com/apache/airflow/pull/24903): @josh-fell
## Provider [google: 8.2.0rc1](https://pypi.org/project/apache-airflow-providers-google/8.2.0rc1)
- [ ] [PubSub assets & system tests migration (AIP-47) (#24867)](https://github.com/apache/airflow/pull/24867): @wojsamjan
- [ ] [Add handling state of existing Dataproc batch (#24924)](https://github.com/apache/airflow/pull/24924): @danielvdende
- [ ] [Add links for Google Kubernetes Engine operators (#24786)](https://github.com/apache/airflow/pull/24786): @MaksYermak
- [ ] [Add test_connection method to GoogleBaseHook (#24682)](https://github.com/apache/airflow/pull/24682): @phanikumv
- [ ] [Add gcp_conn_id argument to GoogleDriveToLocalOperator (#24622)](https://github.com/apache/airflow/pull/24622): @aspain
- [ ] [Add DeprecationWarning for column_transformations parameter in AutoML (#24467)](https://github.com/apache/airflow/pull/24467): @MaksYermak
- [ ] [Modify BigQueryCreateExternalTableOperator to use updated hook function (#24363)](https://github.com/apache/airflow/pull/24363): @cswpy
- [ ] [Move all SQL classes to common-sql provider (#24836)](https://github.com/apache/airflow/pull/24836): @potiuk
- [ ] [Datacatalog assets & system tests migration (AIP-47) (#24600)](https://github.com/apache/airflow/pull/24600): @wojsamjan
- [ ] [Upgrade FAB to 4.1.1 (#24399)](https://github.com/apache/airflow/pull/24399): @potiuk
- [ ] [GCSDeleteObjectsOperator empty prefix bug fix (#24353)](https://github.com/apache/airflow/pull/24353): @Lavedonio
- [ ] [perf(BigQuery): pass table_id as str type (#23141)](https://github.com/apache/airflow/pull/23141): @bryan824
- [ ] [Update providers to use functools compat for ``cached_property`` (#24582)](https://github.com/apache/airflow/pull/24582): @josh-fell
## Provider [hashicorp: 3.0.1rc1](https://pypi.org/project/apache-airflow-providers-hashicorp/3.0.1rc1)
- [ ] [Update providers to use functools compat for ``cached_property`` (#24582)](https://github.com/apache/airflow/pull/24582): @josh-fell
## Provider [http: 4.0.0rc1](https://pypi.org/project/apache-airflow-providers-http/4.0.0rc1)
- [ ] [Add TCP_KEEPALIVE option to http provider (#24967)](https://github.com/apache/airflow/pull/24967): @potiuk
## Provider [jdbc: 3.1.0rc1](https://pypi.org/project/apache-airflow-providers-jdbc/3.1.0rc1)
- [ ] [Move all SQL classes to common-sql provider (#24836)](https://github.com/apache/airflow/pull/24836): @potiuk
## Provider [jira: 3.0.1rc1](https://pypi.org/project/apache-airflow-providers-jira/3.0.1rc1)
- [ ] [Fix the error caused by passing unused context in JiraSensor.poke (#23352)](https://github.com/apache/airflow/pull/23352): @kianelbo
## Provider [microsoft.azure: 4.1.0rc1](https://pypi.org/project/apache-airflow-providers-microsoft-azure/4.1.0rc1)
- [ ] [Add `test_connection` method to AzureCosmosDBHook (#25018)](https://github.com/apache/airflow/pull/25018): @phanikumv
- [ ] [Add test_connection method to AzureFileShareHook (#24843)](https://github.com/apache/airflow/pull/24843): @phanikumv
- [ ] [Add test_connection method to Azure WasbHook (#24771)](https://github.com/apache/airflow/pull/24771): @phanikumv
- [ ] [Implement Azure service bus subscription (create, delete)Operators (#24625)](https://github.com/apache/airflow/pull/24625): @bharanidharan14
- [ ] [Implement Azure Service Bus Queue Operators (#24038)](https://github.com/apache/airflow/pull/24038): @bharanidharan14
- [ ] [Update providers to use functools compat for ``cached_property`` (#24582)](https://github.com/apache/airflow/pull/24582): @josh-fell
## Provider [microsoft.mssql: 3.1.0rc1](https://pypi.org/project/apache-airflow-providers-microsoft-mssql/3.1.0rc1)
- [ ] [Move all SQL classes to common-sql provider (#24836)](https://github.com/apache/airflow/pull/24836): @potiuk
## Provider [mysql: 3.1.0rc1](https://pypi.org/project/apache-airflow-providers-mysql/3.1.0rc1)
- [ ] [Move all SQL classes to common-sql provider (#24836)](https://github.com/apache/airflow/pull/24836): @potiuk
- [ ] [Close the MySQL connections once operations are done. (#24508)](https://github.com/apache/airflow/pull/24508): @pavel-lexyr
## Provider [odbc: 3.1.0rc1](https://pypi.org/project/apache-airflow-providers-odbc/3.1.0rc1)
- [ ] [Move all SQL classes to common-sql provider (#24836)](https://github.com/apache/airflow/pull/24836): @potiuk
## Provider [oracle: 3.2.0rc1](https://pypi.org/project/apache-airflow-providers-oracle/3.2.0rc1)
- [ ] [Move all SQL classes to common-sql provider (#24836)](https://github.com/apache/airflow/pull/24836): @potiuk
## Provider [postgres: 5.1.0rc1](https://pypi.org/project/apache-airflow-providers-postgres/5.1.0rc1)
- [ ] [Move all SQL classes to common-sql provider (#24836)](https://github.com/apache/airflow/pull/24836): @potiuk
## Provider [presto: 3.1.0rc1](https://pypi.org/project/apache-airflow-providers-presto/3.1.0rc1)
- [ ] [Adding generic SqlToSlackOperator (#24663)](https://github.com/apache/airflow/pull/24663): @alexkruc
- [ ] [Move all SQL classes to common-sql provider (#24836)](https://github.com/apache/airflow/pull/24836): @potiuk
## Provider [qubole: 3.1.0rc1](https://pypi.org/project/apache-airflow-providers-qubole/3.1.0rc1)
- [ ] [Move all SQL classes to common-sql provider (#24836)](https://github.com/apache/airflow/pull/24836): @potiuk
## Provider [salesforce: 5.0.0rc1](https://pypi.org/project/apache-airflow-providers-salesforce/5.0.0rc1)
- [ ] [Remove Tableau from Salesforce provider (#23747)](https://github.com/apache/airflow/pull/23747): @eladkal
- [ ] [Add support for Salesforce bulk api (#24473)](https://github.com/apache/airflow/pull/24473): @ishiis
- [ ] [Update providers to use functools compat for ``cached_property`` (#24582)](https://github.com/apache/airflow/pull/24582): @josh-fell
## Provider [sftp: 3.1.0rc1](https://pypi.org/project/apache-airflow-providers-sftp/3.1.0rc1)
- [ ] [Convert sftp hook to use paramiko instead of pysftp (#24512)](https://github.com/apache/airflow/pull/24512): @pauldalewilliams
- [ ] [Update `actual_file_to_check` with rendered `path` (#24451)](https://github.com/apache/airflow/pull/24451): @remem9527
## Provider [slack: 5.1.0rc1](https://pypi.org/project/apache-airflow-providers-slack/5.1.0rc1)
- [ ] [Move all SQL classes to common-sql provider (#24836)](https://github.com/apache/airflow/pull/24836): @potiuk
- [ ] [Adding generic SqlToSlackOperator (#24663)](https://github.com/apache/airflow/pull/24663): @alexkruc
## Provider [snowflake: 3.1.0rc1](https://pypi.org/project/apache-airflow-providers-snowflake/3.1.0rc1)
- [ ] [Adding generic SqlToSlackOperator (#24663)](https://github.com/apache/airflow/pull/24663): @alexkruc
- [ ] [Move all SQL classes to common-sql provider (#24836)](https://github.com/apache/airflow/pull/24836): @potiuk
- [ ] [Pattern parameter in S3ToSnowflakeOperator (#24571)](https://github.com/apache/airflow/pull/24571): @Taragolis
- [ ] [S3ToSnowflakeOperator: escape single quote in s3_keys (#24607)](https://github.com/apache/airflow/pull/24607): @Taragolis
## Provider [sqlite: 3.1.0rc1](https://pypi.org/project/apache-airflow-providers-sqlite/3.1.0rc1)
- [ ] [Move all SQL classes to common-sql provider (#24836)](https://github.com/apache/airflow/pull/24836): @potiuk
## Provider [ssh: 3.1.0rc1](https://pypi.org/project/apache-airflow-providers-ssh/3.1.0rc1)
- [ ] [Less verbose logging in ssh operator (#24915)](https://github.com/apache/airflow/pull/24915): @hsnprsd
- [ ] [Convert sftp hook to use paramiko instead of pysftp (#24512)](https://github.com/apache/airflow/pull/24512): @pauldalewilliams
- [ ] [Update providers to use functools compat for ``cached_property`` (#24582)](https://github.com/apache/airflow/pull/24582): @josh-fell
## Provider [tableau: 3.0.1rc1](https://pypi.org/project/apache-airflow-providers-tableau/3.0.1rc1)
- [ ] [Remove Tableau from Salesforce provider (#23747)](https://github.com/apache/airflow/pull/23747): @eladkal
## Provider [trino: 3.1.0rc1](https://pypi.org/project/apache-airflow-providers-trino/3.1.0rc1)
- [ ] [Move all SQL classes to common-sql provider (#24836)](https://github.com/apache/airflow/pull/24836): @potiuk
- [ ] [Add test_connection method to Trino hook (#24583)](https://github.com/apache/airflow/pull/24583): @phanikumv
- [ ] [Add on_kill() to kill Trino query if Airflow task is killed (#24559)](https://github.com/apache/airflow/pull/24559): @phanikumv
- [ ] [Add TrinoOperator (#24415)](https://github.com/apache/airflow/pull/24415): @phanikumv
## Provider [vertica: 3.1.0rc1](https://pypi.org/project/apache-airflow-providers-vertica/3.1.0rc1)
- [ ] [Move all SQL classes to common-sql provider (#24836)](https://github.com/apache/airflow/pull/24836): @potiuk
The guidelines on how to test providers can be found in
[Verify providers by contributors](https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md#verify-by-contributors)
### Committer
- [X] I acknowledge that I am a maintainer/committer of the Apache Airflow project.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1186208191
> #24617 for Databricks has an issue because selected API is available only on AWS, and will fail on Azure/GCP...
Good check. That is not a regression, test_connection is a new method/functionality added and it partially works, so it's not a reason to cancel it. It can be adressed in the next release.
> More general question - is it possible to subscribe to all Databricks-related RPs?
We discussed it before, unfortunately CODEOWNER (which is a bad name BTW) only allows commiters to be marked as reviewer to part of the repo, which is a bummer (because it's not a codeowner by any means is just assigning people to be reviewers which has nothing to do with either being committer or owner).
For now, the best you can do (and it should be pretty accurate) is to subscribe to all notifiction and write a custom filter - if you are using gmail (that's what I'd do at least). It's actually pretty accurate. All PRs/commit messages with databrics contain list of changed files so subscribing to anything with "providers/databricks" should do the job nicely and you can choose how it should be surfaced in your email (and you can archive/store non-matching emails from commts@github elsewhere).
In the future (the mixed-governance was a pre-requisite to it) we plan to split providers to separate repos and then it will be much more flexible and you will be able to write more precise filters.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1184791652
> @potiuk Re #24512 does the fact that I removed deprecated parameters necessitate a major version bump for the SFTP provider? See the second bullet point on my PR.
Good point. Yes. We need to add a major release for it. I missed the removal. I will remove it from the release and make a new release for SFTP only.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] Taragolis commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
Taragolis commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1184757865
Working as expected: #24662 #24406 #24294
Also check depreciation warnings from #24670 - not listed here but included in `apache-airflow-providers-amazon==4.1.0rc1`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk closed issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
potiuk closed issue #25037: Status of testing Providers that were prepared on July 13, 2022
URL: https://github.com/apache/airflow/issues/25037
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] eskarimov commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
eskarimov commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1184589184
Tested new operators introduced in #24099, working correctly.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1186264624
> Not serious at all. It seems the authentication is missing since the original code only. Nothing is breaking , it just needs additional lines to be able to work in my environment.
Right. Then we can release it in next wave :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1186308923
(both SFTP/Tabular will be rc1 then).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] alexkruc commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
alexkruc commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1184619639
Checked mine - #24663, #24895. Looks good.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1184279162
Thanks @pankajkoti - excellent point, I followed up with some extra comment/questions. I am happy to do either way (continue with self.hook removal, or restore it in RC2, and I think we should discuss what's best approach in general for deferred operators.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] bharanidharan14 commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
bharanidharan14 commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1184309285
Tested the following PR's with the respective rc image and its working fine.
Implement Azure service bus subscription (create, delete)Operators (#24625): @bharanidharan14
Implement Azure Service Bus Queue Operators (#24038): @bharanidharan14
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1184512912
> It's a little difficult to test https://github.com/apache/airflow/pull/24582 since I don't have the means to test all of these providers in the wild, but I spot-checked the package files and +1
Indeed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1184342841
I tested all my changes - mostly they were about common-sql extraction and dependencies. They all looks good!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] ankurbajaj9 commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
ankurbajaj9 commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1185587532
I see an issue with (#24550)
<https://github.com/apache/airflow/pull/24550>.will
try to raise a PR
Regards
Ankur Bajaj
On Wed, 13 Jul 2022 at 23:28, Jarek Potiuk ***@***.***> wrote:
> Body
>
> I have a kind request for all the contributors to the latest provider
> packages release.
> Could you please help us to test the RC versions of the providers?
>
> Let us know in the comment, whether the issue is addressed.
>
> Those are providers that require testing as there were some substantial
> changes introduced:
> Provider airbyte: 3.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-airbyte/3.1.0rc1>
>
> - AirbyteHook add cancel job option (#24593)
> <https://github.com/apache/airflow/pull/24593>: @sivankumar86
> <https://github.com/sivankumar86>
>
> Provider alibaba: 2.0.1rc1
> <https://pypi.org/project/apache-airflow-providers-alibaba/2.0.1rc1>
>
> - Update providers to use functools compat for cached_property (#24582)
> <https://github.com/apache/airflow/pull/24582>: @josh-fell
> <https://github.com/josh-fell>
>
> Provider amazon: 4.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-amazon/4.1.0rc1>
>
> - Add test_connection method to AWS hook (#24662)
> <https://github.com/apache/airflow/pull/24662>: @Taragolis
> <https://github.com/Taragolis>
> - Add AWS operators to create and delete RDS Database (#24099)
> <https://github.com/apache/airflow/pull/24099>: @eskarimov
> <https://github.com/eskarimov>
> - Add batch option to SqsSensor (#24554)
> <https://github.com/apache/airflow/pull/24554>: @LaPetiteSouris
> <https://github.com/LaPetiteSouris>
> - Add AWS Batch & AWS CloudWatch Extra Links (#24406)
> <https://github.com/apache/airflow/pull/24406>: @Taragolis
> <https://github.com/Taragolis>
> - Refactoring EmrClusterLink and add it for other AWS EMR Operators
> (#24294) <https://github.com/apache/airflow/pull/24294>: @Taragolis
> <https://github.com/Taragolis>
> - Move all SQL classes to common-sql provider (#24836)
> <https://github.com/apache/airflow/pull/24836>: @potiuk
> <https://github.com/potiuk>
> - Amazon appflow (#24057)
> <https://github.com/apache/airflow/pull/24057>: @igorborgest
> <https://github.com/igorborgest>
> - Make extra_args in S3Hook immutable between calls (#24527)
> <https://github.com/apache/airflow/pull/24527>: @Taragolis
> <https://github.com/Taragolis>
> - Refactor and fix AWS secret manager invalid exception (#24898)
> <https://github.com/apache/airflow/pull/24898>: @gitstart-airflow
> <https://github.com/gitstart-airflow>
> - fix: RedshiftDataHook and RdsHook not use cached connection (#24387)
> <https://github.com/apache/airflow/pull/24387>: @Taragolis
> <https://github.com/Taragolis>
> - Fix links to sources for examples (#24386)
> <https://github.com/apache/airflow/pull/24386>: @potiuk
> <https://github.com/potiuk>
> - Fix S3KeySensor (#24378)
> <https://github.com/apache/airflow/pull/24378>: @vincbeck
> <https://github.com/vincbeck>
> - Fix: emr_conn_id should be optional in EmrCreateJobFlowOperator
> (#24306) <https://github.com/apache/airflow/pull/24306>: @pankajastro
> <https://github.com/pankajastro>
> - Update providers to use functools compat for cached_property (#24582)
> <https://github.com/apache/airflow/pull/24582>: @josh-fell
> <https://github.com/josh-fell>
>
> Provider apache.drill: 2.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-apache-drill/2.1.0rc1>
>
> - Move all SQL classes to common-sql provider (#24836)
> <https://github.com/apache/airflow/pull/24836>: @potiuk
> <https://github.com/potiuk>
>
> Provider apache.druid: 3.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-apache-druid/3.1.0rc1>
>
> - Move all SQL classes to common-sql provider (#24836)
> <https://github.com/apache/airflow/pull/24836>: @potiuk
> <https://github.com/potiuk>
>
> Provider apache.hdfs: 3.0.1rc1
> <https://pypi.org/project/apache-airflow-providers-apache-hdfs/3.0.1rc1>
>
> - WebHDFSHook Bugfix/optional port (#24550)
> <https://github.com/apache/airflow/pull/24550>: @ankurbajaj9
> <https://github.com/ankurbajaj9>
>
> Provider apache.hive: 3.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-apache-hive/3.1.0rc1>
>
> - Move all SQL classes to common-sql provider (#24836)
> <https://github.com/apache/airflow/pull/24836>: @potiuk
> <https://github.com/potiuk>
> - fix connection extra parameter auth_mechanism in HiveMetastoreHook
> and HiveServer2Hook (#24713)
> <https://github.com/apache/airflow/pull/24713>: @eladkal
> <https://github.com/eladkal>
>
> Provider apache.pinot: 3.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-apache-pinot/3.1.0rc1>
>
> - Move all SQL classes to common-sql provider (#24836)
> <https://github.com/apache/airflow/pull/24836>: @potiuk
> <https://github.com/potiuk>
>
> Provider asana: 2.0.1rc1
> <https://pypi.org/project/apache-airflow-providers-asana/2.0.1rc1>
>
> - Update providers to use functools compat for cached_property (#24582)
> <https://github.com/apache/airflow/pull/24582>: @josh-fell
> <https://github.com/josh-fell>
>
> Provider cncf.kubernetes: 4.2.0rc1
> <https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/4.2.0rc1>
>
> - Add airflow_kpo_in_cluster label to KPO pods (#24658)
> <https://github.com/apache/airflow/pull/24658>: @jedcunningham
> <https://github.com/jedcunningham>
> - Find Pod Before Cleanup In KubernetesPodOperator Execution (#22092)
> <https://github.com/apache/airflow/pull/22092>: @michaelmicheal
> <https://github.com/michaelmicheal>
> - Revert "Fix await_container_completion condition (#23883)" (#24474)
> <https://github.com/apache/airflow/pull/24474>: @jedcunningham
> <https://github.com/jedcunningham>
> - Update providers to use functools compat for cached_property (#24582)
> <https://github.com/apache/airflow/pull/24582>: @josh-fell
> <https://github.com/josh-fell>
>
> Provider databricks: 3.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-databricks/3.1.0rc1>
>
> - Added databricks_conn_id as templated field (#24945)
> <https://github.com/apache/airflow/pull/24945>: @skadyan
> <https://github.com/skadyan>
> - Add test_connection method to Databricks hook (#24617)
> <https://github.com/apache/airflow/pull/24617>: @phanikumv
> <https://github.com/phanikumv>
> - Move all SQL classes to common-sql provider (#24836)
> <https://github.com/apache/airflow/pull/24836>: @potiuk
> <https://github.com/potiuk>
> - Update providers to use functools compat for cached_property (#24582)
> <https://github.com/apache/airflow/pull/24582>: @josh-fell
> <https://github.com/josh-fell>
>
> Provider dbt.cloud: 2.0.1rc1
> <https://pypi.org/project/apache-airflow-providers-dbt-cloud/2.0.1rc1>
>
> - Update providers to use functools compat for cached_property (#24582)
> <https://github.com/apache/airflow/pull/24582>: @josh-fell
> <https://github.com/josh-fell>
>
> Provider docker: 3.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-docker/3.1.0rc1>
>
> - Force-remove container after DockerOperator execution (#23160)
> <https://github.com/apache/airflow/pull/23160>: @zengbotang
> <https://github.com/zengbotang>
> - DockerOperator fix cli.logs giving character array instead of string
> (#24726) <https://github.com/apache/airflow/pull/24726>:
> @pasalkarsachin1 <https://github.com/pasalkarsachin1>
>
> Provider elasticsearch: 4.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-elasticsearch/4.1.0rc1>
>
> - Adding ElasticserachPythonHook - ES Hook With The Python Client
> (#24895) <https://github.com/apache/airflow/pull/24895>: @alexkruc
> <https://github.com/alexkruc>
> - Move all SQL classes to common-sql provider (#24836)
> <https://github.com/apache/airflow/pull/24836>: @potiuk
> <https://github.com/potiuk>
> - Move fallible ti.task.dag assignment back inside try/except block
> (#24533) (#24592) <https://github.com/apache/airflow/pull/24592>:
> @ejk43 <https://github.com/ejk43>
>
> Provider exasol: 3.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-exasol/3.1.0rc1>
>
> - Move all SQL classes to common-sql provider (#24836)
> <https://github.com/apache/airflow/pull/24836>: @potiuk
> <https://github.com/potiuk>
>
> Provider facebook: 3.0.1rc1
> <https://pypi.org/project/apache-airflow-providers-facebook/3.0.1rc1>
>
> - Update providers to use functools compat for cached_property (#24582)
> <https://github.com/apache/airflow/pull/24582>: @josh-fell
> <https://github.com/josh-fell>
>
> Provider ftp: 3.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-ftp/3.1.0rc1>
>
> - Add blocksize arg for ftp hook (#24860)
> <https://github.com/apache/airflow/pull/24860>: @kevgeo
> <https://github.com/kevgeo>
>
> Provider github: 2.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-github/2.1.0rc1>
>
> - Add test connection functionality to GithubHook (#24903)
> <https://github.com/apache/airflow/pull/24903>: @josh-fell
> <https://github.com/josh-fell>
>
> Provider google: 8.2.0rc1
> <https://pypi.org/project/apache-airflow-providers-google/8.2.0rc1>
>
> - PubSub assets & system tests migration (AIP-47) (#24867)
> <https://github.com/apache/airflow/pull/24867>: @wojsamjan
> <https://github.com/wojsamjan>
> - Add handling state of existing Dataproc batch (#24924)
> <https://github.com/apache/airflow/pull/24924>: @danielvdende
> <https://github.com/danielvdende>
> - Add links for Google Kubernetes Engine operators (#24786)
> <https://github.com/apache/airflow/pull/24786>: @MaksYermak
> <https://github.com/MaksYermak>
> - Add test_connection method to GoogleBaseHook (#24682)
> <https://github.com/apache/airflow/pull/24682>: @phanikumv
> <https://github.com/phanikumv>
> - Add gcp_conn_id argument to GoogleDriveToLocalOperator (#24622)
> <https://github.com/apache/airflow/pull/24622>: @aspain
> <https://github.com/aspain>
> - Add DeprecationWarning for column_transformations parameter in
> AutoML (#24467) <https://github.com/apache/airflow/pull/24467>:
> @MaksYermak <https://github.com/MaksYermak>
> - Modify BigQueryCreateExternalTableOperator to use updated hook
> function (#24363) <https://github.com/apache/airflow/pull/24363>:
> @cswpy <https://github.com/cswpy>
> - Move all SQL classes to common-sql provider (#24836)
> <https://github.com/apache/airflow/pull/24836>: @potiuk
> <https://github.com/potiuk>
> - Datacatalog assets & system tests migration (AIP-47) (#24600)
> <https://github.com/apache/airflow/pull/24600>: @wojsamjan
> <https://github.com/wojsamjan>
> - Upgrade FAB to 4.1.1 (#24399)
> <https://github.com/apache/airflow/pull/24399>: @potiuk
> <https://github.com/potiuk>
> - GCSDeleteObjectsOperator empty prefix bug fix (#24353)
> <https://github.com/apache/airflow/pull/24353>: @Lavedonio
> <https://github.com/Lavedonio>
> - perf(BigQuery): pass table_id as str type (#23141)
> <https://github.com/apache/airflow/pull/23141>: @bryan824
> <https://github.com/bryan824>
> - Update providers to use functools compat for cached_property (#24582)
> <https://github.com/apache/airflow/pull/24582>: @josh-fell
> <https://github.com/josh-fell>
>
> Provider hashicorp: 3.0.1rc1
> <https://pypi.org/project/apache-airflow-providers-hashicorp/3.0.1rc1>
>
> - Update providers to use functools compat for cached_property (#24582)
> <https://github.com/apache/airflow/pull/24582>: @josh-fell
> <https://github.com/josh-fell>
>
> Provider http: 4.0.0rc1
> <https://pypi.org/project/apache-airflow-providers-http/4.0.0rc1>
>
> - Add TCP_KEEPALIVE option to http provider (#24967)
> <https://github.com/apache/airflow/pull/24967>: @potiuk
> <https://github.com/potiuk>
>
> Provider jdbc: 3.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-jdbc/3.1.0rc1>
>
> - Move all SQL classes to common-sql provider (#24836)
> <https://github.com/apache/airflow/pull/24836>: @potiuk
> <https://github.com/potiuk>
>
> Provider jira: 3.0.1rc1
> <https://pypi.org/project/apache-airflow-providers-jira/3.0.1rc1>
>
> - Fix the error caused by passing unused context in JiraSensor.poke
> (#23352) <https://github.com/apache/airflow/pull/23352>: @kianelbo
> <https://github.com/kianelbo>
>
> Provider microsoft.azure: 4.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-microsoft-azure/4.1.0rc1>
>
> - Add test_connection method to AzureCosmosDBHook (#25018)
> <https://github.com/apache/airflow/pull/25018>: @phanikumv
> <https://github.com/phanikumv>
> - Add test_connection method to AzureFileShareHook (#24843)
> <https://github.com/apache/airflow/pull/24843>: @phanikumv
> <https://github.com/phanikumv>
> - Add test_connection method to Azure WasbHook (#24771)
> <https://github.com/apache/airflow/pull/24771>: @phanikumv
> <https://github.com/phanikumv>
> - Implement Azure service bus subscription (create, delete)Operators
> (#24625) <https://github.com/apache/airflow/pull/24625>:
> @bharanidharan14 <https://github.com/bharanidharan14>
> - Implement Azure Service Bus Queue Operators (#24038)
> <https://github.com/apache/airflow/pull/24038>: @bharanidharan14
> <https://github.com/bharanidharan14>
> - Update providers to use functools compat for cached_property (#24582)
> <https://github.com/apache/airflow/pull/24582>: @josh-fell
> <https://github.com/josh-fell>
>
> Provider microsoft.mssql: 3.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-microsoft-mssql/3.1.0rc1>
>
> - Move all SQL classes to common-sql provider (#24836)
> <https://github.com/apache/airflow/pull/24836>: @potiuk
> <https://github.com/potiuk>
>
> Provider mysql: 3.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-mysql/3.1.0rc1>
>
> - Move all SQL classes to common-sql provider (#24836)
> <https://github.com/apache/airflow/pull/24836>: @potiuk
> <https://github.com/potiuk>
> - Close the MySQL connections once operations are done. (#24508)
> <https://github.com/apache/airflow/pull/24508>: @pavel-lexyr
> <https://github.com/pavel-lexyr>
>
> Provider odbc: 3.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-odbc/3.1.0rc1>
>
> - Move all SQL classes to common-sql provider (#24836)
> <https://github.com/apache/airflow/pull/24836>: @potiuk
> <https://github.com/potiuk>
>
> Provider oracle: 3.2.0rc1
> <https://pypi.org/project/apache-airflow-providers-oracle/3.2.0rc1>
>
> - Move all SQL classes to common-sql provider (#24836)
> <https://github.com/apache/airflow/pull/24836>: @potiuk
> <https://github.com/potiuk>
>
> Provider postgres: 5.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-postgres/5.1.0rc1>
>
> - Move all SQL classes to common-sql provider (#24836)
> <https://github.com/apache/airflow/pull/24836>: @potiuk
> <https://github.com/potiuk>
>
> Provider presto: 3.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-presto/3.1.0rc1>
>
> - Adding generic SqlToSlackOperator (#24663)
> <https://github.com/apache/airflow/pull/24663>: @alexkruc
> <https://github.com/alexkruc>
> - Move all SQL classes to common-sql provider (#24836)
> <https://github.com/apache/airflow/pull/24836>: @potiuk
> <https://github.com/potiuk>
>
> Provider qubole: 3.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-qubole/3.1.0rc1>
>
> - Move all SQL classes to common-sql provider (#24836)
> <https://github.com/apache/airflow/pull/24836>: @potiuk
> <https://github.com/potiuk>
>
> Provider salesforce: 5.0.0rc1
> <https://pypi.org/project/apache-airflow-providers-salesforce/5.0.0rc1>
>
> - Remove Tableau from Salesforce provider (#23747)
> <https://github.com/apache/airflow/pull/23747>: @eladkal
> <https://github.com/eladkal>
> - Add support for Salesforce bulk api (#24473)
> <https://github.com/apache/airflow/pull/24473>: @ishiis
> <https://github.com/ishiis>
> - Update providers to use functools compat for cached_property (#24582)
> <https://github.com/apache/airflow/pull/24582>: @josh-fell
> <https://github.com/josh-fell>
>
> Provider sftp: 3.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-sftp/3.1.0rc1>
>
> - Convert sftp hook to use paramiko instead of pysftp (#24512)
> <https://github.com/apache/airflow/pull/24512>: @pauldalewilliams
> <https://github.com/pauldalewilliams>
> - Update actual_file_to_check with rendered path (#24451)
> <https://github.com/apache/airflow/pull/24451>: @remem9527
> <https://github.com/remem9527>
>
> Provider slack: 5.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-slack/5.1.0rc1>
>
> - Move all SQL classes to common-sql provider (#24836)
> <https://github.com/apache/airflow/pull/24836>: @potiuk
> <https://github.com/potiuk>
> - Adding generic SqlToSlackOperator (#24663)
> <https://github.com/apache/airflow/pull/24663>: @alexkruc
> <https://github.com/alexkruc>
>
> Provider snowflake: 3.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-snowflake/3.1.0rc1>
>
> - Adding generic SqlToSlackOperator (#24663)
> <https://github.com/apache/airflow/pull/24663>: @alexkruc
> <https://github.com/alexkruc>
> - Move all SQL classes to common-sql provider (#24836)
> <https://github.com/apache/airflow/pull/24836>: @potiuk
> <https://github.com/potiuk>
> - Pattern parameter in S3ToSnowflakeOperator (#24571)
> <https://github.com/apache/airflow/pull/24571>: @Taragolis
> <https://github.com/Taragolis>
> - S3ToSnowflakeOperator: escape single quote in s3_keys (#24607)
> <https://github.com/apache/airflow/pull/24607>: @Taragolis
> <https://github.com/Taragolis>
>
> Provider sqlite: 3.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-sqlite/3.1.0rc1>
>
> - Move all SQL classes to common-sql provider (#24836)
> <https://github.com/apache/airflow/pull/24836>: @potiuk
> <https://github.com/potiuk>
>
> Provider ssh: 3.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-ssh/3.1.0rc1>
>
> - Less verbose logging in ssh operator (#24915)
> <https://github.com/apache/airflow/pull/24915>: @hsnprsd
> <https://github.com/hsnprsd>
> - Convert sftp hook to use paramiko instead of pysftp (#24512)
> <https://github.com/apache/airflow/pull/24512>: @pauldalewilliams
> <https://github.com/pauldalewilliams>
> - Update providers to use functools compat for cached_property (#24582)
> <https://github.com/apache/airflow/pull/24582>: @josh-fell
> <https://github.com/josh-fell>
>
> Provider tableau: 3.0.1rc1
> <https://pypi.org/project/apache-airflow-providers-tableau/3.0.1rc1>
>
> - Remove Tableau from Salesforce provider (#23747)
> <https://github.com/apache/airflow/pull/23747>: @eladkal
> <https://github.com/eladkal>
>
> Provider trino: 3.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-trino/3.1.0rc1>
>
> - Move all SQL classes to common-sql provider (#24836)
> <https://github.com/apache/airflow/pull/24836>: @potiuk
> <https://github.com/potiuk>
> - Add test_connection method to Trino hook (#24583)
> <https://github.com/apache/airflow/pull/24583>: @phanikumv
> <https://github.com/phanikumv>
> - Add on_kill() to kill Trino query if Airflow task is killed (#24559)
> <https://github.com/apache/airflow/pull/24559>: @phanikumv
> <https://github.com/phanikumv>
> - Add TrinoOperator (#24415)
> <https://github.com/apache/airflow/pull/24415>: @phanikumv
> <https://github.com/phanikumv>
>
> Provider vertica: 3.1.0rc1
> <https://pypi.org/project/apache-airflow-providers-vertica/3.1.0rc1>
>
> - Move all SQL classes to common-sql provider (#24836)
> <https://github.com/apache/airflow/pull/24836>: @potiuk
> <https://github.com/potiuk>
>
> The guidelines on how to test providers can be found in
>
> Verify providers by contributors
> <https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md#verify-by-contributors>
> Committer
>
> - I acknowledge that I am a maintainer/committer of the Apache Airflow
> project.
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/airflow/issues/25037>, or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/ACA3ZQEUVRRAKAZV3NCOCV3VT4YILANCNFSM53QD2LHQ>
> .
> You are receiving this because you were mentioned.Message ID:
> ***@***.***>
>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] ankurbajaj9 commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
ankurbajaj9 commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1186257030
> > I see an issue with (#24550) #24550.will try to raise a PR Regards Ankur Bajaj
>
> How Serious? (BTW. it's no big problem we can remove it from the release and make rc2 right after - we are doing that with SFTP already).
Not serious at all. It seems the authentication is missing since the original code only. Nothing is breaking , it just needs additional lines to be able to work in my environment.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] bryan824 commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
bryan824 commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1184730477
#23141 checked. Please see the details below for comparison.
`apache-airflow-providers-google | 8.1.0`
```
ValueError: When default_project is not set, table_id must be a fully-qualified ID in standard SQL format, e.g., "project.dataset_id.table_id", got test.table_to_delete
```
`apache-airflow-providers-google | 8.2.0rc1`
```
[2022-07-14 17:41:49,262] {bigquery.py:1182} INFO - Deleted table test.table_to_delete
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1183697776
@wylde780. - please install the RC1 SFTP provider from the link above.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1185768541
Sure. I will remove tabular from delivery too and add it to the list of rc2's
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] josh-fell commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
josh-fell commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1184440573
cc @denimalpaca for [https://pypi.org/project/apache-airflow-providers-common-sql/1.0.0rc1/](https://pypi.org/project/apache-airflow-providers-common-sql/1.0.0rc1/) 🎉
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] josh-fell commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
josh-fell commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1184508697
#24903 Looks good.
It's a little difficult to test #24582 since I don't have the means to test all of these providers in the wild, but I spot-checked the package files and 👍
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] igorborgest commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
igorborgest commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1184390351
I can confirm that the [Amazon Appflow support](https://github.com/apache/airflow/pull/24057) is working as expected for `apache-airflow-providers-amazon==4.1.0rc1`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] pauldalewilliams commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
pauldalewilliams commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1184789280
@potiuk Re #24512 does the fact that I removed deprecated parameters necessitate a major version bump for the SFTP provider? See the second bullet point on my PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] alexott commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
alexott commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1186176505
#24617 for Databricks has an issue because selected API is available only on AWS, and will fail on Azure/GCP...
More general question - is it possible to subscribe to all Databricks-related RPs?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] phanikumv commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
phanikumv commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1184300229
Tested the below PR with the respective rc images and they are working fine.
Add test_connection method to Databricks hook (#24617): @phanikumv
Add test_connection method to GoogleBaseHook (#24682): @phanikumv
Add test_connection method to AzureCosmosDBHook (#25018): @phanikumv
Add test_connection method to AzureFileShareHook (#24843): @phanikumv
Add test_connection method to Azure WasbHook (#24771): @phanikumv
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] Fokko commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
Fokko commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1185677582
I'll give the Tabular operator a swing right away. Thanks for running this @potiuk! 👏🏻
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] Fokko commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
Fokko commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1185750152
@potiuk would it be possible to include this patch into the RC2 as well? https://github.com/apache/airflow/pull/25099
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1186308638
@Fokko - I actually released 1.0.0 (will be easier) and release 1.0.1 right after - 1.0.0 was the first release, no regression there.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] pasalkarsachin1 commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
pasalkarsachin1 commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1185173840
Looks okay to me https://github.com/apache/airflow/pull/24726
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] pankajkoti commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
pankajkoti commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1184154244
I have a question regarding Provider [http: 4.0.0rc1](https://pypi.org/project/apache-airflow-providers-http/4.0.0rc1) and added it in the PR discussion here: https://github.com/apache/airflow/pull/24967#discussion_r920887030
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] phanikumv commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
phanikumv commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1184369226
Completed testing the below PR and they are working fine.
Add test_connection method to Trino hook (#24583): @phanikumv
<img width="1427" alt="image" src="https://user-images.githubusercontent.com/94376113/178978768-61af41d2-f26f-474a-8384-ebe56bc03026.png">
Add on_kill() to kill Trino query if Airflow task is killed (#24559): @phanikumv
Add TrinoOperator (#24415): @phanikumv
<img width="916" alt="image" src="https://user-images.githubusercontent.com/94376113/178978600-168a0ae0-8d72-4494-9270-60a6ef3e6ab0.png">
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1184777062
Yep #24670 has been removed from changelog as "not important" - we can re-add them later for the docs purpose see changelog with comments included https://raw.githubusercontent.com/apache/airflow/main/airflow/providers/amazon/CHANGELOG.rst)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] kevgeo commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
kevgeo commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1184856578
I have tested #24860, works great!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1185625597
> I see an issue with (#24550) <https://github.com/apache/airflow/pull/24550>.will try to raise a PR Regards Ankur Bajaj
How Serious? (BTW. it's no big problem we can remove it from the release and make rc2 right after - we are doing that with SFTP already).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] pankajastro commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
pankajastro commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1185318145
Tested https://github.com/apache/airflow/pull/24306 with `4.1.0rc1` working fine.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1184394172
cc: @Fokko - this is not mentioned here but it would be great if you test https://pypi.org/project/apache-airflow-providers-tabular/1.0.0rc1/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] ishiis commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
ishiis commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1184661677
#24473 is working as expected.
<img width="1288" alt="image" src="https://user-images.githubusercontent.com/12693596/179033525-71d0504a-a872-4a5a-8118-2ad4ba0888cb.png">
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #25037: Status of testing Providers that were prepared on July 13, 2022
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #25037:
URL: https://github.com/apache/airflow/issues/25037#issuecomment-1186316279
Closing this one as providers are released. Thanks everyone. you rock!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org