You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/10/30 13:49:25 UTC
[GitHub] [airflow] potiuk opened a new issue #19328: Status of testing Providers that were prepared on October 30, 2021
potiuk opened a new issue #19328:
URL: https://github.com/apache/airflow/issues/19328
### Body
I have a kind request for all the contributors to the latest provider packages release.
Could you help us to test the RC versions of the providers and let us know in the comment,
if the issue is addressed there.
## Providers that need testing
Those are providers that require testing as there were some substantial changes introduced:
### Provider [amazon: 2.4.0rc1](https://pypi.org/project/apache-airflow-providers-amazon/2.4.0rc1)
- [ ] [MySQLToS3Operator add support for parquet format (#18755)](https://github.com/apache/airflow/pull/18755): @guotongfei
- [ ] [Add RedshiftSQLHook, RedshiftSQLOperator (#18447)](https://github.com/apache/airflow/pull/18447): @Brooke-white
- [ ] [Add AWS Fargate profile support (#18645)](https://github.com/apache/airflow/pull/18645): @ferruzzi
- [ ] [Add emr cluster link (#18691)](https://github.com/apache/airflow/pull/18691): @anaynayak
- [ ] [AwsGlueJobOperator: add wait_for_completion to Glue job run (#18814)](https://github.com/apache/airflow/pull/18814): @ron-damon
- [ ] [AwsGlueJobOperator: add run_job_kwargs to Glue job run (#16796)](https://github.com/apache/airflow/pull/16796): @ron-damon
- [ ] [Add additional dependency for postgres extra for amazon provider (#18737)](https://github.com/apache/airflow/pull/18737): @potiuk
- [ ] [Remove extra postgres dependency from AWS Provider (#18844)](https://github.com/apache/airflow/pull/18844): @mariotaddeucci
- [ ] [Remove duplicated code on S3ToRedshiftOperator (#18671)](https://github.com/apache/airflow/pull/18671): @mariotaddeucci
- [ ] [Enable AWS Secrets Manager backend to retrieve conns using different fields (#18764)](https://github.com/apache/airflow/pull/18764): @JavierLopezT
- [ ] [Enable FTPToS3Operator to transfer several files (#17937)](https://github.com/apache/airflow/pull/17937): @JavierLopezT
- [ ] [Support all Unix wildcards in S3KeySensor (#18211)](https://github.com/apache/airflow/pull/18211): @john-jac
- [ ] [Fixing ses email backend (#18042)](https://github.com/apache/airflow/pull/18042): @ignaski
- [ ] [Fixup string concatenations (#19099)](https://github.com/apache/airflow/pull/19099): @blag
- [ ] [Update S3PrefixSensor to support checking multiple prefixes within a bucket (#18807)](https://github.com/apache/airflow/pull/18807): @anaynayak
- [ ] [Adds an s3 list prefixes operator (#17145)](https://github.com/apache/airflow/pull/17145): @jarfgit
- [ ] [Move validation of templated input params to run after the context init (#19048)](https://github.com/apache/airflow/pull/19048): @eskarimov
- [ ] [ECSOperator: airflow exception on edge case when cloudwatch log stream is not found (#18733)](https://github.com/apache/airflow/pull/18733): @codenamestif
- [ ] [Amazon Athena Example (#18785)](https://github.com/apache/airflow/pull/18785): @john-jac
- [ ] [Amazon SQS Example (#18760)](https://github.com/apache/airflow/pull/18760): @john-jac
### Provider [apache.beam: 3.1.0rc1](https://pypi.org/project/apache-airflow-providers-apache-beam/3.1.0rc1)
- [ ] [Use google cloud credentials when executing beam commands in subprocesses (#18992)](https://github.com/apache/airflow/pull/18992): @SamWheating
### Provider [apache.cassandra: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-apache-cassandra/2.1.0rc1)
- [ ] [Adding a default conn ID value for Apache Cassandra sensors (#18620)](https://github.com/apache/airflow/pull/18620): @josh-fell
### Provider [apache.hdfs: 2.1.1rc1](https://pypi.org/project/apache-airflow-providers-apache-hdfs/2.1.1rc1)
- [ ] [hdfs provider: fix deprecation warning in WebHDFSHook (#18331)](https://github.com/apache/airflow/pull/18331): @Aakcht
### Provider [apache.hive: 2.0.3rc1](https://pypi.org/project/apache-airflow-providers-apache-hive/2.0.3rc1)
- [ ] [fix get_connections deprecation warn in hivemetastore hook (#18854)](https://github.com/apache/airflow/pull/18854): @Aakcht
### Provider [apache.livy: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-apache-livy/2.1.0rc1)
- [ ] [Fetching and logging Livy session logs for LivyOperator (#17393)](https://github.com/apache/airflow/pull/17393): @sreenath-kamath
### Provider [asana: 1.1.0rc1](https://pypi.org/project/apache-airflow-providers-asana/1.1.0rc1)
- [ ] [Use built-in ``cached_property`` on Python 3.8 for Asana provider (#17597)](https://github.com/apache/airflow/pull/17597): @kaxil
### Provider [cncf.kubernetes: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/2.1.0rc1)
- [ ] [Add more type hints to PodLauncher (#18928)](https://github.com/apache/airflow/pull/18928): @jameslamb
- [ ] [add more information to PodLauncher timeout error (#17953)](https://github.com/apache/airflow/pull/17953): @jameslamb
### Provider [databricks: 2.0.2rc1](https://pypi.org/project/apache-airflow-providers-databricks/2.0.2rc1)
- [ ] [Move DB call out of ``DatabricksHook.__init__`` (#18339)](https://github.com/apache/airflow/pull/18339): @kaxil
### Provider [docker: 2.3.0rc1](https://pypi.org/project/apache-airflow-providers-docker/2.3.0rc1)
- [ ] [Add support of placement in the DockerSwarmOperator (#18990)](https://github.com/apache/airflow/pull/18990): @enima2684
- [ ] [Fixup string concatenations (#19099)](https://github.com/apache/airflow/pull/19099): @blag
- [ ] [Remove the docker timeout workaround (#18872)](https://github.com/apache/airflow/pull/18872): @RyanSiu1995
- [ ] [Move docker decorator example dag to docker provider (#18739)](https://github.com/apache/airflow/pull/18739): @ephraimbuddy
### Provider [elasticsearch: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-elasticsearch/2.1.0rc1)
- [ ] [AIP 39: Documentation (#17552)](https://github.com/apache/airflow/pull/17552): @uranusjr
- [ ] [Adds example showing the ES_hook (#17944)](https://github.com/apache/airflow/pull/17944): @frankcash
### Provider [exasol: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-exasol/2.0.1rc1)
- [ ] [ExasolHook get_pandas_df does not return pandas dataframe but None (#17850)](https://github.com/apache/airflow/pull/17850): @Goodkat
### Provider [facebook: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-facebook/2.1.0rc1)
- [ ] [Align the default version with Facebook business SDK (#18883)](https://github.com/apache/airflow/pull/18883): @RyanSiu1995
### Provider [google: 6.1.0rc1](https://pypi.org/project/apache-airflow-providers-google/6.1.0rc1)
- [ ] [Add value to "namespaceId" of query (#19163)](https://github.com/apache/airflow/pull/19163): @deedmitrij
- [ ] [Add pre-commit hook for common misspelling check in files (#18964)](https://github.com/apache/airflow/pull/18964): @ephraimbuddy
- [ ] [Support query timeout as an argument in CassandraToGCSOperator (#18927)](https://github.com/apache/airflow/pull/18927): @xuan616
- [ ] [Update BigQueryCreateExternalTableOperator doc and parameters (#18676)](https://github.com/apache/airflow/pull/18676): @tnyz
- [ ] [Replacing non-attribute template_fields for BigQueryToMsSqlOperator (#19052)](https://github.com/apache/airflow/pull/19052): @josh-fell
- [ ] [Upgrade the dataproc package to 3.0.0 and migrate from v1beta2 to v1 api (#18879)](https://github.com/apache/airflow/pull/18879): @lwyszomi
- [ ] [Use google cloud credentials when executing beam commands in subprocesses (#18992)](https://github.com/apache/airflow/pull/18992): @SamWheating
- [ ] [Replace default api_version of FacebookAdsReportToGcsOperator (#18996)](https://github.com/apache/airflow/pull/18996): @eladkal
- [ ] [Dataflow Operators - use project and location from job in on_kill method. (#18699)](https://github.com/apache/airflow/pull/18699): @lwyszomi
- [ ] [Fix hard-coded /tmp directory in CloudSQL Hook (#19229)](https://github.com/apache/airflow/pull/19229): @potiuk
- [ ] [Fix bug in Dataflow hook when no jobs are returned (#18981)](https://github.com/apache/airflow/pull/18981): @keze
- [ ] [Fix BigQueryToMsSqlOperator documentation (#18995)](https://github.com/apache/airflow/pull/18995): @potatochip
- [ ] [Move validation of templated input params to run after the context init (#19048)](https://github.com/apache/airflow/pull/19048): @eskarimov
- [ ] [Google provider catch invalid secret name (#18790)](https://github.com/apache/airflow/pull/18790): @raphaelauv
### Provider [hashicorp: 2.1.1rc1](https://pypi.org/project/apache-airflow-providers-hashicorp/2.1.1rc1)
- [ ] [Fixing Vault AppRole authentication with CONN_URI (#18064)](https://github.com/apache/airflow/pull/18064): @nathadfield
### Provider [jdbc: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-jdbc/2.0.1rc1)
- [ ] [Fix type annotations in OracleOperator, JdbcOperator, SqliteOperator (#17406)](https://github.com/apache/airflow/pull/17406): @shadrus
### Provider [jenkins: 2.0.3rc1](https://pypi.org/project/apache-airflow-providers-jenkins/2.0.3rc1)
- [ ] [Remove distutils usages for Python 3.10 (#19064)](https://github.com/apache/airflow/pull/19064): @uranusjr
### Provider [microsoft.azure: 3.3.0rc1](https://pypi.org/project/apache-airflow-providers-microsoft-azure/3.3.0rc1)
- [ ] [update azure cosmos to latest version (#18695)](https://github.com/apache/airflow/pull/18695): @eladkal
- [ ] [Added sas_token var to BlobServiceClient return. Updated tests (#19234)](https://github.com/apache/airflow/pull/19234): @ReadytoRocc
- [ ] [Add pre-commit hook for common misspelling check in files (#18964)](https://github.com/apache/airflow/pull/18964): @ephraimbuddy
- [ ] [Fix changelog for Azure Provider (#18736)](https://github.com/apache/airflow/pull/18736): @potiuk
- [ ] [Expanding docs on client auth for AzureKeyVaultBackend (#18659)](https://github.com/apache/airflow/pull/18659): @alexbegg
- [ ] [Static start_date and default arg cleanup for Microsoft providers example DAGs (#19062)](https://github.com/apache/airflow/pull/19062): @josh-fell
### Provider [microsoft.psrp: 1.0.1rc1](https://pypi.org/project/apache-airflow-providers-microsoft-psrp/1.0.1rc1)
- [ ] [Fix unexpected bug in exiting PSRPHook.client context manager (#18014)](https://github.com/apache/airflow/pull/18014): @malthe
### Provider [mongo: 2.2.0rc1](https://pypi.org/project/apache-airflow-providers-mongo/2.2.0rc1)
- [ ] [#19223 add mongo_db param to MongoSensor (#19276)](https://github.com/apache/airflow/pull/19276): @bhavaniravi
### Provider [neo4j: 2.0.2rc1](https://pypi.org/project/apache-airflow-providers-neo4j/2.0.2rc1)
- [ ] [fix Neo4jHook to get the query response (#18007)](https://github.com/apache/airflow/pull/18007): @minu7
### Provider [openfaas: 2.0.0rc1](https://pypi.org/project/apache-airflow-providers-openfaas/2.0.0rc1)
- [ ] [Auto-apply apply_default decorator (#15667)](https://github.com/apache/airflow/pull/15667): @ashb
### Provider [pagerduty: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-pagerduty/2.1.0rc1)
- [ ] [Add standard hook fields to pagerdutyHook to make hook show up in UI (#18763)](https://github.com/apache/airflow/pull/18763): @GuidoTournois
- [ ] [Make a separate hook for interacting with the Pagerduty Events API (#18784)](https://github.com/apache/airflow/pull/18784): @GuidoTournois
### Provider [papermill: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-papermill/2.1.0rc1)
- [ ] [Add support for templated fields in PapermillOperator (#18357)](https://github.com/apache/airflow/pull/18357): @eladkal
- [ ] [Fix usage of ``range(len())`` to ``enumerate`` (#18174)](https://github.com/apache/airflow/pull/18174): @kaxil
### Provider [postgres: 2.3.0rc1](https://pypi.org/project/apache-airflow-providers-postgres/2.3.0rc1)
- [ ] [Added upsert method on S3ToRedshift operator (#18027)](https://github.com/apache/airflow/pull/18027): @mariotaddeucci
- [ ] [Fix example dag of PostgresOperator (#18236)](https://github.com/apache/airflow/pull/18236): @eladkal
### Provider [salesforce: 3.3.0rc1](https://pypi.org/project/apache-airflow-providers-salesforce/3.3.0rc1)
- [ ] [Add SalesforceApexRestOperator (#18819)](https://github.com/apache/airflow/pull/18819): @mariotaddeucci
### Provider [samba: 3.0.1rc1](https://pypi.org/project/apache-airflow-providers-samba/3.0.1rc1)
- [ ] [Handle leading slash in samba path (#18847)](https://github.com/apache/airflow/pull/18847): @fredthomsen
- [ ] [Open src and dst in binary for samba copy (#18752)](https://github.com/apache/airflow/pull/18752): @fredthomsen
### Provider [sftp: 2.2.0rc1](https://pypi.org/project/apache-airflow-providers-sftp/2.2.0rc1)
- [ ] [SFTP hook to prefer the SSH paramiko key over the key file path (#18988)](https://github.com/apache/airflow/pull/18988): @30blay
### Provider [slack: 4.1.0rc1](https://pypi.org/project/apache-airflow-providers-slack/4.1.0rc1)
- [ ] [Restore 'filename' to template_fields of SlackAPIFileOperator (#18466)](https://github.com/apache/airflow/pull/18466): @SayTen
### Provider [snowflake: 2.3.0rc1](https://pypi.org/project/apache-airflow-providers-snowflake/2.3.0rc1)
- [ ] [Add test_connection method for Snowflake Hook (#19041)](https://github.com/apache/airflow/pull/19041): @msumit
- [ ] [Add region to Snowflake URI. (#18650)](https://github.com/apache/airflow/pull/18650): @dimberman
### Provider [sqlite: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-sqlite/2.0.1rc1)
- [ ] [Fix sqlite hook - insert and replace functions (#17695)](https://github.com/apache/airflow/pull/17695): @subkanthi
### Provider [ssh: 2.3.0rc1](https://pypi.org/project/apache-airflow-providers-ssh/2.3.0rc1)
- [ ] [Refactor SSHOperator so a subclass can run many commands (#10874) (#17378)](https://github.com/apache/airflow/pull/17378): @baolsen
- [ ] [update sshtunnel version (#18684)](https://github.com/apache/airflow/pull/18684): @eladkal
- [ ] [Correctly handle get_pty attribute if command passed as XComArg or template (#19323)](https://github.com/apache/airflow/pull/19323): @josh-fell
### Provider [tableau: 2.1.2rc1](https://pypi.org/project/apache-airflow-providers-tableau/2.1.2rc1)
- [ ] [Remove distutils usages for Python 3.10 (#19064)](https://github.com/apache/airflow/pull/19064): @uranusjr
### Provider [trino: 2.0.2rc1](https://pypi.org/project/apache-airflow-providers-trino/2.0.2rc1)
- [ ] [Properly handle verify parameter in TrinoHook (#18791)](https://github.com/apache/airflow/pull/18791): @danarwix
### Provider [yandex: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-yandex/2.1.0rc1)
- [ ] [Add autoscaling subcluster support and remove defaults (#17033)](https://github.com/apache/airflow/pull/17033): @peter-volkov
## Providers that do not need testing
Those are providers that were either doc-only or had changes that do not require testing.
* Provider [airbyte: 2.1.1rc1](https://pypi.org/project/apache-airflow-providers-airbyte/2.1.1rc1)
* Provider [alibaba: 1.0.0rc1](https://pypi.org/project/apache-airflow-providers-alibaba/1.0.0rc1)
* Provider [apache.drill: 1.0.1rc1](https://pypi.org/project/apache-airflow-providers-apache-drill/1.0.1rc1)
* Provider [apache.druid: 2.0.2rc1](https://pypi.org/project/apache-airflow-providers-apache-druid/2.0.2rc1)
* Provider [apache.kylin: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-apache-kylin/2.0.1rc1)
* Provider [apache.pig: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-apache-pig/2.0.1rc1)
* Provider [apache.pinot: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-apache-pinot/2.0.1rc1)
* Provider [apache.spark: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-apache-spark/2.0.1rc1)
* Provider [apache.sqoop: 2.0.2rc1](https://pypi.org/project/apache-airflow-providers-apache-sqoop/2.0.2rc1)
* Provider [celery: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-celery/2.1.0rc1)
* Provider [cloudant: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-cloudant/2.0.1rc1)
* Provider [datadog: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-datadog/2.0.1rc1)
* Provider [dingding: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-dingding/2.0.1rc1)
* Provider [discord: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-discord/2.0.1rc1)
* Provider [ftp: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-ftp/2.0.1rc1)
* Provider [grpc: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-grpc/2.0.1rc1)
* Provider [http: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-http/2.0.1rc1)
* Provider [imap: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-imap/2.0.1rc1)
* Provider [influxdb: 1.0.0rc1](https://pypi.org/project/apache-airflow-providers-influxdb/1.0.0rc1)
* Provider [jira: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-jira/2.0.1rc1)
* Provider [microsoft.mssql: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-microsoft-mssql/2.0.1rc1)
* Provider [microsoft.winrm: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-microsoft-winrm/2.0.1rc1)
* Provider [mysql: 2.1.1rc1](https://pypi.org/project/apache-airflow-providers-mysql/2.1.1rc1)
* Provider [odbc: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-odbc/2.0.1rc1)
* Provider [opsgenie: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-opsgenie/2.0.1rc1)
* Provider [oracle: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-oracle/2.0.1rc1)
* Provider [plexus: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-plexus/2.0.1rc1)
* Provider [presto: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-presto/2.0.1rc1)
* Provider [qubole: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-qubole/2.0.1rc1)
* Provider [redis: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-redis/2.0.1rc1)
* Provider [segment: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-segment/2.0.1rc1)
* Provider [sendgrid: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-sendgrid/2.0.1rc1)
* Provider [singularity: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-singularity/2.0.1rc1)
* Provider [telegram: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-telegram/2.0.1rc1)
* Provider [vertica: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-vertica/2.0.1rc1)
* Provider [zendesk: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-zendesk/2.0.1rc1)
Thanks to all who contributed to those provider's release
@sreenath-kamath @jarfgit @frankcash @deedmitrij @enima2684 @uranusjr @peter-volkov @mariotaddeucci @potatochip @john-jac @malthe @msumit @dimberman @jameslamb @Brooke-white @codenamestif @GuidoTournois @minu7 @ashb @shadrus @ignaski @ferruzzi @eladkal @ephraimbuddy @eskarimov @JavierLopezT @keze @josh-fell @anaynayak @raphaelauv @blag @Aakcht @guotongfei @SamWheating @potiuk @ron-damon @danarwix
@subkanthi @alexbegg @bhavaniravi @tnyz @Goodkat @fredthomsen @SayTen @kaxil @lwyszomi @ReadytoRocc @baolsen @30blay @nathadfield @xuan616 @RyanSiu1995
### Committer
- [X] I acknowledge that I am a maintainer/committer of the Apache Airflow project.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] JavierLopezT commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
JavierLopezT commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-955754109
#17397 and #18764 were already tested in the last wave
On Sat, 30 Oct 2021 at 20:39, Aakcht ***@***.***> wrote:
> Tested #18854 <https://github.com/apache/airflow/pull/18854> - all good.
>
> #18331 <https://github.com/apache/airflow/pull/18331> is already present
> in 2.1.1 ( it was tested in #18638
> <https://github.com/apache/airflow/issues/18638>) , so I don't think hdfs
> 2.1.1rc1 should be present here.
>
> —
> You are receiving this because you were mentioned.
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/airflow/issues/19328#issuecomment-955575296>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/ACWQK7CHD5D4NJINYNXVWSLUJQ3WBANCNFSM5HBDLQLQ>
> .
> Triage notifications on the go with GitHub Mobile for iOS
> <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675>
> or Android
> <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.
>
>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] enima2684 commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
enima2684 commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956081439
#18872 I tested this PR and it is not working as expected.
The DockerSwarmOperator never returns and keep hanging.
I used for the test the following Job :
```python
task = DockerSwarmOperator(
task_id="task",
image="python:3.9",
enable_logging=True,
tty=True,
command=["echo", "hello world !"]
)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mik-laj edited a comment on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
mik-laj edited a comment on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-957872234
> Provider facebook: 2.1.0rc1
> Align the default version with Facebook business SDK (#18883): @RyanSiu1995
It is a breaking change, so <strike>it should be in a new release</strike> we should bump major version.
> Provider google: 6.1.0rc1
> Replace default api_version of FacebookAdsReportToGcsOperator (#18996): @eladkal
It is breaking change also.
> Provider microsoft.azure: 3.3.0rc1
> update azure cosmos to latest version (#18695): @eladkal
I am not sure here, but when we changed the minimum requirements of the google libraries, we always bumped the major version. Airflow is a thin layer between libraries and user, so breaking changes propagate to Airflow very easily.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] Brooke-white commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
Brooke-white commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956404082
#18447 tested and working
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mariotaddeucci commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
mariotaddeucci commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-957034378
> > #18844 got errors using `RedshiftSQLHook ` when executing multiple commands into a prepared statement. I'll fix it.
>
> How serious / how much of a regression change is it @mariotadeucci ?
@potiuk Happend on `S3ToRedshiftOperator` with specific configuration. By using "UPSERT" or "REPLACE" is generate an sql block with multiple queries. The `RedshiftSQLHook` don't support execute multiple queries in a single call of `execute`. To fix it just need to convert the single query string to a list of queries. Fix is available on PR #19358.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] SamWheating commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
SamWheating commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-959822472
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] GuidoTournois commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
GuidoTournois commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956390518
I have validated that both changes for pagerduty work as intended!
- Add standard hook fields to pagerdutyHook to make hook show up in UI (#18763)
- Make a separate hook for interacting with the Pagerduty Events API (#18784)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-955437783
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] eskarimov commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
eskarimov commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-957252449
Tested #19048, works correctly :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk closed issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk closed issue #19328:
URL: https://github.com/apache/airflow/issues/19328
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] Brooke-white commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
Brooke-white commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956404082
#18447 tested and working
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956090325
| #18872 I tested this PR and it is not working as expected.
@RyanSiu1995 can you double check if you have the same problem ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] bhavaniravi commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
bhavaniravi commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-957301531
Tested #19276 MongoSensor picking up the new db param
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mariotaddeucci edited a comment on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
mariotaddeucci edited a comment on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-957034378
> > #18844 got errors using `RedshiftSQLHook ` when executing multiple commands into a prepared statement. I'll fix it.
>
> How serious / how much of a regression change is it @mariotadeucci ?
@potiuk Happend on `S3ToRedshiftOperator` with specific configuration. By using "UPSERT" or "REPLACE" is generate an sql block with multiple queries. The `RedshiftSQLHook` don't support execute multiple queries in a single call of `execute`. To fix it just need to convert the single query string to a list of queries. Fix is available on PR #19358.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] eskarimov commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
eskarimov commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-957252449
Tested #19048, works correctly :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] GuidoTournois commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
GuidoTournois commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956390518
I have validated that both changes for pagerduty work as intended!
- Add standard hook fields to pagerdutyHook to make hook show up in UI (#18763)
- Make a separate hook for interacting with the Pagerduty Events API (#18784)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-959962812
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] fredthomsen commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
fredthomsen commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956302369
[#18847](https://github.com/apache/airflow/pull/18847) and [#18752](https://github.com/apache/airflow/pull/18752) for [samba: 3.0.1rc1](https://pypi.org/project/apache-airflow-providers-samba/3.0.1rc1) are both good.
‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
On Saturday, October 30th, 2021 at 9:49 AM, Jarek Potiuk ***@***.***> wrote:
> Body
>
> I have a kind request for all the contributors to the latest provider packages release.
> Could you help us to test the RC versions of the providers and let us know in the comment,
> if the issue is addressed there.
>
> Providers that need testing
>
> Those are providers that require testing as there were some substantial changes introduced:
>
> Provider [amazon: 2.4.0rc1](https://pypi.org/project/apache-airflow-providers-amazon/2.4.0rc1)
>
> - [MySQLToS3Operator add support for parquet format (#18755)](https://github.com/apache/airflow/pull/18755): ***@***.***(https://github.com/guotongfei)
> - [Add RedshiftSQLHook, RedshiftSQLOperator (#18447)](https://github.com/apache/airflow/pull/18447): ***@***.***(https://github.com/Brooke-white)
> - [Add AWS Fargate profile support (#18645)](https://github.com/apache/airflow/pull/18645): ***@***.***(https://github.com/ferruzzi)
> - [Add emr cluster link (#18691)](https://github.com/apache/airflow/pull/18691): ***@***.***(https://github.com/anaynayak)
> - [AwsGlueJobOperator: add wait_for_completion to Glue job run (#18814)](https://github.com/apache/airflow/pull/18814): ***@***.***(https://github.com/ron-damon)
> - [AwsGlueJobOperator: add run_job_kwargs to Glue job run (#16796)](https://github.com/apache/airflow/pull/16796): ***@***.***(https://github.com/ron-damon)
> - [Add additional dependency for postgres extra for amazon provider (#18737)](https://github.com/apache/airflow/pull/18737): ***@***.***(https://github.com/potiuk)
> - [Remove extra postgres dependency from AWS Provider (#18844)](https://github.com/apache/airflow/pull/18844): ***@***.***(https://github.com/mariotaddeucci)
> - [Remove duplicated code on S3ToRedshiftOperator (#18671)](https://github.com/apache/airflow/pull/18671): ***@***.***(https://github.com/mariotaddeucci)
> - [Enable AWS Secrets Manager backend to retrieve conns using different fields (#18764)](https://github.com/apache/airflow/pull/18764): ***@***.***(https://github.com/JavierLopezT)
> - [Enable FTPToS3Operator to transfer several files (#17937)](https://github.com/apache/airflow/pull/17937): ***@***.***(https://github.com/JavierLopezT)
> - [Support all Unix wildcards in S3KeySensor (#18211)](https://github.com/apache/airflow/pull/18211): ***@***.***(https://github.com/john-jac)
> - [Fixing ses email backend (#18042)](https://github.com/apache/airflow/pull/18042): ***@***.***(https://github.com/ignaski)
> - [Fixup string concatenations (#19099)](https://github.com/apache/airflow/pull/19099): ***@***.***(https://github.com/blag)
> - [Update S3PrefixSensor to support checking multiple prefixes within a bucket (#18807)](https://github.com/apache/airflow/pull/18807): ***@***.***(https://github.com/anaynayak)
> - [Adds an s3 list prefixes operator (#17145)](https://github.com/apache/airflow/pull/17145): ***@***.***(https://github.com/jarfgit)
> - [Move validation of templated input params to run after the context init (#19048)](https://github.com/apache/airflow/pull/19048): ***@***.***(https://github.com/eskarimov)
> - [ECSOperator: airflow exception on edge case when cloudwatch log stream is not found (#18733)](https://github.com/apache/airflow/pull/18733): ***@***.***(https://github.com/codenamestif)
> - [Amazon Athena Example (#18785)](https://github.com/apache/airflow/pull/18785): ***@***.***(https://github.com/john-jac)
> - [Amazon SQS Example (#18760)](https://github.com/apache/airflow/pull/18760): ***@***.***(https://github.com/john-jac)
>
> Provider [apache.beam: 3.1.0rc1](https://pypi.org/project/apache-airflow-providers-apache-beam/3.1.0rc1)
>
> - [Use google cloud credentials when executing beam commands in subprocesses (#18992)](https://github.com/apache/airflow/pull/18992): ***@***.***(https://github.com/SamWheating)
>
> Provider [apache.cassandra: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-apache-cassandra/2.1.0rc1)
>
> - [Adding a default conn ID value for Apache Cassandra sensors (#18620)](https://github.com/apache/airflow/pull/18620): ***@***.***(https://github.com/josh-fell)
>
> Provider [apache.hdfs: 2.1.1rc1](https://pypi.org/project/apache-airflow-providers-apache-hdfs/2.1.1rc1)
>
> - [hdfs provider: fix deprecation warning in WebHDFSHook (#18331)](https://github.com/apache/airflow/pull/18331): ***@***.***(https://github.com/Aakcht)
>
> Provider [apache.hive: 2.0.3rc1](https://pypi.org/project/apache-airflow-providers-apache-hive/2.0.3rc1)
>
> - [fix get_connections deprecation warn in hivemetastore hook (#18854)](https://github.com/apache/airflow/pull/18854): ***@***.***(https://github.com/Aakcht)
>
> Provider [apache.livy: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-apache-livy/2.1.0rc1)
>
> - [Fetching and logging Livy session logs for LivyOperator (#17393)](https://github.com/apache/airflow/pull/17393): ***@***.***(https://github.com/sreenath-kamath)
>
> Provider [asana: 1.1.0rc1](https://pypi.org/project/apache-airflow-providers-asana/1.1.0rc1)
>
> - [Use built-in cached_property on Python 3.8 for Asana provider (#17597)](https://github.com/apache/airflow/pull/17597): ***@***.***(https://github.com/kaxil)
>
> Provider [cncf.kubernetes: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/2.1.0rc1)
>
> - [Add more type hints to PodLauncher (#18928)](https://github.com/apache/airflow/pull/18928): ***@***.***(https://github.com/jameslamb)
> - [add more information to PodLauncher timeout error (#17953)](https://github.com/apache/airflow/pull/17953): ***@***.***(https://github.com/jameslamb)
>
> Provider [databricks: 2.0.2rc1](https://pypi.org/project/apache-airflow-providers-databricks/2.0.2rc1)
>
> - [Move DB call out of DatabricksHook.__init__ (#18339)](https://github.com/apache/airflow/pull/18339): ***@***.***(https://github.com/kaxil)
>
> Provider [docker: 2.3.0rc1](https://pypi.org/project/apache-airflow-providers-docker/2.3.0rc1)
>
> - [Add support of placement in the DockerSwarmOperator (#18990)](https://github.com/apache/airflow/pull/18990): ***@***.***(https://github.com/enima2684)
> - [Fixup string concatenations (#19099)](https://github.com/apache/airflow/pull/19099): ***@***.***(https://github.com/blag)
> - [Remove the docker timeout workaround (#18872)](https://github.com/apache/airflow/pull/18872): ***@***.***(https://github.com/RyanSiu1995)
> - [Move docker decorator example dag to docker provider (#18739)](https://github.com/apache/airflow/pull/18739): ***@***.***(https://github.com/ephraimbuddy)
>
> Provider [elasticsearch: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-elasticsearch/2.1.0rc1)
>
> - [AIP 39: Documentation (#17552)](https://github.com/apache/airflow/pull/17552): ***@***.***(https://github.com/uranusjr)
> - [Adds example showing the ES_hook (#17944)](https://github.com/apache/airflow/pull/17944): ***@***.***(https://github.com/frankcash)
>
> Provider [exasol: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-exasol/2.0.1rc1)
>
> - [ExasolHook get_pandas_df does not return pandas dataframe but None (#17850)](https://github.com/apache/airflow/pull/17850): ***@***.***(https://github.com/Goodkat)
>
> Provider [facebook: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-facebook/2.1.0rc1)
>
> - [Align the default version with Facebook business SDK (#18883)](https://github.com/apache/airflow/pull/18883): ***@***.***(https://github.com/RyanSiu1995)
>
> Provider [google: 6.1.0rc1](https://pypi.org/project/apache-airflow-providers-google/6.1.0rc1)
>
> - [Add value to "namespaceId" of query (#19163)](https://github.com/apache/airflow/pull/19163): ***@***.***(https://github.com/deedmitrij)
> - [Add pre-commit hook for common misspelling check in files (#18964)](https://github.com/apache/airflow/pull/18964): ***@***.***(https://github.com/ephraimbuddy)
> - [Support query timeout as an argument in CassandraToGCSOperator (#18927)](https://github.com/apache/airflow/pull/18927): ***@***.***(https://github.com/xuan616)
> - [Update BigQueryCreateExternalTableOperator doc and parameters (#18676)](https://github.com/apache/airflow/pull/18676): ***@***.***(https://github.com/tnyz)
> - [Replacing non-attribute template_fields for BigQueryToMsSqlOperator (#19052)](https://github.com/apache/airflow/pull/19052): ***@***.***(https://github.com/josh-fell)
> - [Upgrade the dataproc package to 3.0.0 and migrate from v1beta2 to v1 api (#18879)](https://github.com/apache/airflow/pull/18879): ***@***.***(https://github.com/lwyszomi)
> - [Use google cloud credentials when executing beam commands in subprocesses (#18992)](https://github.com/apache/airflow/pull/18992): ***@***.***(https://github.com/SamWheating)
> - [Replace default api_version of FacebookAdsReportToGcsOperator (#18996)](https://github.com/apache/airflow/pull/18996): ***@***.***(https://github.com/eladkal)
> - [Dataflow Operators - use project and location from job in on_kill method. (#18699)](https://github.com/apache/airflow/pull/18699): ***@***.***(https://github.com/lwyszomi)
> - [Fix hard-coded /tmp directory in CloudSQL Hook (#19229)](https://github.com/apache/airflow/pull/19229): ***@***.***(https://github.com/potiuk)
> - [Fix bug in Dataflow hook when no jobs are returned (#18981)](https://github.com/apache/airflow/pull/18981): ***@***.***(https://github.com/keze)
> - [Fix BigQueryToMsSqlOperator documentation (#18995)](https://github.com/apache/airflow/pull/18995): ***@***.***(https://github.com/potatochip)
> - [Move validation of templated input params to run after the context init (#19048)](https://github.com/apache/airflow/pull/19048): ***@***.***(https://github.com/eskarimov)
> - [Google provider catch invalid secret name (#18790)](https://github.com/apache/airflow/pull/18790): ***@***.***(https://github.com/raphaelauv)
>
> Provider [hashicorp: 2.1.1rc1](https://pypi.org/project/apache-airflow-providers-hashicorp/2.1.1rc1)
>
> - [Fixing Vault AppRole authentication with CONN_URI (#18064)](https://github.com/apache/airflow/pull/18064): ***@***.***(https://github.com/nathadfield)
>
> Provider [jdbc: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-jdbc/2.0.1rc1)
>
> - [Fix type annotations in OracleOperator, JdbcOperator, SqliteOperator (#17406)](https://github.com/apache/airflow/pull/17406): ***@***.***(https://github.com/shadrus)
>
> Provider [jenkins: 2.0.3rc1](https://pypi.org/project/apache-airflow-providers-jenkins/2.0.3rc1)
>
> - [Remove distutils usages for Python 3.10 (#19064)](https://github.com/apache/airflow/pull/19064): ***@***.***(https://github.com/uranusjr)
>
> Provider [microsoft.azure: 3.3.0rc1](https://pypi.org/project/apache-airflow-providers-microsoft-azure/3.3.0rc1)
>
> - [update azure cosmos to latest version (#18695)](https://github.com/apache/airflow/pull/18695): ***@***.***(https://github.com/eladkal)
> - [Added sas_token var to BlobServiceClient return. Updated tests (#19234)](https://github.com/apache/airflow/pull/19234): ***@***.***(https://github.com/ReadytoRocc)
> - [Add pre-commit hook for common misspelling check in files (#18964)](https://github.com/apache/airflow/pull/18964): ***@***.***(https://github.com/ephraimbuddy)
> - [Fix changelog for Azure Provider (#18736)](https://github.com/apache/airflow/pull/18736): ***@***.***(https://github.com/potiuk)
> - [Expanding docs on client auth for AzureKeyVaultBackend (#18659)](https://github.com/apache/airflow/pull/18659): ***@***.***(https://github.com/alexbegg)
> - [Static start_date and default arg cleanup for Microsoft providers example DAGs (#19062)](https://github.com/apache/airflow/pull/19062): ***@***.***(https://github.com/josh-fell)
>
> Provider [microsoft.psrp: 1.0.1rc1](https://pypi.org/project/apache-airflow-providers-microsoft-psrp/1.0.1rc1)
>
> - [Fix unexpected bug in exiting PSRPHook.client context manager (#18014)](https://github.com/apache/airflow/pull/18014): ***@***.***(https://github.com/malthe)
>
> Provider [mongo: 2.2.0rc1](https://pypi.org/project/apache-airflow-providers-mongo/2.2.0rc1)
>
> - [#19223 add mongo_db param to MongoSensor (#19276)](https://github.com/apache/airflow/pull/19276): ***@***.***(https://github.com/bhavaniravi)
>
> Provider [neo4j: 2.0.2rc1](https://pypi.org/project/apache-airflow-providers-neo4j/2.0.2rc1)
>
> - [fix Neo4jHook to get the query response (#18007)](https://github.com/apache/airflow/pull/18007): ***@***.***(https://github.com/minu7)
>
> Provider [openfaas: 2.0.0rc1](https://pypi.org/project/apache-airflow-providers-openfaas/2.0.0rc1)
>
> - [Auto-apply apply_default decorator (#15667)](https://github.com/apache/airflow/pull/15667): ***@***.***(https://github.com/ashb)
>
> Provider [pagerduty: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-pagerduty/2.1.0rc1)
>
> - [Add standard hook fields to pagerdutyHook to make hook show up in UI (#18763)](https://github.com/apache/airflow/pull/18763): ***@***.***(https://github.com/GuidoTournois)
> - [Make a separate hook for interacting with the Pagerduty Events API (#18784)](https://github.com/apache/airflow/pull/18784): ***@***.***(https://github.com/GuidoTournois)
>
> Provider [papermill: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-papermill/2.1.0rc1)
>
> - [Add support for templated fields in PapermillOperator (#18357)](https://github.com/apache/airflow/pull/18357): ***@***.***(https://github.com/eladkal)
> - [Fix usage of range(len()) to enumerate (#18174)](https://github.com/apache/airflow/pull/18174): ***@***.***(https://github.com/kaxil)
>
> Provider [postgres: 2.3.0rc1](https://pypi.org/project/apache-airflow-providers-postgres/2.3.0rc1)
>
> - [Added upsert method on S3ToRedshift operator (#18027)](https://github.com/apache/airflow/pull/18027): ***@***.***(https://github.com/mariotaddeucci)
> - [Fix example dag of PostgresOperator (#18236)](https://github.com/apache/airflow/pull/18236): ***@***.***(https://github.com/eladkal)
>
> Provider [salesforce: 3.3.0rc1](https://pypi.org/project/apache-airflow-providers-salesforce/3.3.0rc1)
>
> - [Add SalesforceApexRestOperator (#18819)](https://github.com/apache/airflow/pull/18819): ***@***.***(https://github.com/mariotaddeucci)
>
> Provider [samba: 3.0.1rc1](https://pypi.org/project/apache-airflow-providers-samba/3.0.1rc1)
>
> - [Handle leading slash in samba path (#18847)](https://github.com/apache/airflow/pull/18847): ***@***.***(https://github.com/fredthomsen)
> - [Open src and dst in binary for samba copy (#18752)](https://github.com/apache/airflow/pull/18752): ***@***.***(https://github.com/fredthomsen)
>
> Provider [sftp: 2.2.0rc1](https://pypi.org/project/apache-airflow-providers-sftp/2.2.0rc1)
>
> - [SFTP hook to prefer the SSH paramiko key over the key file path (#18988)](https://github.com/apache/airflow/pull/18988): ***@***.***(https://github.com/30blay)
>
> Provider [slack: 4.1.0rc1](https://pypi.org/project/apache-airflow-providers-slack/4.1.0rc1)
>
> - [Restore 'filename' to template_fields of SlackAPIFileOperator (#18466)](https://github.com/apache/airflow/pull/18466): ***@***.***(https://github.com/SayTen)
>
> Provider [snowflake: 2.3.0rc1](https://pypi.org/project/apache-airflow-providers-snowflake/2.3.0rc1)
>
> - [Add test_connection method for Snowflake Hook (#19041)](https://github.com/apache/airflow/pull/19041): ***@***.***(https://github.com/msumit)
> - [Add region to Snowflake URI. (#18650)](https://github.com/apache/airflow/pull/18650): ***@***.***(https://github.com/dimberman)
>
> Provider [sqlite: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-sqlite/2.0.1rc1)
>
> - [Fix sqlite hook - insert and replace functions (#17695)](https://github.com/apache/airflow/pull/17695): ***@***.***(https://github.com/subkanthi)
>
> Provider [ssh: 2.3.0rc1](https://pypi.org/project/apache-airflow-providers-ssh/2.3.0rc1)
>
> - [Refactor SSHOperator so a subclass can run many commands (#10874) (#17378)](https://github.com/apache/airflow/pull/17378): ***@***.***(https://github.com/baolsen)
> - [update sshtunnel version (#18684)](https://github.com/apache/airflow/pull/18684): ***@***.***(https://github.com/eladkal)
> - [Correctly handle get_pty attribute if command passed as XComArg or template (#19323)](https://github.com/apache/airflow/pull/19323): ***@***.***(https://github.com/josh-fell)
>
> Provider [tableau: 2.1.2rc1](https://pypi.org/project/apache-airflow-providers-tableau/2.1.2rc1)
>
> - [Remove distutils usages for Python 3.10 (#19064)](https://github.com/apache/airflow/pull/19064): ***@***.***(https://github.com/uranusjr)
>
> Provider [trino: 2.0.2rc1](https://pypi.org/project/apache-airflow-providers-trino/2.0.2rc1)
>
> - [Properly handle verify parameter in TrinoHook (#18791)](https://github.com/apache/airflow/pull/18791): @danarwix
>
> Provider [yandex: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-yandex/2.1.0rc1)
>
> - [Add autoscaling subcluster support and remove defaults (#17033)](https://github.com/apache/airflow/pull/17033): @peter-volkov
>
> Providers that do not need testing
>
> Those are providers that were either doc-only or had changes that do not require testing.
>
> - Provider [airbyte: 2.1.1rc1](https://pypi.org/project/apache-airflow-providers-airbyte/2.1.1rc1)
> - Provider [alibaba: 1.0.0rc1](https://pypi.org/project/apache-airflow-providers-alibaba/1.0.0rc1)
> - Provider [apache.drill: 1.0.1rc1](https://pypi.org/project/apache-airflow-providers-apache-drill/1.0.1rc1)
> - Provider [apache.druid: 2.0.2rc1](https://pypi.org/project/apache-airflow-providers-apache-druid/2.0.2rc1)
> - Provider [apache.kylin: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-apache-kylin/2.0.1rc1)
> - Provider [apache.pig: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-apache-pig/2.0.1rc1)
> - Provider [apache.pinot: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-apache-pinot/2.0.1rc1)
> - Provider [apache.spark: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-apache-spark/2.0.1rc1)
> - Provider [apache.sqoop: 2.0.2rc1](https://pypi.org/project/apache-airflow-providers-apache-sqoop/2.0.2rc1)
> - Provider [celery: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-celery/2.1.0rc1)
> - Provider [cloudant: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-cloudant/2.0.1rc1)
> - Provider [datadog: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-datadog/2.0.1rc1)
> - Provider [dingding: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-dingding/2.0.1rc1)
> - Provider [discord: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-discord/2.0.1rc1)
> - Provider [ftp: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-ftp/2.0.1rc1)
> - Provider [grpc: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-grpc/2.0.1rc1)
> - Provider [http: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-http/2.0.1rc1)
> - Provider [imap: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-imap/2.0.1rc1)
> - Provider [influxdb: 1.0.0rc1](https://pypi.org/project/apache-airflow-providers-influxdb/1.0.0rc1)
> - Provider [jira: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-jira/2.0.1rc1)
> - Provider [microsoft.mssql: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-microsoft-mssql/2.0.1rc1)
> - Provider [microsoft.winrm: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-microsoft-winrm/2.0.1rc1)
> - Provider [mysql: 2.1.1rc1](https://pypi.org/project/apache-airflow-providers-mysql/2.1.1rc1)
> - Provider [odbc: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-odbc/2.0.1rc1)
> - Provider [opsgenie: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-opsgenie/2.0.1rc1)
> - Provider [oracle: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-oracle/2.0.1rc1)
> - Provider [plexus: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-plexus/2.0.1rc1)
> - Provider [presto: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-presto/2.0.1rc1)
> - Provider [qubole: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-qubole/2.0.1rc1)
> - Provider [redis: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-redis/2.0.1rc1)
> - Provider [segment: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-segment/2.0.1rc1)
> - Provider [sendgrid: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-sendgrid/2.0.1rc1)
> - Provider [singularity: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-singularity/2.0.1rc1)
> - Provider [telegram: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-telegram/2.0.1rc1)
> - Provider [vertica: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-vertica/2.0.1rc1)
> - Provider [zendesk: 2.0.1rc1](https://pypi.org/project/apache-airflow-providers-zendesk/2.0.1rc1)
>
> Thanks to all who contributed to those provider's release
>
> ***@***.***(https://github.com/sreenath-kamath) ***@***.***(https://github.com/jarfgit) ***@***.***(https://github.com/frankcash) ***@***.***(https://github.com/deedmitrij) ***@***.***(https://github.com/enima2684) ***@***.***(https://github.com/uranusjr) @peter-volkov ***@***.***(https://github.com/mariotaddeucci) ***@***.***(https://github.com/potatochip) ***@***.***(https://github.com/john-jac) ***@***.***(https://github.com/malthe) ***@***.***(https://github.com/msumit) ***@***.***(https://github.com/dimberman) ***@***.***(https://github.com/jameslamb) ***@***.***(https://github.com/Brooke-white) ***@***.***(https://github.com/codenamestif) ***@***.***(https://github.com/GuidoTournois) ***@***.***(https://github.com/minu7) ***@***.***(https://github.com/ashb) ***@***.***(https://github.com/shadrus) ***@***.***(https://github.com/ignaski) ***@***.***(https://github.com/ferruzzi) ***@***.***(https://github.com/eladkal) ***@***.***(https://github.com/ephraimbuddy) ***@***.***(h
ttps://github.com/eskarimov) ***@***.***(https://github.com/JavierLopezT) ***@***.***(https://github.com/keze) ***@***.***(https://github.com/josh-fell) ***@***.***(https://github.com/anaynayak) ***@***.***(https://github.com/raphaelauv) ***@***.***(https://github.com/blag) ***@***.***(https://github.com/Aakcht) ***@***.***(https://github.com/guotongfei) ***@***.***(https://github.com/SamWheating) ***@***.***(https://github.com/potiuk) ***@***.***(https://github.com/ron-damon) @danarwix
> ***@***.***(https://github.com/subkanthi) ***@***.***(https://github.com/alexbegg) ***@***.***(https://github.com/bhavaniravi) ***@***.***(https://github.com/tnyz) ***@***.***(https://github.com/Goodkat) ***@***.***(https://github.com/fredthomsen) ***@***.***(https://github.com/SayTen) ***@***.***(https://github.com/kaxil) ***@***.***(https://github.com/lwyszomi) ***@***.***(https://github.com/ReadytoRocc) ***@***.***(https://github.com/baolsen) ***@***.***(https://github.com/30blay) ***@***.***(https://github.com/nathadfield) ***@***.***(https://github.com/xuan616) ***@***.***(https://github.com/RyanSiu1995)
>
> Committer
>
> - I acknowledge that I am a maintainer/committer of the Apache Airflow project.
>
> —
> You are receiving this because you were mentioned.
> Reply to this email directly, [view it on GitHub](https://github.com/apache/airflow/issues/19328), or [unsubscribe](https://github.com/notifications/unsubscribe-auth/AAGW3QC7BCJJ3AEDYHQ4UATUJQAXLANCNFSM5HBDLQLQ).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-959962812
> > > Provider facebook: 2.1.0rc1
> > > Provider google: 6.1.0rc1
> > > microsoft.azure 3.3.0rc1
Hey @mik-laj - thanks for raising your concenrs. i looked closer, and I do not see those changes as really "breaking" (or at least not really breaking enough and under our control to justify major version change (but I am open to hear to arguments if others disagree).
## Facebook
Facebook API does not follow SemVer. AT ALL.
They mostly introduce new features and bugfixes when they bump the version. More interestingly, they even CHANGE behaviour of old versions of APIs when this behaviour is working for quite some time in the new versions.
Here are the changes to insights features we are using for example:
> Insights
> Applies to v9.0+. Will apply to all versions on May 9, 2021.
> IG User follower_count values now align more closely with their corresponding values displayed in the Instagram app. In > addition, follower_count now returns a maximum of 30 days of data instead of 2 years.
and:
> Ads Insights API
> Updated date_preset parameter
> Applies to v10.0+.
> The lifetime parameter (date_preset=lifetime) is disabled and replaced with date_preset=maximum, which can be used to retrieve a maximum of 37 months of data. The API will return an error when requests contain date ranges beyond the 37-month window.
> For v9.0 and lower, there will be no change in functionality until May 25, 2021. At that time, date_preset=maximum will be enabled and any lifetime calls will default to maximum and return only 37 months of data.
and:
> Deprecation of Store Visit Metrics
> Applies to 11.0+. Will apply to all versions on Sept. 6, 2021.
This means that the version 6.0 of "insights" we were using so far has anyway changed behaviour on Sep 6th this year to match the current 11+ behaviour :scream:
So from what we see here, Facebook has chosen a "move fast break things" approach for their APIs. I assume Facebook users know it and I think the approach we took is a good one - we should not really try to keep compatibilty with version vN of Facebook, because even they don't do/recommend it (and we won't be able to actually do that because they can anyhow change the behaviour without us knowing it). So keeping the approach where by default API version is "latest" seems like a good approach and I do not see it really breaking anything.
## Cosmos
> Provider microsoft.azure: 3.3.0rc1
> update azure cosmos to latest version (#18695): @eladkal
I looked at the changes again, and I do not see any breaking change. We indeed sometimes (but not always) bumped major versions for our providers when underlying libraries changed but only when they changed the Airflow API of that provider (format of data returned and similar). The sheer fact of library upgrading it's version does not automatically invalidates and forces bump to new version of all the applications and libraries using it. In this particular case, we simply adapted our implementation so that the API remained the same (the breaking change which affected us was simply throwing a different exception - in our case we caught it and returned None, and this behaviour remained so there is no reason to bump the major version here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk closed issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk closed issue #19328:
URL: https://github.com/apache/airflow/issues/19328
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956086845
> #18844 got errors using `RedshiftSQLHook ` when executing multiple commands into a prepared statement. I'll fix it.
How serious / how much of a regression change is it @mariotadeucci ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mariotaddeucci commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
mariotaddeucci commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-955781820
#18027 is already present in 2.3.0, tested in #18638
#18671 and #18819 are all good
#18844 got errors using `RedshiftSQLHook ` when executing multiple commands into a prepared statement. I'll fix it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mik-laj commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
mik-laj commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-957872234
> Provider facebook: 2.1.0rc1
> Align the default version with Facebook business SDK (#18883): @RyanSiu1995
It is a breaking change, so it should be in a new release.
> Provider google: 6.1.0rc1
> Replace default api_version of FacebookAdsReportToGcsOperator (#18996): @eladkal
It is breaking change also.
> Provider microsoft.azure: 3.3.0rc1
> update azure cosmos to latest version (#18695): @eladkal
I am not sure here, but when we changed the minimum requirements of the google libraries, we always bumped the major version. Airflow is a thin layer between libraries and user, so breaking changes propagate to Airflow very easily.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mariotaddeucci edited a comment on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
mariotaddeucci edited a comment on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-957034378
> > #18844 got errors using `RedshiftSQLHook ` when executing multiple commands into a prepared statement. I'll fix it.
>
> How serious / how much of a regression change is it @mariotadeucci ?
@potiuk Happend on `S3ToRedshiftOperator` with specific configuration. By using "UPSERT" or "REPLACE" is generate an sql block with multiple queries. The `RedshiftSQLHook` don't support execute multiple queries in a single call of `execute`. To fix it just need to convert the single query string to a list of queries. Fix is available on PR #19358.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-959962812
> > > Provider facebook: 2.1.0rc1
> > > Provider google: 6.1.0rc1
> > > microsoft.azure 3.3.0rc1
Hey @mik-laj - thanks for raising your concenrs. i looked closer, and I do not see those changes as really "breaking" (or at least not really breaking enough and under our control to justify major version change (but I am open to hear to arguments if others disagree).
## Facebook
Facebook API does not follow SemVer. AT ALL.
They mostly introduce new features and bugfixes when they bump the version. More interestingly, they even CHANGE behaviour of old versions of APIs when this behaviour is working for quite some time in the new versions.
Here are the changes to insights features we are using for example:
> Insights
> Applies to v9.0+. Will apply to all versions on May 9, 2021.
> IG User follower_count values now align more closely with their corresponding values displayed in the Instagram app. In > addition, follower_count now returns a maximum of 30 days of data instead of 2 years.
and:
> Ads Insights API
> Updated date_preset parameter
> Applies to v10.0+.
> The lifetime parameter (date_preset=lifetime) is disabled and replaced with date_preset=maximum, which can be used to retrieve a maximum of 37 months of data. The API will return an error when requests contain date ranges beyond the 37-month window.
> For v9.0 and lower, there will be no change in functionality until May 25, 2021. At that time, date_preset=maximum will be enabled and any lifetime calls will default to maximum and return only 37 months of data.
and:
> Deprecation of Store Visit Metrics
> Applies to 11.0+. Will apply to all versions on Sept. 6, 2021.
This means that the version 6.0 of "insights" we were using so far has anyway changed behaviour on Sep 6th this year to match the current 11+ behaviour :scream:
So from what we see here, Facebook has chosen a "move fast break things" approach for their APIs. I assume Facebook users know it and I think the approach we took is a good one - we should not really try to keep compatibilty with version vN of Facebook, because even they don't do/recommend it (and we won't be able to actually do that because they can anyhow change the behaviour without us knowing it). So keeping the approach where by default API version is "latest" seems like a good approach and I do not see it really breaking anything.
## Cosmos
> Provider microsoft.azure: 3.3.0rc1
> update azure cosmos to latest version (#18695): @eladkal
I looked at the changes again, and I do not see any breaking change. We indeed sometimes (but not always) bumped major versions for our providers when underlying libraries changed but only when they changed the Airflow API of that provider (format of data returned and similar). The sheer fact of library upgrading it's version does not automatically invalidates and forces bump to new version of all the applications and libraries using it. In this particular case, we simply adapted our implementation so that the API remained the same (the breaking change which affected us was simply throwing a different exception - in our case we caught it and returned None, and this behaviour remained so there is no reason to bump the major version here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] tnyz commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
tnyz commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956487076
tested #18676 and working
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-961340526
Closing this one. As described in https://lists.apache.org/thread/6tzsq6xkm5r1q6pqtyq5yhvr5p1jqd13 I am releasing the wave now and we are removing the Amazon Provider from that release due to Redshift regression (and I will release fixed version soon). Thanks @mariotaddeucci for testing and spotting the problem (it was not obvious in the initial change and it's great you tested this case!)
Thanks everyone who helped!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-961340526
Closing this one. As described in https://lists.apache.org/thread/6tzsq6xkm5r1q6pqtyq5yhvr5p1jqd13 I am releasing the wave now and we are removing the Amazon Provider from that release due to Redshift regression (and I will release fixed version soon). Thanks @mariotaddeucci for testing and spotting the problem (it was not obvious in the initial change and it's great you tested this case!)
Thanks everyone who helped!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] raphaelauv commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
raphaelauv commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-955242022
for **cncf.kubernetes: 2.1.0rc1** it's all good
add more information to PodLauncher timeout error (#17953) -> is working
```
File "/usr/local/lib/python3.9/site-packages/airflow/providers/cncf/kubernetes/operators/kubernetes_pod.py", line 374, in execute
raise AirflowException(f'Pod Launching failed: {ex}')
airflow.exceptions.AirflowException: Pod Launching failed: Pod took longer than 120 seconds to start. Check the pod events in kubernetes to determine why.
[2021-10-30, 14:21:41 UTC] {local_task_job.py:154} INFO - Task exited with return code 1
[2021-10-30, 14:21:41 UTC] {local_task_job.py:264} INFO - 0 downstream tasks scheduled from follow-on schedule check
```
Add more type hints to PodLauncher (#18928) > just typing , so OK
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956085116
> #17397 and #18764 were already tested in the last wave
Correct - already removed (that was amazon's later release and wrong tag set - already corrected :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk edited a comment on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk edited a comment on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956086845
> #18844 got errors using `RedshiftSQLHook ` when executing multiple commands into a prepared statement. I'll fix it.
How serious / how much of a regression change is it @mariotadeucci ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] Goodkat commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
Goodkat commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956089831
#17850 was already tested within 2.0.0rc2 release
#15016 (comment)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk edited a comment on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk edited a comment on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956090325
| #18872 I tested this PR and it is not working as expected.
@RyanSiu1995 can you please double check if you have the same problem ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956083915
> #18331 is already present in 2.1.1 ( it was tested in #18638) , so I don't think `hdfs 2.1.1rc1` should be present here.
Right - the issue generation script has a bug apparently in this case - hdfs is not being released. I Will fix it. Removed it from the issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-957949728
> > Provider facebook: 2.1.0rc1
> > Align the default version with Facebook business SDK (#18883): @RyanSiu1995
>
> It is a breaking change, so it should be in a new release.
>
> > Provider google: 6.1.0rc1
> > Replace default api_version of FacebookAdsReportToGcsOperator (#18996): @eladkal
>
> It is breaking change also.
>
> > Provider microsoft.azure: 3.3.0rc1
> > update azure cosmos to latest version (#18695): @eladkal
>
> I am not sure here, but when we changed the minimum requirements of the google libraries, we always bumped the major version. Airflow is a thin layer between libraries and user, so breaking changes propagate to Airflow very easily.
>
Thanks @mik-laj I will take a look and decide
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] codenamestif commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
codenamestif commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-955242623
I think #18733 was released in 2.3.0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk removed a comment on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk removed a comment on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-955437787
> I think #18733 was released in 2.3.0
Good spot @codenamestif ! It turned out that after last month's release of 2.3.0 as rc2 I set the "2.3.0" tag wrongly to rc1 - so the changes added between rc1 and rc2 were duplicated in the issue and changelog (and I missed that when I prepared it today). Those are the duplicated issues:
* ``Add AWS Fargate profile support (#18645)``
* ``Add emr cluster link (#18691)``
* ``AwsGlueJobOperator: add wait_for_completion to Glue job run (#18814)``
* ``AwsGlueJobOperator: add run_job_kwargs to Glue job run (#16796)``
* ``Add additional dependency for postgres extra for amazon provider (#18737)``
* ``Adds an s3 list prefixes operator (#17145)``
* ``ECSOperator: airflow exception on edge case when cloudwatch log stream is not found (#18733)``
* ``Amazon Athena Example (#18785)``
* ``Amazon SQS Example (#18760)``
I already corrected the tag, the issue and I will also correct the Changelog (and in docs those entries will be missing), but unless there are other, more serious changes that make it rc1, it will remain in the package README (and tecchnically those changes ARE in 2.4.0 as well as 2.3.0), In the future packages changelog will corrected.
Sorry everyone involved for spamming!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] tnyz commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
tnyz commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956487076
tested #18676 and working
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] raphaelauv commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
raphaelauv commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-955277760
for **google: 6.1.0rc1**
Google provider catch invalid secret name (#18790) -> is working
```
[2021-10-30 14:56:31,254] {logging_mixin.py:104} INFO - Running <TaskInstance: a_nice_dag.also_run_this 2021-10-20T00:00:00+00:00 [running]> on host 0dbece050201
[2021-10-30 14:56:31,797] {secret_manager_client.py:100} ERROR - Google Cloud API Call Error (InvalidArgument): Invalid secret ID XXXXXXXXXXXXXX-variable-toto.tata.
Only ASCII alphabets (a-Z), numbers (0-9), dashes (-), and underscores (_)
are allowed in the secret ID.
[2021-10-30 14:56:31,858] {taskinstance.py:1300} INFO - Exporting the following env vars:
...
```
the error about secrets with a non valid char is now catch
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] Aakcht commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
Aakcht commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-955575296
Tested #18854 - all good.
#18331 is already present in 2.1.1 ( it was tested in #18638) , so I don't think `hdfs 2.1.1rc1` should be present here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mik-laj commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
mik-laj commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-957872234
> Provider facebook: 2.1.0rc1
> Align the default version with Facebook business SDK (#18883): @RyanSiu1995
It is a breaking change, so it should be in a new release.
> Provider google: 6.1.0rc1
> Replace default api_version of FacebookAdsReportToGcsOperator (#18996): @eladkal
It is breaking change also.
> Provider microsoft.azure: 3.3.0rc1
> update azure cosmos to latest version (#18695): @eladkal
I am not sure here, but when we changed the minimum requirements of the google libraries, we always bumped the major version. Airflow is a thin layer between libraries and user, so breaking changes propagate to Airflow very easily.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956100305
I removed the few other providers which suffered from the same issue - sorry :(
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mariotaddeucci commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
mariotaddeucci commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-957034378
> > #18844 got errors using `RedshiftSQLHook ` when executing multiple commands into a prepared statement. I'll fix it.
>
> How serious / how much of a regression change is it @mariotadeucci ?
@potiuk Happend on `S3ToRedshiftOperator` with specific configuration. By using "UPSERT" or "REPLACE" is generate an sql block with multiple queries. The `RedshiftSQLHook` don't support execute multiple queries in a single call of `execute`. To fix it just need to convert the single query string to a list of queries. Fix is available on PR #19358.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mik-laj commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
mik-laj commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-957872234
> Provider facebook: 2.1.0rc1
> Align the default version with Facebook business SDK (#18883): @RyanSiu1995
It is a breaking change, so it should be in a new release.
> Provider google: 6.1.0rc1
> Replace default api_version of FacebookAdsReportToGcsOperator (#18996): @eladkal
It is breaking change also.
> Provider microsoft.azure: 3.3.0rc1
> update azure cosmos to latest version (#18695): @eladkal
I am not sure here, but when we changed the minimum requirements of the google libraries, we always bumped the major version. Airflow is a thin layer between libraries and user, so breaking changes propagate to Airflow very easily.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956618907
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mariotaddeucci edited a comment on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
mariotaddeucci edited a comment on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-957034378
> > #18844 got errors using `RedshiftSQLHook ` when executing multiple commands into a prepared statement. I'll fix it.
>
> How serious / how much of a regression change is it @mariotadeucci ?
@potiuk Happend on `S3ToRedshiftOperator` with specific configuration. By using "UPSERT" or "REPLACE" is generate an sql block with multiple queries. The `RedshiftSQLHook` don't support execute multiple queries in a single call of `execute`. To fix it just need to convert the single query string to a list of queries. Fix is available on PR #19358.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mariotaddeucci commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
mariotaddeucci commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-957034378
> > #18844 got errors using `RedshiftSQLHook ` when executing multiple commands into a prepared statement. I'll fix it.
>
> How serious / how much of a regression change is it @mariotadeucci ?
@potiuk Happend on `S3ToRedshiftOperator` with specific configuration. By using "UPSERT" or "REPLACE" is generate an sql block with multiple queries. The `RedshiftSQLHook` don't support execute multiple queries in a single call of `execute`. To fix it just need to convert the single query string to a list of queries. Fix is available on PR #19358.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956091279
> #17850 was already tested within 2.0.0rc2 release
Correct - exasol is not being released (same bug as with hdfs when generating issue only). I will fix it. Sorry for spam.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] anaynayak commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
anaynayak commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956413495
#18807 tested and verified both single + multiple s3 prefix matches.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956618907
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] bhavaniravi commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
bhavaniravi commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-957301531
Tested #19276 MongoSensor picking up the new db param
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] josh-fell commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
josh-fell commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956438029
Tested and verified #19052, #19062, and #19323. Thanks for organizing this release Jarek!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-961340526
Closing this one. As described in https://lists.apache.org/thread/6tzsq6xkm5r1q6pqtyq5yhvr5p1jqd13 I am releasing the wave now and we are removing the Amazon Provider from that release due to Redshift regression (and I will release fixed version soon). Thanks @mariotaddeucci for testing and spotting the problem (it was not obvious in the initial change and it's great you tested this case!)
Thanks everyone who helped!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] enima2684 commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
enima2684 commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956080176
#18990 tested and working
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] josh-fell commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
josh-fell commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956438029
Tested and verified #19052, #19062, and #19323. Thanks for organizing this release Jarek!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] bhavaniravi commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
bhavaniravi commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-957301531
Tested #19276 MongoSensor picking up the new db param
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mik-laj edited a comment on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
mik-laj edited a comment on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-957872234
> Provider facebook: 2.1.0rc1
> Align the default version with Facebook business SDK (#18883): @RyanSiu1995
It is a breaking change, so <strike>it should be in a new release</strike> we should bump major version.
> Provider google: 6.1.0rc1
> Replace default api_version of FacebookAdsReportToGcsOperator (#18996): @eladkal
It is breaking change also.
> Provider microsoft.azure: 3.3.0rc1
> update azure cosmos to latest version (#18695): @eladkal
I am not sure here, but when we changed the minimum requirements of the google libraries, we always bumped the major version. Airflow is a thin layer between libraries and user, so breaking changes propagate to Airflow very easily.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] anaynayak commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
anaynayak commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956413495
#18807 tested and verified both single + multiple s3 prefix matches.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-956618907
Good progress so far :)!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] eskarimov commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
eskarimov commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-957252449
Tested #19048, works correctly :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] SamWheating commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
SamWheating commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-959822472
regarding https://github.com/apache/airflow/pull/18992
I've tested this change in our environment with the DataflowCreateJavaJobOperator. I haven't had a chance to set up test jobs for the other operators but based on the similarities in implementation I think that this fix should be applicable to all of them.
This PR introduced a change in behaviour, but I don't think it should be considered a breaking change as it is simply returning to the original / documented behaviour.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] SamWheating commented on issue #19328: Status of testing Providers that were prepared on October 30, 2021
Posted by GitBox <gi...@apache.org>.
SamWheating commented on issue #19328:
URL: https://github.com/apache/airflow/issues/19328#issuecomment-959822472
regarding https://github.com/apache/airflow/pull/18992
I've tested this change in our environment with the DataflowCreateJavaJobOperator. I haven't had a chance to set up test jobs for the other operators but based on the similarities in implementation I think that this fix should be applicable to all of them.
This PR introduced a change in behaviour, but I don't think it should be considered a breaking change as it is simply returning to the original / documented behaviour.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org