You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/07/27 16:35:49 UTC
[GitHub] [airflow] potiuk opened a new issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
potiuk opened a new issue #17268:
URL: https://github.com/apache/airflow/issues/17268
This is the second attempt (rc2) of releasing July Providers :). I carried over the "checkmarks" from the last testing so there is no need to re-test those.
I have a kind request for all the contributors to the latest provider packages release.
Could you help us to test the RC versions of the providers and let us know in the comment, if the issue is addressed there.
## Providers that need testing
Those are providers that require testing as there were some substantial changes introduced:
### Provider [airbyte: 2.1.0rc2](https://pypi.org/project/apache-airflow-providers-airbyte/2.1.0rc2)
- [x] [Fixed wrongly escaped characters in amazon's changelog (#17020)](https://github.com/apache/airflow/pull/17020): @potiuk
### Provider [amazon: 2.1.0rc2](https://pypi.org/project/apache-airflow-providers-amazon/2.1.0rc2)
- [ ] [Allow attaching to previously launched task in ECSOperator (#16685)](https://github.com/apache/airflow/pull/16685): @pmalafosse
- [ ] [Update AWS Base hook to use refreshable credentials (#16770) (#16771)](https://github.com/apache/airflow/pull/16771): @baolsen
- [x] [Added select_query to the templated fields in RedshiftToS3Operator (#16767)](https://github.com/apache/airflow/pull/16767): @hewe
- [ ] [AWS Hook - allow IDP HTTP retry (#12639) (#16612)](https://github.com/apache/airflow/pull/16612): @baolsen
- [ ] [Update Boto3 API calls in ECSOperator (#16050)](https://github.com/apache/airflow/pull/16050): @scottypate
- [ ] [Adding custom Salesforce connection type + SalesforceToS3Operator updates (#17162)](https://github.com/apache/airflow/pull/17162): @josh-fell
- [ ] [Adding SalesforceToS3Operator to Amazon Provider (#17094)](https://github.com/apache/airflow/pull/17094): @josh-fell
- [ ] [AWS DataSync Operator does not cancel task on Exception (#11011)](https://github.com/apache/airflow/issues/11011): @baolsen
- [ ] [Fix wrong template_fields_renderers for AWS operators (#16820)](https://github.com/apache/airflow/pull/16820): @codenamestif
- [ ] [AWS DataSync cancel task on exception (#11011) (#16589)](https://github.com/apache/airflow/pull/16589): @baolsen
- [ ] [Fixed template_fields_renderers for Amazon provider (#17087)](https://github.com/apache/airflow/pull/17087): @oyarushe
- [ ] [removing try-catch block to fix timeout exception getting ignored in aws batch operator (#17081)](https://github.com/apache/airflow/pull/17081): @ayushchauhan0811
- [ ] [ECSOperator / pass context to self.xcom_pull as it was missing (when using reattach) (#17141)](https://github.com/apache/airflow/pull/17141): @pmalafosse
- [ ] [Made S3ToRedshiftOperator transaction safe (#17117)](https://github.com/apache/airflow/pull/17117): @oyarushe
### Provider [apache.druid: 2.0.1rc2](https://pypi.org/project/apache-airflow-providers-apache-druid/2.0.1rc2)
- [ ] [Fix error in Druid connection attribute retrieval (#17095)](https://github.com/apache/airflow/pull/17095): @potiuk
### Provider [apache.hive: 2.0.1rc2](https://pypi.org/project/apache-airflow-providers-apache-hive/2.0.1rc2)
- [ ] [Add python 3.9 (#15515)](https://github.com/apache/airflow/pull/15515): @potiuk
### Provider [apache.spark: 2.0.0rc2](https://pypi.org/project/apache-airflow-providers-apache-spark/2.0.0rc2)
- [ ] [Make SparkSqlHook use Connection (#15794)](https://github.com/apache/airflow/pull/15794): @uranusjr
### Provider [apache.sqoop: 2.0.1rc2](https://pypi.org/project/apache-airflow-providers-apache-sqoop/2.0.1rc2)
- [x] [Fix Minor Bugs in Apache Sqoop Hook and Operator (#16350)](https://github.com/apache/airflow/pull/16350): @ciancolo
### Provider [cncf.kubernetes: 2.0.1rc2](https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/2.0.1rc2)
- [x] [BugFix: Using `json` string in template_field fails with K8s Operators (#16930)](https://github.com/apache/airflow/pull/16930): @kaxil
### Provider [dingding: 2.0.0rc2](https://pypi.org/project/apache-airflow-providers-dingding/2.0.0rc2)
- [ ] [Fix hooks extended from http hook (#16109)](https://github.com/apache/airflow/pull/16109): @msumit
### Provider [discord: 2.0.0rc2](https://pypi.org/project/apache-airflow-providers-discord/2.0.0rc2)
- [ ] [Fix hooks extended from http hook (#16109)](https://github.com/apache/airflow/pull/16109): @msumit
### Provider [docker: 2.1.0rc2](https://pypi.org/project/apache-airflow-providers-docker/2.1.0rc2)
- [ ] [Adds option to disable mounting temporary folder in DockerOperator (#16932)](https://github.com/apache/airflow/pull/16932): @potiuk
- [ ] [[FIX] Docker provider - retry docker in docker (#17061)](https://github.com/apache/airflow/pull/17061): @raphaelauv
- [ ] [Fix string encoding in DockerOperator when using xcom / json (#13536)](https://github.com/apache/airflow/pull/13536): @AlessioM
### Provider [google: 5.0.0rc2](https://pypi.org/project/apache-airflow-providers-google/5.0.0rc2)
- [ ] [apache-airflow-providers-google: google-ads-12.0.0 (#17111)](https://github.com/apache/airflow/issues/17111): @rv-irosario
- [ ] [Google Ads Hook: Support newer versions of the google-ads library (#17160)](https://github.com/apache/airflow/pull/17160): @infused-kim
- [ ] [Standardise dataproc location param to region (#16034)](https://github.com/apache/airflow/pull/16034): @Daniel-Han-Yang
- [ ] [Adding custom Salesforce connection type + SalesforceToS3Operator updates (#17162)](https://github.com/apache/airflow/pull/17162): @josh-fell
- [ ] [Update alias for field_mask in Google Memmcache (#16975)](https://github.com/apache/airflow/pull/16975): @potiuk
- [ ] [fix: get_cluster call project_id as self.project_id (#17075)](https://github.com/apache/airflow/pull/17075): @iostreamdoth
- [ ] [Fix GCStoGCS operator with replace diabled and existing destination object (#16991)](https://github.com/apache/airflow/pull/16991): @aslantar
### Provider [hashicorp: 2.0.0rc2](https://pypi.org/project/apache-airflow-providers-hashicorp/2.0.0rc2)
- [ ] [Sanitize end of line character when loading token from a file (vault) (#16407)](https://github.com/apache/airflow/pull/16407): @mmenarguezpear
### Provider [http: 2.0.0rc2](https://pypi.org/project/apache-airflow-providers-http/2.0.0rc2)
- [ ] [Update SimpleHttpOperator to take auth type object (#15605)](https://github.com/apache/airflow/pull/15605): @fredthomsen
- [ ] [HttpHook. Use request factory and respect defaults (#14701)](https://github.com/apache/airflow/pull/14701): @ngaranko
### Provider [jenkins: 2.0.1rc2](https://pypi.org/project/apache-airflow-providers-jenkins/2.0.1rc2)
- [ ] [Fixed to check number key from jenkins response (#16963)](https://github.com/apache/airflow/pull/16963): @namjals
### Provider [microsoft.azure: 3.1.0rc2](https://pypi.org/project/apache-airflow-providers-microsoft-azure/3.1.0rc2)
- [ ] [Add support for managed identity in WASB hook (#16628)](https://github.com/apache/airflow/pull/16628): @malthe
- [ ] [WASB hook: reduce log messages for happy path (#16626)](https://github.com/apache/airflow/pull/16626): @malthe
- [ ] [Fix multiple issues in Microsoft AzureContainerInstancesOperator (#15634)](https://github.com/apache/airflow/pull/15634): @BKronenbitter
### Provider [mysql: 2.1.0rc2](https://pypi.org/project/apache-airflow-providers-mysql/2.1.0rc2)
- [ ] [Added template_fields_renderers for MySQL Operator (#16914)](https://github.com/apache/airflow/pull/16914): @oyarushe
- [ ] [Extended template_fields_renderers for MySQL provider (#16987)](https://github.com/apache/airflow/pull/16987): @oyarushe
- [ ] [Parse JSON template parameters field for MySQL operator (#17080)](https://github.com/apache/airflow/pull/17080): @oyarushe
### Provider [odbc: 2.0.0rc2](https://pypi.org/project/apache-airflow-providers-odbc/2.0.0rc2)
- [ ] [OdbcHook returns None. Related to #15016 issue. (#15510)](https://github.com/apache/airflow/pull/15510): @Goodkat
- [ ] [Fix OdbcHook handling of port (#15772)](https://github.com/apache/airflow/pull/15772): @dstandish
### Provider [opsgenie: 2.0.0rc2](https://pypi.org/project/apache-airflow-providers-opsgenie/2.0.0rc2)
- [ ] [Fix hooks extended from http hook (#16109)](https://github.com/apache/airflow/pull/16109): @msumit
### Provider [oracle: 2.0.0rc2](https://pypi.org/project/apache-airflow-providers-oracle/2.0.0rc2)
- [ ] [Add optional result handler to database hooks (#15581)](https://github.com/apache/airflow/pull/15581): @malthe
- [ ] [[Oracle] Add port to DSN (#15589)](https://github.com/apache/airflow/pull/15589): @malthe
- [ ] [Add link to Oracle Connection Docs (#15632)](https://github.com/apache/airflow/pull/15632): @sunkickr
### Provider [papermill: 2.0.0rc2](https://pypi.org/project/apache-airflow-providers-papermill/2.0.0rc2)
- [ ] [Emit error on duplicated DAG ID (#15302)](https://github.com/apache/airflow/pull/15302): @uranusjr
### Provider [plexus: 2.0.0rc2](https://pypi.org/project/apache-airflow-providers-plexus/2.0.0rc2)
- [ ] [Removes arrow higher limits for plexus provider (#16026)](https://github.com/apache/airflow/pull/16026): @potiuk
### Provider [postgres: 2.1.0rc2](https://pypi.org/project/apache-airflow-providers-postgres/2.1.0rc2)
- [ ] [Add schema override in DbApiHook (#16521)](https://github.com/apache/airflow/pull/16521): @LukeHong
### Provider [qubole: 2.0.0rc2](https://pypi.org/project/apache-airflow-providers-qubole/2.0.0rc2)
- [ ] [Qubole Hook Does Not Support 'include_headers' (#15598)](https://github.com/apache/airflow/issues/15598): @levyitay
- [ ] [Feature qubole hook support headers (#15683)](https://github.com/apache/airflow/pull/15683): @levyitay
- [ ] [Feature qubole hook support headers (#15615)](https://github.com/apache/airflow/pull/15615): @levyitay
### Provider [samba: 2.0.0rc2](https://pypi.org/project/apache-airflow-providers-samba/2.0.0rc2)
- [ ] [Add support for extra parameters to samba client (#16115)](https://github.com/apache/airflow/pull/16115): @malthe
### Provider [sftp: 2.1.0rc2](https://pypi.org/project/apache-airflow-providers-sftp/2.1.0rc2)
- [ ] [Add support for non-RSA type client host key (#16314)](https://github.com/apache/airflow/pull/16314): @malthe
### Provider [slack: 4.0.0rc2](https://pypi.org/project/apache-airflow-providers-slack/4.0.0rc2)
- [ ] [Fix hooks extended from http hook (#16109)](https://github.com/apache/airflow/pull/16109): @msumit
### Provider [snowflake: 2.1.0rc2](https://pypi.org/project/apache-airflow-providers-snowflake/2.1.0rc2)
- [x] [Adding: Snowflake Role in snowflake provider hook (#16735)](https://github.com/apache/airflow/pull/16735): @saurasingh
### Provider [ssh: 2.1.0rc2](https://pypi.org/project/apache-airflow-providers-ssh/2.1.0rc2)
- [ ] [Add support for non-RSA type client host key (#16314)](https://github.com/apache/airflow/pull/16314): @malthe
- [ ] [SSHHook: Using correct hostname for host_key when using non-default ssh port (#15964)](https://github.com/apache/airflow/pull/15964): @freget
- [ ] [Correctly load openssh-gerenated private keys in SSHHook (#16756)](https://github.com/apache/airflow/pull/16756): @ashb
### Provider [tableau: 2.1.0rc2](https://pypi.org/project/apache-airflow-providers-tableau/2.1.0rc2)
- [ ] [Allow disable SSL for TableauHook (#16365)](https://github.com/apache/airflow/pull/16365): @ciancolo
- [ ] [Deprecate Tableau personal token authentication (#16916)](https://github.com/apache/airflow/pull/16916): @samgans
- [ ] [Fix bool conversion Verify parameter in Tableau Hook (#17125)](https://github.com/apache/airflow/pull/17125): @ciancolo
## New Providers
- [x] [apache.drill: 1.0.0rc1](https://pypi.org/project/apache-airflow-providers-apache-drill/1.0.0rc1) @dzamo
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] josh-fell commented on issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
josh-fell commented on issue #17268:
URL: https://github.com/apache/airflow/issues/17268#issuecomment-887795821
Contributions for Google, Amazon, and Salesforce providers look good!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk edited a comment on issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
potiuk edited a comment on issue #17268:
URL: https://github.com/apache/airflow/issues/17268#issuecomment-889786620
> So I think we need to release the Postgres provider after Airflow.
Ah yeah. This is backwards-compatible change, so it's ok to release Postgres now, but indeed testing will be possible only with new Airflow released (and it i's a new feature so it should be only released in 2.2. Good that you raised it!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] ciancolo commented on issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
ciancolo commented on issue #17268:
URL: https://github.com/apache/airflow/issues/17268#issuecomment-889889005
Tested #16365 and #17125 on my local Tableau Server and they works.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #17268:
URL: https://github.com/apache/airflow/issues/17268#issuecomment-890794694
Thanks everyone who tested! This is really great help for the community. The vote has passed and I am proceeding to release the providers!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] oyarushe commented on issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
oyarushe commented on issue #17268:
URL: https://github.com/apache/airflow/issues/17268#issuecomment-889778132
I'm trying to check #16521, but the fix was provided in DbApiHook, which is a general class and I suppose will be released with Airflow itself.
So I think we need to release the Postgres provider after Airflow.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] iostreamdoth commented on issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
iostreamdoth commented on issue #17268:
URL: https://github.com/apache/airflow/issues/17268#issuecomment-888531655
fix: get_cluster call project_id as self.project_id (#17075) looks good.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] pmalafosse commented on issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
pmalafosse commented on issue #17268:
URL: https://github.com/apache/airflow/issues/17268#issuecomment-887810873
amazon: 2.1.0rc2:
- Allow attaching to previously launched task in ECSOperator (#16685)
- ECSOperator / pass context to self.xcom_pull as it was missing (when using reattach) (#17141)
I just tried it and ECSOperator is working as expected
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] raphaelauv edited a comment on issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
raphaelauv edited a comment on issue #17268:
URL: https://github.com/apache/airflow/issues/17268#issuecomment-887784405
for docker 2.1.0rc2
for docker in docker everything work and also the XCOM
--------
```
t3 = DockerOperator(
api_version='auto',
docker_url="unix://var/run/docker.sock",
command='/bin/echo toto',
image='centos:latest',
network_mode='bridge',
mount_tmp_dir=False,
do_xcom_push=True,
task_id='docker_op_tester',
dag=dag,
)
```
give
```
[2021-07-27 19:38:44,647] {docker.py:246} INFO - Starting docker container from image centos:latest
[2021-07-27 19:38:44,682] {docker.py:256} WARNING - Using remote engine or docker-in-docker and mounting temporary volume from host is not supported. Falling back to `mount_tmp_dir=False` mode. You can set `mount_tmp_dir` parameter to False to disable mounting and remove the warning
[2021-07-27 19:38:46,975] {docker.py:307} INFO - toto
[2021-07-27 19:38:47,664] {taskinstance.py:1204} INFO - Marking task as SUCCESS. dag_id=docker_sample, task_id=docker_op_tester, execution_date=20210727T150000, start_date=20210727T193839, end_date=20210727T193847
[2021-07-27 19:38:47,770] {taskinstance.py:1265} INFO - 0 downstream tasks scheduled from follow-on schedule check
[2021-07-27 19:38:47,815] {local_task_job.py:149} INFO - Task exited with return code 0
```
and
```
t3 = DockerOperator(
api_version='auto',
docker_url="unix://var/run/docker.sock",
command='/bin/echo toto',
image='centos:latest',
network_mode='bridge',
mount_tmp_dir=False,
do_xcom_push=True,
task_id='docker_op_tester',
dag=dag,
)
```
give
```
[2021-07-27 19:39:27,176] {docker.py:246} INFO - Starting docker container from image centos:latest
[2021-07-27 19:39:28,091] {docker.py:307} INFO - toto
[2021-07-27 19:39:28,383] {taskinstance.py:1204} INFO - Marking task as SUCCESS. dag_id=docker_sample, task_id=docker_op_tester, execution_date=20210727T180000, start_date=20210727T193926, end_date=20210727T193928
[2021-07-27 19:39:28,424] {taskinstance.py:1265} INFO - 0 downstream tasks scheduled from follow-on schedule check
[2021-07-27 19:39:28,464] {local_task_job.py:149} INFO - Task exited with return code 0
```
and in all case a XCOM
key : return_value
value : toto
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] levyitay commented on issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
levyitay commented on issue #17268:
URL: https://github.com/apache/airflow/issues/17268#issuecomment-887794588
qubole: 2.0.0rc2 tested and working
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #17268:
URL: https://github.com/apache/airflow/issues/17268#issuecomment-889766777
Hey @oyarushe @scottypate @uranusjr @msumit @Daniel-Han-Yang @rv-irosario @aslantar @malthe @LukeHong
@sunkickr @mmenarguezpear @fredthomsen @ngaranko @namjals @dstandish @BKronenbitter @freget @ashb @ciancolo @samgans - last chance to test before we release later tonight :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] codenamestif commented on issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
codenamestif commented on issue #17268:
URL: https://github.com/apache/airflow/issues/17268#issuecomment-888127323
#16820 is also good to go
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk edited a comment on issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
potiuk edited a comment on issue #17268:
URL: https://github.com/apache/airflow/issues/17268#issuecomment-889119821
> Google ads #17160 is working fine, but I am the one who submitted the PR and it would be good to get it tested by a few more people.
@overbryd and @rv-irosario - since this was addressing your issues #17113 and #17111 - could you please also take a look if https://pypi.org/project/apache-airflow-providers-google/5.0.0rc2 solves the ads compatibility ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #17268:
URL: https://github.com/apache/airflow/issues/17268#issuecomment-889786620
> So I think we need to release the Postgres provider after Airflow.
Ah yeah. This is backwards-compatible change, so it's ok to release Postgres now, but indeed testing will be possible only with new Airflow relesed (and it i's a new feature so it should be only released in 2.2.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] infused-kim commented on issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
infused-kim commented on issue #17268:
URL: https://github.com/apache/airflow/issues/17268#issuecomment-889039178
Google ads #17160 is working fine, but I am the one who submitted the PR and it would be good to get it tested by a few more people.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #17268:
URL: https://github.com/apache/airflow/issues/17268#issuecomment-888126448
Getting very good progress on testing with this release :) . Thanks a bunch for those! looking forward for more quick tests :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] baolsen commented on issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
baolsen commented on issue #17268:
URL: https://github.com/apache/airflow/issues/17268#issuecomment-888189378
#16771 and #16612 tested and working as expected.
On Wed, 28 Jul 2021, 10:41 AM Pavel Hlushchanka, ***@***.***>
wrote:
> #16820 <https://github.com/apache/airflow/pull/16820> is also good to go
>
> —
> You are receiving this because you were mentioned.
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/airflow/issues/17268#issuecomment-888127323>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AGLEIYZHSJOW72BLXQVJWYTTZ67CFANCNFSM5BCTM7EQ>
> .
>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk closed issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
potiuk closed issue #17268:
URL: https://github.com/apache/airflow/issues/17268
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] raphaelauv commented on issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
raphaelauv commented on issue #17268:
URL: https://github.com/apache/airflow/issues/17268#issuecomment-887784405
for docker 2.1.0rc2
for docker in docker everything work and also the XCOM
```
t3 = DockerOperator(
api_version='auto',
docker_url="unix://var/run/docker.sock",
command='/bin/echo toto',
image='centos:latest',
network_mode='bridge',
mount_tmp_dir=False,
do_xcom_push=True,
task_id='docker_op_tester',
dag=dag,
)
```
give
```
[2021-07-27 19:38:44,647] {docker.py:246} INFO - Starting docker container from image centos:latest
[2021-07-27 19:38:44,682] {docker.py:256} WARNING - Using remote engine or docker-in-docker and mounting temporary volume from host is not supported. Falling back to `mount_tmp_dir=False` mode. You can set `mount_tmp_dir` parameter to False to disable mounting and remove the warning
[2021-07-27 19:38:46,975] {docker.py:307} INFO - toto
[2021-07-27 19:38:47,664] {taskinstance.py:1204} INFO - Marking task as SUCCESS. dag_id=docker_sample, task_id=docker_op_tester, execution_date=20210727T150000, start_date=20210727T193839, end_date=20210727T193847
[2021-07-27 19:38:47,770] {taskinstance.py:1265} INFO - 0 downstream tasks scheduled from follow-on schedule check
[2021-07-27 19:38:47,815] {local_task_job.py:149} INFO - Task exited with return code 0
```
and for
```
t3 = DockerOperator(
api_version='auto',
docker_url="unix://var/run/docker.sock",
command='/bin/echo toto',
image='centos:latest',
network_mode='bridge',
mount_tmp_dir=False,
do_xcom_push=True,
task_id='docker_op_tester',
dag=dag,
)
```
```
[2021-07-27 19:39:27,176] {docker.py:246} INFO - Starting docker container from image centos:latest
[2021-07-27 19:39:28,091] {docker.py:307} INFO - toto
[2021-07-27 19:39:28,383] {taskinstance.py:1204} INFO - Marking task as SUCCESS. dag_id=docker_sample, task_id=docker_op_tester, execution_date=20210727T180000, start_date=20210727T193926, end_date=20210727T193928
[2021-07-27 19:39:28,424] {taskinstance.py:1265} INFO - 0 downstream tasks scheduled from follow-on schedule check
[2021-07-27 19:39:28,464] {local_task_job.py:149} INFO - Task exited with return code 0
```
and in all case a XCOM
key : return_value
value : toto
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] raphaelauv edited a comment on issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
raphaelauv edited a comment on issue #17268:
URL: https://github.com/apache/airflow/issues/17268#issuecomment-887784405
for docker 2.1.0rc2 it's all good
docker in docker work and also the XCOM
--------
```
t3 = DockerOperator(
api_version='auto',
docker_url="unix://var/run/docker.sock",
command='/bin/echo toto',
image='centos:latest',
network_mode='bridge',
mount_tmp_dir=False,
do_xcom_push=True,
task_id='docker_op_tester',
dag=dag,
)
```
give
```
[2021-07-27 19:38:44,647] {docker.py:246} INFO - Starting docker container from image centos:latest
[2021-07-27 19:38:44,682] {docker.py:256} WARNING - Using remote engine or docker-in-docker and mounting temporary volume from host is not supported. Falling back to `mount_tmp_dir=False` mode. You can set `mount_tmp_dir` parameter to False to disable mounting and remove the warning
[2021-07-27 19:38:46,975] {docker.py:307} INFO - toto
[2021-07-27 19:38:47,664] {taskinstance.py:1204} INFO - Marking task as SUCCESS. dag_id=docker_sample, task_id=docker_op_tester, execution_date=20210727T150000, start_date=20210727T193839, end_date=20210727T193847
[2021-07-27 19:38:47,770] {taskinstance.py:1265} INFO - 0 downstream tasks scheduled from follow-on schedule check
[2021-07-27 19:38:47,815] {local_task_job.py:149} INFO - Task exited with return code 0
```
and
```
t3 = DockerOperator(
api_version='auto',
docker_url="unix://var/run/docker.sock",
command='/bin/echo toto',
image='centos:latest',
network_mode='bridge',
mount_tmp_dir=False,
do_xcom_push=True,
task_id='docker_op_tester',
dag=dag,
)
```
give
```
[2021-07-27 19:39:27,176] {docker.py:246} INFO - Starting docker container from image centos:latest
[2021-07-27 19:39:28,091] {docker.py:307} INFO - toto
[2021-07-27 19:39:28,383] {taskinstance.py:1204} INFO - Marking task as SUCCESS. dag_id=docker_sample, task_id=docker_op_tester, execution_date=20210727T180000, start_date=20210727T193926, end_date=20210727T193928
[2021-07-27 19:39:28,424] {taskinstance.py:1265} INFO - 0 downstream tasks scheduled from follow-on schedule check
[2021-07-27 19:39:28,464] {local_task_job.py:149} INFO - Task exited with return code 0
```
and in all case a XCOM
key : return_value
value : toto
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] raphaelauv edited a comment on issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
raphaelauv edited a comment on issue #17268:
URL: https://github.com/apache/airflow/issues/17268#issuecomment-887784405
for docker 2.1.0rc2 it's all good
docker in docker work and also the XCOM
--------
```
t3 = DockerOperator(
api_version='auto',
docker_url="unix://var/run/docker.sock",
command='/bin/echo toto',
image='centos:latest',
network_mode='bridge',
do_xcom_push=True,
task_id='docker_op_tester',
dag=dag,
)
```
give
```
[2021-07-27 19:38:44,647] {docker.py:246} INFO - Starting docker container from image centos:latest
[2021-07-27 19:38:44,682] {docker.py:256} WARNING - Using remote engine or docker-in-docker and mounting temporary volume from host is not supported. Falling back to `mount_tmp_dir=False` mode. You can set `mount_tmp_dir` parameter to False to disable mounting and remove the warning
[2021-07-27 19:38:46,975] {docker.py:307} INFO - toto
[2021-07-27 19:38:47,664] {taskinstance.py:1204} INFO - Marking task as SUCCESS. dag_id=docker_sample, task_id=docker_op_tester, execution_date=20210727T150000, start_date=20210727T193839, end_date=20210727T193847
[2021-07-27 19:38:47,770] {taskinstance.py:1265} INFO - 0 downstream tasks scheduled from follow-on schedule check
[2021-07-27 19:38:47,815] {local_task_job.py:149} INFO - Task exited with return code 0
```
and
```
t3 = DockerOperator(
api_version='auto',
docker_url="unix://var/run/docker.sock",
command='/bin/echo toto',
image='centos:latest',
network_mode='bridge',
mount_tmp_dir=False,
do_xcom_push=True,
task_id='docker_op_tester',
dag=dag,
)
```
give
```
[2021-07-27 19:39:27,176] {docker.py:246} INFO - Starting docker container from image centos:latest
[2021-07-27 19:39:28,091] {docker.py:307} INFO - toto
[2021-07-27 19:39:28,383] {taskinstance.py:1204} INFO - Marking task as SUCCESS. dag_id=docker_sample, task_id=docker_op_tester, execution_date=20210727T180000, start_date=20210727T193926, end_date=20210727T193928
[2021-07-27 19:39:28,424] {taskinstance.py:1265} INFO - 0 downstream tasks scheduled from follow-on schedule check
[2021-07-27 19:39:28,464] {local_task_job.py:149} INFO - Task exited with return code 0
```
and in all case a XCOM
key : return_value
value : toto
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] pmalafosse commented on issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
pmalafosse commented on issue #17268:
URL: https://github.com/apache/airflow/issues/17268#issuecomment-887811638
This one is fine too:
- Update Boto3 API calls in ECSOperator (#16050)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] Goodkat commented on issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
Goodkat commented on issue #17268:
URL: https://github.com/apache/airflow/issues/17268#issuecomment-888122151
Tested again the **odbc** connection, it works as expected with the boolean parameters:
https://github.com/apache/airflow/issues/15016#issuecomment-826650629
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] ayushchauhan0811 commented on issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
ayushchauhan0811 commented on issue #17268:
URL: https://github.com/apache/airflow/issues/17268#issuecomment-888304229
#17081 is also good to go
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #17268: Status of testing Providers that were prepared on July 27, 2021 (rc2)
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #17268:
URL: https://github.com/apache/airflow/issues/17268#issuecomment-889119821
> Google ads #17160 is working fine, but I am the one who submitted the PR and it would be good to get it tested by a few more people.
@overbryd and @rv-irosario - since this was addressing your issues #17113 and #17111 - could you also take a look if https://pypi.org/project/apache-airflow-providers-google/5.0.0rc2 solves the ads compatibility ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org