You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/10/13 16:00:10 UTC
[GitHub] [airflow] sr-murthy opened a new issue #18951: Airflow AWS default connection not accessible or null
sr-murthy opened a new issue #18951:
URL: https://github.com/apache/airflow/issues/18951
### Apache Airflow version
2.0.2
### Operating System
Mac OS Catalina
### Versions of Apache Airflow Providers
```
apache-airflow-providers-amazon==2.2.0
apache-airflow-providers-docker==2.1.1
apache-airflow-providers-ftp==2.0.1
apache-airflow-providers-http==2.0.1
apache-airflow-providers-imap==2.0.1
apache-airflow-providers-slack==4.0.1
apache-airflow-providers-sqlite==2.0.1
```
### Deployment
MWAA
### Deployment details
MWAA environment + ECS cluster
### What happened
We have a DAG in our MWAA environment that uses `ECSOperator` to call an ECS task in our ECS cluster. The operator uses the default AWS connection `aws_default` created in the Airflow UI (Connections). This used to work, but stopped working recently. Below is an excerpt of the error stack trace from the Airflow task log
```
[2021-10-13 14:06:23,322] {{taskinstance.py:1089}} INFO - Executing <Task(TriggerDagRunOperator): upsert_analysis_db_table> on 2021-10-13T13:21:24.456808+00:00
[2021-10-13 14:06:23,399] {{standard_task_runner.py:52}} INFO - Started process 90 to run task
[2021-10-13 14:06:23,420] {{standard_task_runner.py:76}} INFO - Running: ['airflow', 'tasks', 'run', 'upsert_analysis_db_table', 'upsert_analysis_db_table', '2021-10-13T13:21:24.456808+00:00', '--job-id', '2170', '--pool', 'default_pool', '--raw', '--subdir', 'DAGS_FOLDER/mana_ops/upsert_analysis_db_table.py', '--cfg-path', '/tmp/tmpvjylnmpq', '--error-file', '/tmp/tmpsok2607d']
[2021-10-13 14:06:23,654] {{standard_task_runner.py:77}} INFO - Job 2170: Subtask upsert_analysis_db_table
[2021-10-13 14:06:23,861] {{logging_mixin.py:104}} INFO - [2021-10-13 14:06:23,861] {{base_aws.py:368}} INFO - Airflow Connection: aws_conn_id=aws_default
[2021-10-13 14:06:23,939] {{logging_mixin.py:104}} INFO - [2021-10-13 14:06:23,939] {{base_aws.py:179}} INFO - No credentials retrieved from Connection
[2021-10-13 14:06:24,012] {{logging_mixin.py:104}} INFO - [2021-10-13 14:06:24,012] {{base_aws.py:87}} INFO - Creating session with aws_access_key_id=None region_name=eu-west-1
[2021-10-13 14:06:24,121] {{logging_mixin.py:104}} INFO - [2021-10-13 14:06:24,121] {{base_aws.py:157}} INFO - role_arn is None
```
### What you expected to happen
I don't know.
### How to reproduce
Re-run the DAG. It keeps failing at the moment.
### Anything else
_No response_
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk closed issue #18951: Airflow AWS default connection not accessible or null
Posted by GitBox <gi...@apache.org>.
potiuk closed issue #18951:
URL: https://github.com/apache/airflow/issues/18951
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] boring-cyborg[bot] commented on issue #18951: Airflow AWS default connection not accessible or null
Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #18951:
URL: https://github.com/apache/airflow/issues/18951#issuecomment-942450478
Thanks for opening your first issue here! Be sure to follow the issue template!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk closed issue #18951: Airflow AWS default connection not accessible or null
Posted by GitBox <gi...@apache.org>.
potiuk closed issue #18951:
URL: https://github.com/apache/airflow/issues/18951
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] boring-cyborg[bot] commented on issue #18951: Airflow AWS default connection not accessible or null
Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #18951:
URL: https://github.com/apache/airflow/issues/18951#issuecomment-942450478
Thanks for opening your first issue here! Be sure to follow the issue template!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org