You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2023/01/10 05:42:01 UTC
[GitHub] [airflow] Amar1404 opened a new issue, #28821: Dynamic Task Mapping Throwing can't set attribute error And the DAG Dependency is not shown
Amar1404 opened a new issue, #28821:
URL: https://github.com/apache/airflow/issues/28821
### Apache Airflow version
Other Airflow 2 version (please specify below)
### What happened
While using the Dynamic Task Mapping the following error is thrown in worker while loading DAG.
Setting task policy for Dag: DAG1 Task: DownstreamDagTrigger
[2023-01-09 09:44:36,545: ERROR/ForkPoolWorker-7] can’t set attribute
Traceback (most recent call last):
File “/home/airflow/.local/lib/python3.8/site-packages/airflow/models/dagbag.py”, line 523, in collect_dags
found_dags = self.process_file(filepath, only_if_updated=only_if_updated, safe_mode=safe_mode)
File “/home/airflow/.local/lib/python3.8/site-packages/airflow/models/dagbag.py”, line 291, in process_file
found_dags = self._process_modules(filepath, mods, file_last_changed_on_disk)
File “/home/airflow/.local/lib/python3.8/site-packages/airflow/models/dagbag.py”, line 407, in _process_modules
self.bag_dag(dag=dag, root_dag=dag)
File “/home/airflow/.local/lib/python3.8/site-packages/airflow/models/dagbag.py”, line 434, in bag_dag
self._bag_dag(dag=dag, root_dag=root_dag, recursive=True)
File “/home/airflow/.local/lib/python3.8/site-packages/airflow/models/dagbag.py”, line 451, in _bag_dag
settings.task_policy(task)
File “/home/airflow/.local/lib/python3.8/site-packages/datahub_provider/_plugin.py”, line 308, in custom_task_policy
task_policy(task)
File “/home/airflow/.local/lib/python3.8/site-packages/datahub_provider/_plugin.py”, line 297, in task_policy
task.on_failure_callback = _wrap_on_failure_callback(task.on_failure_callback)
AttributeError: can’t set attribute
This error is thrown can some please help.
I am using the TriggerDagRunOperator for Triggering Multiple Downstream DAG.
### What you think should happen instead
The DAG Dependency Graph should be shown like
[](url)
### How to reproduce
You can use
TriggerDagRunOperator.partial(
task_id="Task1",
dag=dag,
reset_dag_run=True,
).expand(trigger_dag_id=task_conf.ops_params['downstream_dag'])
### Operating System
Deployed on EKS
### Versions of Apache Airflow Providers
apache-airflow 2.3.4
apache-airflow-providers-amazon 5.0.0
apache-airflow-providers-apache-hive 4.1.0
apache-airflow-providers-apache-livy 3.1.0
apache-airflow-providers-apache-spark 4.0.0
apache-airflow-providers-celery 3.0.0
apache-airflow-providers-cncf-kubernetes 4.3.0
apache-airflow-providers-common-sql 1.3.1
apache-airflow-providers-docker 3.1.0
apache-airflow-providers-elasticsearch 4.2.0
apache-airflow-providers-ftp 3.1.0
apache-airflow-providers-google 8.3.0
apache-airflow-providers-grpc 3.0.0
apache-airflow-providers-hashicorp 3.1.0
apache-airflow-providers-http 4.0.0
apache-airflow-providers-imap 3.0.0
apache-airflow-providers-microsoft-azure 4.2.0
apache-airflow-providers-mysql 3.2.0
apache-airflow-providers-odbc 3.1.1
apache-airflow-providers-postgres 5.2.0
apache-airflow-providers-redis 3.0.0
apache-airflow-providers-sendgrid 3.0.0
apache-airflow-providers-sftp 4.0.0
apache-airflow-providers-slack 5.1.0
apache-airflow-providers-sqlite 3.2.0
apache-airflow-providers-ssh 3.1.0
### Deployment
Official Apache Airflow Helm Chart
### Deployment details
_No response_
### Anything else
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk closed issue #28821: Dynamic Task Mapping Throwing can't set attribute error And the DAG Dependency is not shown
Posted by GitBox <gi...@apache.org>.
potiuk closed issue #28821: Dynamic Task Mapping Throwing can't set attribute error And the DAG Dependency is not shown
URL: https://github.com/apache/airflow/issues/28821
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #28821: Dynamic Task Mapping Throwing can't set attribute error And the DAG Dependency is not shown
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #28821:
URL: https://github.com/apache/airflow/issues/28821#issuecomment-1376826838
Duplicate of https://github.com/apache/airflow/issues/24547. Fixed in https://github.com/apache/airflow/pull/28313 - will be part of 2.5.1 likely.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org