Re: [D] Airflow DAG sometimes fail with "Failed to execute job" error [airflow]

["liiang-huang (via GitHub)" <gi...@apache.org>]

GitHub user liiang-huang edited a discussion: Airflow DAG sometimes fail with "Failed to execute job" error

Hi Airflow community, our DAG sometimes fail with the below error
```
[2024-11-17, 23:21:17 UTC] {{base.py:287}} INFO - Success criteria met. Exiting.
[2024-11-17, 23:21:17 UTC] {{subdag.py:187}} INFO - Execution finished. State is failed
[2024-11-17, 23:21:17 UTC] {{taskinstance.py:1937}} ERROR - Task failed with exception
Traceback (most recent call last):
  File "/usr/local/airflow/.local/lib/python3.11/site-packages/airflow/models/taskinstance.py", line 1518, in _run_raw_task
    self._execute_task_with_callbacks(context, test_mode, session=session)
  File "/usr/local/airflow/.local/lib/python3.11/site-packages/airflow/models/taskinstance.py", line 1684, in _execute_task_with_callbacks
    self.task.post_execute(context=context, result=result)  # type: ignore[union-attr]
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/airflow/.local/lib/python3.11/site-packages/airflow/operators/subdag.py", line 190, in post_execute
    raise AirflowException(f"Expected state: SUCCESS. Actual state: {dag_run.state}")
airflow.exceptions.AirflowException: Expected state: SUCCESS. Actual state: failed
[2024-11-17, 23:21:17 UTC] {{taskinstance.py:1400}} INFO - Marking task as FAILED. dag_id=linepay_recon_v1, task_id=copier_subdag, execution_date=20241116T230000, start_date=20241117T230015, end_date=20241117T232117
[2024-11-17, 23:21:17 UTC] {{base.py:73}} INFO - Using connection ID 'aws_default' for task execution.
[2024-11-17, 23:21:17 UTC] {{base.py:73}} INFO - Using connection ID 'slack_api_default' for task execution.
[2024-11-17, 23:21:18 UTC] {{base.py:73}} INFO - Using connection ID 'slack_api_default' for task execution.
[2024-11-17, 23:21:18 UTC] {{standard_task_runner.py:104}} ERROR - Failed to execute job 363190 for task copier_subdag (Expected state: SUCCESS. Actual state: failed; 32466)
[2024-11-17, 23:21:18 UTC] {{local_task_job_runner.py:228}} INFO - Task exited with return code 1
[2024-11-17, 23:21:18 UTC] {{taskinstance.py:2778}} INFO - 0 downstream tasks scheduled from follow-on schedule check
```

Can anyone help to identify the issue/cause?

GitHub link: https://github.com/apache/airflow/discussions/44231

----
This is an automatically sent email for commits@airflow.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@airflow.apache.org