You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "qingwuxiamo (via GitHub)" <gi...@apache.org> on 2023/08/08 11:28:57 UTC
[GitHub] [airflow] qingwuxiamo opened a new issue, #33201: Task in DAG,after marking as success, immediately mark as failure.
qingwuxiamo opened a new issue, #33201:
URL: https://github.com/apache/airflow/issues/33201
### Apache Airflow version
Other Airflow 2 version (please specify below)
### What happened
Airflow version 2.2.5
In the recent Airflow, tasks in DAGs often have this kind of problem - the tasks actually succeed in executing normally. However, strange things happen, the tasks are first marked as success but then immediately marked as failure, resulting in many tasks not being able to be scheduled normally and triggering alerts.
### What you think should happen instead
I've been using it for two years and I haven't encountered this kind of problem.I don't know, I'm at a loss.
### How to reproduce
Often occurring, every day.
### Operating System
Alibaba Cloud Elastic Compute Service
### Versions of Apache Airflow Providers
Airflow version 2.2.5
### Deployment
Official Apache Airflow Helm Chart
### Deployment details
_No response_
### Anything else
_No response_
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #33201: Task in DAG,after marking as success, immediately mark as failure.
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #33201:
URL: https://github.com/apache/airflow/issues/33201#issuecomment-1670829737
You are missing on not having those 1000s fixes applied.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] eladkal commented on issue #33201: Task in DAG,after marking as success, immediately mark as failure.
Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal commented on issue #33201:
URL: https://github.com/apache/airflow/issues/33201#issuecomment-1669712594
Can you please add reproduce example?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] github-actions[bot] commented on issue #33201: Task in DAG,after marking as success, immediately mark as failure.
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #33201:
URL: https://github.com/apache/airflow/issues/33201#issuecomment-1712351767
This issue has been closed because it has not received response from the issue author.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] qingwuxiamo commented on issue #33201: Task in DAG,after marking as success, immediately mark as failure.
Posted by "qingwuxiamo (via GitHub)" <gi...@apache.org>.
qingwuxiamo commented on issue #33201:
URL: https://github.com/apache/airflow/issues/33201#issuecomment-1670751410
Then, occasional error situations can occur.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] github-actions[bot] commented on issue #33201: Task in DAG,after marking as success, immediately mark as failure.
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #33201:
URL: https://github.com/apache/airflow/issues/33201#issuecomment-1703537753
This issue has been automatically marked as stale because it has been open for 14 days with no response from the author. It will be closed in next 7 days if no further activity occurs from the issue author.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #33201: Task in DAG,after marking as success, immediately mark as failure.
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #33201:
URL: https://github.com/apache/airflow/issues/33201#issuecomment-1670829199
BTW. This is REALLY old version of Airflow. With likely 1000s of bugs fixes. It is extremely likely that this has been fixed already by one of the 1000 bugs but it's impossible that anyone would remmember all things fixed in the last 2 years or so. So my suggestion is - before anyone looses more time on, to upgrade to latest version of Airflow.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] qingwuxiamo commented on issue #33201: Task in DAG,after marking as success, immediately mark as failure.
Posted by "qingwuxiamo (via GitHub)" <gi...@apache.org>.
qingwuxiamo commented on issue #33201:
URL: https://github.com/apache/airflow/issues/33201#issuecomment-1676727212
It looks like I really need to upgrade then, thank you for your answer.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #33201: Task in DAG,after marking as success, immediately mark as failure.
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #33201:
URL: https://github.com/apache/airflow/issues/33201#issuecomment-1670826564
I think that it could help if you could compare the log of successful output and unsuccessful one for the same task. And having it in a form that you can see the text of it (gists in github?) rather than log sceenshots would be helpful .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] qingwuxiamo commented on issue #33201: Task in DAG,after marking as success, immediately mark as failure.
Posted by "qingwuxiamo (via GitHub)" <gi...@apache.org>.
qingwuxiamo commented on issue #33201:
URL: https://github.com/apache/airflow/issues/33201#issuecomment-1670749031
> Can you please add reproduce example?
For example, this simple task. The function is to query the tables in MySQL to determine whether the current task is completed or not, and then select the task scheduling cycle.
`def select_task(**kwargs):
sql_hook = MySqlHook(_mysql_xray_conn_name)
result1 = sql_hook.get_records(_select_running_sql)
running_cnt = result1[0][0]
if running_cnt == 0:
report_date_list = get_n_days(1, 4)
kwargs['ti'].xcom_push(key=_xcom_key_name, value=report_date_list)
report_date_str = report_date_list[-1] + "-" + report_date_list[0]
process_date = datetime.now().strftime("%Y-%m-%d")
kwargs['ti'].xcom_push(key='process_date', value=process_date)
create_at = datetime.now().strftime("%Y-%m-%d %H:%M:%S")
return _start_task_name
else:
return _end_task_name`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] github-actions[bot] closed issue #33201: Task in DAG,after marking as success, immediately mark as failure.
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #33201: Task in DAG,after marking as success, immediately mark as failure.
URL: https://github.com/apache/airflow/issues/33201
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] qingwuxiamo commented on issue #33201: Task in DAG,after marking as success, immediately mark as failure.
Posted by "qingwuxiamo (via GitHub)" <gi...@apache.org>.
qingwuxiamo commented on issue #33201:
URL: https://github.com/apache/airflow/issues/33201#issuecomment-1670745102
> Can you please add reproduce example?
Sorry, this is sporadic at the moment and cannot be reproduced completely. It may occur in any task. According to observation, the occurrence rate of this exception should be less than one percent per day.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] boring-cyborg[bot] commented on issue #33201: Task in DAG,after marking as success, immediately mark as failure.
Posted by "boring-cyborg[bot] (via GitHub)" <gi...@apache.org>.
boring-cyborg[bot] commented on issue #33201:
URL: https://github.com/apache/airflow/issues/33201#issuecomment-1669437204
Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org