You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "chen xianxin (Jira)" <ji...@apache.org> on 2019/10/16 14:26:00 UTC
[jira] [Comment Edited] (AIRFLOW-5642)
sqlalchemy.exc.OperationalError happens when sql is too long, which cause
scheduler processor will be exited
[ https://issues.apache.org/jira/browse/AIRFLOW-5642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16952875#comment-16952875 ]
chen xianxin edited comment on AIRFLOW-5642 at 10/16/19 2:25 PM:
-----------------------------------------------------------------
max_tis_per_query seems to only work in here [https://github.com/apache/airflow/blob/v1-10-stable/airflow/jobs/scheduler_job.py#L1172-L1183,] if executor.queued_tasks has too many tasks were not executed, sqlalchemy.exc.OperationalError will occur in here https://github.com/apache/airflow/blob/v1-10-stable/airflow/jobs/scheduler_job.py#L1206-L1207
was (Author: chiven):
max_tis_per_query seems to only work in here [https://github.com/apache/airflow/blob/v1-10-stable/airflow/jobs/scheduler_job.py#L1172-L1183,] if executor.queued_tasks has too many tasks were not executed, sqlalchemy.exc.OperationalError will occur
> sqlalchemy.exc.OperationalError happens when sql is too long, which cause scheduler processor will be exited
> ------------------------------------------------------------------------------------------------------------
>
> Key: AIRFLOW-5642
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5642
> Project: Apache Airflow
> Issue Type: Bug
> Components: scheduler
> Affects Versions: 1.10.5
> Reporter: chen xianxin
> Priority: Minor
>
> h2. code
> https://github.com/apache/airflow/blob/v1-10-stable/airflow/jobs/scheduler_job.py#L1060-L1069
> h2. Error description
> {{if there is too many queued_tasks, sqlalchemy.exc.OperationalError will occur. details are as follow:}}
> {{<}}
> {{sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError) (2006, "MySQL server has gone away (BrokenPipeError(32, 'Broken pipe'))")}}
> [SQL: SELECT ...]
> (Background on this error at: [http://sqlalche.me/e/e3q8])
> {{> }}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)