You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/07/15 06:37:51 UTC
[GitHub] [airflow] zhbdesign commented on issue #9826: Celery command failed
zhbdesign commented on issue #9826:
URL: https://github.com/apache/airflow/issues/9826#issuecomment-658576075
Check the scheduler to see the following log:
[2020-07-15 14:30:40,779] {scheduler_job.py:958} INFO - 2 tasks up for execution:
<TaskInstance: user_MySql_2_ClickHouse_increment_srt_Activity.MySql_2_ClickHouse_Activity_Activity_Discuss_inc 2020-07-15 14:30:36.508244+00:00 [scheduled]>
<TaskInstance: user_MySql_2_ClickHouse_increment_srt_Activity.MySql_2_ClickHouse_Activity_Activity_inc 2020-07-15 14:30:36.508244+00:00 [scheduled]>
[2020-07-15 14:30:40,891] {scheduler_job.py:989} INFO - Figuring out tasks to run in Pool(name=default_pool) with 128 open slots and 2 task instances ready to be queued
[2020-07-15 14:30:40,892] {scheduler_job.py:1017} INFO - DAG user_MySql_2_ClickHouse_increment_srt_Activity has 0/31 running and queued tasks
[2020-07-15 14:30:40,892] {scheduler_job.py:1017} INFO - DAG user_MySql_2_ClickHouse_increment_srt_Activity has 1/31 running and queued tasks
[2020-07-15 14:30:40,901] {scheduler_job.py:1067} INFO - Setting the following tasks to queued state:
<TaskInstance: user_MySql_2_ClickHouse_increment_srt_Activity.MySql_2_ClickHouse_Activity_Activity_Discuss_inc 2020-07-15 14:30:36.508244+00:00 [scheduled]>
<TaskInstance: user_MySql_2_ClickHouse_increment_srt_Activity.MySql_2_ClickHouse_Activity_Activity_inc 2020-07-15 14:30:36.508244+00:00 [scheduled]>
[2020-07-15 14:30:40,925] {scheduler_job.py:1141} INFO - Setting the following 2 tasks to queued state:
<TaskInstance: user_MySql_2_ClickHouse_increment_srt_Activity.MySql_2_ClickHouse_Activity_Activity_Discuss_inc 2020-07-15 14:30:36.508244+00:00 [queued]>
<TaskInstance: user_MySql_2_ClickHouse_increment_srt_Activity.MySql_2_ClickHouse_Activity_Activity_inc 2020-07-15 14:30:36.508244+00:00 [queued]>
[2020-07-15 14:30:40,925] {scheduler_job.py:1177} INFO - Sending ('user_MySql_2_ClickHouse_increment_srt_Activity', 'MySql_2_ClickHouse_Activity_Activity_Discuss_inc', datetime.datetime(2020, 7, 15, 14, 30, 36, 508244, tzinfo=<Timezone [UTC]>), 1) to executor with priority 1 and queue default
[2020-07-15 14:30:40,926] {base_executor.py:58} INFO - Adding to queue: ['airflow', 'run', 'user_MySql_2_ClickHouse_increment_srt_Activity', 'MySql_2_ClickHouse_Activity_Activity_Discuss_inc', '2020-07-15T14:30:36.508244+00:00', '--local', '--pool', 'default_pool', '-sd', '/opt/airflow/dags/MySql_2_ClickHouse_srt_Activity.py']
[2020-07-15 14:30:40,926] {scheduler_job.py:1177} INFO - Sending ('user_MySql_2_ClickHouse_increment_srt_Activity', 'MySql_2_ClickHouse_Activity_Activity_inc', datetime.datetime(2020, 7, 15, 14, 30, 36, 508244, tzinfo=<Timezone [UTC]>), 1) to executor with priority 1 and queue default
[2020-07-15 14:30:40,927] {base_executor.py:58} INFO - Adding to queue: ['airflow', 'run', 'user_MySql_2_ClickHouse_increment_srt_Activity', 'MySql_2_ClickHouse_Activity_Activity_inc', '2020-07-15T14:30:36.508244+00:00', '--local', '--pool', 'default_pool', '-sd', '/opt/airflow/dags/MySql_2_ClickHouse_srt_Activity.py']
[2020-07-15 14:30:51,338] {scheduler_job.py:1316} INFO - Executor reports execution of user_MySql_2_ClickHouse_increment_srt_Activity.MySql_2_ClickHouse_Activity_Activity_inc execution_date=2020-07-15 14:30:36.508244+00:00 exited with status failed for try_number 1
[2020-07-15 14:30:51,356] {scheduler_job.py:1333} ERROR - Executor reports task instance <TaskInstance: user_MySql_2_ClickHouse_increment_srt_Activity.MySql_2_ClickHouse_Activity_Activity_inc 2020-07-15 14:30:36.508244+00:00 [queued]> finished (failed) although the task says its queued. Was the task killed externally?
[2020-07-15 14:30:51,357] {dagbag.py:396} INFO - Filling up the DagBag from /opt/airflow/dags/MySql_2_ClickHouse_srt_Activity.py
ClickHouse_url======================>>>>>>>>>>>>>>>>>>>>>>> jdbc:clickhouse://192.168.10.186:8123/ods
ClickHouse_url======================>>>>>>>>>>>>>>>>>>>>>>> jdbc:clickhouse://192.168.10.186:8123/ods
ClickHouse_url======================>>>>>>>>>>>>>>>>>>>>>>> jdbc:clickhouse://192.168.10.186:8123/ods
ClickHouse_url======================>>>>>>>>>>>>>>>>>>>>>>> jdbc:clickhouse://192.168.10.186:8123/ods
[2020-07-15 14:30:51,511] {taskinstance.py:1150} ERROR - Executor reports task instance <TaskInstance: user_MySql_2_ClickHouse_increment_srt_Activity.MySql_2_ClickHouse_Activity_Activity_inc 2020-07-15 14:30:36.508244+00:00 [queued]> finished (failed) although the task says its queued. Was the task killed externally?
NoneType: None
[2020-07-15 14:30:51,620] {taskinstance.py:1194} INFO - Marking task as FAILED. dag_id=user_MySql_2_ClickHouse_increment_srt_Activity, task_id=MySql_2_ClickHouse_Activity_Activity_inc, execution_date=20200715T143036, start_date=, end_date=20200715T143051
[2020-07-15 14:31:15,231] {scheduler_job.py:1316} INFO - Executor reports execution of user_MySql_2_ClickHouse_increment_srt_Activity.MySql_2_ClickHouse_Activity_Activity_Discuss_inc execution_date=2020-07-15 14:30:36.508244+00:00 exited with status success for try_number 1
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org