You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2022/10/19 09:40:17 UTC
[GitHub] [dolphinscheduler] ChewJ404 opened a new issue, #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop
ChewJ404 opened a new issue, #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
![image](https://user-images.githubusercontent.com/10162958/196633790-2ed739fb-268b-4edb-9f85-4efe6bf9f73a.png)
```
[ERROR] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[72] - [WorkflowInstance-0][TaskInstance-0] - Failed to submit the workflow instance, will resend the workflow start event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=211)
[INFO] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowEventQueue:[38] - [WorkflowInstance-0][TaskInstance-0] - Added workflow event to workflowEvent queue, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=211)
[INFO] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[373] - [WorkflowInstance-210][TaskInstance-442] - TaskInstance finished task code:7259222836288 state:TaskExecutionStatus{code=7, desc='success'}
[INFO] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.runner.StateWheelExecuteThread:[195] - [WorkflowInstance-210][TaskInstance-442] - remove task instance from timeout check list
[INFO] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1714] - [WorkflowInstance-214][TaskInstance-0] - add task to stand by list, task name:e_ads_yl_user_server_relation_by_service_men_create_shop_dept, task id:null, task code:7250501537088
[INFO] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.runner.StateWheelExecuteThread:[218] - [WorkflowInstance-210][TaskInstance-442] - remove task instance from retry check list
[INFO] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.runner.StateWheelExecuteThread:[237] - [WorkflowInstance-210][TaskInstance-442] - Removed task instance from state check list
[INFO] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowEventLooper:[78] - [WorkflowInstance-209][TaskInstance-0] - Workflow event looper receive a workflow event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=209), will handle this
[INFO] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[54] - [WorkflowInstance-209][TaskInstance-0] - Handle workflow start event, begin to start a workflow, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=209)
[INFO] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowEventLooper:[78] - [WorkflowInstance-211][TaskInstance-0] - Workflow event looper receive a workflow event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=211), will handle this
[INFO] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[54] - [WorkflowInstance-211][TaskInstance-0] - Handle workflow start event, begin to start a workflow, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=211)
[ERROR] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1010] - [WorkflowInstance-224][TaskInstance-0] - submit standby task error, taskCode: 7250501537088, taskInstanceId: null
java.lang.NullPointerException: null
[ERROR] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1010] - [WorkflowInstance-217][TaskInstance-0] - submit standby task error, taskCode: 7250501537088, taskInstanceId: null
java.lang.NullPointerException: null
[ERROR] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[701] - [WorkflowInstance-224][TaskInstance-0] - Start workflow error
java.lang.NullPointerException: null
at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1826)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1349)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:695)
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[ERROR] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[72] - [WorkflowInstance-0][TaskInstance-0] - Failed to submit the workflow instance, will resend the workflow start event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=224)
[ERROR] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[701] - [WorkflowInstance-217][TaskInstance-0] - Start workflow error
java.lang.NullPointerException: null
at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1826)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1349)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:695)
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[INFO] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowEventQueue:[38] - [WorkflowInstance-0][TaskInstance-0] - Added workflow event to workflowEvent queue, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=224)
[ERROR] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[72] - [WorkflowInstance-0][TaskInstance-0] - Failed to submit the workflow instance, will resend the workflow start event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=217)
[INFO] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowEventQueue:[38] - [WorkflowInstance-0][TaskInstance-0] - Added workflow event to workflowEvent queue, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=217)
[INFO] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1714] - [WorkflowInstance-209][TaskInstance-0] - add task to stand by list, task name:e_ads_yl_user_server_relation_by_service_men_create_shop_dept, task id:null, task code:7250501537088
[INFO] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1714] - [WorkflowInstance-211][TaskInstance-0] - add task to stand by list, task name:e_ads_yl_user_server_relation_by_service_men_create_shop_dept, task id:null, task code:7250501537088
[INFO] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowEventLooper:[78] - [WorkflowInstance-224][TaskInstance-0] - Workflow event looper receive a workflow event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=224), will handle this
[INFO] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[54] - [WorkflowInstance-224][TaskInstance-0] - Handle workflow start event, begin to start a workflow, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=224)
[ERROR] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1010] - [WorkflowInstance-214][TaskInstance-0] - submit standby task error, taskCode: 7250501537088, taskInstanceId: null
java.lang.NullPointerException: null
[INFO] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowEventLooper:[78] - [WorkflowInstance-217][TaskInstance-0] - Workflow event looper receive a workflow event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=217), will handle this
[INFO] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[54] - [WorkflowInstance-217][TaskInstance-0] - Handle workflow start event, begin to start a workflow, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=217)
[ERROR] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[701] - [WorkflowInstance-214][TaskInstance-0] - Start workflow error
java.lang.NullPointerException: null
at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1826)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1349)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:695)
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[ERROR] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[72] - [WorkflowInstance-0][TaskInstance-0] - Failed to submit the workflow instance, will resend the workflow start event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=214)
[INFO] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowEventQueue:[38] - [WorkflowInstance-0][TaskInstance-0] - Added workflow event to workflowEvent queue, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=214)
[INFO] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowEventLooper:[78] - [WorkflowInstance-214][TaskInstance-0] - Workflow event looper receive a workflow event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=214), will handle this
[INFO] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[54] - [WorkflowInstance-214][TaskInstance-0] - Handle workflow start event, begin to start a workflow, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=214)
[INFO] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1714] - [WorkflowInstance-224][TaskInstance-0] - add task to stand by list, task name:e_ads_yl_user_server_relation_by_service_men_create_shop_dept, task id:null, task code:7250501537088
[WARN] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1334] - [WorkflowInstance-210][TaskInstance-442] - Task is already at submit queue, taskInstanceId: null
[INFO] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1714] - [WorkflowInstance-217][TaskInstance-0] - add task to stand by list, task name:e_ads_yl_user_server_relation_by_service_men_create_shop_dept, task id:null, task code:7250501537088
[ERROR] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[415] - [WorkflowInstance-210][TaskInstance-442] - Task finish failed, get a exception, will remove this taskInstance from completeTaskMap
java.lang.NullPointerException: null
[ERROR] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1010] - [WorkflowInstance-211][TaskInstance-0] - submit standby task error, taskCode: 7250501537088, taskInstanceId: null
java.lang.NullPointerException: null
[ERROR] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[301] - [WorkflowInstance-210][TaskInstance-442] - State event handle error, get a unknown exception, will retry this event: TaskStateEvent(processInstanceId=210, taskInstanceId=442, taskCode=0, status=TaskExecutionStatus{code=7, desc='success'}, type=TASK_STATE_CHANGE, key=null, channel=null, context=null)
java.lang.NullPointerException: null
[ERROR] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[701] - [WorkflowInstance-211][TaskInstance-0] - Start workflow error
java.lang.NullPointerException: null
at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1826)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1349)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:695)
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[ERROR] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[72] - [WorkflowInstance-0][TaskInstance-0] - Failed to submit the workflow instance, will resend the workflow start event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=211)
[INFO] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowEventQueue:[38] - [WorkflowInstance-0][TaskInstance-0] - Added workflow event to workflowEvent queue, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=211)
[INFO] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowEventLooper:[78] - [WorkflowInstance-211][TaskInstance-0] - Workflow event looper receive a workflow event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=211), will handle this
[INFO] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1714] - [WorkflowInstance-214][TaskInstance-0] - add task to stand by list, task name:e_ads_yl_user_server_relation_by_service_men_create_shop_dept, task id:null, task code:7250501537088
[INFO] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[54] - [WorkflowInstance-211][TaskInstance-0] - Handle workflow start event, begin to start a workflow, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=211)
[ERROR] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1010] - [WorkflowInstance-209][TaskInstance-0] - submit standby task error, taskCode: 7250501537088, taskInstanceId: null
java.lang.NullPointerException: null
[ERROR] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[701] - [WorkflowInstance-209][TaskInstance-0] - Start workflow error
java.lang.NullPointerException: null
at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1826)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1349)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:695)
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[ERROR] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1010] - [WorkflowInstance-224][TaskInstance-0] - submit standby task error, taskCode: 7250501537088, taskInstanceId: null
java.lang.NullPointerException: null
[INFO] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1714] - [WorkflowInstance-211][TaskInstance-0] - add task to stand by list, task name:e_ads_yl_user_server_relation_by_service_men_create_shop_dept, task id:null, task code:7250501537088
[ERROR] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[701] - [WorkflowInstance-224][TaskInstance-0] - Start workflow error
java.lang.NullPointerException: null
at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1826)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1349)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:695)
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[ERROR] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[72] - [WorkflowInstance-0][TaskInstance-0] - Failed to submit the workflow instance, will resend the workflow start event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=224)
[INFO] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowEventQueue:[38] - [WorkflowInstance-0][TaskInstance-0] - Added workflow event to workflowEvent queue, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=224)
[INFO] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowEventLooper:[78] - [WorkflowInstance-224][TaskInstance-0] - Workflow event looper receive a workflow event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=224), will handle this
[INFO] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[54] - [WorkflowInstance-224][TaskInstance-0] - Handle workflow start event, begin to start a workflow, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=224)
[ERROR] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[72] - [WorkflowInstance-0][TaskInstance-0] - Failed to submit the workflow instance, will resend the workflow start event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=209)
[ERROR] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1010] - [WorkflowInstance-214][TaskInstance-0] - submit standby task error, taskCode: 7250501537088, taskInstanceId: null
java.lang.NullPointerException: null
[INFO] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowEventLooper:[78] - [WorkflowInstance-209][TaskInstance-0] - Workflow event looper receive a workflow event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=209), will handle this
[ERROR] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[701] - [WorkflowInstance-214][TaskInstance-0] - Start workflow error
java.lang.NullPointerException: null
at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1826)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1349)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:695)
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[INFO] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowEventQueue:[38] - [WorkflowInstance-0][TaskInstance-0] - Added workflow event to workflowEvent queue, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=209)
[ERROR] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[72] - [WorkflowInstance-0][TaskInstance-0] - Failed to submit the workflow instance, will resend the workflow start event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=214)
[INFO] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[54] - [WorkflowInstance-209][TaskInstance-0] - Handle workflow start event, begin to start a workflow, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=209)
[INFO] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowEventQueue:[38] - [WorkflowInstance-0][TaskInstance-0] - Added workflow event to workflowEvent queue, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=214)
[INFO] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowEventLooper:[78] - [WorkflowInstance-214][TaskInstance-0] - Workflow event looper receive a workflow event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=214), will handle this
[INFO] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[54] - [WorkflowInstance-214][TaskInstance-0] - Handle workflow start event, begin to start a workflow, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=214)
[INFO] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1714] - [WorkflowInstance-224][TaskInstance-0] - add task to stand by list, task name:e_ads_yl_user_server_relation_by_service_men_create_shop_dept, task id:null, task code:7250501537088
[ERROR] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1010] - [WorkflowInstance-211][TaskInstance-0] - submit standby task error, taskCode: 7250501537088, taskInstanceId: null
java.lang.NullPointerException: null
[ERROR] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1010] - [WorkflowInstance-217][TaskInstance-0] - submit standby task error, taskCode: 7250501537088, taskInstanceId: null
java.lang.NullPointerException: null
[ERROR] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[701] - [WorkflowInstance-211][TaskInstance-0] - Start workflow error
java.lang.NullPointerException: null
at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1826)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1349)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:695)
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[ERROR] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[72] - [WorkflowInstance-0][TaskInstance-0] - Failed to submit the workflow instance, will resend the workflow start event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=211)
[INFO] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowEventQueue:[38] - [WorkflowInstance-0][TaskInstance-0] - Added workflow event to workflowEvent queue, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=211)
[ERROR] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[701] - [WorkflowInstance-217][TaskInstance-0] - Start workflow error
java.lang.NullPointerException: null
at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1826)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1349)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:695)
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
```
### What you expected to happen
more and more log filling up my journal It will never stop
### How to reproduce
.
### Anything else
_No response_
### Version
3.1.x
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] hstdream commented on issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop
Posted by GitBox <gi...@apache.org>.
hstdream commented on issue #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440#issuecomment-1287565018
Please provide the reproduction steps, I will fix this problem.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] novice-gamer commented on issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop
Posted by "novice-gamer (via GitHub)" <gi...@apache.org>.
novice-gamer commented on issue #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440#issuecomment-1510938034
Version 3.1.5 still has this error message
```shell
[INFO] 2023-04-17 16:37:25.272 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowEventQueue:[38] - [WorkflowInstance-0][TaskInstance-0] - Added workflow event to workflowEvent queue, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=76)
[INFO] 2023-04-17 16:37:25.272 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowEventLooper:[78] - [WorkflowInstance-76][TaskInstance-0] - Workflow event looper receive a workflow event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=76), will handle this
[INFO] 2023-04-17 16:37:25.273 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[54] - [WorkflowInstance-76][TaskInstance-0] - Handle workflow start event, begin to start a workflow, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=76)
[INFO] 2023-04-17 16:37:25.273 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1732] - [WorkflowInstance-76][TaskInstance-0] - Add task to stand by list, task name:凭安企业清洗, task id:null, task code:9250878476832
[INFO] 2023-04-17 16:37:25.273 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1408] - [WorkflowInstance-76][TaskInstance-0] - The dependTasks of task all success, currentTaskCode: 9250878476832, dependTaskCodes: [9250878476834]
[INFO] 2023-04-17 16:37:25.273 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1839] - [WorkflowInstance-76][TaskInstance-0] - The dependResult of task 凭安企业清洗 is success, so ready to submit to execute
[ERROR] 2023-04-17 16:37:25.274 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1015] - [WorkflowInstance-76][TaskInstance-0] - Submit standby task 凭安企业清洗 error, taskCode: 9250878476832
java.lang.NullPointerException: null
[ERROR] 2023-04-17 16:37:25.274 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[704] - [WorkflowInstance-0][TaskInstance-0] - Start workflow error
java.lang.NullPointerException: null
at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1850)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1362)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:698)
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[ERROR] 2023-04-17 16:37:25.274 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[72] - [WorkflowInstance-0][TaskInstance-0] - Failed to submit the workflow instance, will resend the workflow start event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=76)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] closed issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop
URL: https://github.com/apache/dolphinscheduler/issues/12440
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] gubinjie commented on issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop
Posted by "gubinjie (via GitHub)" <gi...@apache.org>.
gubinjie commented on issue #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440#issuecomment-1515937971
#13956
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440#issuecomment-1423413182
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] Anubisxcw commented on issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop
Posted by "Anubisxcw (via GitHub)" <gi...@apache.org>.
Anubisxcw commented on issue #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440#issuecomment-1584888274
3.1.7 is same
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] drummerglen commented on issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop
Posted by GitBox <gi...@apache.org>.
drummerglen commented on issue #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440#issuecomment-1331916069
> first mandatory success one Workflow <img alt="image" width="1404" src="https://user-images.githubusercontent.com/53160760/202424428-90453dab-9816-479f-b0aa-e3be8b1eea10.png"> <img alt="image" width="1326" src="https://user-images.githubusercontent.com/53160760/202424555-aba31e1a-b639-4ffd-a3f9-43bc6895deaa.png"> select t1.task_code,t1.state,t2.state from t_ds_task_instance t1 left join t_ds_process_instance t2 on t1.process_instance_id = t2.id where t1.task_code='7503085541984'
>
> update state=7
>
> Resolve on error
ver 3.1.1
Temporarily Resolved by modifying the database directly. Community should pay attention to this problem.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] ChewJ404 commented on issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop
Posted by GitBox <gi...@apache.org>.
ChewJ404 commented on issue #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440#issuecomment-1288358704
> Please provide the reproduction steps, I will fix this problem.
first stop one Workflow
second the Workflow status is 4 ,It's always in a stopping state ,
third Restart the service
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop
Posted by github-actions.
github-actions[bot] commented on issue #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440#issuecomment-1411261245
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] songjianet commented on issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop
Posted by GitBox <gi...@apache.org>.
songjianet commented on issue #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440#issuecomment-1284021120
Please make sure this issue exists in 30x and dev.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] 15810785091 commented on issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop
Posted by GitBox <gi...@apache.org>.
15810785091 commented on issue #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440#issuecomment-1318437304
first mandatory stop one Workflow
<img width="1404" alt="image" src="https://user-images.githubusercontent.com/53160760/202424428-90453dab-9816-479f-b0aa-e3be8b1eea10.png">
<img width="1326" alt="image" src="https://user-images.githubusercontent.com/53160760/202424555-aba31e1a-b639-4ffd-a3f9-43bc6895deaa.png">
select t1.task_code,t1.state,t2.state
from
t_ds_task_instance t1
left join
t_ds_process_instance t2
on t1.process_instance_id = t2.id
where t1.task_code='7503085541984'
update state=7
Resolve on error
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] slankka commented on issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop
Posted by "slankka (via GitHub)" <gi...@apache.org>.
slankka commented on issue #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440#issuecomment-1473026547
version 3.1.4 still.
Step to reproduce:
1. upload a jar named xxxx.jar
1. create a flow.
2. create a task, `shell: java -jar xxxx.jar`
3. switch flow to online.
4. run once and success.
5. delete the jar xxxx.jar and upload again.
6. switch flow to offline.
7. update flow and task, rebind xxxx.jar, switch flow to online.
8. run flow
the flow may never create a instance of task.
NPE and infinite:
```
[ERROR] 2023-03-16 18:07:24.519 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[704] - Start workflow error
java.lang.NullPointerException: null
at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1847)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1362)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:698)
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1590)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org