You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2022/10/19 09:40:17 UTC

[GitHub] [dolphinscheduler] ChewJ404 opened a new issue, #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop

ChewJ404 opened a new issue, #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### What happened
   
   ![image](https://user-images.githubusercontent.com/10162958/196633790-2ed739fb-268b-4edb-9f85-4efe6bf9f73a.png)
   
   ```
   
   [ERROR] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[72] - [WorkflowInstance-0][TaskInstance-0] - Failed to submit the workflow instance, will resend the workflow start event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=211)
   [INFO] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowEventQueue:[38] - [WorkflowInstance-0][TaskInstance-0] - Added workflow event to workflowEvent queue, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=211)
   [INFO] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[373] - [WorkflowInstance-210][TaskInstance-442] - TaskInstance finished task code:7259222836288 state:TaskExecutionStatus{code=7, desc='success'}
   [INFO] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.runner.StateWheelExecuteThread:[195] - [WorkflowInstance-210][TaskInstance-442] - remove task instance from timeout check list
   [INFO] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1714] - [WorkflowInstance-214][TaskInstance-0] - add task to stand by list, task name:e_ads_yl_user_server_relation_by_service_men_create_shop_dept, task id:null, task code:7250501537088
   [INFO] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.runner.StateWheelExecuteThread:[218] - [WorkflowInstance-210][TaskInstance-442] - remove task instance from retry check list
   [INFO] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.runner.StateWheelExecuteThread:[237] - [WorkflowInstance-210][TaskInstance-442] - Removed task instance from state check list
   [INFO] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowEventLooper:[78] - [WorkflowInstance-209][TaskInstance-0] - Workflow event looper receive a workflow event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=209), will handle this
   [INFO] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[54] - [WorkflowInstance-209][TaskInstance-0] - Handle workflow start event, begin to start a workflow, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=209)
   [INFO] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowEventLooper:[78] - [WorkflowInstance-211][TaskInstance-0] - Workflow event looper receive a workflow event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=211), will handle this
   [INFO] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[54] - [WorkflowInstance-211][TaskInstance-0] - Handle workflow start event, begin to start a workflow, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=211)
   [ERROR] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1010] - [WorkflowInstance-224][TaskInstance-0] - submit standby task error, taskCode: 7250501537088, taskInstanceId: null
   java.lang.NullPointerException: null
   [ERROR] 2022-10-19 16:02:25.887 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1010] - [WorkflowInstance-217][TaskInstance-0] - submit standby task error, taskCode: 7250501537088, taskInstanceId: null
   java.lang.NullPointerException: null
   [ERROR] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[701] - [WorkflowInstance-224][TaskInstance-0] - Start workflow error
   java.lang.NullPointerException: null
   	at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
   	at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1826)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1349)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:695)
   	at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   [ERROR] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[72] - [WorkflowInstance-0][TaskInstance-0] - Failed to submit the workflow instance, will resend the workflow start event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=224)
   [ERROR] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[701] - [WorkflowInstance-217][TaskInstance-0] - Start workflow error
   java.lang.NullPointerException: null
   	at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
   	at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1826)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1349)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:695)
   	at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   [INFO] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowEventQueue:[38] - [WorkflowInstance-0][TaskInstance-0] - Added workflow event to workflowEvent queue, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=224)
   [ERROR] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[72] - [WorkflowInstance-0][TaskInstance-0] - Failed to submit the workflow instance, will resend the workflow start event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=217)
   [INFO] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowEventQueue:[38] - [WorkflowInstance-0][TaskInstance-0] - Added workflow event to workflowEvent queue, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=217)
   [INFO] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1714] - [WorkflowInstance-209][TaskInstance-0] - add task to stand by list, task name:e_ads_yl_user_server_relation_by_service_men_create_shop_dept, task id:null, task code:7250501537088
   [INFO] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1714] - [WorkflowInstance-211][TaskInstance-0] - add task to stand by list, task name:e_ads_yl_user_server_relation_by_service_men_create_shop_dept, task id:null, task code:7250501537088
   [INFO] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowEventLooper:[78] - [WorkflowInstance-224][TaskInstance-0] - Workflow event looper receive a workflow event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=224), will handle this
   [INFO] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[54] - [WorkflowInstance-224][TaskInstance-0] - Handle workflow start event, begin to start a workflow, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=224)
   [ERROR] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1010] - [WorkflowInstance-214][TaskInstance-0] - submit standby task error, taskCode: 7250501537088, taskInstanceId: null
   java.lang.NullPointerException: null
   [INFO] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowEventLooper:[78] - [WorkflowInstance-217][TaskInstance-0] - Workflow event looper receive a workflow event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=217), will handle this
   [INFO] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[54] - [WorkflowInstance-217][TaskInstance-0] - Handle workflow start event, begin to start a workflow, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=217)
   [ERROR] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[701] - [WorkflowInstance-214][TaskInstance-0] - Start workflow error
   java.lang.NullPointerException: null
   	at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
   	at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1826)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1349)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:695)
   	at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   [ERROR] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[72] - [WorkflowInstance-0][TaskInstance-0] - Failed to submit the workflow instance, will resend the workflow start event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=214)
   [INFO] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowEventQueue:[38] - [WorkflowInstance-0][TaskInstance-0] - Added workflow event to workflowEvent queue, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=214)
   [INFO] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowEventLooper:[78] - [WorkflowInstance-214][TaskInstance-0] - Workflow event looper receive a workflow event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=214), will handle this
   [INFO] 2022-10-19 16:02:25.888 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[54] - [WorkflowInstance-214][TaskInstance-0] - Handle workflow start event, begin to start a workflow, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=214)
   [INFO] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1714] - [WorkflowInstance-224][TaskInstance-0] - add task to stand by list, task name:e_ads_yl_user_server_relation_by_service_men_create_shop_dept, task id:null, task code:7250501537088
   [WARN] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1334] - [WorkflowInstance-210][TaskInstance-442] - Task is already at submit queue, taskInstanceId: null
   [INFO] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1714] - [WorkflowInstance-217][TaskInstance-0] - add task to stand by list, task name:e_ads_yl_user_server_relation_by_service_men_create_shop_dept, task id:null, task code:7250501537088
   [ERROR] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[415] - [WorkflowInstance-210][TaskInstance-442] - Task finish failed, get a exception, will remove this taskInstance from completeTaskMap
   java.lang.NullPointerException: null
   [ERROR] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1010] - [WorkflowInstance-211][TaskInstance-0] - submit standby task error, taskCode: 7250501537088, taskInstanceId: null
   java.lang.NullPointerException: null
   [ERROR] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[301] - [WorkflowInstance-210][TaskInstance-442] - State event handle error, get a unknown exception, will retry this event: TaskStateEvent(processInstanceId=210, taskInstanceId=442, taskCode=0, status=TaskExecutionStatus{code=7, desc='success'}, type=TASK_STATE_CHANGE, key=null, channel=null, context=null)
   java.lang.NullPointerException: null
   [ERROR] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[701] - [WorkflowInstance-211][TaskInstance-0] - Start workflow error
   java.lang.NullPointerException: null
   	at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
   	at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1826)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1349)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:695)
   	at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   [ERROR] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[72] - [WorkflowInstance-0][TaskInstance-0] - Failed to submit the workflow instance, will resend the workflow start event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=211)
   [INFO] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowEventQueue:[38] - [WorkflowInstance-0][TaskInstance-0] - Added workflow event to workflowEvent queue, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=211)
   [INFO] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowEventLooper:[78] - [WorkflowInstance-211][TaskInstance-0] - Workflow event looper receive a workflow event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=211), will handle this
   [INFO] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1714] - [WorkflowInstance-214][TaskInstance-0] - add task to stand by list, task name:e_ads_yl_user_server_relation_by_service_men_create_shop_dept, task id:null, task code:7250501537088
   [INFO] 2022-10-19 16:02:25.889 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[54] - [WorkflowInstance-211][TaskInstance-0] - Handle workflow start event, begin to start a workflow, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=211)
   [ERROR] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1010] - [WorkflowInstance-209][TaskInstance-0] - submit standby task error, taskCode: 7250501537088, taskInstanceId: null
   java.lang.NullPointerException: null
   [ERROR] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[701] - [WorkflowInstance-209][TaskInstance-0] - Start workflow error
   java.lang.NullPointerException: null
   	at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
   	at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1826)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1349)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:695)
   	at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   [ERROR] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1010] - [WorkflowInstance-224][TaskInstance-0] - submit standby task error, taskCode: 7250501537088, taskInstanceId: null
   java.lang.NullPointerException: null
   [INFO] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1714] - [WorkflowInstance-211][TaskInstance-0] - add task to stand by list, task name:e_ads_yl_user_server_relation_by_service_men_create_shop_dept, task id:null, task code:7250501537088
   [ERROR] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[701] - [WorkflowInstance-224][TaskInstance-0] - Start workflow error
   java.lang.NullPointerException: null
   	at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
   	at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1826)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1349)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:695)
   	at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   [ERROR] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[72] - [WorkflowInstance-0][TaskInstance-0] - Failed to submit the workflow instance, will resend the workflow start event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=224)
   [INFO] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowEventQueue:[38] - [WorkflowInstance-0][TaskInstance-0] - Added workflow event to workflowEvent queue, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=224)
   [INFO] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowEventLooper:[78] - [WorkflowInstance-224][TaskInstance-0] - Workflow event looper receive a workflow event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=224), will handle this
   [INFO] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[54] - [WorkflowInstance-224][TaskInstance-0] - Handle workflow start event, begin to start a workflow, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=224)
   [ERROR] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[72] - [WorkflowInstance-0][TaskInstance-0] - Failed to submit the workflow instance, will resend the workflow start event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=209)
   [ERROR] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1010] - [WorkflowInstance-214][TaskInstance-0] - submit standby task error, taskCode: 7250501537088, taskInstanceId: null
   java.lang.NullPointerException: null
   [INFO] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowEventLooper:[78] - [WorkflowInstance-209][TaskInstance-0] - Workflow event looper receive a workflow event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=209), will handle this
   [ERROR] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[701] - [WorkflowInstance-214][TaskInstance-0] - Start workflow error
   java.lang.NullPointerException: null
   	at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
   	at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1826)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1349)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:695)
   	at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   [INFO] 2022-10-19 16:02:25.890 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowEventQueue:[38] - [WorkflowInstance-0][TaskInstance-0] - Added workflow event to workflowEvent queue, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=209)
   [ERROR] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[72] - [WorkflowInstance-0][TaskInstance-0] - Failed to submit the workflow instance, will resend the workflow start event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=214)
   [INFO] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[54] - [WorkflowInstance-209][TaskInstance-0] - Handle workflow start event, begin to start a workflow, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=209)
   [INFO] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowEventQueue:[38] - [WorkflowInstance-0][TaskInstance-0] - Added workflow event to workflowEvent queue, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=214)
   [INFO] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowEventLooper:[78] - [WorkflowInstance-214][TaskInstance-0] - Workflow event looper receive a workflow event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=214), will handle this
   [INFO] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[54] - [WorkflowInstance-214][TaskInstance-0] - Handle workflow start event, begin to start a workflow, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=214)
   [INFO] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1714] - [WorkflowInstance-224][TaskInstance-0] - add task to stand by list, task name:e_ads_yl_user_server_relation_by_service_men_create_shop_dept, task id:null, task code:7250501537088
   [ERROR] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1010] - [WorkflowInstance-211][TaskInstance-0] - submit standby task error, taskCode: 7250501537088, taskInstanceId: null
   java.lang.NullPointerException: null
   [ERROR] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1010] - [WorkflowInstance-217][TaskInstance-0] - submit standby task error, taskCode: 7250501537088, taskInstanceId: null
   java.lang.NullPointerException: null
   [ERROR] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[701] - [WorkflowInstance-211][TaskInstance-0] - Start workflow error
   java.lang.NullPointerException: null
   	at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
   	at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1826)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1349)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:695)
   	at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   [ERROR] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[72] - [WorkflowInstance-0][TaskInstance-0] - Failed to submit the workflow instance, will resend the workflow start event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=211)
   [INFO] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowEventQueue:[38] - [WorkflowInstance-0][TaskInstance-0] - Added workflow event to workflowEvent queue, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=211)
   [ERROR] 2022-10-19 16:02:25.891 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[701] - [WorkflowInstance-217][TaskInstance-0] - Start workflow error
   java.lang.NullPointerException: null
   	at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
   	at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1826)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1349)
   	at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:695)
   	at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   ```
   
   ### What you expected to happen
   
    more and more log filling up my journal It will never stop
   
   ### How to reproduce
   
     .
   
   ### Anything else
   
   _No response_
   
   ### Version
   
   3.1.x
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] hstdream commented on issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop

Posted by GitBox <gi...@apache.org>.
hstdream commented on issue #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440#issuecomment-1287565018

   Please provide the reproduction steps, I will fix this problem.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] novice-gamer commented on issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop

Posted by "novice-gamer (via GitHub)" <gi...@apache.org>.
novice-gamer commented on issue #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440#issuecomment-1510938034

   Version 3.1.5 still has this error message
   ```shell
   [INFO] 2023-04-17 16:37:25.272 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowEventQueue:[38] - [WorkflowInstance-0][TaskInstance-0] - Added workflow event to workflowEvent queue, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=76)
   [INFO] 2023-04-17 16:37:25.272 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowEventLooper:[78] - [WorkflowInstance-76][TaskInstance-0] - Workflow event looper receive a workflow event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=76), will handle this
   [INFO] 2023-04-17 16:37:25.273 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[54] - [WorkflowInstance-76][TaskInstance-0] - Handle workflow start event, begin to start a workflow, event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=76)
   [INFO] 2023-04-17 16:37:25.273 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1732] - [WorkflowInstance-76][TaskInstance-0] - Add task to stand by list, task name:凭安企业清洗, task id:null, task code:9250878476832
   [INFO] 2023-04-17 16:37:25.273 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1408] - [WorkflowInstance-76][TaskInstance-0] - The dependTasks of task all success, currentTaskCode: 9250878476832, dependTaskCodes: [9250878476834]
   [INFO] 2023-04-17 16:37:25.273 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1839] - [WorkflowInstance-76][TaskInstance-0] - The dependResult of task 凭安企业清洗 is success, so ready to submit to execute
   [ERROR] 2023-04-17 16:37:25.274 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1015] - [WorkflowInstance-76][TaskInstance-0] - Submit standby task 凭安企业清洗 error, taskCode: 9250878476832
   java.lang.NullPointerException: null
   [ERROR] 2023-04-17 16:37:25.274 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[704] - [WorkflowInstance-0][TaskInstance-0] - Start workflow error
   java.lang.NullPointerException: null
           at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
           at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
           at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1850)
           at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1362)
           at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:698)
           at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
           at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
           at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
           at java.lang.Thread.run(Thread.java:748)
   [ERROR] 2023-04-17 16:37:25.274 +0800 org.apache.dolphinscheduler.server.master.event.WorkflowStartEventHandler:[72] - [WorkflowInstance-0][TaskInstance-0] - Failed to submit the workflow instance, will resend the workflow start event: WorkflowEvent(workflowEventType=START_WORKFLOW, workflowInstanceId=76)
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] github-actions[bot] closed issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #12440: [Bug] [dolphinscheduler master]  Infinite loop  process_instance when status is  prepare to stop
URL: https://github.com/apache/dolphinscheduler/issues/12440


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] gubinjie commented on issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop

Posted by "gubinjie (via GitHub)" <gi...@apache.org>.
gubinjie commented on issue #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440#issuecomment-1515937971

   #13956 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440#issuecomment-1423413182

   This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] Anubisxcw commented on issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop

Posted by "Anubisxcw (via GitHub)" <gi...@apache.org>.
Anubisxcw commented on issue #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440#issuecomment-1584888274

   3.1.7 is same


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] drummerglen commented on issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop

Posted by GitBox <gi...@apache.org>.
drummerglen commented on issue #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440#issuecomment-1331916069

   > first mandatory success one Workflow <img alt="image" width="1404" src="https://user-images.githubusercontent.com/53160760/202424428-90453dab-9816-479f-b0aa-e3be8b1eea10.png"> <img alt="image" width="1326" src="https://user-images.githubusercontent.com/53160760/202424555-aba31e1a-b639-4ffd-a3f9-43bc6895deaa.png"> select t1.task_code,t1.state,t2.state from t_ds_task_instance t1 left join t_ds_process_instance t2 on t1.process_instance_id = t2.id where t1.task_code='7503085541984'
   > 
   > update state=7
   > 
   > Resolve on error
   
   ver 3.1.1
   Temporarily Resolved by modifying the database directly. Community should pay attention to this problem.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] ChewJ404 commented on issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop

Posted by GitBox <gi...@apache.org>.
ChewJ404 commented on issue #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440#issuecomment-1288358704

   > Please provide the reproduction steps, I will fix this problem.
   
   first stop one  Workflow  
   second  the Workflow   status  is  4 ,It's always in a stopping state , 
   third   Restart the service  


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop

Posted by github-actions.
github-actions[bot] commented on issue #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440#issuecomment-1411261245

   This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] songjianet commented on issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop

Posted by GitBox <gi...@apache.org>.
songjianet commented on issue #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440#issuecomment-1284021120

   Please make sure this issue exists in 30x and dev.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] 15810785091 commented on issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop

Posted by GitBox <gi...@apache.org>.
15810785091 commented on issue #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440#issuecomment-1318437304

   first mandatory stop one Workflow
   <img width="1404" alt="image" src="https://user-images.githubusercontent.com/53160760/202424428-90453dab-9816-479f-b0aa-e3be8b1eea10.png">
   <img width="1326" alt="image" src="https://user-images.githubusercontent.com/53160760/202424555-aba31e1a-b639-4ffd-a3f9-43bc6895deaa.png">
   select t1.task_code,t1.state,t2.state
   from 
     t_ds_task_instance t1
   left join 
     t_ds_process_instance t2
   on t1.process_instance_id = t2.id
   where t1.task_code='7503085541984'
   
   update state=7
   
   Resolve on error
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] slankka commented on issue #12440: [Bug] [dolphinscheduler master] Infinite loop process_instance when status is prepare to stop

Posted by "slankka (via GitHub)" <gi...@apache.org>.
slankka commented on issue #12440:
URL: https://github.com/apache/dolphinscheduler/issues/12440#issuecomment-1473026547

   version 3.1.4 still.
   
   Step to reproduce:
   1. upload a jar named xxxx.jar
   1. create a flow.
   2. create a task,  `shell: java -jar xxxx.jar`
   3. switch flow to online.
   4. run once and success.
   5. delete the jar xxxx.jar and upload again.
   6. switch flow to offline.
   7. update flow and task, rebind xxxx.jar, switch flow to online.
   8. run flow
   
   the flow may never create a instance of task.
   
   NPE and infinite:
   
   ```
   [ERROR] 2023-03-16 18:07:24.519 +0800 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[704] - Start workflow error
   java.lang.NullPointerException: null
           at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
           at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
           at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1847)
           at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1362)
           at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:698)
           at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1590)
           at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
           at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
           at java.lang.Thread.run(Thread.java:745)
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org