You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2021/07/12 01:23:25 UTC

[GitHub] [dolphinscheduler] HeChuanXUPT opened a new issue #5798: [Question] one process is always failed when it has multi contabs

HeChuanXUPT opened a new issue #5798:
URL: https://github.com/apache/dolphinscheduler/issues/5798


   **Describe the question**
   A clear and concise description of what the question is.
   A process has 2 crontab task, but one is always success, and the other always failed. same process, simple shell command.
   任务配置了2个定时任务, 一个总是成功, 一个总是失败. 同一个任务内容, 同一个简答的脚本.
   
   **Which version of DolphinScheduler:**
   docker deploy, apache/dolphinscheduler:latest 
   
   docker images:
   apache/dolphinscheduler                         latest                                        971ed8486b5d        2 months ago        393MB
   
   
   **Additional context**
   ![image](https://user-images.githubusercontent.com/5425689/125216683-83bb0680-e2f1-11eb-94e2-ac14aecd4921.png)
   
   ![image](https://user-images.githubusercontent.com/5425689/125216693-89b0e780-e2f1-11eb-88d6-8a91b5963c45.png)
   
   ![image](https://user-images.githubusercontent.com/5425689/125216855-f88e4080-e2f1-11eb-8c4d-ff8007bbd590.png)
   
   ![image](https://user-images.githubusercontent.com/5425689/125216865-ff1cb800-e2f1-11eb-8e67-c8668120c841.png)
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #5798: [Question] one process is always failed when it has multi contabs

Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #5798:
URL: https://github.com/apache/dolphinscheduler/issues/5798#issuecomment-877903870


   **Describe the question**
   A clear and concise description of what the question is.
   A process has 2 crontab task, but one is always success, and the other always failed. same process, simple shell command.
   The task is configured with 2 timed tasks, one always succeeds, the other always fails. The same task content, the same short answer script.
   
   **Which version of DolphinScheduler:**
   docker deploy, apache/dolphinscheduler:latest
   
   docker images:
   apache/dolphinscheduler latest 971ed8486b5d 2 months ago 393MB
   
   
   **Additional context**
   ![image](https://user-images.githubusercontent.com/5425689/125216683-83bb0680-e2f1-11eb-94e2-ac14aecd4921.png)
   
   ![image](https://user-images.githubusercontent.com/5425689/125216693-89b0e780-e2f1-11eb-88d6-8a91b5963c45.png)
   
   ![image](https://user-images.githubusercontent.com/5425689/125216855-f88e4080-e2f1-11eb-8c4d-ff8007bbd590.png)
   
   ![image](https://user-images.githubusercontent.com/5425689/125216865-ff1cb800-e2f1-11eb-8e67-c8668120c841.png)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #5798: [Question] one process is always failed when it has multi contabs

Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #5798:
URL: https://github.com/apache/dolphinscheduler/issues/5798#issuecomment-877903938


   Hi:
   * Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
   * In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
   * If you haven't received a reply for a long time, you can subscribe to the developer's email，Mail subscription steps reference https://dolphinscheduler.apache.org/zh-cn/community/development/subscribe.html ,Then write the issue URL in the email content and send question to dev@dolphinscheduler.apache.org.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [dolphinscheduler] HeChuanXUPT edited a comment on issue #5798: [Question] one process is always failed when it has multi contabs

Posted by GitBox <gi...@apache.org>.
HeChuanXUPT edited a comment on issue #5798:
URL: https://github.com/apache/dolphinscheduler/issues/5798#issuecomment-897514365


   ```
   [INFO] 2021-08-12 18:08:00.518 org.apache.dolphinscheduler.server.master.runner.MasterSchedulerService:[145] - find one command: id: 43158, type: SCHEDULER
   [INFO] 2021-08-12 18:08:00.520 org.apache.dolphinscheduler.server.master.runner.MasterSchedulerService:[153] - start master exec thread , split DAG ...
   [INFO] 2021-08-12 18:08:00.523 org.apache.dolphinscheduler.server.master.runner.MasterSchedulerService:[145] - find one command: id: 43159, type: SCHEDULER
   [INFO] 2021-08-12 18:08:00.524 org.apache.dolphinscheduler.server.master.runner.MasterSchedulerService:[153] - start master exec thread , split DAG ...
   [INFO] 2021-08-12 18:08:00.616 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[315] - prepare process :43157 end
   [INFO] 2021-08-12 18:08:00.618 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[315] - prepare process :43158 end
   [INFO] 2021-08-12 18:08:00.712 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[792] - add task to stand by list: test 222
   [INFO] 2021-08-12 18:08:00.712 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[792] - add task to stand by list: ping检测
   [INFO] 2021-08-12 18:08:00.713 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[805] - remove task from stand by list: test 222
   [INFO] 2021-08-12 18:08:00.713 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[805] - remove task from stand by list: ping检测
   [INFO] 2021-08-12 18:08:00.714 org.apache.dolphinscheduler.service.process.ProcessService:[845] - start submit task : ping检测, instance id:43158, state: RUNNING_EXECUTION
   [INFO] 2021-08-12 18:08:00.714 org.apache.dolphinscheduler.service.process.ProcessService:[845] - start submit task : test 222, instance id:43157, state: RUNNING_EXECUTION
   [ERROR] 2021-08-12 18:08:00.715 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[187] - task commit to mysql and dispatcht task failed
   java.lang.NullPointerException: null
   [INFO] 2021-08-12 18:08:00.715 org.apache.dolphinscheduler.service.process.ProcessService:[858] - end submit task to db successfully:ping检测 state:SUBMITTED_SUCCESS complete, instance id:43158 state: RUNNING_EXECUTION
   [INFO] 2021-08-12 18:08:00.716 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[216] - task ready to submit: TaskInstance{id=121440, name='ping检测', taskType='SHELL', processDefinitionId=56, processInstanceId=43158, processInstanceName='null', taskJson='{"conditionResult":"{\"successNode\":[\"\"],\"failedNode\":[\"\"]}","conditionsTask":false,"depList":[],"dependence":"{}","forbidden":false,"id":"tasks-69084","maxRetryTimes":0,"name":"ping检测","params":"{\"rawScript\":\"ping 10.42.7.19 -W 3 -c 1 && exit  0\\nping 10.42.7.19 -W 3 -c 1 && exit  0\\nping 10.42.7.19 -W 3 -c 1 && exit  0\",\"localParams\":[],\"resourceList\":[]}","preTasks":"[]","retryInterval":1,"runFlag":"NORMAL","taskInstancePriority":"MEDIUM","taskTimeoutParameter":{"enable":false,"interval":0},"timeout":"{\"enable\":false,\"strategy\":\"\"}","type":"SHELL","workerGroup":"default"}', state=SUBMITTED_SUCCESS, submitTime=Thu Aug 12 18:08:00 CST 2021, startTime=null, endTime=null, host='nul
 l', executePath='null', logPath='null', retryTimes=0, alertFlag=NO, processInstance=null, processDefine=null, pid=0, appLink='null', flag=YES, dependency='null', duration=null, maxRetryTimes=0, retryInterval=1, taskInstancePriority=MEDIUM, processInstancePriority=MEDIUM, dependentResult='null', workerGroup='default', executorId=1, executorName='null'}
   [INFO] 2021-08-12 18:08:00.716 org.apache.dolphinscheduler.service.process.ProcessService:[845] - start submit task : test 222, instance id:43157, state: RUNNING_EXECUTION
   [INFO] 2021-08-12 18:08:00.716 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[227] - master submit success, task : ping检测
   [INFO] 2021-08-12 18:08:00.716 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[116] - wait task: process id: 43158, task id:121440, task name:ping检测 complete
   [ERROR] 2021-08-12 18:08:00.717 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[187] - task commit to mysql and dispatcht task failed
   java.lang.NullPointerException: null
   [INFO] 2021-08-12 18:08:00.717 org.apache.dolphinscheduler.service.process.ProcessService:[845] - start submit task : test 222, instance id:43157, state: RUNNING_EXECUTION
   [ERROR] 2021-08-12 18:08:00.718 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[187] - task commit to mysql and dispatcht task failed
   java.lang.NullPointerException: null
   [INFO] 2021-08-12 18:08:00.717 org.apache.dolphinscheduler.service.process.ProcessService:[845] - start submit task : test 222, instance id:43157, state: RUNNING_EXECUTION
   [ERROR] 2021-08-12 18:08:00.718 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[187] - task commit to mysql and dispatcht task failed
   java.lang.NullPointerException: null
   [INFO] 2021-08-12 18:08:00.718 org.apache.dolphinscheduler.service.process.ProcessService:[845] - start submit task : test 222, instance id:43157, state: RUNNING_EXECUTION
   [ERROR] 2021-08-12 18:08:00.719 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[187] - task commit to mysql and dispatcht task failed
   java.lang.NullPointerException: null
   [INFO] 2021-08-12 18:08:00.720 org.apache.dolphinscheduler.service.process.ProcessService:[845] - start submit task : test 222, instance id:43157, state: RUNNING_EXECUTION
   [ERROR] 2021-08-12 18:08:00.720 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[187] - task commit to mysql and dispatcht task failed
   java.lang.NullPointerException: null
   [ERROR] 2021-08-12 18:08:00.720 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[94] - submit task instance to mysql and queue failed , please check and fix it
   [INFO] 2021-08-12 18:08:00.973 org.apache.dolphinscheduler.server.master.processor.TaskAckProcessor:[69] - taskAckCommand : TaskExecuteAckCommand{taskInstanceId=121440, startTime=Thu Aug 12 18:08:00 CST 2021, host='172.20.0.7:1234', status=1, logPath='/opt/apache-dolphinscheduler-1.3.6-bin/logs/56/43158/121440.log', executePath='/tmp/dolphinscheduler/exec/process/1/56/43158/121440'}
   [ERROR] 2021-08-12 18:08:01.715 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[185] - process execute failed, process id:43157
   ```
   
   There some other tasks running, The error task is test222.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [dolphinscheduler] Yao-MR commented on issue #5798: [Question] one process is always failed when it has multi contabs

Posted by GitBox <gi...@apache.org>.
Yao-MR commented on issue #5798:
URL: https://github.com/apache/dolphinscheduler/issues/5798#issuecomment-897288351


   @HeChuanXUPT  can you add some log of the master and worker?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [dolphinscheduler] HeChuanXUPT commented on issue #5798: [Question] one process is always failed when it has multi contabs

Posted by GitBox <gi...@apache.org>.
HeChuanXUPT commented on issue #5798:
URL: https://github.com/apache/dolphinscheduler/issues/5798#issuecomment-897514365


   ```
   [INFO] 2021-08-12 18:08:00.518 org.apache.dolphinscheduler.server.master.runner.MasterSchedulerService:[145] - find one command: id: 43158, type: SCHEDULER
   [INFO] 2021-08-12 18:08:00.520 org.apache.dolphinscheduler.server.master.runner.MasterSchedulerService:[153] - start master exec thread , split DAG ...
   [INFO] 2021-08-12 18:08:00.523 org.apache.dolphinscheduler.server.master.runner.MasterSchedulerService:[145] - find one command: id: 43159, type: SCHEDULER
   [INFO] 2021-08-12 18:08:00.524 org.apache.dolphinscheduler.server.master.runner.MasterSchedulerService:[153] - start master exec thread , split DAG ...
   [INFO] 2021-08-12 18:08:00.616 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[315] - prepare process :43157 end
   [INFO] 2021-08-12 18:08:00.618 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[315] - prepare process :43158 end
   [INFO] 2021-08-12 18:08:00.712 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[792] - add task to stand by list: test 222
   [INFO] 2021-08-12 18:08:00.712 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[792] - add task to stand by list: ping检测
   [INFO] 2021-08-12 18:08:00.713 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[805] - remove task from stand by list: test 222
   [INFO] 2021-08-12 18:08:00.713 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[805] - remove task from stand by list: ping检测
   [INFO] 2021-08-12 18:08:00.714 org.apache.dolphinscheduler.service.process.ProcessService:[845] - start submit task : ping检测, instance id:43158, state: RUNNING_EXECUTION
   [INFO] 2021-08-12 18:08:00.714 org.apache.dolphinscheduler.service.process.ProcessService:[845] - start submit task : test 222, instance id:43157, state: RUNNING_EXECUTION
   [ERROR] 2021-08-12 18:08:00.715 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[187] - task commit to mysql and dispatcht task failed
   java.lang.NullPointerException: null
   [INFO] 2021-08-12 18:08:00.715 org.apache.dolphinscheduler.service.process.ProcessService:[858] - end submit task to db successfully:ping检测 state:SUBMITTED_SUCCESS complete, instance id:43158 state: RUNNING_EXECUTION
   [INFO] 2021-08-12 18:08:00.716 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[216] - task ready to submit: TaskInstance{id=121440, name='ping检测', taskType='SHELL', processDefinitionId=56, processInstanceId=43158, processInstanceName='null', taskJson='{"conditionResult":"{\"successNode\":[\"\"],\"failedNode\":[\"\"]}","conditionsTask":false,"depList":[],"dependence":"{}","forbidden":false,"id":"tasks-69084","maxRetryTimes":0,"name":"ping检测","params":"{\"rawScript\":\"ping 10.42.7.19 -W 3 -c 1 && exit  0\\nping 10.42.7.19 -W 3 -c 1 && exit  0\\nping 10.42.7.19 -W 3 -c 1 && exit  0\",\"localParams\":[],\"resourceList\":[]}","preTasks":"[]","retryInterval":1,"runFlag":"NORMAL","taskInstancePriority":"MEDIUM","taskTimeoutParameter":{"enable":false,"interval":0},"timeout":"{\"enable\":false,\"strategy\":\"\"}","type":"SHELL","workerGroup":"default"}', state=SUBMITTED_SUCCESS, submitTime=Thu Aug 12 18:08:00 CST 2021, startTime=null, endTime=null, host='nul
 l', executePath='null', logPath='null', retryTimes=0, alertFlag=NO, processInstance=null, processDefine=null, pid=0, appLink='null', flag=YES, dependency='null', duration=null, maxRetryTimes=0, retryInterval=1, taskInstancePriority=MEDIUM, processInstancePriority=MEDIUM, dependentResult='null', workerGroup='default', executorId=1, executorName='null'}
   [INFO] 2021-08-12 18:08:00.716 org.apache.dolphinscheduler.service.process.ProcessService:[845] - start submit task : test 222, instance id:43157, state: RUNNING_EXECUTION
   [INFO] 2021-08-12 18:08:00.716 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[227] - master submit success, task : ping检测
   [INFO] 2021-08-12 18:08:00.716 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[116] - wait task: process id: 43158, task id:121440, task name:ping检测 complete
   [ERROR] 2021-08-12 18:08:00.717 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[187] - task commit to mysql and dispatcht task failed
   java.lang.NullPointerException: null
   [INFO] 2021-08-12 18:08:00.717 org.apache.dolphinscheduler.service.process.ProcessService:[845] - start submit task : test 222, instance id:43157, state: RUNNING_EXECUTION
   [ERROR] 2021-08-12 18:08:00.718 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[187] - task commit to mysql and dispatcht task failed
   java.lang.NullPointerException: null
   [INFO] 2021-08-12 18:08:00.717 org.apache.dolphinscheduler.service.process.ProcessService:[845] - start submit task : test 222, instance id:43157, state: RUNNING_EXECUTION
   [ERROR] 2021-08-12 18:08:00.718 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[187] - task commit to mysql and dispatcht task failed
   java.lang.NullPointerException: null
   [INFO] 2021-08-12 18:08:00.718 org.apache.dolphinscheduler.service.process.ProcessService:[845] - start submit task : test 222, instance id:43157, state: RUNNING_EXECUTION
   [ERROR] 2021-08-12 18:08:00.719 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[187] - task commit to mysql and dispatcht task failed
   java.lang.NullPointerException: null
   [INFO] 2021-08-12 18:08:00.720 org.apache.dolphinscheduler.service.process.ProcessService:[845] - start submit task : test 222, instance id:43157, state: RUNNING_EXECUTION
   [ERROR] 2021-08-12 18:08:00.720 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[187] - task commit to mysql and dispatcht task failed
   java.lang.NullPointerException: null
   [ERROR] 2021-08-12 18:08:00.720 org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread:[94] - submit task instance to mysql and queue failed , please check and fix it
   [INFO] 2021-08-12 18:08:00.973 org.apache.dolphinscheduler.server.master.processor.TaskAckProcessor:[69] - taskAckCommand : TaskExecuteAckCommand{taskInstanceId=121440, startTime=Thu Aug 12 18:08:00 CST 2021, host='172.20.0.7:1234', status=1, logPath='/opt/apache-dolphinscheduler-1.3.6-bin/logs/56/43158/121440.log', executePath='/tmp/dolphinscheduler/exec/process/1/56/43158/121440'}
   [ERROR] 2021-08-12 18:08:01.715 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[185] - process execute failed, process id:43157
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org