You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2020/09/08 08:56:00 UTC
[GitHub] [incubator-dolphinscheduler] Heltman opened a new issue #3696: [Bug][Module Name] executor process instance error
Heltman opened a new issue #3696:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3696
I get a error when I want to recovery wrong task
version: 1.2.1
What I do:
When a task stuck，I kill workflow in web ui, bug it's no use，so I restart ds, then I can not rerun any workflow...
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] Heltman commented on issue #3696: [Bug] executor process instance error
Posted by GitBox <gi...@apache.org>.
Heltman commented on issue #3696:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3696#issuecomment-707632176
I check the code, and found a bug:
this is "ProcessInstanceId"，but in database，table "t_ds_command" has a wrong data:
so tmpObj is "processInstanceId":
so I got a NullPointerException，Idelete the wrong data, and now it is success!
t_ds_command中的脏数据包含的processInstanceId为小写开头，但是代码里面 却是大写开头的，这是导致空指针的原因，至于脏数据产生的原因，猜测可能是写入mysql时产生了锁，该条数据无法被删除，这也导致了整个ds不会再生成新的调度任务，我是通过重启解决了锁的问题，但是这个脏数据也就永远不会被删除了，而这个脏数据的大小写的问题，可能需要大佬来解释一下了
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] Heltman commented on issue #3696: [Bug][Module Name] executor process instance error
Posted by GitBox <gi...@apache.org>.
Heltman commented on issue #3696:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3696#issuecomment-688728300
master.log
[ERROR] 2020-09-08 16:43:02.346 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[174] - master exec thread exception: null
java.lang.NullPointerException: null
at org.apache.dolphinscheduler.dao.utils.BeanContext.getBean(BeanContext.java:56)
at org.apache.dolphinscheduler.server.master.runner.MasterBaseTaskExecThread.<init>(MasterBaseTaskExecThread.java:84)
at org.apache.dolphinscheduler.server.master.runner.MasterTaskExecThread.<init>(MasterTaskExecThread.java:52)
at org.apache.dolphinscheduler.server.master.runner.MasterExecThread.submitTaskExec(MasterExecThread.java:374)
at org.apache.dolphinscheduler.server.master.runner.MasterExecThread.submitStandByTask(MasterExecThread.java:979)
at org.apache.dolphinscheduler.server.master.runner.MasterExecThread.runProcess(MasterExecThread.java:879)
at org.apache.dolphinscheduler.server.master.runner.MasterExecThread.executeProcess(MasterExecThread.java:192)
at org.apache.dolphinscheduler.server.master.runner.MasterExecThread.run(MasterExecThread.java:171)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[ERROR] 2020-09-08 16:43:02.347 org.apache.dolphinscheduler.server.master.runner.MasterExecThread:[175] - process execute failed, process id:1728
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] lenboo commented on issue #3696: [Bug] executor process instance error
Posted by GitBox <gi...@apache.org>.
lenboo commented on issue #3696:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3696#issuecomment-739794935
it is not dirty data.
i notice that workflow state is 'failed', 'recovery from failed task' from web ui would set the "ProcessInstanceId" into params, i think there may be something error here.
The key 'processInstanceId' is write for 'sub process'.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] dataHunterAssassi commented on issue #3696: [Bug] executor process instance error
Posted by GitBox <gi...@apache.org>.
dataHunterAssassi commented on issue #3696:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3696#issuecomment-732534569
+1 ，I come across the same problem
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] Heltman closed issue #3696: [Bug] executor process instance error
Posted by GitBox <gi...@apache.org>.
Heltman closed issue #3696:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3696
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] CalvinKirs commented on issue #3696: [Bug] executor process instance error
Posted by GitBox <gi...@apache.org>.
CalvinKirs commented on issue #3696:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3696#issuecomment-737017007
> +1 ，I come across the same problem
Is it also version 1.2.1?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] Heltman commented on issue #3696: [Bug][Module Name] executor process instance error
Posted by GitBox <gi...@apache.org>.
Heltman commented on issue #3696:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3696#issuecomment-688727404
api-server.log:
[ERROR] 2020-09-08 16:52:12.087 org.apache.dolphinscheduler.api.controller.ExecutorController:[156] - execute process instance error
java.lang.NullPointerException: null
at org.apache.dolphinscheduler.dao.ProcessDao.verifyIsNeedCreateCommand(ProcessDao.java:223)
at org.apache.dolphinscheduler.dao.ProcessDao$$FastClassBySpringCGLIB$$ee5e71ba.invoke(<generated>)
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:684)
at org.apache.dolphinscheduler.dao.ProcessDao$$EnhancerBySpringCGLIB$$f01aea7c.verifyIsNeedCreateCommand(<generated>)
at org.apache.dolphinscheduler.api.service.ExecutorService.insertCommand(ExecutorService.java:348)
at org.apache.dolphinscheduler.api.service.ExecutorService.execute(ExecutorService.java:220)
at org.apache.dolphinscheduler.api.controller.ExecutorController.execute(ExecutorController.java:153)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org