You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by "liuchunhua (via GitHub)" <gi...@apache.org> on 2024/02/27 02:30:34 UTC
[I] [Bug] [Master,Api-server] version:3.2.1 ProcessServiceImpl.java:1964 NullPointerException [dolphinscheduler]
liuchunhua opened a new issue, #15638:
URL: https://github.com/apache/dolphinscheduler/issues/15638
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
3.2.0升级到3.2.1后，任务执行master会报
```
[WI-0][TI-0] - [ERROR] 2024-02-27 01:29:00.848 +0800 o.a.d.s.m.r.MasterSchedulerBootstrap:[156] - Master handle command 6370 error
org.apache.dolphinscheduler.server.master.exception.WorkflowCreateException: Create WorkflowExecuteRunnable failed
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnableFactory.createWorkflowExecuteRunnable(WorkflowExecuteRunnableFactory.java:98)
at org.apache.dolphinscheduler.server.master.runner.MasterSchedulerBootstrap.lambda$run$0(MasterSchedulerBootstrap.java:139)
at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:290)
at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:731)
at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
at java.util.concurrent.ForkJoinTask.doInvoke(ForkJoinTask.java:401)
at java.util.concurrent.ForkJoinTask.invoke(ForkJoinTask.java:734)
at java.util.stream.ForEachOps$ForEachOp.evaluateParallel(ForEachOps.java:159)
at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateParallel(ForEachOps.java:173)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:233)
at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485)
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:650)
at org.apache.dolphinscheduler.server.master.runner.MasterSchedulerBootstrap.run(MasterSchedulerBootstrap.java:136)
Caused by: java.lang.NullPointerException: null
at org.apache.dolphinscheduler.service.process.ProcessServiceImpl.transformTask(ProcessServiceImpl.java:1964)
at org.apache.dolphinscheduler.service.process.ProcessServiceImpl$$FastClassBySpringCGLIB$$9d3e18f9.invoke(<generated>)
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386)
at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704)
at org.apache.dolphinscheduler.service.process.ProcessServiceImpl$$EnhancerBySpringCGLIB$$237be7b3.transformTask(<generated>)
at org.apache.dolphinscheduler.server.master.graph.WorkflowGraphFactory.createWorkflowGraph(WorkflowGraphFactory.java:74)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteContextFactory.createWorkflowExecuteRunnableContext(WorkflowExecuteContextFactory.java:65)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnableFactory.createWorkflowExecuteRunnable(WorkflowExecuteRunnableFactory.java:83)
... 15 common frames omitted
```
该工作流首个节点状态是禁止运行，修改后保存报错：
```
[ERROR] 2024-02-27 01:04:00.714 +0800 o.a.d.a.s.i.ProcessDefinitionServiceImpl:[489] - Check task relation list error, meet an unknown exception, given taskRelationJson: [{"name":"","preTaskC
ode":0,"preTaskVersion":0,"postTaskCode":11299422634176,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634309,"preTaskVersion":2,"postTaskCo
de":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634049,"postTaskVersion":
2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634310,"postTaskVersion":2,"conditionType":"NONE","conditionPa
rams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634179,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11
299422634176,"preTaskVersion":1,"postTaskCode":11299422634180,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"post
TaskCode":11299422634306,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634309,"postTaskVer
sion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634048,"preTaskVersion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","condi
tionParams":{}},{"name":"","preTaskCode":11299422634049,"preTaskVersion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCo
de":11299422634177,"preTaskVersion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634178,"preTaskVersion":2
,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634179,"preTaskVersion":2,"postTaskCode":11299422634308,"postT
askVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634180,"preTaskVersion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE",
"conditionParams":{}},{"name":"","preTaskCode":11299422634304,"preTaskVersion":3,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","pre
TaskCode":11299422634305,"preTaskVersion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634306,"preTaskVers
ion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634310,"preTaskVersion":2,"postTaskCode":11299422634308,
"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634048,"postTaskVersion":2,"conditionType":"
NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634178,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"
","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634177,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTa
skVersion":1,"postTaskCode":11299422634305,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":112994226
34304,"postTaskVersion":3,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634307,"postTaskVersion":3,"conditionT
ype":"NONE","conditionParams":{}}]
java.lang.NullPointerException: null
at org.apache.dolphinscheduler.service.process.ProcessServiceImpl.transformTask(ProcessServiceImpl.java:1964)
......
[ERROR] 2024-02-27 01:04:00.777 +0800 o.a.d.a.e.ApiExceptionHandler:[40] - org.apache.dolphinscheduler.api.controller.ProcessDefinitionController#updateProcessDefinition[12 args] Meet a ServiceException: 请求参数[{0}]无效
```
### What you expected to happen
正常执行
### How to reproduce
from 3.2.0 upgrade to 3.2.1
### Anything else
###
### Version
3.2.x
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Master,Api-server] version:3.2.1 ProcessServiceImpl.java:1964 NullPointerException [dolphinscheduler]
Posted by "liuchunhua (via GitHub)" <gi...@apache.org>.
liuchunhua closed issue #15638: [Bug] [Master,Api-server] version:3.2.1 ProcessServiceImpl.java:1964 NullPointerException
URL: https://github.com/apache/dolphinscheduler/issues/15638
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Master,Api-server] version:3.2.1 ProcessServiceImpl.java:1964 NullPointerException [dolphinscheduler]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #15638:
URL: https://github.com/apache/dolphinscheduler/issues/15638#issuecomment-1965677541
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
3.2.0升级到3.2.1后，任务执行master会报
```
[WI-0][TI-0] - [ERROR] 2024-02-27 01:29:00.848 +0800 o.a.d.s.m.r.MasterSchedulerBootstrap:[156] - Master handle command 6370 error
org.apache.dolphinscheduler.server.master.exception.WorkflowCreateException: Create WorkflowExecuteRunnable failed
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnableFactory.createWorkflowExecuteRunnable(WorkflowExecuteRunnableFactory.java:98)
at org.apache.dolphinscheduler.server.master.runner.MasterSchedulerBootstrap.lambda$run$0(MasterSchedulerBootstrap.java:139)
at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:290)
at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:731)
at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
at java.util.concurrent.ForkJoinTask.doInvoke(ForkJoinTask.java:401)
at java.util.concurrent.ForkJoinTask.invoke(ForkJoinTask.java:734)
at java.util.stream.ForEachOps$ForEachOp.evaluateParallel(ForEachOps.java:159)
at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateParallel(ForEachOps.java:173)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:233)
at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485)
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:650)
at org.apache.dolphinscheduler.server.master.runner.MasterSchedulerBootstrap.run(MasterSchedulerBootstrap.java:136)
Caused by: java.lang.NullPointerException: null
at org.apache.dolphinscheduler.service.process.ProcessServiceImpl.transformTask(ProcessServiceImpl.java:1964)
at org.apache.dolphinscheduler.service.process.ProcessServiceImpl$$FastClassBySpringCGLIB$$9d3e18f9.invoke(<generated>)
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386)
at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704)
at org.apache.dolphinscheduler.service.process.ProcessServiceImpl$$EnhancerBySpringCGLIB$$237be7b3.transformTask(<generated>)
at org.apache.dolphinscheduler.server.master.graph.WorkflowGraphFactory.createWorkflowGraph(WorkflowGraphFactory.java:74)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteContextFactory.createWorkflowExecuteRunnableContext(WorkflowExecuteContextFactory.java:65)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnableFactory.createWorkflowExecuteRunnable(WorkflowExecuteRunnableFactory.java:83)
... 15 common frames omitted
```
该工作流首个节点状态是禁止运行，修改后保存报错：
```
[ERROR] 2024-02-27 01:04:00.714 +0800 o.a.d.a.s.i.ProcessDefinitionServiceImpl:[489] - Check task relation list error, meet an unknown exception, given taskRelationJson: [{"name":"","preTaskC
ode":0,"preTaskVersion":0,"postTaskCode":11299422634176,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634309,"preTaskVersion":2,"postTaskCo
de":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634049,"postTaskVersion":
2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634310,"postTaskVersion":2,"conditionType":"NONE","conditionPa
rams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634179,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11
299422634176,"preTaskVersion":1,"postTaskCode":11299422634180,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"post
TaskCode":11299422634306,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634309,"postTaskVer
sion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634048,"preTaskVersion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","condi
tionParams":{}},{"name":"","preTaskCode":11299422634049,"preTaskVersion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCo
de":11299422634177,"preTaskVersion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634178,"preTaskVersion":2
,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634179,"preTaskVersion":2,"postTaskCode":11299422634308,"postT
askVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634180,"preTaskVersion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE",
"conditionParams":{}},{"name":"","preTaskCode":11299422634304,"preTaskVersion":3,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","pre
TaskCode":11299422634305,"preTaskVersion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634306,"preTaskVers
ion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634310,"preTaskVersion":2,"postTaskCode":11299422634308,
"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634048,"postTaskVersion":2,"conditionType":"
NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634178,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"
","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634177,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTa
skVersion":1,"postTaskCode":11299422634305,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":112994226
34304,"postTaskVersion":3,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634307,"postTaskVersion":3,"conditionT
ype":"NONE","conditionParams":{}}]
java.lang.NullPointerException: null
at org.apache.dolphinscheduler.service.process.ProcessServiceImpl.transformTask(ProcessServiceImpl.java:1964)
......
[ERROR] 2024-02-27 01:04:00.777 +0800 o.a.d.a.e.ApiExceptionHandler:[40] - org.apache.dolphinscheduler.api.controller.ProcessDefinitionController#updateProcessDefinition[12 args] Meet a ServiceException: 请求参数[{0}]无效
```
### What you expected to happen
正常执行
### How to reproduce
from 3.2.0 upgrade to 3.2.1
### Anything else
###
### Version
3.2.x
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org