You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2022/03/22 01:34:28 UTC
[GitHub] [dolphinscheduler] darkz1984 opened a new issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
darkz1984 opened a new issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
I had upgrade ds from 2.0.1 to 2.0.5 in my test server
I use postgresql storage
I have some process in some project and before upgrade, I cab see them
After I upgrade follow the document as : [https://dolphinscheduler.apache.org/zh-cn/docs/latest/user_doc/guide/upgrade.html](https://dolphinscheduler.apache.org/zh-cn/docs/latest/user_doc/guide/upgrade.html)
I found I could not see the process in the webUI
I can found the data in the postgresql database
I try to create new process in the project exists before ds upgrade, and it still could not been see, but run fine as see the process log from the webUI
I try create a new project and then create process in it , it can be see
the log of api server:
```
[INFO] 2022-03-22 09:03:34.465 org.apache.dolphinscheduler.api.aspect.AccessLogAspect:[90] - REQUEST TRACE_ID:9c6ecab2-b396-4308-b1af-c8701360d499, LOGIN_USER:admin, URI:/dolphinscheduler/users/get-user-info, METHOD:GET, HANDLER:org.apache.dolphinscheduler.api.controller.UsersController.getUserInfo, ARGS:{}
[INFO] 2022-03-22 09:03:34.733 org.apache.dolphinscheduler.api.aspect.AccessLogAspect:[90] - REQUEST TRACE_ID:cdb857de-c5c9-40c2-be95-903b5ad3b8bd, LOGIN_USER:admin, URI:/dolphinscheduler/projects/3855559831744/process-definition, METHOD:GET, HANDLER:org.apache.dolphinscheduler.api.controller.ProcessDefinitionController.queryProcessDefinitionListPaging, ARGS:{searchVal=, projectCode=3855559831744, pageNo=1, pageSize=10, userId=0}
[ERROR] 2022-03-22 09:03:34.750 org.apache.dolphinscheduler.api.exceptions.ApiExceptionHandler:[46] - 分页查询工作流定义列表错误
java.lang.NullPointerException: null
at org.apache.dolphinscheduler.api.service.impl.ProcessDefinitionServiceImpl.queryProcessDefinitionListPaging(ProcessDefinitionServiceImpl.java:421)
at org.apache.dolphinscheduler.api.service.impl.ProcessDefinitionServiceImpl$$FastClassBySpringCGLIB$$e8e34ed9.invoke(<generated>)
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:689)
at org.apache.dolphinscheduler.api.service.impl.ProcessDefinitionServiceImpl$$EnhancerBySpringCGLIB$$29d3b64.queryProcessDefinitionListPaging(<generated>)
at org.apache.dolphinscheduler.api.controller.ProcessDefinitionController.queryProcessDefinitionListPaging(ProcessDefinitionController.java:493)
at org.apache.dolphinscheduler.api.controller.ProcessDefinitionController$$FastClassBySpringCGLIB$$dc9bf5db.invoke(<generated>)
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:783)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:753)
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89)
at org.apache.dolphinscheduler.api.aspect.AccessLogAspect.doAround(AccessLogAspect.java:101)
at sun.reflect.GeneratedMethodAccessor145.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624)
at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:753)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:753)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:698)
at org.apache.dolphinscheduler.api.controller.ProcessDefinitionController$$EnhancerBySpringCGLIB$$6683953e.queryProcessDefinitionListPaging(<generated>)
at sun.reflect.GeneratedMethodAccessor379.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150)
at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117)
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895)
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808)
at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87)
at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1067)
at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:963)
at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006)
at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:898)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:497)
at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:584)
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1631)
at org.springframework.web.filter.CorsFilter.doFilterInternal(CorsFilter.java:91)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)
at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
at com.github.xiaoymin.swaggerbootstrapui.filter.SecurityBasicAuthFilter.doFilter(SecurityBasicAuthFilter.java:84)
at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
at com.github.xiaoymin.swaggerbootstrapui.filter.ProductionSecurityFilter.doFilter(ProductionSecurityFilter.java:53)
at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)
at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)
at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)
at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:600)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624)
at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594)
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:763)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
at org.eclipse.jetty.server.Server.handle(Server.java:516)
at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:400)
at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:645)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:392)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
at java.lang.Thread.run(Thread.java:748)
```
### What you expected to happen
I expected all is ok
### How to reproduce
after grade , just fresh the process list page from webUI
### Anything else
_No response_
### Version
2.0.5
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] SbloodyS edited a comment on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
SbloodyS edited a comment on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074671552
It seems there are some mistake in ```https://dolphinscheduler.apache.org/zh-cn/docs/latest/user_doc/guide/upgrade.html```.
You can try to execute database upgrade script ```./script/upgrade-dolphinscheduler.sh```.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] SbloodyS commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
SbloodyS commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074808431
> > > I had trace all the sql operation of postgresql. found the result of the process query is fine, but the web page show error...
> >
> >
> > Did the error log you paste is when you entering process instance page happened?
>
> I trace sql operation from Postgresql side, not ds code The error log show when I enter the process define page. The process instance page and task instance page shows no error in the log
Base on the error log you pasted. It seems like there are some dirty data in the process definition.
Could you please execute the following sql to check if there are ```null``` or ```""``` value in ````operator``` in it?
```
SELECT td.id, td.code, td.name, td.version, td.release_state, td.project_code, td.user_id, td.description,
td.global_params, td.flag, td.warning_group_id, td.timeout, td.tenant_id, td.update_time, td.create_time,
sc.schedule_release_state, tu.user_name
FROM t_ds_process_definition td
left join (select process_definition_code,release_state as schedule_release_state from t_ds_schedules group by
process_definition_code,release_state) sc on sc.process_definition_code = td.code
left join t_ds_user tu on td.user_id = tu.id
where td.project_code = #{projectCode}
and td.user_id = #{userId}
order by sc.schedule_release_state desc,td.update_time desc,td.id asc
limit 10
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] darkz1984 closed issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
darkz1984 closed issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] darkz1984 commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
darkz1984 commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074671463
@songjianet How to reslove this problem manual but not wait for a new release ??
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] SbloodyS commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
SbloodyS commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074825330
> > > > > > I had trace all the sql operation of postgresql. found the result of the process query is fine, but the web page show error...
> > > > >
> > > > >
> > > > > Did the error log you paste is when you entering process instance page happened?
> > > >
> > > >
> > > > I trace sql operation from Postgresql side, not ds code The error log show when I enter the process define page. The process instance page and task instance page shows no error in the log
> > >
> > >
> > > Base on the error log you pasted. It seems like there are some dirty data in the process definition.
> > > Could you please execute the following sql to check if there are `null` or `""` value in `operator` in it?
> > > ```
> > > SELECT td.id, td.code, td.name, td.version, td.release_state, td.project_code, td.user_id, td.description,
> > > td.global_params, td.flag, td.warning_group_id, td.timeout, td.tenant_id, td.update_time, td.create_time,
> > > sc.schedule_release_state, tu.user_name
> > > FROM t_ds_process_definition td
> > > left join (select process_definition_code,release_state as schedule_release_state from t_ds_schedules group by
> > > process_definition_code,release_state) sc on sc.process_definition_code = td.code
> > > left join t_ds_user tu on td.user_id = tu.id
> > > where td.project_code = #{projectCode}
> > > and td.user_id = #{userId}
> > > order by sc.schedule_release_state desc,td.update_time desc,td.id asc
> > > limit 10
> > > ```
> >
> >
> > After this sql, it will execute the following sql base on the above sql's result data. And then throws NPE. There are some dirty data between these two sql's result.
> > ```
> > select
> > *
> > from t_ds_process_definition_log
> > where code = #{code}
> > and version = #{version}
> > ```
>
> This sql return none and "where code = #{code}" should be "where project_code = #{code}" ??
No, it's ```t_ds_process_definition.code``` and ```t_ds_process_definition.version```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] darkz1984 commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
darkz1984 commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074839251
> > > Some problem encounter in the upgrade progress, So my be caused by this...
> >
> >
> > It's strange. I'm also using 2.0.5 which was upgraded from 2.0.1. So far, I didn't have the same problem. Do you have a backup of your data? Maybe you can reuse the backup data and upgrade it again.
>
> I had restore the database and upgrade it , it also shows error as I mention above
and in my online server, the version is also 1.4.0 in the table **t_ds_version**
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] SbloodyS commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
SbloodyS commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074845619
Could you try to change version to 2.0.1 in table ```t_ds_version```. And try upgrade again? @darkz1984
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] darkz1984 commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
darkz1984 commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074834806
Some problem encounter in the upgrade progress, So my be caused by this...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] darkz1984 commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
darkz1984 commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074837865
The error logs durning upgrade the database and I rerun the upgrade scripts:
May be caused by the t_ds_version.
I the 2.0.1, the db version is 1.4.0
```
2022-03-22 11:23:23.867 INFO 19063 --- [ main] o.a.d.dao.upgrade.UpgradeDao : sqlSQLFilePathclass path resource [sql/upgrade/2.0.0_schema/postgresql/dolphinscheduler_dml.sql]
2022-03-22 11:23:23.970 ERROR 19063 --- [ main] o.a.d.dao.upgrade.ProcessDefinitionDao : ERROR: column "process_definition_json" does not exist
Position: 11
org.postgresql.util.PSQLException: ERROR: column "process_definition_json" does not exist
Position: 11
at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2440) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2183) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:308) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:143) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:106) ~[postgresql-42.2.5.jar:42.2.5]
at com.zaxxer.hikari.pool.ProxyPreparedStatement.executeQuery(ProxyPreparedStatement.java:52) ~[HikariCP-4.0.3.jar:na]
at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeQuery(HikariProxyPreparedStatement.java) ~[HikariCP-4.0.3.jar:na]
at org.apache.dolphinscheduler.dao.upgrade.ProcessDefinitionDao.queryAllProcessDefinition(ProcessDefinitionDao.java:58) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.processDefinitionJsonSplit(UpgradeDao.java:400) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerTo200(UpgradeDao.java:149) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
at org.apache.dolphinscheduler.dao.upgrade.DolphinSchedulerManager.upgradeDolphinScheduler(DolphinSchedulerManager.java:111) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler$UpgradeRunner.run(UpgradeDolphinScheduler.java:55) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:791) [spring-boot-2.5.6.jar:2.5.6]
at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:775) [spring-boot-2.5.6.jar:2.5.6]
at org.springframework.boot.SpringApplication.run(SpringApplication.java:345) [spring-boot-2.5.6.jar:2.5.6]
at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:143) [spring-boot-2.5.6.jar:2.5.6]
at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler.main(UpgradeDolphinScheduler.java:39) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
2022-03-22 11:23:23.977 ERROR 19063 --- [ main] o.a.d.dao.upgrade.UpgradeDao : json split error
java.lang.RuntimeException: sql: SELECT id,process_definition_json FROM t_ds_process_definition
at org.apache.dolphinscheduler.dao.upgrade.ProcessDefinitionDao.queryAllProcessDefinition(ProcessDefinitionDao.java:68) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.processDefinitionJsonSplit(UpgradeDao.java:400) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerTo200(UpgradeDao.java:149) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
at org.apache.dolphinscheduler.dao.upgrade.DolphinSchedulerManager.upgradeDolphinScheduler(DolphinSchedulerManager.java:111) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler$UpgradeRunner.run(UpgradeDolphinScheduler.java:55) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:791) [spring-boot-2.5.6.jar:2.5.6]
at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:775) [spring-boot-2.5.6.jar:2.5.6]
at org.springframework.boot.SpringApplication.run(SpringApplication.java:345) [spring-boot-2.5.6.jar:2.5.6]
at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:143) [spring-boot-2.5.6.jar:2.5.6]
at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler.main(UpgradeDolphinScheduler.java:39) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
Caused by: org.postgresql.util.PSQLException: ERROR: column "process_definition_json" does not exist
Position: 11
at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2440) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2183) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:308) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:143) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:106) ~[postgresql-42.2.5.jar:42.2.5]
at com.zaxxer.hikari.pool.ProxyPreparedStatement.executeQuery(ProxyPreparedStatement.java:52) ~[HikariCP-4.0.3.jar:na]
at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeQuery(HikariProxyPreparedStatement.java) ~[HikariCP-4.0.3.jar:na]
at org.apache.dolphinscheduler.dao.upgrade.ProcessDefinitionDao.queryAllProcessDefinition(ProcessDefinitionDao.java:58) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
... 9 common frames omitted
2022-03-22 11:23:23.978 INFO 19063 --- [ main] o.a.d.dao.upgrade.UpgradeDao : dolphinscheduler
2022-03-22 11:23:23.979 INFO 19063 --- [ main] o.a.d.common.utils.ScriptRunner : sql: /* * Licensed to the Apache Software Foundation (ASF) under one or more * contributor license agreements. See the NOTICE file distributed with * this work for additional information regarding copyright ownership. * The ASF licenses this file to You under the Apache License, Version 2.0 * (the "License"); you may not use this file except in compliance with * the License. You may obtain a copy of the License at * * http://www.apache.org/licenses/LICENSE-2.0 * * Unless required by applicable law or agreed to in writing, software * distributed under the License is distributed on an "AS IS" BASIS, * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. * See the License for the specific language governing permissions and * limitations under the License. */ ALTER TABLE "t_ds_process_definition" DROP CONSTRAINT "t_ds_process_definition_pkey"
2022-03-22 11:23:24.049 INFO 19063 --- [ main] o.a.d.common.utils.ScriptRunner : sql: ALTER TABLE "t_ds_process_definition" ADD CONSTRAINT "t_ds_process_definition_pkey" PRIMARY KEY ("id","code")
2022-03-22 11:23:24.071 INFO 19063 --- [ main] o.a.d.common.utils.ScriptRunner : sql: ALTER TABLE "t_ds_process_definition" DROP CONSTRAINT "process_definition_unique"
2022-03-22 11:23:24.087 INFO 19063 --- [ main] o.a.d.common.utils.ScriptRunner : sql: DROP INDEX "process_definition_index"
2022-03-22 11:23:24.103 INFO 19063 --- [ main] o.a.d.common.utils.ScriptRunner : sql: ALTER TABLE "t_ds_process_definition" DROP "process_definition_json"
2022-03-22 11:23:24.109 ERROR 19063 --- [ main] o.a.d.common.utils.ScriptRunner : SQLException
org.postgresql.util.PSQLException: ERROR: column "process_definition_json" of relation "t_ds_process_definition" does not exist
at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2440) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2183) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:308) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:307) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgStatement.executeCachedSql(PgStatement.java:293) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:270) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:266) ~[postgresql-42.2.5.jar:42.2.5]
at com.zaxxer.hikari.pool.ProxyStatement.execute(ProxyStatement.java:94) ~[HikariCP-4.0.3.jar:na]
at com.zaxxer.hikari.pool.HikariProxyStatement.execute(HikariProxyStatement.java) ~[HikariCP-4.0.3.jar:na]
at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:117) [dolphinscheduler-common-2.0.5.jar:2.0.5]
at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:72) [dolphinscheduler-common-2.0.5.jar:2.0.5]
at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerDDL(UpgradeDao.java:333) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerTo200(UpgradeDao.java:150) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
at org.apache.dolphinscheduler.dao.upgrade.DolphinSchedulerManager.upgradeDolphinScheduler(DolphinSchedulerManager.java:111) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler$UpgradeRunner.run(UpgradeDolphinScheduler.java:55) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:791) [spring-boot-2.5.6.jar:2.5.6]
at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:775) [spring-boot-2.5.6.jar:2.5.6]
at org.springframework.boot.SpringApplication.run(SpringApplication.java:345) [spring-boot-2.5.6.jar:2.5.6]
at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:143) [spring-boot-2.5.6.jar:2.5.6]
at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler.main(UpgradeDolphinScheduler.java:39) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
2022-03-22 11:23:24.110 ERROR 19063 --- [ main] o.a.d.common.utils.ScriptRunner : Error executing: ALTER TABLE "t_ds_process_definition" DROP "process_definition_json"
2022-03-22 11:23:24.111 ERROR 19063 --- [ main] o.a.d.dao.upgrade.UpgradeDao : ERROR: column "process_definition_json" of relation "t_ds_process_definition" does not exist
org.postgresql.util.PSQLException: ERROR: column "process_definition_json" of relation "t_ds_process_definition" does not exist
at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2440) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2183) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:308) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:307) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgStatement.executeCachedSql(PgStatement.java:293) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:270) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:266) ~[postgresql-42.2.5.jar:42.2.5]
at com.zaxxer.hikari.pool.ProxyStatement.execute(ProxyStatement.java:94) ~[HikariCP-4.0.3.jar:na]
at com.zaxxer.hikari.pool.HikariProxyStatement.execute(HikariProxyStatement.java) ~[HikariCP-4.0.3.jar:na]
at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:117) ~[dolphinscheduler-common-2.0.5.jar:2.0.5]
at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:72) ~[dolphinscheduler-common-2.0.5.jar:2.0.5]
at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerDDL(UpgradeDao.java:333) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerTo200(UpgradeDao.java:150) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
at org.apache.dolphinscheduler.dao.upgrade.DolphinSchedulerManager.upgradeDolphinScheduler(DolphinSchedulerManager.java:111) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler$UpgradeRunner.run(UpgradeDolphinScheduler.java:55) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:791) [spring-boot-2.5.6.jar:2.5.6]
at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:775) [spring-boot-2.5.6.jar:2.5.6]
at org.springframework.boot.SpringApplication.run(SpringApplication.java:345) [spring-boot-2.5.6.jar:2.5.6]
at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:143) [spring-boot-2.5.6.jar:2.5.6]
at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler.main(UpgradeDolphinScheduler.java:39) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
2022-03-22 11:23:24.116 INFO 19063 --- [ main] ConditionEvaluationReportLoggingListener :
Error starting ApplicationContext. To display the conditions report re-run your application with 'debug' enabled.
2022-03-22 11:23:24.170 ERROR 19063 --- [ main] o.s.boot.SpringApplication : Application run failed
java.lang.IllegalStateException: Failed to execute CommandLineRunner
at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:794) ~[spring-boot-2.5.6.jar:2.5.6]
at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:775) ~[spring-boot-2.5.6.jar:2.5.6]
at org.springframework.boot.SpringApplication.run(SpringApplication.java:345) ~[spring-boot-2.5.6.jar:2.5.6]
at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:143) [spring-boot-2.5.6.jar:2.5.6]
at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler.main(UpgradeDolphinScheduler.java:39) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
Caused by: java.lang.RuntimeException: ERROR: column "process_definition_json" of relation "t_ds_process_definition" does not exist
at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerDDL(UpgradeDao.java:341) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerTo200(UpgradeDao.java:150) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
at org.apache.dolphinscheduler.dao.upgrade.DolphinSchedulerManager.upgradeDolphinScheduler(DolphinSchedulerManager.java:111) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler$UpgradeRunner.run(UpgradeDolphinScheduler.java:55) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:791) ~[spring-boot-2.5.6.jar:2.5.6]
... 4 common frames omitted
Caused by: org.postgresql.util.PSQLException: ERROR: column "process_definition_json" of relation "t_ds_process_definition" does not exist
at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2440) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2183) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:308) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:307) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgStatement.executeCachedSql(PgStatement.java:293) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:270) ~[postgresql-42.2.5.jar:42.2.5]
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:266) ~[postgresql-42.2.5.jar:42.2.5]
at com.zaxxer.hikari.pool.ProxyStatement.execute(ProxyStatement.java:94) ~[HikariCP-4.0.3.jar:na]
at com.zaxxer.hikari.pool.HikariProxyStatement.execute(HikariProxyStatement.java) ~[HikariCP-4.0.3.jar:na]
at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:117) ~[dolphinscheduler-common-2.0.5.jar:2.0.5]
at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:72) ~[dolphinscheduler-common-2.0.5.jar:2.0.5]
at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerDDL(UpgradeDao.java:333) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
... 8 common frames omitted
2022-03-22 11:23:24.183 INFO 19063 --- [ main] com.zaxxer.hikari.HikariDataSource : DolphinScheduler - Shutdown initiated...
2022-03-22 11:23:24.196 INFO 19063 --- [ main] com.zaxxer.hikari.HikariDataSource : DolphinScheduler - Shutdown completed.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] darkz1984 commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
darkz1984 commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074832124
> > > > > > > I had trace all the sql operation of postgresql. found the result of the process query is fine, but the web page show error...
> > > > > >
> > > > > >
> > > > > > Did the error log you paste is when you entering process instance page happened?
> > > > >
> > > > >
> > > > > I trace sql operation from Postgresql side, not ds code The error log show when I enter the process define page. The process instance page and task instance page shows no error in the log
> > > >
> > > >
> > > > Base on the error log you pasted. It seems like there are some dirty data in the process definition.
> > > > Could you please execute the following sql to check if there are `null` or `""` value in `operator` in it?
> > > > ```
> > > > SELECT td.id, td.code, td.name, td.version, td.release_state, td.project_code, td.user_id, td.description,
> > > > td.global_params, td.flag, td.warning_group_id, td.timeout, td.tenant_id, td.update_time, td.create_time,
> > > > sc.schedule_release_state, tu.user_name
> > > > FROM t_ds_process_definition td
> > > > left join (select process_definition_code,release_state as schedule_release_state from t_ds_schedules group by
> > > > process_definition_code,release_state) sc on sc.process_definition_code = td.code
> > > > left join t_ds_user tu on td.user_id = tu.id
> > > > where td.project_code = #{projectCode}
> > > > and td.user_id = #{userId}
> > > > order by sc.schedule_release_state desc,td.update_time desc,td.id asc
> > > > limit 10
> > > > ```
> > >
> > >
> > > After this sql, it will execute the following sql base on the above sql's result data. And then throws NPE. There are some dirty data between these two sql's result.
> > > ```
> > > select
> > > *
> > > from t_ds_process_definition_log
> > > where code = #{code}
> > > and version = #{version}
> > > ```
> >
> >
> > This sql return none and "where code = #{code}" should be "where project_code = #{code}" ??
>
> No, it's `t_ds_process_definition.code` and `t_ds_process_definition.version`
The first SQl return **3** process definition
and the t_ds_process_definition_log query just return **1** result
So why tihs happen??
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] darkz1984 commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
darkz1984 commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074824030
> > > > > I had trace all the sql operation of postgresql. found the result of the process query is fine, but the web page show error...
> > > >
> > > >
> > > > Did the error log you paste is when you entering process instance page happened?
> > >
> > >
> > > I trace sql operation from Postgresql side, not ds code The error log show when I enter the process define page. The process instance page and task instance page shows no error in the log
> >
> >
> > Base on the error log you pasted. It seems like there are some dirty data in the process definition.
> > Could you please execute the following sql to check if there are `null` or `""` value in `operator` in it?
> > ```
> > SELECT td.id, td.code, td.name, td.version, td.release_state, td.project_code, td.user_id, td.description,
> > td.global_params, td.flag, td.warning_group_id, td.timeout, td.tenant_id, td.update_time, td.create_time,
> > sc.schedule_release_state, tu.user_name
> > FROM t_ds_process_definition td
> > left join (select process_definition_code,release_state as schedule_release_state from t_ds_schedules group by
> > process_definition_code,release_state) sc on sc.process_definition_code = td.code
> > left join t_ds_user tu on td.user_id = tu.id
> > where td.project_code = #{projectCode}
> > and td.user_id = #{userId}
> > order by sc.schedule_release_state desc,td.update_time desc,td.id asc
> > limit 10
> > ```
>
> After this sql, it will execute the following sql base on the above sql's result data. And then throws NPE. There are some dirty data between these two sql's result.
>
> ```
> select
> *
> from t_ds_process_definition_log
> where code = #{code}
> and version = #{version}
> ```
This sql return none
and "where code = #{code}" should be "where project_code = #{code}" ??
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] darkz1984 commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
darkz1984 commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074823330
> > > > I had trace all the sql operation of postgresql. found the result of the process query is fine, but the web page show error...
> > >
> > >
> > > Did the error log you paste is when you entering process instance page happened?
> >
> >
> > I trace sql operation from Postgresql side, not ds code The error log show when I enter the process define page. The process instance page and task instance page shows no error in the log
>
> Base on the error log you pasted. It seems like there are some dirty data in the process definition.
>
> Could you please execute the following sql to check if there are `null` or `""` value in `operator` in it?
>
> ```
> SELECT td.id, td.code, td.name, td.version, td.release_state, td.project_code, td.user_id, td.description,
> td.global_params, td.flag, td.warning_group_id, td.timeout, td.tenant_id, td.update_time, td.create_time,
> sc.schedule_release_state, tu.user_name
> FROM t_ds_process_definition td
> left join (select process_definition_code,release_state as schedule_release_state from t_ds_schedules group by
> process_definition_code,release_state) sc on sc.process_definition_code = td.code
> left join t_ds_user tu on td.user_id = tu.id
> where td.project_code = #{projectCode}
> and td.user_id = #{userId}
> order by sc.schedule_release_state desc,td.update_time desc,td.id asc
> limit 10
> ```
This SQL return the result of process define
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] darkz1984 commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
darkz1984 commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074838755
> > Some problem encounter in the upgrade progress, So my be caused by this...
>
> It's strange. I'm also using 2.0.5 which was upgraded from 2.0.1. So far, I didn't have the same problem. Do you have a backup of your data? Maybe you can reuse the backup data and upgrade it again.
I had restore the database and upgrade it , it also shows error as I mention above
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074592727
Hi:
* Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
* In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
* If you haven't received a reply for a long time, you can subscribe to the developer's email，Mail subscription steps reference https://dolphinscheduler.apache.org/en-us/community/development/subscribe.html ,Then write the issue URL in the email content and send question to dev@dolphinscheduler.apache.org.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] SbloodyS edited a comment on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
SbloodyS edited a comment on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074782731
> > It seems there are some mistake in `https://dolphinscheduler.apache.org/zh-cn/docs/latest/user_doc/guide/upgrade.html`.
> > You can try to execute database upgrade script `./script/upgrade-dolphinscheduler.sh`.
>
> I had try use this upgrade script, but the problem is still there....
Sorry for my carelessness. It seems like you did not shutdown ds during the upgrade. Please check if ```operator``` has value in the table ```t_ds_process_definition_log``` or if this ```operator``` can be found by ```select * from t_ds_user where id = {operator}```.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] SbloodyS commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
SbloodyS commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074782731
> > It seems there are some mistake in `https://dolphinscheduler.apache.org/zh-cn/docs/latest/user_doc/guide/upgrade.html`.
> > You can try to execute database upgrade script `./script/upgrade-dolphinscheduler.sh`.
>
> I had try use this upgrade script, but the problem is still there....
Sorry for my carelessness. It seems like you did not shutdown ds during the upgrade. Please check if ```operator``` has value in the table ```t_ds_process_definition_log```.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] SbloodyS commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
SbloodyS commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074836542
> Some problem encounter in the upgrade progress, So my be caused by this...
It's strange. I'm also using 2.0.5 which was upgraded from 2.0.1. So far, I didn't have the same problem. Do you have a backup of your data? Maybe you can reuse the backup data and upgrade it again.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] darkz1984 commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
darkz1984 commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074794269
> > > It seems there are some mistake in `https://dolphinscheduler.apache.org/zh-cn/docs/latest/user_doc/guide/upgrade.html`.
> > > You can try to execute database upgrade script `./script/upgrade-dolphinscheduler.sh`.
> >
> >
> > I had try use this upgrade script, but the problem is still there....
>
> Sorry for my carelessness. It seems like you did not shutdown ds during the upgrade. Please check if `operator` has value in the table `t_ds_process_definition_log` or if this `operator` can be found by `select * from t_ds_user where id = {operator}`.
operator has value in the table t_ds_process_definition_log, and it exists in the t_ds_user table
I shut down all there process of ds by using **shut-all.sh**
and I have just only one user in the ds system.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] darkz1984 commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
darkz1984 commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074795568
I had trace all the sql operation of postgresql. found the result of the process query is fine, but the web page show error...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074592610
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
I had upgrade ds from 2.0.1 to 2.0.5 in my test server
I use postgresql storage
I have some process in some project and before upgrade, I cab see them
After I upgrade follow the document as : [https://dolphinscheduler.apache.org/zh-cn/docs/latest/user_doc/guide/upgrade.html](https://dolphinscheduler.apache.org/zh-cn/docs/latest/user_doc/guide/upgrade.html)
I found I could not see the process in the webUI
I can found the data in the postgresql database
I try to create new process in the project exists before ds upgrade, and it still could not been see, but run fine as see the process log from the webUI
I try create a new project and then create process in it , it can be see
the log of api server:
```
[INFO] 2022-03-22 09:03:34.465 org.apache.dolphinscheduler.api.aspect.AccessLogAspect:[90] - REQUEST TRACE_ID:9c6ecab2-b396-4308-b1af-c8701360d499, LOGIN_USER:admin, URI:/dolphinscheduler/users/get-user-info, METHOD:GET, HANDLER:org.apache.dolphinscheduler.api.controller.UsersController.getUserInfo, ARGS:{}
[INFO] 2022-03-22 09:03:34.733 org.apache.dolphinscheduler.api.aspect.AccessLogAspect:[90] - REQUEST TRACE_ID:cdb857de-c5c9-40c2-be95-903b5ad3b8bd, LOGIN_USER:admin, URI:/dolphinscheduler/projects/3855559831744/process-definition, METHOD:GET, HANDLER:org.apache.dolphinscheduler.api.controller.ProcessDefinitionController.queryProcessDefinitionListPaging, ARGS:{searchVal=, projectCode=3855559831744, pageNo=1, pageSize=10, userId=0}
[ERROR] 2022-03-22 09:03:34.750 org.apache.dolphinscheduler.api.exceptions.ApiExceptionHandler:[46] - 分页查询工作流定义列表错误
java.lang.NullPointerException: null
at org.apache.dolphinscheduler.api.service.impl.ProcessDefinitionServiceImpl.queryProcessDefinitionListPaging(ProcessDefinitionServiceImpl.java:421)
at org.apache.dolphinscheduler.api.service.impl.ProcessDefinitionServiceImpl$$FastClassBySpringCGLIB$$e8e34ed9.invoke(<generated>)
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:689)
at org.apache.dolphinscheduler.api.service.impl.ProcessDefinitionServiceImpl$$EnhancerBySpringCGLIB$$29d3b64.queryProcessDefinitionListPaging(<generated>)
at org.apache.dolphinscheduler.api.controller.ProcessDefinitionController.queryProcessDefinitionListPaging(ProcessDefinitionController.java:493)
at org.apache.dolphinscheduler.api.controller.ProcessDefinitionController$$FastClassBySpringCGLIB$$dc9bf5db.invoke(<generated>)
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:783)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:753)
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89)
at org.apache.dolphinscheduler.api.aspect.AccessLogAspect.doAround(AccessLogAspect.java:101)
at sun.reflect.GeneratedMethodAccessor145.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624)
at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:753)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:753)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:698)
at org.apache.dolphinscheduler.api.controller.ProcessDefinitionController$$EnhancerBySpringCGLIB$$6683953e.queryProcessDefinitionListPaging(<generated>)
at sun.reflect.GeneratedMethodAccessor379.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150)
at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117)
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895)
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808)
at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87)
at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1067)
at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:963)
at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006)
at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:898)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:497)
at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:584)
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1631)
at org.springframework.web.filter.CorsFilter.doFilterInternal(CorsFilter.java:91)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)
at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
at com.github.xiaoymin.swaggerbootstrapui.filter.SecurityBasicAuthFilter.doFilter(SecurityBasicAuthFilter.java:84)
at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
at com.github.xiaoymin.swaggerbootstrapui.filter.ProductionSecurityFilter.doFilter(ProductionSecurityFilter.java:53)
at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)
at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)
at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)
at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:600)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624)
at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594)
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:763)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
at org.eclipse.jetty.server.Server.handle(Server.java:516)
at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:400)
at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:645)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:392)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
at java.lang.Thread.run(Thread.java:748)
```
### What you expected to happen
I expected all is ok
### How to reproduce
after grade , just fresh the process list page from webUI
### Anything else
_No response_
### Version
2.0.5
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] darkz1984 commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
darkz1984 commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074853164
> Could you try to change version to 2.0.1 in table `t_ds_version`. And try upgrade again? @darkz1984
After `update t_ds_version set version='2.0.1';`
the database upgrade ok and the process of in the project shows fine
This problem resloved
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] darkz1984 commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
darkz1984 commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074775832
> It seems there are some mistake in `https://dolphinscheduler.apache.org/zh-cn/docs/latest/user_doc/guide/upgrade.html`.
>
> You can try to execute database upgrade script `./script/upgrade-dolphinscheduler.sh`.
I had try use this upgrade script, but the problem is still there....
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] darkz1984 commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
darkz1984 commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074846033
> Could you try to change version to 2.0.1 in table `t_ds_version`. And try upgrade again? @darkz1984
Yes, I will try, just wait a moment...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] SbloodyS commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
SbloodyS commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074853903
> > Could you try to change version to 2.0.1 in table `t_ds_version`. And try upgrade again? @darkz1984
>
> After `update t_ds_version set version='2.0.1';`
>
> the database upgrade ok and the process of in the project shows fine
>
> This problem resloved
Glad to hear that.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] SbloodyS edited a comment on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
SbloodyS edited a comment on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074808431
> > > I had trace all the sql operation of postgresql. found the result of the process query is fine, but the web page show error...
> >
> >
> > Did the error log you paste is when you entering process instance page happened?
>
> I trace sql operation from Postgresql side, not ds code The error log show when I enter the process define page. The process instance page and task instance page shows no error in the log
Base on the error log you pasted. It seems like there are some dirty data in the process definition.
Could you please execute the following sql to check if there are ```null``` or ```""``` value in ```operator``` in it?
```
SELECT td.id, td.code, td.name, td.version, td.release_state, td.project_code, td.user_id, td.description,
td.global_params, td.flag, td.warning_group_id, td.timeout, td.tenant_id, td.update_time, td.create_time,
sc.schedule_release_state, tu.user_name
FROM t_ds_process_definition td
left join (select process_definition_code,release_state as schedule_release_state from t_ds_schedules group by
process_definition_code,release_state) sc on sc.process_definition_code = td.code
left join t_ds_user tu on td.user_id = tu.id
where td.project_code = #{projectCode}
and td.user_id = #{userId}
order by sc.schedule_release_state desc,td.update_time desc,td.id asc
limit 10
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] SbloodyS commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
SbloodyS commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074815621
> > > > I had trace all the sql operation of postgresql. found the result of the process query is fine, but the web page show error...
> > >
> > >
> > > Did the error log you paste is when you entering process instance page happened?
> >
> >
> > I trace sql operation from Postgresql side, not ds code The error log show when I enter the process define page. The process instance page and task instance page shows no error in the log
>
> Base on the error log you pasted. It seems like there are some dirty data in the process definition.
>
> Could you please execute the following sql to check if there are `null` or `""` value in `operator` in it?
>
> ```
> SELECT td.id, td.code, td.name, td.version, td.release_state, td.project_code, td.user_id, td.description,
> td.global_params, td.flag, td.warning_group_id, td.timeout, td.tenant_id, td.update_time, td.create_time,
> sc.schedule_release_state, tu.user_name
> FROM t_ds_process_definition td
> left join (select process_definition_code,release_state as schedule_release_state from t_ds_schedules group by
> process_definition_code,release_state) sc on sc.process_definition_code = td.code
> left join t_ds_user tu on td.user_id = tu.id
> where td.project_code = #{projectCode}
> and td.user_id = #{userId}
> order by sc.schedule_release_state desc,td.update_time desc,td.id asc
> limit 10
> ```
After this sql, it will execute the following sql base on the above sql's result data. And then throws NPE. There are some dirty data between these two sql's result.
```
select
*
from t_ds_process_definition_log
where code = #{code}
and version = #{version}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] darkz1984 edited a comment on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
darkz1984 edited a comment on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074842224
> > The error logs durning upgrade the database and I rerun the upgrade scripts:
> > May be caused by the t_ds_version.
> > I the 2.0.1, the db version is 1.4.0
> > ```
> > 2022-03-22 11:23:23.867 INFO 19063 --- [ main] o.a.d.dao.upgrade.UpgradeDao : sqlSQLFilePathclass path resource [sql/upgrade/2.0.0_schema/postgresql/dolphinscheduler_dml.sql]
> > 2022-03-22 11:23:23.970 ERROR 19063 --- [ main] o.a.d.dao.upgrade.ProcessDefinitionDao : ERROR: column "process_definition_json" does not exist
> > Position: 11
> >
> > org.postgresql.util.PSQLException: ERROR: column "process_definition_json" does not exist
> > Position: 11
> > at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2440) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2183) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:308) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:143) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:106) ~[postgresql-42.2.5.jar:42.2.5]
> > at com.zaxxer.hikari.pool.ProxyPreparedStatement.executeQuery(ProxyPreparedStatement.java:52) ~[HikariCP-4.0.3.jar:na]
> > at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeQuery(HikariProxyPreparedStatement.java) ~[HikariCP-4.0.3.jar:na]
> > at org.apache.dolphinscheduler.dao.upgrade.ProcessDefinitionDao.queryAllProcessDefinition(ProcessDefinitionDao.java:58) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.processDefinitionJsonSplit(UpgradeDao.java:400) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerTo200(UpgradeDao.java:149) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.DolphinSchedulerManager.upgradeDolphinScheduler(DolphinSchedulerManager.java:111) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler$UpgradeRunner.run(UpgradeDolphinScheduler.java:55) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:791) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:775) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.SpringApplication.run(SpringApplication.java:345) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:143) [spring-boot-2.5.6.jar:2.5.6]
> > at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler.main(UpgradeDolphinScheduler.java:39) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> >
> > 2022-03-22 11:23:23.977 ERROR 19063 --- [ main] o.a.d.dao.upgrade.UpgradeDao : json split error
> >
> > java.lang.RuntimeException: sql: SELECT id,process_definition_json FROM t_ds_process_definition
> > at org.apache.dolphinscheduler.dao.upgrade.ProcessDefinitionDao.queryAllProcessDefinition(ProcessDefinitionDao.java:68) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.processDefinitionJsonSplit(UpgradeDao.java:400) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerTo200(UpgradeDao.java:149) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.DolphinSchedulerManager.upgradeDolphinScheduler(DolphinSchedulerManager.java:111) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler$UpgradeRunner.run(UpgradeDolphinScheduler.java:55) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:791) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:775) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.SpringApplication.run(SpringApplication.java:345) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:143) [spring-boot-2.5.6.jar:2.5.6]
> > at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler.main(UpgradeDolphinScheduler.java:39) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > Caused by: org.postgresql.util.PSQLException: ERROR: column "process_definition_json" does not exist
> > Position: 11
> > at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2440) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2183) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:308) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:143) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:106) ~[postgresql-42.2.5.jar:42.2.5]
> > at com.zaxxer.hikari.pool.ProxyPreparedStatement.executeQuery(ProxyPreparedStatement.java:52) ~[HikariCP-4.0.3.jar:na]
> > at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeQuery(HikariProxyPreparedStatement.java) ~[HikariCP-4.0.3.jar:na]
> > at org.apache.dolphinscheduler.dao.upgrade.ProcessDefinitionDao.queryAllProcessDefinition(ProcessDefinitionDao.java:58) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > ... 9 common frames omitted
> >
> > 2022-03-22 11:23:23.978 INFO 19063 --- [ main] o.a.d.dao.upgrade.UpgradeDao : dolphinscheduler
> > 2022-03-22 11:23:23.979 INFO 19063 --- [ main] o.a.d.common.utils.ScriptRunner : sql: /* * Licensed to the Apache Software Foundation (ASF) under one or more * contributor license agreements. See the NOTICE file distributed with * this work for additional information regarding copyright ownership. * The ASF licenses this file to You under the Apache License, Version 2.0 * (the "License"); you may not use this file except in compliance with * the License. You may obtain a copy of the License at * * http://www.apache.org/licenses/LICENSE-2.0 * * Unless required by applicable law or agreed to in writing, software * distributed under the License is distributed on an "AS IS" BASIS, * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. * See the License for the specific language governing permissions and * limitations under the License. */ ALTER TABLE "t_ds_process_definition" DROP CONSTRAINT "t_ds_process_definition_pkey"
> > 2022-03-22 11:23:24.049 INFO 19063 --- [ main] o.a.d.common.utils.ScriptRunner : sql: ALTER TABLE "t_ds_process_definition" ADD CONSTRAINT "t_ds_process_definition_pkey" PRIMARY KEY ("id","code")
> > 2022-03-22 11:23:24.071 INFO 19063 --- [ main] o.a.d.common.utils.ScriptRunner : sql: ALTER TABLE "t_ds_process_definition" DROP CONSTRAINT "process_definition_unique"
> > 2022-03-22 11:23:24.087 INFO 19063 --- [ main] o.a.d.common.utils.ScriptRunner : sql: DROP INDEX "process_definition_index"
> > 2022-03-22 11:23:24.103 INFO 19063 --- [ main] o.a.d.common.utils.ScriptRunner : sql: ALTER TABLE "t_ds_process_definition" DROP "process_definition_json"
> > 2022-03-22 11:23:24.109 ERROR 19063 --- [ main] o.a.d.common.utils.ScriptRunner : SQLException
> >
> > org.postgresql.util.PSQLException: ERROR: column "process_definition_json" of relation "t_ds_process_definition" does not exist
> > at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2440) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2183) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:308) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:307) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeCachedSql(PgStatement.java:293) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:270) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:266) ~[postgresql-42.2.5.jar:42.2.5]
> > at com.zaxxer.hikari.pool.ProxyStatement.execute(ProxyStatement.java:94) ~[HikariCP-4.0.3.jar:na]
> > at com.zaxxer.hikari.pool.HikariProxyStatement.execute(HikariProxyStatement.java) ~[HikariCP-4.0.3.jar:na]
> > at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:117) [dolphinscheduler-common-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:72) [dolphinscheduler-common-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerDDL(UpgradeDao.java:333) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerTo200(UpgradeDao.java:150) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.DolphinSchedulerManager.upgradeDolphinScheduler(DolphinSchedulerManager.java:111) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler$UpgradeRunner.run(UpgradeDolphinScheduler.java:55) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:791) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:775) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.SpringApplication.run(SpringApplication.java:345) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:143) [spring-boot-2.5.6.jar:2.5.6]
> > at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler.main(UpgradeDolphinScheduler.java:39) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> >
> > 2022-03-22 11:23:24.110 ERROR 19063 --- [ main] o.a.d.common.utils.ScriptRunner : Error executing: ALTER TABLE "t_ds_process_definition" DROP "process_definition_json"
> > 2022-03-22 11:23:24.111 ERROR 19063 --- [ main] o.a.d.dao.upgrade.UpgradeDao : ERROR: column "process_definition_json" of relation "t_ds_process_definition" does not exist
> >
> > org.postgresql.util.PSQLException: ERROR: column "process_definition_json" of relation "t_ds_process_definition" does not exist
> > at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2440) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2183) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:308) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:307) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeCachedSql(PgStatement.java:293) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:270) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:266) ~[postgresql-42.2.5.jar:42.2.5]
> > at com.zaxxer.hikari.pool.ProxyStatement.execute(ProxyStatement.java:94) ~[HikariCP-4.0.3.jar:na]
> > at com.zaxxer.hikari.pool.HikariProxyStatement.execute(HikariProxyStatement.java) ~[HikariCP-4.0.3.jar:na]
> > at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:117) ~[dolphinscheduler-common-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:72) ~[dolphinscheduler-common-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerDDL(UpgradeDao.java:333) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerTo200(UpgradeDao.java:150) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.DolphinSchedulerManager.upgradeDolphinScheduler(DolphinSchedulerManager.java:111) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler$UpgradeRunner.run(UpgradeDolphinScheduler.java:55) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:791) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:775) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.SpringApplication.run(SpringApplication.java:345) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:143) [spring-boot-2.5.6.jar:2.5.6]
> > at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler.main(UpgradeDolphinScheduler.java:39) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> >
> > 2022-03-22 11:23:24.116 INFO 19063 --- [ main] ConditionEvaluationReportLoggingListener :
> >
> > Error starting ApplicationContext. To display the conditions report re-run your application with 'debug' enabled.
> > 2022-03-22 11:23:24.170 ERROR 19063 --- [ main] o.s.boot.SpringApplication : Application run failed
> >
> > java.lang.IllegalStateException: Failed to execute CommandLineRunner
> > at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:794) ~[spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:775) ~[spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.SpringApplication.run(SpringApplication.java:345) ~[spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:143) [spring-boot-2.5.6.jar:2.5.6]
> > at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler.main(UpgradeDolphinScheduler.java:39) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > Caused by: java.lang.RuntimeException: ERROR: column "process_definition_json" of relation "t_ds_process_definition" does not exist
> > at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerDDL(UpgradeDao.java:341) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerTo200(UpgradeDao.java:150) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.DolphinSchedulerManager.upgradeDolphinScheduler(DolphinSchedulerManager.java:111) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler$UpgradeRunner.run(UpgradeDolphinScheduler.java:55) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:791) ~[spring-boot-2.5.6.jar:2.5.6]
> > ... 4 common frames omitted
> > Caused by: org.postgresql.util.PSQLException: ERROR: column "process_definition_json" of relation "t_ds_process_definition" does not exist
> > at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2440) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2183) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:308) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:307) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeCachedSql(PgStatement.java:293) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:270) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:266) ~[postgresql-42.2.5.jar:42.2.5]
> > at com.zaxxer.hikari.pool.ProxyStatement.execute(ProxyStatement.java:94) ~[HikariCP-4.0.3.jar:na]
> > at com.zaxxer.hikari.pool.HikariProxyStatement.execute(HikariProxyStatement.java) ~[HikariCP-4.0.3.jar:na]
> > at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:117) ~[dolphinscheduler-common-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:72) ~[dolphinscheduler-common-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerDDL(UpgradeDao.java:333) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > ... 8 common frames omitted
> >
> > 2022-03-22 11:23:24.183 INFO 19063 --- [ main] com.zaxxer.hikari.HikariDataSource : DolphinScheduler - Shutdown initiated...
> > 2022-03-22 11:23:24.196 INFO 19063 --- [ main] com.zaxxer.hikari.HikariDataSource : DolphinScheduler - Shutdown completed.
> > ```
>
> What? There are no 1.4.0-release version in `https://dolphinscheduler.apache.org/en-us/docs/release/history-versions.html`. Where did you find it?
I had check code
https://github.com/apache/dolphinscheduler/blob/2.0.1-release/dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_mysql.sql
and
https://github.com/apache/dolphinscheduler/blob/2.0.1-release/dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_postgre.sql
the version code in mysql is 2.0.2 of 2.0.1 release and
the version code in postgresql is 1.4.0 of 2.0.1 release
and I use postgresql !!!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] SbloodyS commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
SbloodyS commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074671552
It seems there are some mistake in ```https://dolphinscheduler.apache.org/zh-cn/docs/latest/user_doc/guide/upgrade.html```. You can try to execute database upgrade script ```./script/upgrade-dolphinscheduler.sh```.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] darkz1984 commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
darkz1984 commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074801299
> > I had trace all the sql operation of postgresql. found the result of the process query is fine, but the web page show error...
>
> Did the error log you paste is when you entering process instance page happened?
I trace sql operation from Postgresql side, not ds code
The error log show when I enter the process define page. The process instance page and task instance page shows no error in the log
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] SbloodyS commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
SbloodyS commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074797551
> I had trace all the sql operation of postgresql. found the result of the process query is fine, but the web page show error...
Did the error log you paste is when you entering process instance page happened?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] darkz1984 commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
darkz1984 commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074842224
> > The error logs durning upgrade the database and I rerun the upgrade scripts:
> > May be caused by the t_ds_version.
> > I the 2.0.1, the db version is 1.4.0
> > ```
> > 2022-03-22 11:23:23.867 INFO 19063 --- [ main] o.a.d.dao.upgrade.UpgradeDao : sqlSQLFilePathclass path resource [sql/upgrade/2.0.0_schema/postgresql/dolphinscheduler_dml.sql]
> > 2022-03-22 11:23:23.970 ERROR 19063 --- [ main] o.a.d.dao.upgrade.ProcessDefinitionDao : ERROR: column "process_definition_json" does not exist
> > Position: 11
> >
> > org.postgresql.util.PSQLException: ERROR: column "process_definition_json" does not exist
> > Position: 11
> > at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2440) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2183) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:308) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:143) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:106) ~[postgresql-42.2.5.jar:42.2.5]
> > at com.zaxxer.hikari.pool.ProxyPreparedStatement.executeQuery(ProxyPreparedStatement.java:52) ~[HikariCP-4.0.3.jar:na]
> > at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeQuery(HikariProxyPreparedStatement.java) ~[HikariCP-4.0.3.jar:na]
> > at org.apache.dolphinscheduler.dao.upgrade.ProcessDefinitionDao.queryAllProcessDefinition(ProcessDefinitionDao.java:58) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.processDefinitionJsonSplit(UpgradeDao.java:400) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerTo200(UpgradeDao.java:149) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.DolphinSchedulerManager.upgradeDolphinScheduler(DolphinSchedulerManager.java:111) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler$UpgradeRunner.run(UpgradeDolphinScheduler.java:55) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:791) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:775) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.SpringApplication.run(SpringApplication.java:345) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:143) [spring-boot-2.5.6.jar:2.5.6]
> > at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler.main(UpgradeDolphinScheduler.java:39) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> >
> > 2022-03-22 11:23:23.977 ERROR 19063 --- [ main] o.a.d.dao.upgrade.UpgradeDao : json split error
> >
> > java.lang.RuntimeException: sql: SELECT id,process_definition_json FROM t_ds_process_definition
> > at org.apache.dolphinscheduler.dao.upgrade.ProcessDefinitionDao.queryAllProcessDefinition(ProcessDefinitionDao.java:68) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.processDefinitionJsonSplit(UpgradeDao.java:400) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerTo200(UpgradeDao.java:149) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.DolphinSchedulerManager.upgradeDolphinScheduler(DolphinSchedulerManager.java:111) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler$UpgradeRunner.run(UpgradeDolphinScheduler.java:55) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:791) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:775) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.SpringApplication.run(SpringApplication.java:345) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:143) [spring-boot-2.5.6.jar:2.5.6]
> > at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler.main(UpgradeDolphinScheduler.java:39) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > Caused by: org.postgresql.util.PSQLException: ERROR: column "process_definition_json" does not exist
> > Position: 11
> > at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2440) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2183) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:308) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:143) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:106) ~[postgresql-42.2.5.jar:42.2.5]
> > at com.zaxxer.hikari.pool.ProxyPreparedStatement.executeQuery(ProxyPreparedStatement.java:52) ~[HikariCP-4.0.3.jar:na]
> > at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeQuery(HikariProxyPreparedStatement.java) ~[HikariCP-4.0.3.jar:na]
> > at org.apache.dolphinscheduler.dao.upgrade.ProcessDefinitionDao.queryAllProcessDefinition(ProcessDefinitionDao.java:58) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > ... 9 common frames omitted
> >
> > 2022-03-22 11:23:23.978 INFO 19063 --- [ main] o.a.d.dao.upgrade.UpgradeDao : dolphinscheduler
> > 2022-03-22 11:23:23.979 INFO 19063 --- [ main] o.a.d.common.utils.ScriptRunner : sql: /* * Licensed to the Apache Software Foundation (ASF) under one or more * contributor license agreements. See the NOTICE file distributed with * this work for additional information regarding copyright ownership. * The ASF licenses this file to You under the Apache License, Version 2.0 * (the "License"); you may not use this file except in compliance with * the License. You may obtain a copy of the License at * * http://www.apache.org/licenses/LICENSE-2.0 * * Unless required by applicable law or agreed to in writing, software * distributed under the License is distributed on an "AS IS" BASIS, * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. * See the License for the specific language governing permissions and * limitations under the License. */ ALTER TABLE "t_ds_process_definition" DROP CONSTRAINT "t_ds_process_definition_pkey"
> > 2022-03-22 11:23:24.049 INFO 19063 --- [ main] o.a.d.common.utils.ScriptRunner : sql: ALTER TABLE "t_ds_process_definition" ADD CONSTRAINT "t_ds_process_definition_pkey" PRIMARY KEY ("id","code")
> > 2022-03-22 11:23:24.071 INFO 19063 --- [ main] o.a.d.common.utils.ScriptRunner : sql: ALTER TABLE "t_ds_process_definition" DROP CONSTRAINT "process_definition_unique"
> > 2022-03-22 11:23:24.087 INFO 19063 --- [ main] o.a.d.common.utils.ScriptRunner : sql: DROP INDEX "process_definition_index"
> > 2022-03-22 11:23:24.103 INFO 19063 --- [ main] o.a.d.common.utils.ScriptRunner : sql: ALTER TABLE "t_ds_process_definition" DROP "process_definition_json"
> > 2022-03-22 11:23:24.109 ERROR 19063 --- [ main] o.a.d.common.utils.ScriptRunner : SQLException
> >
> > org.postgresql.util.PSQLException: ERROR: column "process_definition_json" of relation "t_ds_process_definition" does not exist
> > at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2440) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2183) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:308) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:307) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeCachedSql(PgStatement.java:293) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:270) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:266) ~[postgresql-42.2.5.jar:42.2.5]
> > at com.zaxxer.hikari.pool.ProxyStatement.execute(ProxyStatement.java:94) ~[HikariCP-4.0.3.jar:na]
> > at com.zaxxer.hikari.pool.HikariProxyStatement.execute(HikariProxyStatement.java) ~[HikariCP-4.0.3.jar:na]
> > at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:117) [dolphinscheduler-common-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:72) [dolphinscheduler-common-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerDDL(UpgradeDao.java:333) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerTo200(UpgradeDao.java:150) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.DolphinSchedulerManager.upgradeDolphinScheduler(DolphinSchedulerManager.java:111) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler$UpgradeRunner.run(UpgradeDolphinScheduler.java:55) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:791) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:775) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.SpringApplication.run(SpringApplication.java:345) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:143) [spring-boot-2.5.6.jar:2.5.6]
> > at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler.main(UpgradeDolphinScheduler.java:39) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> >
> > 2022-03-22 11:23:24.110 ERROR 19063 --- [ main] o.a.d.common.utils.ScriptRunner : Error executing: ALTER TABLE "t_ds_process_definition" DROP "process_definition_json"
> > 2022-03-22 11:23:24.111 ERROR 19063 --- [ main] o.a.d.dao.upgrade.UpgradeDao : ERROR: column "process_definition_json" of relation "t_ds_process_definition" does not exist
> >
> > org.postgresql.util.PSQLException: ERROR: column "process_definition_json" of relation "t_ds_process_definition" does not exist
> > at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2440) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2183) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:308) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:307) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeCachedSql(PgStatement.java:293) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:270) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:266) ~[postgresql-42.2.5.jar:42.2.5]
> > at com.zaxxer.hikari.pool.ProxyStatement.execute(ProxyStatement.java:94) ~[HikariCP-4.0.3.jar:na]
> > at com.zaxxer.hikari.pool.HikariProxyStatement.execute(HikariProxyStatement.java) ~[HikariCP-4.0.3.jar:na]
> > at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:117) ~[dolphinscheduler-common-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:72) ~[dolphinscheduler-common-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerDDL(UpgradeDao.java:333) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerTo200(UpgradeDao.java:150) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.DolphinSchedulerManager.upgradeDolphinScheduler(DolphinSchedulerManager.java:111) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler$UpgradeRunner.run(UpgradeDolphinScheduler.java:55) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:791) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:775) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.SpringApplication.run(SpringApplication.java:345) [spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:143) [spring-boot-2.5.6.jar:2.5.6]
> > at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler.main(UpgradeDolphinScheduler.java:39) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> >
> > 2022-03-22 11:23:24.116 INFO 19063 --- [ main] ConditionEvaluationReportLoggingListener :
> >
> > Error starting ApplicationContext. To display the conditions report re-run your application with 'debug' enabled.
> > 2022-03-22 11:23:24.170 ERROR 19063 --- [ main] o.s.boot.SpringApplication : Application run failed
> >
> > java.lang.IllegalStateException: Failed to execute CommandLineRunner
> > at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:794) ~[spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:775) ~[spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.SpringApplication.run(SpringApplication.java:345) ~[spring-boot-2.5.6.jar:2.5.6]
> > at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:143) [spring-boot-2.5.6.jar:2.5.6]
> > at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler.main(UpgradeDolphinScheduler.java:39) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > Caused by: java.lang.RuntimeException: ERROR: column "process_definition_json" of relation "t_ds_process_definition" does not exist
> > at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerDDL(UpgradeDao.java:341) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerTo200(UpgradeDao.java:150) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.DolphinSchedulerManager.upgradeDolphinScheduler(DolphinSchedulerManager.java:111) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler$UpgradeRunner.run(UpgradeDolphinScheduler.java:55) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:791) ~[spring-boot-2.5.6.jar:2.5.6]
> > ... 4 common frames omitted
> > Caused by: org.postgresql.util.PSQLException: ERROR: column "process_definition_json" of relation "t_ds_process_definition" does not exist
> > at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2440) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2183) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:308) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:307) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeCachedSql(PgStatement.java:293) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:270) ~[postgresql-42.2.5.jar:42.2.5]
> > at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:266) ~[postgresql-42.2.5.jar:42.2.5]
> > at com.zaxxer.hikari.pool.ProxyStatement.execute(ProxyStatement.java:94) ~[HikariCP-4.0.3.jar:na]
> > at com.zaxxer.hikari.pool.HikariProxyStatement.execute(HikariProxyStatement.java) ~[HikariCP-4.0.3.jar:na]
> > at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:117) ~[dolphinscheduler-common-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:72) ~[dolphinscheduler-common-2.0.5.jar:2.0.5]
> > at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerDDL(UpgradeDao.java:333) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> > ... 8 common frames omitted
> >
> > 2022-03-22 11:23:24.183 INFO 19063 --- [ main] com.zaxxer.hikari.HikariDataSource : DolphinScheduler - Shutdown initiated...
> > 2022-03-22 11:23:24.196 INFO 19063 --- [ main] com.zaxxer.hikari.HikariDataSource : DolphinScheduler - Shutdown completed.
> > ```
>
> What? There are no 1.4.0-release version in `https://dolphinscheduler.apache.org/en-us/docs/release/history-versions.html`. Where did you find it?
I had check code
https://github.com/apache/dolphinscheduler/blob/2.0.1-release/dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_mysql.sql
and
https://github.com/apache/dolphinscheduler/blob/02350ea37b3863f7303a196408a558d6a94ea5f3/dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_postgre.sql
the version code in mysql is 2.0.2 of 2.0.1 release and
the version code in postgresql is 1.4.0 of 2.0.1 release
and I use postgresql !!!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] SbloodyS commented on issue #9068: [Bug] [API server] could not get flow in exists project after upgrade from 2.0.1 to 2.0.5
Posted by GitBox <gi...@apache.org>.
SbloodyS commented on issue #9068:
URL: https://github.com/apache/dolphinscheduler/issues/9068#issuecomment-1074839890
> The error logs durning upgrade the database and I rerun the upgrade scripts:
>
> May be caused by the t_ds_version.
>
> I the 2.0.1, the db version is 1.4.0
>
> ```
> 2022-03-22 11:23:23.867 INFO 19063 --- [ main] o.a.d.dao.upgrade.UpgradeDao : sqlSQLFilePathclass path resource [sql/upgrade/2.0.0_schema/postgresql/dolphinscheduler_dml.sql]
> 2022-03-22 11:23:23.970 ERROR 19063 --- [ main] o.a.d.dao.upgrade.ProcessDefinitionDao : ERROR: column "process_definition_json" does not exist
> Position: 11
>
> org.postgresql.util.PSQLException: ERROR: column "process_definition_json" does not exist
> Position: 11
> at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2440) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2183) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:308) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:143) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:106) ~[postgresql-42.2.5.jar:42.2.5]
> at com.zaxxer.hikari.pool.ProxyPreparedStatement.executeQuery(ProxyPreparedStatement.java:52) ~[HikariCP-4.0.3.jar:na]
> at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeQuery(HikariProxyPreparedStatement.java) ~[HikariCP-4.0.3.jar:na]
> at org.apache.dolphinscheduler.dao.upgrade.ProcessDefinitionDao.queryAllProcessDefinition(ProcessDefinitionDao.java:58) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.processDefinitionJsonSplit(UpgradeDao.java:400) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerTo200(UpgradeDao.java:149) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> at org.apache.dolphinscheduler.dao.upgrade.DolphinSchedulerManager.upgradeDolphinScheduler(DolphinSchedulerManager.java:111) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler$UpgradeRunner.run(UpgradeDolphinScheduler.java:55) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:791) [spring-boot-2.5.6.jar:2.5.6]
> at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:775) [spring-boot-2.5.6.jar:2.5.6]
> at org.springframework.boot.SpringApplication.run(SpringApplication.java:345) [spring-boot-2.5.6.jar:2.5.6]
> at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:143) [spring-boot-2.5.6.jar:2.5.6]
> at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler.main(UpgradeDolphinScheduler.java:39) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
>
> 2022-03-22 11:23:23.977 ERROR 19063 --- [ main] o.a.d.dao.upgrade.UpgradeDao : json split error
>
> java.lang.RuntimeException: sql: SELECT id,process_definition_json FROM t_ds_process_definition
> at org.apache.dolphinscheduler.dao.upgrade.ProcessDefinitionDao.queryAllProcessDefinition(ProcessDefinitionDao.java:68) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.processDefinitionJsonSplit(UpgradeDao.java:400) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerTo200(UpgradeDao.java:149) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> at org.apache.dolphinscheduler.dao.upgrade.DolphinSchedulerManager.upgradeDolphinScheduler(DolphinSchedulerManager.java:111) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler$UpgradeRunner.run(UpgradeDolphinScheduler.java:55) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:791) [spring-boot-2.5.6.jar:2.5.6]
> at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:775) [spring-boot-2.5.6.jar:2.5.6]
> at org.springframework.boot.SpringApplication.run(SpringApplication.java:345) [spring-boot-2.5.6.jar:2.5.6]
> at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:143) [spring-boot-2.5.6.jar:2.5.6]
> at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler.main(UpgradeDolphinScheduler.java:39) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> Caused by: org.postgresql.util.PSQLException: ERROR: column "process_definition_json" does not exist
> Position: 11
> at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2440) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2183) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:308) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:143) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:106) ~[postgresql-42.2.5.jar:42.2.5]
> at com.zaxxer.hikari.pool.ProxyPreparedStatement.executeQuery(ProxyPreparedStatement.java:52) ~[HikariCP-4.0.3.jar:na]
> at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeQuery(HikariProxyPreparedStatement.java) ~[HikariCP-4.0.3.jar:na]
> at org.apache.dolphinscheduler.dao.upgrade.ProcessDefinitionDao.queryAllProcessDefinition(ProcessDefinitionDao.java:58) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> ... 9 common frames omitted
>
> 2022-03-22 11:23:23.978 INFO 19063 --- [ main] o.a.d.dao.upgrade.UpgradeDao : dolphinscheduler
> 2022-03-22 11:23:23.979 INFO 19063 --- [ main] o.a.d.common.utils.ScriptRunner : sql: /* * Licensed to the Apache Software Foundation (ASF) under one or more * contributor license agreements. See the NOTICE file distributed with * this work for additional information regarding copyright ownership. * The ASF licenses this file to You under the Apache License, Version 2.0 * (the "License"); you may not use this file except in compliance with * the License. You may obtain a copy of the License at * * http://www.apache.org/licenses/LICENSE-2.0 * * Unless required by applicable law or agreed to in writing, software * distributed under the License is distributed on an "AS IS" BASIS, * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. * See the License for the specific language governing permissions and * limitations under the License. */ ALTER TABLE "t_ds_process_definition" DROP CONSTRAINT "t_ds_process_definition_pkey"
> 2022-03-22 11:23:24.049 INFO 19063 --- [ main] o.a.d.common.utils.ScriptRunner : sql: ALTER TABLE "t_ds_process_definition" ADD CONSTRAINT "t_ds_process_definition_pkey" PRIMARY KEY ("id","code")
> 2022-03-22 11:23:24.071 INFO 19063 --- [ main] o.a.d.common.utils.ScriptRunner : sql: ALTER TABLE "t_ds_process_definition" DROP CONSTRAINT "process_definition_unique"
> 2022-03-22 11:23:24.087 INFO 19063 --- [ main] o.a.d.common.utils.ScriptRunner : sql: DROP INDEX "process_definition_index"
> 2022-03-22 11:23:24.103 INFO 19063 --- [ main] o.a.d.common.utils.ScriptRunner : sql: ALTER TABLE "t_ds_process_definition" DROP "process_definition_json"
> 2022-03-22 11:23:24.109 ERROR 19063 --- [ main] o.a.d.common.utils.ScriptRunner : SQLException
>
> org.postgresql.util.PSQLException: ERROR: column "process_definition_json" of relation "t_ds_process_definition" does not exist
> at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2440) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2183) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:308) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:307) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgStatement.executeCachedSql(PgStatement.java:293) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:270) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:266) ~[postgresql-42.2.5.jar:42.2.5]
> at com.zaxxer.hikari.pool.ProxyStatement.execute(ProxyStatement.java:94) ~[HikariCP-4.0.3.jar:na]
> at com.zaxxer.hikari.pool.HikariProxyStatement.execute(HikariProxyStatement.java) ~[HikariCP-4.0.3.jar:na]
> at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:117) [dolphinscheduler-common-2.0.5.jar:2.0.5]
> at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:72) [dolphinscheduler-common-2.0.5.jar:2.0.5]
> at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerDDL(UpgradeDao.java:333) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerTo200(UpgradeDao.java:150) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> at org.apache.dolphinscheduler.dao.upgrade.DolphinSchedulerManager.upgradeDolphinScheduler(DolphinSchedulerManager.java:111) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler$UpgradeRunner.run(UpgradeDolphinScheduler.java:55) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:791) [spring-boot-2.5.6.jar:2.5.6]
> at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:775) [spring-boot-2.5.6.jar:2.5.6]
> at org.springframework.boot.SpringApplication.run(SpringApplication.java:345) [spring-boot-2.5.6.jar:2.5.6]
> at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:143) [spring-boot-2.5.6.jar:2.5.6]
> at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler.main(UpgradeDolphinScheduler.java:39) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
>
> 2022-03-22 11:23:24.110 ERROR 19063 --- [ main] o.a.d.common.utils.ScriptRunner : Error executing: ALTER TABLE "t_ds_process_definition" DROP "process_definition_json"
> 2022-03-22 11:23:24.111 ERROR 19063 --- [ main] o.a.d.dao.upgrade.UpgradeDao : ERROR: column "process_definition_json" of relation "t_ds_process_definition" does not exist
>
> org.postgresql.util.PSQLException: ERROR: column "process_definition_json" of relation "t_ds_process_definition" does not exist
> at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2440) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2183) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:308) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:307) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgStatement.executeCachedSql(PgStatement.java:293) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:270) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:266) ~[postgresql-42.2.5.jar:42.2.5]
> at com.zaxxer.hikari.pool.ProxyStatement.execute(ProxyStatement.java:94) ~[HikariCP-4.0.3.jar:na]
> at com.zaxxer.hikari.pool.HikariProxyStatement.execute(HikariProxyStatement.java) ~[HikariCP-4.0.3.jar:na]
> at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:117) ~[dolphinscheduler-common-2.0.5.jar:2.0.5]
> at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:72) ~[dolphinscheduler-common-2.0.5.jar:2.0.5]
> at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerDDL(UpgradeDao.java:333) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerTo200(UpgradeDao.java:150) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> at org.apache.dolphinscheduler.dao.upgrade.DolphinSchedulerManager.upgradeDolphinScheduler(DolphinSchedulerManager.java:111) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler$UpgradeRunner.run(UpgradeDolphinScheduler.java:55) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:791) [spring-boot-2.5.6.jar:2.5.6]
> at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:775) [spring-boot-2.5.6.jar:2.5.6]
> at org.springframework.boot.SpringApplication.run(SpringApplication.java:345) [spring-boot-2.5.6.jar:2.5.6]
> at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:143) [spring-boot-2.5.6.jar:2.5.6]
> at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler.main(UpgradeDolphinScheduler.java:39) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
>
> 2022-03-22 11:23:24.116 INFO 19063 --- [ main] ConditionEvaluationReportLoggingListener :
>
> Error starting ApplicationContext. To display the conditions report re-run your application with 'debug' enabled.
> 2022-03-22 11:23:24.170 ERROR 19063 --- [ main] o.s.boot.SpringApplication : Application run failed
>
> java.lang.IllegalStateException: Failed to execute CommandLineRunner
> at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:794) ~[spring-boot-2.5.6.jar:2.5.6]
> at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:775) ~[spring-boot-2.5.6.jar:2.5.6]
> at org.springframework.boot.SpringApplication.run(SpringApplication.java:345) ~[spring-boot-2.5.6.jar:2.5.6]
> at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:143) [spring-boot-2.5.6.jar:2.5.6]
> at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler.main(UpgradeDolphinScheduler.java:39) [dolphinscheduler-dao-2.0.5.jar:2.0.5]
> Caused by: java.lang.RuntimeException: ERROR: column "process_definition_json" of relation "t_ds_process_definition" does not exist
> at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerDDL(UpgradeDao.java:341) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerTo200(UpgradeDao.java:150) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> at org.apache.dolphinscheduler.dao.upgrade.DolphinSchedulerManager.upgradeDolphinScheduler(DolphinSchedulerManager.java:111) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> at org.apache.dolphinscheduler.dao.upgrade.shell.UpgradeDolphinScheduler$UpgradeRunner.run(UpgradeDolphinScheduler.java:55) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:791) ~[spring-boot-2.5.6.jar:2.5.6]
> ... 4 common frames omitted
> Caused by: org.postgresql.util.PSQLException: ERROR: column "process_definition_json" of relation "t_ds_process_definition" does not exist
> at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2440) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2183) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:308) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:307) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgStatement.executeCachedSql(PgStatement.java:293) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:270) ~[postgresql-42.2.5.jar:42.2.5]
> at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:266) ~[postgresql-42.2.5.jar:42.2.5]
> at com.zaxxer.hikari.pool.ProxyStatement.execute(ProxyStatement.java:94) ~[HikariCP-4.0.3.jar:na]
> at com.zaxxer.hikari.pool.HikariProxyStatement.execute(HikariProxyStatement.java) ~[HikariCP-4.0.3.jar:na]
> at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:117) ~[dolphinscheduler-common-2.0.5.jar:2.0.5]
> at org.apache.dolphinscheduler.common.utils.ScriptRunner.runScript(ScriptRunner.java:72) ~[dolphinscheduler-common-2.0.5.jar:2.0.5]
> at org.apache.dolphinscheduler.dao.upgrade.UpgradeDao.upgradeDolphinSchedulerDDL(UpgradeDao.java:333) ~[dolphinscheduler-dao-2.0.5.jar:2.0.5]
> ... 8 common frames omitted
>
> 2022-03-22 11:23:24.183 INFO 19063 --- [ main] com.zaxxer.hikari.HikariDataSource : DolphinScheduler - Shutdown initiated...
> 2022-03-22 11:23:24.196 INFO 19063 --- [ main] com.zaxxer.hikari.HikariDataSource : DolphinScheduler - Shutdown completed.
> ```
What? There are no 1.4.0-release version in ```https://dolphinscheduler.apache.org/en-us/docs/release/history-versions.html```. Where did you find it?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org