You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2020/11/19 08:15:52 UTC
[GitHub] [incubator-dolphinscheduler] wangxj3 opened a new issue #4084: taskInstance state change error
wangxj3 opened a new issue #4084:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4084
phenomenon：
taskInstance state change from 7 to 1，and user observes the state change from "SUCCESS" to "RUNNING"。
master still loop for check taskInstance state，wait for taskInstance's state is finish.
reason：
master receive the message of TaskResponseProcessor first，and than receive the TaskAckProcessor。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] dailidong closed issue #4084: taskInstance state change error
Posted by GitBox <gi...@apache.org>.
dailidong closed issue #4084:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4084
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] lenboo closed issue #4084: taskInstance state change error
Posted by GitBox <gi...@apache.org>.
lenboo closed issue #4084:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4084
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] CalvinKirs commented on issue #4084: taskInstance state change error
Posted by GitBox <gi...@apache.org>.
CalvinKirs commented on issue #4084:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4084#issuecomment-732758445
org.apache.dolphinscheduler.server.master.processor.TaskAckProcessor#process
+sleep can reproduce. The task is as simple as possible.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] lenboo edited a comment on issue #4084: taskInstance state change error
Posted by GitBox <gi...@apache.org>.
lenboo edited a comment on issue #4084:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4084#issuecomment-731070187
sorry, may be the same problem, please describe the detail of your problem.
eg: the task's content / system info of master and worker ...
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] wangxj3 commented on issue #4084: taskInstance state change error
Posted by GitBox <gi...@apache.org>.
wangxj3 commented on issue #4084:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4084#issuecomment-731884164
>
>
> sorry, may be it's not the same problem, please describe the detail of your problem.
> eg: the task's content / system info of master and worker ...
master向worker发送task：
1.worker接收到task后，会回复给master一个“ack”，然后去执行task，执行结束之后给master发送result。
2.master接受到ack后将taskInstance的状态更新成1，接收到result后将状态更新成7（假设task的状态是成功）
正常：
ack和result根据worker执行的顺序，ack会先发送到master，task状态从0->1,result 后发送到master ，task状态从1->7。
异常：
在ack的response处理的时候出现阻塞，或者是在netty消息传输或消费的，反正resul更新数据库的时间早于ack，导致状态变化0->7->1.而实际worker已经执行过task了，所以master就会阻塞住，一直循环查看当前节点的状态。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] wangxj3 edited a comment on issue #4084: taskInstance state change error
Posted by GitBox <gi...@apache.org>.
wangxj3 edited a comment on issue #4084:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4084#issuecomment-731884164
>
>
> sorry, may be it's not the same problem, please describe the detail of your problem.
> eg: the task's content / system info of master and worker ...
master向worker发送task：
1.worker接收到task后，会回复给master一个“ack”，然后去执行task，执行结束之后给master发送result。
2.master接受到ack后将taskInstance的状态更新成1，接收到result后将状态更新成7（假设task的状态是成功）
正常：
ack和result根据worker执行的顺序，ack会先发送到master，task状态从0->1,result 后发送到master ，task状态从1->7。
异常：
在ack的response处理的时候出现阻塞，或者是在netty消息传输或消费的，反正resul更新数据库的时间早于ack，导致状态变化0->7->1.而实际worker已经执行过task了，所以master就会阻塞住，一直循环查看当前节点的状态。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] lenboo edited a comment on issue #4084: taskInstance state change error
Posted by GitBox <gi...@apache.org>.
lenboo edited a comment on issue #4084:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4084#issuecomment-731070187
sorry, may be it's not the same problem, please describe the detail of your problem.
eg: the task's content / system info of master and worker ...
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] lenboo commented on issue #4084: taskInstance state change error
Posted by GitBox <gi...@apache.org>.
lenboo commented on issue #4084:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4084#issuecomment-731070187
sorry, may be the same problem, please descript
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] wangxj3 removed a comment on issue #4084: taskInstance state change error
Posted by GitBox <gi...@apache.org>.
wangxj3 removed a comment on issue #4084:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4084#issuecomment-731052067
我看了Github上的代码，这部分的代码和1.3.2的事一样的，所以麻烦您修复的方案是什么样的啊，代码在什么地方啊，想学习一下
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] lenboo commented on issue #4084: taskInstance state change error
Posted by GitBox <gi...@apache.org>.
lenboo commented on issue #4084:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4084#issuecomment-730799473
already fixed in 1.3.3-release
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] wangxj3 commented on issue #4084: taskInstance state change error
Posted by GitBox <gi...@apache.org>.
wangxj3 commented on issue #4084:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4084#issuecomment-731052321
>
>
> already fixed in 1.3.3-release
我看了Github上的代码，这部分的代码和1.3.2的事一样的，所以麻烦您修复的方案是什么样的啊，代码在什么地方啊，想学习一下
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] wangxj3 commented on issue #4084: taskInstance state change error
Posted by GitBox <gi...@apache.org>.
wangxj3 commented on issue #4084:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4084#issuecomment-731052067
我看了Github上的代码，这部分的代码和1.3.2的事一样的，所以麻烦您修复的方案是什么样的啊，代码在什么地方啊，想学习一下
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org