You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2022/01/04 08:17:20 UTC
[GitHub] [dolphinscheduler] mchcz opened a new issue #7788: [Bug] [API] Submit duplicate tasks
mchcz opened a new issue #7788:
URL: https://github.com/apache/dolphinscheduler/issues/7788
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
1.Many SQL tasks submitted at the same time
2.It will be retried when a task fails, and may be submitted multiple times when retrying
3.The task instance code is the same for multiple submissions
[INFO] 2022-01-04 00:50:34.791 org.apache.dolphinscheduler.service.process.ProcessService:[1076] - end submit task to db successfully:6838135 013.XXX:SUBMITTED_SUCCESS complete, instance id:609369 state: RUNNING_EXECUTION
[INFO] 2022-01-04 00:50:35.315 org.apache.dolphinscheduler.service.process.ProcessService:[1076] - end submit task to db successfully:6838145 013.XXX:SUBMITTED_SUCCESS complete, instance id:609369 state: RUNNING_EXECUTION
### What you expected to happen
When the task is retried, submit it once.
### How to reproduce
The reason is unknown.
### Anything else
_No response_
### Version
2.0.1
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] lenboo closed issue #7788: [Bug] [MasterServer] Submit duplicate tasks
Posted by GitBox <gi...@apache.org>.
lenboo closed issue #7788:
URL: https://github.com/apache/dolphinscheduler/issues/7788
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] caishunfeng commented on issue #7788: [Bug] [API] Submit duplicate tasks
Posted by GitBox <gi...@apache.org>.
caishunfeng commented on issue #7788:
URL: https://github.com/apache/dolphinscheduler/issues/7788#issuecomment-1004637750
@mchcz can you provide the DAG info? I can't reproduce it at local.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #7788: [Bug] [API] Submit duplicate tasks
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #7788:
URL: https://github.com/apache/dolphinscheduler/issues/7788#issuecomment-1004605583
Hi:
* Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
* In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
* If you haven't received a reply for a long time, you can subscribe to the developer's email，Mail subscription steps reference https://dolphinscheduler.apache.org/en-us/community/development/subscribe.html ,Then write the issue URL in the email content and send question to dev@dolphinscheduler.apache.org.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] caishunfeng commented on issue #7788: [Bug] [MasterServer] Submit duplicate tasks
Posted by GitBox <gi...@apache.org>.
caishunfeng commented on issue #7788:
URL: https://github.com/apache/dolphinscheduler/issues/7788#issuecomment-1006691975
When task A fail and run `WorkflowExecuteThread.taskFinished`, it will add retry task into standby queue, which will submit by `WorkflowExecuteThread.submitPostNode` and `StateWheelExecuteThread.checkTask4Retry`; When I add sleep 30s in `submitTaskInstanceToDB` like Figure 4, it will increase the probability of repeated retries. In this way, retry task A in standby list will be submit by `WorkflowExecuteThread.submitPostNode` because run task c, and then, `StateWheelExecuteThread.checkTask4Retry` add it into standby list and submit again.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org