[GitHub] [dolphinscheduler] caishunfeng opened a new issue #6891: [Feature][MasterServer] add cache manager for process and task

[GitBox <gi...@apache.org>]

caishunfeng opened a new issue #6891:
URL: https://github.com/apache/dolphinscheduler/issues/6891


   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar feature requirement.
   
   
   ### Description
   
   Now when Master run a workflow, it will do mane db operation, which will make Master handle slowly.
   Such as a easy dag, contains a shell task, run once and will occur more than 30 db operation: 1 delete, 2 insert, 5 update and 26 select.
   
   So I think if Master use cache of process instance and task instance, instead of selecting from db every time, it will reduce the db stress and improve the Master handling workflow. What do you think?
   
   BTW, I found that the old design `TaskInstanceCacheManagerImpl`, but it seems never used now.
   
   ### Use case
   
   _No response_
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #6891: [Feature][MasterServer] add cache manager for process and task

[GitBox <gi...@apache.org>]

github-actions[bot] commented on issue #6891:
URL: https://github.com/apache/dolphinscheduler/issues/6891#issuecomment-971511231


   Hi:
   * Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
   * In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
   * If you haven't received a reply for a long time, you can subscribe to the developer's email，Mail subscription steps reference https://dolphinscheduler.apache.org/en-us/community/development/subscribe.html ,Then write the issue URL in the email content and send question to dev@dolphinscheduler.apache.org.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [dolphinscheduler] caishunfeng closed issue #6891: [Feature][MasterServer] reduce db query operation when process instance running

[GitBox <gi...@apache.org>]

caishunfeng closed issue #6891:
URL: https://github.com/apache/dolphinscheduler/issues/6891


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org