You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2021/05/30 03:03:41 UTC

[GitHub] [dolphinscheduler] ruanwenjun commented on issue #5539: [Improvement][Master] Check status of taskInstance from cache

ruanwenjun commented on issue #5539:
URL: https://github.com/apache/dolphinscheduler/issues/5539#issuecomment-850931930


   @blackberrier Hi, I get you point. 
   In your plan, there might be one thing need to consider, when a master do worker tolerance, if it cannot connect to the master that is executing this worker, how to handle this situation. 
   There may two possible reason for this case:
   1. They may be deployed in different network centers, in the current architecture we don't require the masters to be able to communicate with each other.
   2. The Master1 is crashed too.
   ![image](https://user-images.githubusercontent.com/22415594/120090088-67dd1600-c132-11eb-9f40-b195e3b1d17f.png)
   
   If you want to modify the worker tolerance, it may be complicated.
   I think in this case, you can schedule a time rotation in the cache to query `ExecutionStatus.NEED_FAULT_TOLERANCE ` tasks from database and replace the cache.
   What do you think?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org