[GitHub] [incubator-doris] morningman opened a new pull request #2356: Fixed a bug that Load job's state is incorrect when upgrading from 0.10.x to 0.11.x

[GitBox <gi...@apache.org>]

morningman opened a new pull request #2356: Fixed a bug that Load job's state is incorrect when upgrading from 0.10.x to 0.11.x
URL: https://github.com/apache/incubator-doris/pull/2356
 
 
   There is bug in Doris version 0.10.x. When a load job in PENDING or LOADING
   state was replayed from image (not through the edit log), we forgot to add
   the corresponding callback id in the CallbackFactory. As a result, the
   subsequent finish txn edit logs cannot properly finish the job during the
   replay process. This results in that when the FE restarts, these load jobs
   that should have been completed are re-entered into the pending state,
   resulting in repeated submission load tasks.
   
   Those wrong images are unrecoverable, so that we have to reset all load jobs
   in PENDING or LOADING state when restarting FE, depends on its corresponding
   txn's status, to avoid submit jobs repeatedly.
   
   If corresponding txn exist, set load job' state depends on txn's status.
   If txn does not exist, may be the txn has been removed due to label expiration.
   So that we don't know the txn is aborted or visible. So we have to set the job's state
   as UNKNOWN, which need handle it manually.
   
   ISSUE #2354 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org