[jira] [Commented] (KYLIN-4178) Job scheduler support safe mode

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KYLIN-4178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937567#comment-16937567 ] 

ASF GitHub Bot commented on KYLIN-4178:
---------------------------------------

zhoukangcn commented on pull request #858: KYLIN-4178: job scheduler safe mode
URL: https://github.com/apache/kylin/pull/858
 
 
   See: https://issues.apache.org/jira/browse/KYLIN-4178?filter=-2
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Job scheduler support safe mode 
> --------------------------------
>
>                 Key: KYLIN-4178
>                 URL: https://issues.apache.org/jira/browse/KYLIN-4178
>             Project: Kylin
>          Issue Type: Improvement
>            Reporter: ZhouKang
>            Priority: Major
>
> Job scheduler should support safe mode in case of the HBase cluster change.
> In xiaomi, we want update the HBase cluster from hbase0.98 to HBase 2.0. The history data can be migrated previously, but the job has been submitted will keep running and write data to the old cluster. So we need a method to ensure that, job create htable in the old cluster will write data to the old cluster, and the job have not create htable should not be scheduled.
> So we need  job scheduler safe mode. Open safe mode before changing cluster config,  the  running jobs can run continuous, and the new job cannot be scheduled. 
> After all running job finished, we can change the cluster config to the new one,  and rest of job can be scheduled again.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)