[jira] [Commented] (KYLIN-3421) Improve job scheduler fetch performance

["Zhong Yanghong (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KYLIN-3421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16518865#comment-16518865 ] 

Zhong Yanghong commented on KYLIN-3421:
---------------------------------------

Hi [~kangkaisen], could you help review this patch? Thanks very much.

> Improve job scheduler fetch performance
> ---------------------------------------
>
>                 Key: KYLIN-3421
>                 URL: https://issues.apache.org/jira/browse/KYLIN-3421
>             Project: Kylin
>          Issue Type: Improvement
>          Components: Job Engine
>            Reporter: Zhong Yanghong
>            Assignee: Zhong Yanghong
>            Priority: Major
>         Attachments: APACHE-KYLIN-3421.patch
>
>
> Currently, there are several improvements we can do for job scheduler:
> * For {{DistributedScheduler}}, it does not check {{isReady()}} for checkpoint jobs
> * Since the state lots of executables fetched from HBase are not READY, it's better to fetch their output first, which can reduce lots of get requests to hbase
> * {{FetcherRunnerWithPriority}} is not enabled in {{DistributedScheduler}}, which needs to change the lockPath from *{color:#f79232}segmentId{color}* to *{color:#f79232}jobId{color}*



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)