You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@griffin.apache.org by "Yang (JIRA)" <ji...@apache.org> on 2019/01/25 03:02:00 UTC

[jira] [Updated] (GRIFFIN-220) Job rate limit for scheduler

     [ https://issues.apache.org/jira/browse/GRIFFIN-220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yang updated GRIFFIN-220:
-------------------------
    Summary: Job rate limit for scheduler  (was: Livy concurrent submission queue)

> Job rate limit for scheduler
> ----------------------------
>
>                 Key: GRIFFIN-220
>                 URL: https://issues.apache.org/jira/browse/GRIFFIN-220
>             Project: Griffin (Incubating)
>          Issue Type: Improvement
>          Components: timeliness-batch
>            Reporter: Yang
>            Priority: Minor
>
> Hi William and Lionel：
> Problem：
> Too many tasks submitted at the same time, resulting in failure of livy's submission job
> Optimization thinking:
> In view of the shortage of cluster resources caused by too many jobs submitted at the same time.We increase Livy submission job queue, when Livy submits,queues are increased, producer-consumer mode is adopted, and the number of jobs submitted is limited. When one job is completed, the next job is executed.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)