You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@griffin.apache.org by "Yang (JIRA)" <ji...@apache.org> on 2018/12/07 05:16:00 UTC

[jira] [Created] (GRIFFIN-220) Livy concurrent submission queue

Yang created GRIFFIN-220:
----------------------------

             Summary: Livy concurrent submission queue
                 Key: GRIFFIN-220
                 URL: https://issues.apache.org/jira/browse/GRIFFIN-220
             Project: Griffin (Incubating)
          Issue Type: Improvement
          Components: timeliness-batch
            Reporter: Yang


Hi William and Lionel：

Problem：

Too many tasks submitted at the same time, resulting in failure of livy's submission job

Optimization thinking:

In view of the shortage of cluster resources caused by too many jobs submitted at the same time.We increase Livy submission job queue, when Livy submits,queues are increased, producer-consumer mode is adopted, and the number of jobs submitted is limited. When one job is completed, the next job is executed.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)