You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@livy.apache.org by "Hong Shen (JIRA)" <ji...@apache.org> on 2017/10/18 09:38:01 UTC

[jira] [Created] (LIVY-412) CreateSession should be reject when there is too more child process "spark-submit" is running

Hong Shen created LIVY-412:
------------------------------

             Summary: CreateSession should be reject when there is too more child process "spark-submit" is running
                 Key: LIVY-412
                 URL: https://issues.apache.org/jira/browse/LIVY-412
             Project: Livy
          Issue Type: Improvement
          Components: Server
    Affects Versions: 0.4
            Reporter: Hong Shen


In our cluster, livy server run with spark yarn cluster mode, when createSession request is too frequently, livyServer will start too more spark-submit child process, it will cause the machine oom. I think livy server should reject the create session request when there is too more spark-submit child process. I have fix it in our own cluster.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)