You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@livy.apache.org by "Hong Shen (JIRA)" <ji...@apache.org> on 2017/10/18 09:38:01 UTC
[jira] [Created] (LIVY-412) CreateSession should be reject when
there is too more child process "spark-submit" is running
Hong Shen created LIVY-412:
------------------------------
Summary: CreateSession should be reject when there is too more child process "spark-submit" is running
Key: LIVY-412
URL: https://issues.apache.org/jira/browse/LIVY-412
Project: Livy
Issue Type: Improvement
Components: Server
Affects Versions: 0.4
Reporter: Hong Shen
In our cluster, livy server run with spark yarn cluster mode, when createSession request is too frequently, livyServer will start too more spark-submit child process, it will cause the machine oom. I think livy server should reject the create session request when there is too more spark-submit child process. I have fix it in our own cluster.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)