You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@livy.apache.org by "zhuweibin (JIRA)" <ji...@apache.org> on 2017/11/25 06:11:00 UTC
[jira] [Updated] (LIVY-421) support multi statements run at the
same time
[ https://issues.apache.org/jira/browse/LIVY-421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
zhuweibin updated LIVY-421:
---------------------------
Description:
In the v0.4.0-incubating's’ implementation, the number of threads used to execute the statement code is hardcoded to one. When idle resources are sufficient to execute multiple statements, a lot of resources are wasted and blocking statements run. We are considering improvements in one of two ways:
# 1. Add a configuration in livy.conf to globally control the number of threads in interpreterExecutor for all repl/sessions to execute statements
# 2 in the session to create a rest api parameter to set the maximum number of statements can be run at the same time the number of statements
hope to discuss this issue, thanks
was:
In the current version of the implementation, the number of threads used to execute the statement code is hardcoded to one. When idle resources are sufficient to execute multiple statements, a lot of resources are wasted and blocking statements run. We are considering improvements in one of two ways:
# 1. Add a configuration in livy.conf to globally control the number of threads in interpreterExecutor for all repl/sessions to execute statements
# 2 in the session to create a rest api parameter to set the maximum number of statements can be run at the same time the number of statements
hope to discuss this issue, thanks
> support multi statements run at the same time
> ---------------------------------------------
>
> Key: LIVY-421
> URL: https://issues.apache.org/jira/browse/LIVY-421
> Project: Livy
> Issue Type: Improvement
> Components: REPL
> Affects Versions: 0.4
> Reporter: zhuweibin
> Priority: Critical
> Labels: performance
>
> In the v0.4.0-incubating's’ implementation, the number of threads used to execute the statement code is hardcoded to one. When idle resources are sufficient to execute multiple statements, a lot of resources are wasted and blocking statements run. We are considering improvements in one of two ways:
> # 1. Add a configuration in livy.conf to globally control the number of threads in interpreterExecutor for all repl/sessions to execute statements
> # 2 in the session to create a rest api parameter to set the maximum number of statements can be run at the same time the number of statements
> hope to discuss this issue, thanks
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)