You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@livy.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/10/18 06:36:00 UTC
[jira] [Commented] (LIVY-411) Session cannot be started when Python
or R package is missing
[ https://issues.apache.org/jira/browse/LIVY-411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16208872#comment-16208872 ]
ASF GitHub Bot commented on LIVY-411:
-------------------------------------
GitHub user jerryshao opened a pull request:
https://github.com/apache/incubator-livy/pull/56
[LIVY-411][REPL] Fix session cannot start issue when python or r package is missing
## What changes were proposed in this pull request?
https://issues.apache.org/jira/browse/LIVY-411
In Livy 0.5.0, we supported multiple languages in one session, but it requires that all the packages should be available before session creation, such as R package and Python package, otherwise session will be failed to create. However, in some cases python or R package may be missing in Spark distro, this will make Livy fail to creation interactive session.
To fix this issue, we should not force such restriction on session creation, but delay the check until related interpreter is used. If such packaging is missing, we should make the related execution failure and return user the cause of issue, but don't affect other correctly started interpreters.
## How was this patch tested?
Existing test and manually verification on local cluster.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jerryshao/incubator-livy LIVY-411
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-livy/pull/56.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #56
----
commit 6f808d282757f3f4d6d38bdeb4dda59b167d9de5
Author: jerryshao <ss...@hortonworks.com>
Date: 2017-10-18T06:30:25Z
Fix session cannot start issue when python or r package is missing
----
> Session cannot be started when Python or R package is missing
> -------------------------------------------------------------
>
> Key: LIVY-411
> URL: https://issues.apache.org/jira/browse/LIVY-411
> Project: Livy
> Issue Type: Bug
> Components: REPL
> Affects Versions: 0.5.0
> Reporter: Saisai Shao
> Assignee: Saisai Shao
>
> In Livy 0.5.0, we supported multiple languages in one session, but it requires that the packages should be available, such as R package and Python package, otherwise session will be failed to create. However, in some cases python or R package may be missing in Spark distro, this will make Livy fail to creation interactive session.
> To fix this issue, we should not force such restriction on session creation, but delay the check until related interpreter is used. If such packaging is missing, we should make the related execution failure and return user the cause of issue, but don't affect other correctly started interpreters.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)