You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@toree.apache.org by "Gino Bustelo (JIRA)" <ji...@apache.org> on 2016/04/26 20:34:12 UTC
[jira] [Commented] (TOREE-302) Respect SPARK_HOME environmental
variable
[ https://issues.apache.org/jira/browse/TOREE-302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15258660#comment-15258660 ]
Gino Bustelo commented on TOREE-302:
------------------------------------
As discussed in gitter... we should have the install see the env_variable already set and use it.
[~Lull3rSkat3r]
> Respect SPARK_HOME environmental variable
> -----------------------------------------
>
> Key: TOREE-302
> URL: https://issues.apache.org/jira/browse/TOREE-302
> Project: TOREE
> Issue Type: Improvement
> Affects Versions: 0.1.0
> Environment: OSX w/ bash
> Toree version 0.1.0.dev5 / commit 855fb4100b07
> Reporter: Seth Bromberger
> Priority: Minor
> Fix For: 0.1.0
>
>
> I have SPARK_HOME set (because I installed spark via Homebrew). The toree installation initially failed:
> ```
> phase:~ me$ jupyter toree install
> [ToreeInstall] Installing toree kernel with interpreter Scala
> [ToreeInstall] Removing existing kernelspec in /usr/local/share/jupyter/kernels/toree_scala
> [ToreeInstall] Installed kernelspec toree_scala in /usr/local/share/jupyter/kernels/toree_scala
> Traceback (most recent call last):
> File "/Users/me/Library/Python/2.7/bin/jupyter-toree", line 9, in <module>
> load_entry_point('toree==0.1.0.dev5', 'console_scripts', 'jupyter-toree')()
> File "/Users/me/Library/Python/2.7/lib/python/site-packages/toree/toreeapp.py", line 149, in main
> ToreeApp.launch_instance()
> File "/Users/me/Library/Python/2.7/lib/python/site-packages/traitlets/config/application.py", line 596, in launch_instance
> app.start()
> File "/Users/me/Library/Python/2.7/lib/python/site-packages/toree/toreeapp.py", line 146, in start
> return self.subapp.start()
> File "/Users/me/Library/Python/2.7/lib/python/site-packages/toree/toreeapp.py", line 115, in start
> self.create_kernel_json(install_dir, interpreter)
> File "/Users/me/Library/Python/2.7/lib/python/site-packages/toree/toreeapp.py", line 79, in create_kernel_json
> python_lib_contents = listdir("{0}/python/lib".format(self.spark_home))
> OSError: [Errno 2] No such file or directory: '/usr/local/spark/python/lib'
> ```
> I got this working by running `jupyter toree install --spark_home=$SPARK_HOME`.
> It would be nice if SPARK_HOME were used automatically if it is set.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)