[jira] [Created] (ZEPPELIN-2292) Pyspark interpreter module not found even though --files parameter provided

["Shishir Choudhary (JIRA)" <ji...@apache.org>]

Shishir Choudhary created ZEPPELIN-2292:
-------------------------------------------

             Summary: Pyspark interpreter module not found even though --files parameter provided
                 Key: ZEPPELIN-2292
                 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2292
             Project: Zeppelin
          Issue Type: Bug
          Components: pySpark
    Affects Versions: 0.7.0
         Environment: Mac OSX, Spark 2.0.2 and 2.1.0 and Built in Spark
            Reporter: Shishir Choudhary


I have included my custom python library in spark submit --files option. It works in zeppelin 0.6.2 but fails in 0.7.0 with error module not found. 

Code in notebook 
%pyspark 
from learney import xyz
from learney import abc

In zeppelin-env.sh (0.6.2 which works)
export SPARK_HOME=/Users/shishircc/old-spark-2.0.2-bin-hadoop2.7
export SPARK_SUBMIT_OPTIONS=" --files /Users/shishircc/learney-pyspark/learney.zip"

In zeppelin-env.sh (0.7.0 which does not work)
export SPARK_HOME=/Users/shishircc/old-spark-2.0.2-bin-hadoop2.7                             
export SPARK_SUBMIT_OPTIONS=" --files /Users/shishircc/learney-pyspark/learney.zip "   

In zeppelin-env.sh (0.7.0 which does not work)
export SPARK_HOME=/Users/shishircc/old-spark-2.1.0-bin-hadoop2.7                             
export SPARK_SUBMIT_OPTIONS=" --files /Users/shishircc/learney-pyspark/learney.zip "   



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)