You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@zeppelin.apache.org by "Lee moon soo (JIRA)" <ji...@apache.org> on 2015/10/12 17:52:05 UTC

[jira] [Created] (ZEPPELIN-339) --packages argument for spark-submit command does not apply in pyspark

Lee moon soo created ZEPPELIN-339:
-------------------------------------

             Summary: --packages argument for spark-submit command does not apply in pyspark 
                 Key: ZEPPELIN-339
                 URL: https://issues.apache.org/jira/browse/ZEPPELIN-339
             Project: Zeppelin
          Issue Type: Bug
            Reporter: Lee moon soo


When {{SPARK_HOME}} is exported in zeppelin-env.sh, {{--packages}} can be used to load additional libraries for the job, like
{code}
export SPARK_HOME=....
export SPARK_SUBMIT_OPTIONS="--packages org.apache.spark:spark-streaming-kafka_2.10:1.5.1"
{code}

The library loaded in this way is available in spark, but not available in pyspark.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)