You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by Ydalia Delgado <yd...@gmail.com> on 2016/04/26 02:24:51 UTC
ZeppelinContext not found when SPARK_HOME is set.
Hi,
I have set in conf/zeppelin-env.sh
export SPARK_HOME="/home/username/libs/spark-1.6.1-bin-hadoop2.6/"
export SPARK_SUBMIT_OPTIONS="--driver-memory 2G --executor-memory 4G
--driver-class-path
/home/username/libs/mysql-spark/mysql-connector-java-5.1.38-bin.jar"
I have tried everything from
https://mail-archives.apache.org/mod_mbox/incubator-zeppelin-users/201509.mbox/%3cCALf24saa=TW_uapCKju4Z=j+C=ey6NnvrSHvjdHsY+Fgzto8pg@mail.gmail.com%3e
but it doesn't work.
I need to connect to a MySQL DB using JDBC. The only way I get it working
is setting SPARK_HOME and SPARK_SUBMIT_OPTIONS. But then I get the
following error:
val inputValue = z.input("value")
<console>:27: error: not found: value z
Thank you a lot for your help!
Ydalia
Re: ZeppelinContext not found when SPARK_HOME is set.
Posted by moon soo Lee <mo...@apache.org>.
Hi,
Are you able to access 'sc' or 'sqlContext'? And do you see any special
error in the log files?
While all they're created in similar way [1], i guess if one available, the
others available, too. vise versa.
Thanks,
moon
[1]
https://github.com/apache/incubator-zeppelin/blob/master/spark/src/main/java/org/apache/zeppelin/spark/SparkInterpreter.java#L549
On Mon, Apr 25, 2016 at 5:24 PM Ydalia Delgado <yd...@gmail.com> wrote:
> Hi,
>
> I have set in conf/zeppelin-env.sh
>
> export SPARK_HOME="/home/username/libs/spark-1.6.1-bin-hadoop2.6/"
> export SPARK_SUBMIT_OPTIONS="--driver-memory 2G --executor-memory 4G
> --driver-class-path
> /home/username/libs/mysql-spark/mysql-connector-java-5.1.38-bin.jar"
>
> I have tried everything from
> https://mail-archives.apache.org/mod_mbox/incubator-zeppelin-users/201509.mbox/%3cCALf24saa=TW_uapCKju4Z=j+C=ey6NnvrSHvjdHsY+Fgzto8pg@mail.gmail.com%3e
> but it doesn't work.
>
> I need to connect to a MySQL DB using JDBC. The only way I get it working
> is setting SPARK_HOME and SPARK_SUBMIT_OPTIONS. But then I get the
> following error:
>
> val inputValue = z.input("value")
> <console>:27: error: not found: value z
>
> Thank you a lot for your help!
> Ydalia
>
Re: ZeppelinContext not found when SPARK_HOME is set.
Posted by Ydalia Delgado <yd...@gmail.com>.
Hi,
Using --jars instead of --driver-class-path solved my problem. Thanks!
On Mon, Apr 25, 2016 at 8:42 PM, Hyung Sung Shim <hs...@nflabs.com> wrote:
> Hello.
>
> If you want to use external library, use '--jars' option not '
> --driver-class-path' in the SPARK_SUBMIT_OPTIONS.
>
> Thanks.
>
> 2016-04-26 9:24 GMT+09:00 Ydalia Delgado <yd...@gmail.com>:
>
>> Hi,
>>
>> I have set in conf/zeppelin-env.sh
>>
>> export SPARK_HOME="/home/username/libs/spark-1.6.1-bin-hadoop2.6/"
>> export SPARK_SUBMIT_OPTIONS="--driver-memory 2G --executor-memory 4G
>> --driver-class-path
>> /home/username/libs/mysql-spark/mysql-connector-java-5.1.38-bin.jar"
>>
>> I have tried everything from
>> https://mail-archives.apache.org/mod_mbox/incubator-zeppelin-users/201509.mbox/%3cCALf24saa=TW_uapCKju4Z=j+C=ey6NnvrSHvjdHsY+Fgzto8pg@mail.gmail.com%3e
>> but it doesn't work.
>>
>> I need to connect to a MySQL DB using JDBC. The only way I get it
>> working is setting SPARK_HOME and SPARK_SUBMIT_OPTIONS. But then I get the
>> following error:
>>
>> val inputValue = z.input("value")
>> <console>:27: error: not found: value z
>>
>> Thank you a lot for your help!
>> Ydalia
>>
>
>
--
ydalia
Re: ZeppelinContext not found when SPARK_HOME is set.
Posted by Hyung Sung Shim <hs...@nflabs.com>.
Hello.
If you want to use external library, use '--jars' option not '
--driver-class-path' in the SPARK_SUBMIT_OPTIONS.
Thanks.
2016-04-26 9:24 GMT+09:00 Ydalia Delgado <yd...@gmail.com>:
> Hi,
>
> I have set in conf/zeppelin-env.sh
>
> export SPARK_HOME="/home/username/libs/spark-1.6.1-bin-hadoop2.6/"
> export SPARK_SUBMIT_OPTIONS="--driver-memory 2G --executor-memory 4G
> --driver-class-path
> /home/username/libs/mysql-spark/mysql-connector-java-5.1.38-bin.jar"
>
> I have tried everything from
> https://mail-archives.apache.org/mod_mbox/incubator-zeppelin-users/201509.mbox/%3cCALf24saa=TW_uapCKju4Z=j+C=ey6NnvrSHvjdHsY+Fgzto8pg@mail.gmail.com%3e
> but it doesn't work.
>
> I need to connect to a MySQL DB using JDBC. The only way I get it working
> is setting SPARK_HOME and SPARK_SUBMIT_OPTIONS. But then I get the
> following error:
>
> val inputValue = z.input("value")
> <console>:27: error: not found: value z
>
> Thank you a lot for your help!
> Ydalia
>