You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by Meethu Mathew <me...@flytxt.com> on 2017/04/04 12:45:15 UTC
sqlContext not avilable as hiveContext in notebook
Hi,
I am running zeppelin 0.7.0. the sqlContext already created in the zeppelin
notebook returns a <pyspark.sql.context.SQLContext object at 0x7f707a9e9050>,
even though my spark is built with HIVE.
"zeppelin.spark.useHiveContext" in the spark properties is set to true.
As mentioned in https://issues.apache.org/jira/browse/ZEPPELIN-1728, I
tried
hc = HiveContext.getOrCreate(sc)
but still its returning
<pyspark.sql.context.SQLContext object at 0x7f707a9e9050>
.
My pyspark shell and jupyter notebook is returning
<pyspark.sql.context.HiveContext at 0x7fa3421b1c90>
without doing anything.
How to get
<pyspark.sql.context.HiveContext at 0x7fa3421b1c90>
in the zeppelin notebook ?
Regards,
Meethu Mathew
Re: sqlContext not avilable as hiveContext in notebook
Posted by "Jianfeng (Jeff) Zhang" <jz...@hortonworks.com>.
I could get hiveContext correctly in zeppelin master, could you try 0.7.1 which is released recently ?
Best Regard,
Jeff Zhang
From: Meethu Mathew <me...@flytxt.com>>
Reply-To: "users@zeppelin.apache.org<ma...@zeppelin.apache.org>" <us...@zeppelin.apache.org>>
Date: Tuesday, April 4, 2017 at 8:45 PM
To: "users@zeppelin.apache.org<ma...@zeppelin.apache.org>" <us...@zeppelin.apache.org>>
Subject: sqlContext not avilable as hiveContext in notebook
Hi,
I am running zeppelin 0.7.0. the sqlContext already created in the zeppelin notebook returns a <pyspark.sql.context.SQLContext object at 0x7f707a9e9050>, even though my spark is built with HIVE.
"zeppelin.spark.useHiveContext" in the spark properties is set to true.
As mentioned in https://issues.apache.org/jira/browse/ZEPPELIN-1728, I tried
hc = HiveContext.getOrCreate(sc)
but still its returning
<pyspark.sql.context.SQLContext object at 0x7f707a9e9050>
.
My pyspark shell and jupyter notebook is returning
<pyspark.sql.context.HiveContext at 0x7fa3421b1c90>
without doing anything.
How to get
<pyspark.sql.context.HiveContext at 0x7fa3421b1c90>
in the zeppelin notebook ?
Regards,
Meethu Mathew