You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Manoj Samel <ma...@gmail.com> on 2014/12/10 02:51:19 UTC

Can HiveContext be used without using Hive?

>From 1.1.1 documentation, it seems one can use HiveContext instead of
SQLContext without having a Hive installation. The benefit is richer SQL
dialect.

Is my understanding correct ?

Thanks

RE: Can HiveContext be used without using Hive?

Posted by "Cheng, Hao" <ha...@intel.com>.
It works exactly like Create Table As Select (CTAS) in Hive.

Cheng Hao

From: Anas Mosaad [mailto:anas.mosaad@incorta.com]
Sent: Wednesday, December 10, 2014 11:59 AM
To: Michael Armbrust
Cc: Manoj Samel; user@spark.apache.org
Subject: Re: Can HiveContext be used without using Hive?


In that case, what should be the behavior of saveTableAs?
On Dec 10, 2014 4:03 AM, "Michael Armbrust" <mi...@databricks.com>> wrote:
That is correct.  It the hive context will create an embedded metastore in the current directory if you have not configured hive.

On Tue, Dec 9, 2014 at 5:51 PM, Manoj Samel <ma...@gmail.com>> wrote:
From 1.1.1 documentation, it seems one can use HiveContext instead of SQLContext without having a Hive installation. The benefit is richer SQL dialect.

Is my understanding correct ?

Thanks

Re: Can HiveContext be used without using Hive?

Posted by Anas Mosaad <an...@incorta.com>.
In that case, what should be the behavior of saveTableAs?
On Dec 10, 2014 4:03 AM, "Michael Armbrust" <mi...@databricks.com> wrote:

> That is correct.  It the hive context will create an embedded metastore in
> the current directory if you have not configured hive.
>
> On Tue, Dec 9, 2014 at 5:51 PM, Manoj Samel <ma...@gmail.com>
> wrote:
>
>> From 1.1.1 documentation, it seems one can use HiveContext instead of
>> SQLContext without having a Hive installation. The benefit is richer SQL
>> dialect.
>>
>> Is my understanding correct ?
>>
>> Thanks
>>
>>
>>
>

Re: Can HiveContext be used without using Hive?

Posted by Michael Armbrust <mi...@databricks.com>.
That is correct.  It the hive context will create an embedded metastore in
the current directory if you have not configured hive.

On Tue, Dec 9, 2014 at 5:51 PM, Manoj Samel <ma...@gmail.com>
wrote:

> From 1.1.1 documentation, it seems one can use HiveContext instead of
> SQLContext without having a Hive installation. The benefit is richer SQL
> dialect.
>
> Is my understanding correct ?
>
> Thanks
>
>
>