You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@phoenix.apache.org by Buntu Dev <bu...@gmail.com> on 2015/06/17 08:26:07 UTC
Phoenix and Hive
I got quite a bit of data in a Hive managed tables and I looking for ways
to join those tables with the one I create in Phoenix. I'm aware of HBase
and Hive integration but not sure if there is any current support for
Phoenix and Hive integration. Please let me know.
Thanks!
Re: Phoenix and Hive
Posted by Buntu Dev <bu...@gmail.com>.
Thanks for the pointers, I will give it a try.
On Wed, Jun 17, 2015 at 12:06 PM, Fulin Sun <su...@certusnet.com.cn> wrote:
> Hi there
> AFAIK, spark can smoothly read hive data using HiveContext, or use
> dataframe and data source api to read any
> external data source to tranform that into dataframe. So I would recommend
> using phoenix-spark module to
> achieve this goal. And you can simply choose to write spark dataframe to
> what kind of storage.
>
> Best,
> Sun.
>
> ------------------------------
> ------------------------------
>
> CertusNet
>
>
> *From:* Buntu Dev <bu...@gmail.com>
> *Date:* 2015-06-17 14:56
> *To:* user <us...@phoenix.apache.org>
> *Subject:* Phoenix and Hive
> I got quite a bit of data in a Hive managed tables and I looking for ways
> to join those tables with the one I create in Phoenix. I'm aware of HBase
> and Hive integration but not sure if there is any current support for
> Phoenix and Hive integration. Please let me know.
>
> Thanks!
>
>
Re: Phoenix and Hive
Posted by Fulin Sun <su...@certusnet.com.cn>.
Hi there
AFAIK, spark can smoothly read hive data using HiveContext, or use dataframe and data source api to read any
external data source to tranform that into dataframe. So I would recommend using phoenix-spark module to
achieve this goal. And you can simply choose to write spark dataframe to what kind of storage.
Best,
Sun.
CertusNet
From: Buntu Dev
Date: 2015-06-17 14:56
To: user
Subject: Phoenix and Hive
I got quite a bit of data in a Hive managed tables and I looking for ways to join those tables with the one I create in Phoenix. I'm aware of HBase and Hive integration but not sure if there is any current support for Phoenix and Hive integration. Please let me know.
Thanks!
Re: Phoenix and Hive
Posted by James Taylor <ja...@apache.org>.
Have you seen this:
http://phoenix.apache.org/faq.html#Can_phoenix_work_on_tables_with_arbitrary_timestamp_as_flexible_as_HBase_API
Also see these other relevant JIRAs: PHOENIX-914 and PHOENIX-590
On Wed, Jun 17, 2015 at 7:40 AM, Buntu Dev <bu...@gmail.com> wrote:
> Thanks for the info, I've read about integration efforts with Apache
> Calcite.
>
> I noticed that one can't query based column timestamp and queries always
> access data with the latest timestamp via Hive. Is this something Phoenix
> already/will address? Is there a work around for such use cases?
>
>
> On Wed, Jun 17, 2015 at 6:19 PM, Riesland, Zack <Za...@sensus.com>
> wrote:
>>
>> At HadoopSummit, Hortonworks hinted at a solution for this coming later in
>> the year.
>>
>>
>>
>> I think the idea is a single driver that can interact with Hive, HBase,
>> Phoenix, and others, and supports joining data across the connections.
>>
>>
>>
>> They didn’t provide very solid specifics, but there will probably be
>> something on the website in the near future.
>>
>>
>>
>> From: 김영우 [mailto:warwithin@gmail.com]
>> Sent: Wednesday, June 17, 2015 2:36 AM
>> To: user@phoenix.apache.org
>> Subject: Re: Phoenix and Hive
>>
>>
>>
>> Looks like Hive SH for Phoenix is WIP,
>>
>> https://issues.apache.org/jira/browse/PHOENIX-331
>>
>> https://github.com/nmaillard/Phoenix-Hive
>>
>>
>>
>> HTH
>>
>> - Youngwoo
>>
>>
>>
>> On Wed, Jun 17, 2015 at 3:26 PM, Buntu Dev <bu...@gmail.com> wrote:
>>
>> I got quite a bit of data in a Hive managed tables and I looking for ways
>> to join those tables with the one I create in Phoenix. I'm aware of HBase
>> and Hive integration but not sure if there is any current support for
>> Phoenix and Hive integration. Please let me know.
>>
>>
>>
>> Thanks!
>>
>>
>
>
Re: Phoenix and Hive
Posted by Buntu Dev <bu...@gmail.com>.
Thanks for the info, I've read about integration efforts with Apache
Calcite.
I noticed that one can't query based column timestamp and queries always
access data with the latest timestamp via Hive. Is this something Phoenix
already/will address? Is there a work around for such use cases?
On Wed, Jun 17, 2015 at 6:19 PM, Riesland, Zack <Za...@sensus.com>
wrote:
> At HadoopSummit, Hortonworks hinted at a solution for this coming later
> in the year.
>
>
>
> I think the idea is a single driver that can interact with Hive, HBase,
> Phoenix, and others, and supports joining data across the connections.
>
>
>
> They didn’t provide very solid specifics, but there will probably be
> something on the website in the near future.
>
>
>
> *From:* 김영우 [mailto:warwithin@gmail.com]
> *Sent:* Wednesday, June 17, 2015 2:36 AM
> *To:* user@phoenix.apache.org
> *Subject:* Re: Phoenix and Hive
>
>
>
> Looks like Hive SH for Phoenix is WIP,
>
> https://issues.apache.org/jira/browse/PHOENIX-331
>
> https://github.com/nmaillard/Phoenix-Hive
>
>
>
> HTH
>
> - Youngwoo
>
>
>
> On Wed, Jun 17, 2015 at 3:26 PM, Buntu Dev <bu...@gmail.com> wrote:
>
> I got quite a bit of data in a Hive managed tables and I looking for ways
> to join those tables with the one I create in Phoenix. I'm aware of HBase
> and Hive integration but not sure if there is any current support for
> Phoenix and Hive integration. Please let me know.
>
>
>
> Thanks!
>
>
>
RE: Phoenix and Hive
Posted by "Riesland, Zack" <Za...@sensus.com>.
At HadoopSummit, Hortonworks hinted at a solution for this coming later in the year.
I think the idea is a single driver that can interact with Hive, HBase, Phoenix, and others, and supports joining data across the connections.
They didn’t provide very solid specifics, but there will probably be something on the website in the near future.
From: 김영우 [mailto:warwithin@gmail.com]
Sent: Wednesday, June 17, 2015 2:36 AM
To: user@phoenix.apache.org
Subject: Re: Phoenix and Hive
Looks like Hive SH for Phoenix is WIP,
https://issues.apache.org/jira/browse/PHOENIX-331
https://github.com/nmaillard/Phoenix-Hive
HTH
- Youngwoo
On Wed, Jun 17, 2015 at 3:26 PM, Buntu Dev <bu...@gmail.com>> wrote:
I got quite a bit of data in a Hive managed tables and I looking for ways to join those tables with the one I create in Phoenix. I'm aware of HBase and Hive integration but not sure if there is any current support for Phoenix and Hive integration. Please let me know.
Thanks!
Re: Phoenix and Hive
Posted by 김영우 <wa...@gmail.com>.
Looks like Hive SH for Phoenix is WIP,
https://issues.apache.org/jira/browse/PHOENIX-331
https://github.com/nmaillard/Phoenix-Hive
HTH
- Youngwoo
On Wed, Jun 17, 2015 at 3:26 PM, Buntu Dev <bu...@gmail.com> wrote:
> I got quite a bit of data in a Hive managed tables and I looking for ways
> to join those tables with the one I create in Phoenix. I'm aware of HBase
> and Hive integration but not sure if there is any current support for
> Phoenix and Hive integration. Please let me know.
>
> Thanks!
>