You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by John Lilley <jo...@redpoint.net> on 2014/07/08 18:05:53 UTC
HBase metadata
Greetings!
We would like to support HBase in a general manner, having our software connect to any HBase table and read/write it in a row-oriented fashion. However, as we explore HBase, the raw interface is at a very low level -- basically a map from binary record keys to named columns. So my question about metadata standards. What do users mostly do to use HBase for row-oriented access? It is always going through Hive?
Thanks
john
Re: HBase metadata
Posted by Bryan Beaudreault <bb...@hubspot.com>.
At HubSpot we write all of our own code using the normal Java API for
Scans, Gets, etc. We built a lightweight internal framework around this to
enforce some standards.
Some people also use the Thrift interface and code in, for example, python.
I doubt many (or any) people use Hive as the interface.
On Tue, Jul 8, 2014 at 1:01 PM, Martin, Nick <Ni...@pssd.com> wrote:
> Can’t speak for the rest of the Hadoop community but we use Lingual. Not
> sure if that’s common or not.
>
>
>
> Maybe worth posting the same question to @hbase.
>
>
>
> *From:* John Lilley [mailto:john.lilley@redpoint.net]
> *Sent:* Tuesday, July 08, 2014 12:57 PM
>
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Sorry to be rude, but what does everyone actually use now? We are an ISV
> and need to support the most common access pattern.
>
> john
>
>
>
> *From:* Martin, Nick [mailto:NiMartin@pssd.com <Ni...@pssd.com>]
> *Sent:* Tuesday, July 08, 2014 10:53 AM
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Have you looked @ Lingual?
>
>
>
> *From:* John Lilley [mailto:john.lilley@redpoint.net
> <jo...@redpoint.net>]
> *Sent:* Tuesday, July 08, 2014 12:43 PM
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Those look intriguing. But what do people actually use today? Is it all
> application-specific coding? Hive?
>
> John
>
>
>
>
>
> *From:* Mirko Kämpf [mailto:mirko.kaempf@gmail.com
> <mi...@gmail.com>]
> *Sent:* Tuesday, July 08, 2014 10:12 AM
> *To:* user@hadoop.apache.org
> *Subject:* Re: HBase metadata
>
>
>
> Hi John,
>
> I suggest the project: http://www.kiji.org/
>
>
>
> or even the brand new: http://phoenix.apache.org/
>
> Cheers,
>
> Mirko
>
>
>
>
> 2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>:
>
> Greetings!
>
>
>
> We would like to support HBase in a general manner, having our software
> connect to any HBase table and read/write it in a row-oriented fashion.
> However, as we explore HBase, the raw interface is at a very low level --
> basically a map from binary record keys to named columns. So my question
> about metadata standards. What do users mostly do to use HBase for
> row-oriented access? It is always going through Hive?
>
>
>
> Thanks
>
> john
>
>
>
>
>
RE: HBase metadata
Posted by John Lilley <jo...@redpoint.net>.
Thanks. Apologies, I should have gone there first.
john
From: Ted Yu [mailto:yuzhihong@gmail.com]
Sent: Tuesday, July 08, 2014 11:04 AM
To: common-user@hadoop.apache.org
Subject: Re: HBase metadata
I have forwarded the original post to user@hbase
FYI
On Tue, Jul 8, 2014 at 10:01 AM, Martin, Nick <Ni...@pssd.com>> wrote:
Can’t speak for the rest of the Hadoop community but we use Lingual. Not sure if that’s common or not.
Maybe worth posting the same question to @hbase.
From: John Lilley [mailto:john.lilley@redpoint.net<ma...@redpoint.net>]
Sent: Tuesday, July 08, 2014 12:57 PM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Sorry to be rude, but what does everyone actually use now? We are an ISV and need to support the most common access pattern.
john
From: Martin, Nick [mailto:NiMartin@pssd.com]
Sent: Tuesday, July 08, 2014 10:53 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Have you looked @ Lingual?
From: John Lilley [mailto:john.lilley@redpoint.net]
Sent: Tuesday, July 08, 2014 12:43 PM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Those look intriguing. But what do people actually use today? Is it all application-specific coding? Hive?
John
From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
Sent: Tuesday, July 08, 2014 10:12 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Re: HBase metadata
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>>:
Greetings!
We would like to support HBase in a general manner, having our software connect to any HBase table and read/write it in a row-oriented fashion. However, as we explore HBase, the raw interface is at a very low level -- basically a map from binary record keys to named columns. So my question about metadata standards. What do users mostly do to use HBase for row-oriented access? It is always going through Hive?
Thanks
john
RE: HBase metadata
Posted by John Lilley <jo...@redpoint.net>.
Thanks. Apologies, I should have gone there first.
john
From: Ted Yu [mailto:yuzhihong@gmail.com]
Sent: Tuesday, July 08, 2014 11:04 AM
To: common-user@hadoop.apache.org
Subject: Re: HBase metadata
I have forwarded the original post to user@hbase
FYI
On Tue, Jul 8, 2014 at 10:01 AM, Martin, Nick <Ni...@pssd.com>> wrote:
Can’t speak for the rest of the Hadoop community but we use Lingual. Not sure if that’s common or not.
Maybe worth posting the same question to @hbase.
From: John Lilley [mailto:john.lilley@redpoint.net<ma...@redpoint.net>]
Sent: Tuesday, July 08, 2014 12:57 PM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Sorry to be rude, but what does everyone actually use now? We are an ISV and need to support the most common access pattern.
john
From: Martin, Nick [mailto:NiMartin@pssd.com]
Sent: Tuesday, July 08, 2014 10:53 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Have you looked @ Lingual?
From: John Lilley [mailto:john.lilley@redpoint.net]
Sent: Tuesday, July 08, 2014 12:43 PM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Those look intriguing. But what do people actually use today? Is it all application-specific coding? Hive?
John
From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
Sent: Tuesday, July 08, 2014 10:12 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Re: HBase metadata
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>>:
Greetings!
We would like to support HBase in a general manner, having our software connect to any HBase table and read/write it in a row-oriented fashion. However, as we explore HBase, the raw interface is at a very low level -- basically a map from binary record keys to named columns. So my question about metadata standards. What do users mostly do to use HBase for row-oriented access? It is always going through Hive?
Thanks
john
RE: HBase metadata
Posted by John Lilley <jo...@redpoint.net>.
Thanks. Apologies, I should have gone there first.
john
From: Ted Yu [mailto:yuzhihong@gmail.com]
Sent: Tuesday, July 08, 2014 11:04 AM
To: common-user@hadoop.apache.org
Subject: Re: HBase metadata
I have forwarded the original post to user@hbase
FYI
On Tue, Jul 8, 2014 at 10:01 AM, Martin, Nick <Ni...@pssd.com>> wrote:
Can’t speak for the rest of the Hadoop community but we use Lingual. Not sure if that’s common or not.
Maybe worth posting the same question to @hbase.
From: John Lilley [mailto:john.lilley@redpoint.net<ma...@redpoint.net>]
Sent: Tuesday, July 08, 2014 12:57 PM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Sorry to be rude, but what does everyone actually use now? We are an ISV and need to support the most common access pattern.
john
From: Martin, Nick [mailto:NiMartin@pssd.com]
Sent: Tuesday, July 08, 2014 10:53 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Have you looked @ Lingual?
From: John Lilley [mailto:john.lilley@redpoint.net]
Sent: Tuesday, July 08, 2014 12:43 PM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Those look intriguing. But what do people actually use today? Is it all application-specific coding? Hive?
John
From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
Sent: Tuesday, July 08, 2014 10:12 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Re: HBase metadata
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>>:
Greetings!
We would like to support HBase in a general manner, having our software connect to any HBase table and read/write it in a row-oriented fashion. However, as we explore HBase, the raw interface is at a very low level -- basically a map from binary record keys to named columns. So my question about metadata standards. What do users mostly do to use HBase for row-oriented access? It is always going through Hive?
Thanks
john
RE: HBase metadata
Posted by John Lilley <jo...@redpoint.net>.
Thanks. Apologies, I should have gone there first.
john
From: Ted Yu [mailto:yuzhihong@gmail.com]
Sent: Tuesday, July 08, 2014 11:04 AM
To: common-user@hadoop.apache.org
Subject: Re: HBase metadata
I have forwarded the original post to user@hbase
FYI
On Tue, Jul 8, 2014 at 10:01 AM, Martin, Nick <Ni...@pssd.com>> wrote:
Can’t speak for the rest of the Hadoop community but we use Lingual. Not sure if that’s common or not.
Maybe worth posting the same question to @hbase.
From: John Lilley [mailto:john.lilley@redpoint.net<ma...@redpoint.net>]
Sent: Tuesday, July 08, 2014 12:57 PM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Sorry to be rude, but what does everyone actually use now? We are an ISV and need to support the most common access pattern.
john
From: Martin, Nick [mailto:NiMartin@pssd.com]
Sent: Tuesday, July 08, 2014 10:53 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Have you looked @ Lingual?
From: John Lilley [mailto:john.lilley@redpoint.net]
Sent: Tuesday, July 08, 2014 12:43 PM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Those look intriguing. But what do people actually use today? Is it all application-specific coding? Hive?
John
From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
Sent: Tuesday, July 08, 2014 10:12 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Re: HBase metadata
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>>:
Greetings!
We would like to support HBase in a general manner, having our software connect to any HBase table and read/write it in a row-oriented fashion. However, as we explore HBase, the raw interface is at a very low level -- basically a map from binary record keys to named columns. So my question about metadata standards. What do users mostly do to use HBase for row-oriented access? It is always going through Hive?
Thanks
john
Re: HBase metadata
Posted by Ted Yu <yu...@gmail.com>.
I have forwarded the original post to user@hbase
FYI
On Tue, Jul 8, 2014 at 10:01 AM, Martin, Nick <Ni...@pssd.com> wrote:
> Can’t speak for the rest of the Hadoop community but we use Lingual. Not
> sure if that’s common or not.
>
>
>
> Maybe worth posting the same question to @hbase.
>
>
>
> *From:* John Lilley [mailto:john.lilley@redpoint.net]
> *Sent:* Tuesday, July 08, 2014 12:57 PM
>
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Sorry to be rude, but what does everyone actually use now? We are an ISV
> and need to support the most common access pattern.
>
> john
>
>
>
> *From:* Martin, Nick [mailto:NiMartin@pssd.com <Ni...@pssd.com>]
> *Sent:* Tuesday, July 08, 2014 10:53 AM
>
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Have you looked @ Lingual?
>
>
>
> *From:* John Lilley [mailto:john.lilley@redpoint.net
> <jo...@redpoint.net>]
> *Sent:* Tuesday, July 08, 2014 12:43 PM
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Those look intriguing. But what do people actually use today? Is it all
> application-specific coding? Hive?
>
> John
>
>
>
>
>
> *From:* Mirko Kämpf [mailto:mirko.kaempf@gmail.com
> <mi...@gmail.com>]
> *Sent:* Tuesday, July 08, 2014 10:12 AM
> *To:* user@hadoop.apache.org
> *Subject:* Re: HBase metadata
>
>
>
> Hi John,
>
> I suggest the project: http://www.kiji.org/
>
>
>
> or even the brand new: http://phoenix.apache.org/
>
> Cheers,
>
> Mirko
>
>
>
>
> 2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>:
>
> Greetings!
>
>
>
> We would like to support HBase in a general manner, having our software
> connect to any HBase table and read/write it in a row-oriented fashion.
> However, as we explore HBase, the raw interface is at a very low level --
> basically a map from binary record keys to named columns. So my question
> about metadata standards. What do users mostly do to use HBase for
> row-oriented access? It is always going through Hive?
>
>
>
> Thanks
>
> john
>
>
>
>
>
Re: HBase metadata
Posted by Bryan Beaudreault <bb...@hubspot.com>.
At HubSpot we write all of our own code using the normal Java API for
Scans, Gets, etc. We built a lightweight internal framework around this to
enforce some standards.
Some people also use the Thrift interface and code in, for example, python.
I doubt many (or any) people use Hive as the interface.
On Tue, Jul 8, 2014 at 1:01 PM, Martin, Nick <Ni...@pssd.com> wrote:
> Can’t speak for the rest of the Hadoop community but we use Lingual. Not
> sure if that’s common or not.
>
>
>
> Maybe worth posting the same question to @hbase.
>
>
>
> *From:* John Lilley [mailto:john.lilley@redpoint.net]
> *Sent:* Tuesday, July 08, 2014 12:57 PM
>
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Sorry to be rude, but what does everyone actually use now? We are an ISV
> and need to support the most common access pattern.
>
> john
>
>
>
> *From:* Martin, Nick [mailto:NiMartin@pssd.com <Ni...@pssd.com>]
> *Sent:* Tuesday, July 08, 2014 10:53 AM
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Have you looked @ Lingual?
>
>
>
> *From:* John Lilley [mailto:john.lilley@redpoint.net
> <jo...@redpoint.net>]
> *Sent:* Tuesday, July 08, 2014 12:43 PM
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Those look intriguing. But what do people actually use today? Is it all
> application-specific coding? Hive?
>
> John
>
>
>
>
>
> *From:* Mirko Kämpf [mailto:mirko.kaempf@gmail.com
> <mi...@gmail.com>]
> *Sent:* Tuesday, July 08, 2014 10:12 AM
> *To:* user@hadoop.apache.org
> *Subject:* Re: HBase metadata
>
>
>
> Hi John,
>
> I suggest the project: http://www.kiji.org/
>
>
>
> or even the brand new: http://phoenix.apache.org/
>
> Cheers,
>
> Mirko
>
>
>
>
> 2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>:
>
> Greetings!
>
>
>
> We would like to support HBase in a general manner, having our software
> connect to any HBase table and read/write it in a row-oriented fashion.
> However, as we explore HBase, the raw interface is at a very low level --
> basically a map from binary record keys to named columns. So my question
> about metadata standards. What do users mostly do to use HBase for
> row-oriented access? It is always going through Hive?
>
>
>
> Thanks
>
> john
>
>
>
>
>
Re: HBase metadata
Posted by Ted Yu <yu...@gmail.com>.
I have forwarded the original post to user@hbase
FYI
On Tue, Jul 8, 2014 at 10:01 AM, Martin, Nick <Ni...@pssd.com> wrote:
> Can’t speak for the rest of the Hadoop community but we use Lingual. Not
> sure if that’s common or not.
>
>
>
> Maybe worth posting the same question to @hbase.
>
>
>
> *From:* John Lilley [mailto:john.lilley@redpoint.net]
> *Sent:* Tuesday, July 08, 2014 12:57 PM
>
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Sorry to be rude, but what does everyone actually use now? We are an ISV
> and need to support the most common access pattern.
>
> john
>
>
>
> *From:* Martin, Nick [mailto:NiMartin@pssd.com <Ni...@pssd.com>]
> *Sent:* Tuesday, July 08, 2014 10:53 AM
>
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Have you looked @ Lingual?
>
>
>
> *From:* John Lilley [mailto:john.lilley@redpoint.net
> <jo...@redpoint.net>]
> *Sent:* Tuesday, July 08, 2014 12:43 PM
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Those look intriguing. But what do people actually use today? Is it all
> application-specific coding? Hive?
>
> John
>
>
>
>
>
> *From:* Mirko Kämpf [mailto:mirko.kaempf@gmail.com
> <mi...@gmail.com>]
> *Sent:* Tuesday, July 08, 2014 10:12 AM
> *To:* user@hadoop.apache.org
> *Subject:* Re: HBase metadata
>
>
>
> Hi John,
>
> I suggest the project: http://www.kiji.org/
>
>
>
> or even the brand new: http://phoenix.apache.org/
>
> Cheers,
>
> Mirko
>
>
>
>
> 2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>:
>
> Greetings!
>
>
>
> We would like to support HBase in a general manner, having our software
> connect to any HBase table and read/write it in a row-oriented fashion.
> However, as we explore HBase, the raw interface is at a very low level --
> basically a map from binary record keys to named columns. So my question
> about metadata standards. What do users mostly do to use HBase for
> row-oriented access? It is always going through Hive?
>
>
>
> Thanks
>
> john
>
>
>
>
>
Re: HBase metadata
Posted by Ted Yu <yu...@gmail.com>.
I have forwarded the original post to user@hbase
FYI
On Tue, Jul 8, 2014 at 10:01 AM, Martin, Nick <Ni...@pssd.com> wrote:
> Can’t speak for the rest of the Hadoop community but we use Lingual. Not
> sure if that’s common or not.
>
>
>
> Maybe worth posting the same question to @hbase.
>
>
>
> *From:* John Lilley [mailto:john.lilley@redpoint.net]
> *Sent:* Tuesday, July 08, 2014 12:57 PM
>
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Sorry to be rude, but what does everyone actually use now? We are an ISV
> and need to support the most common access pattern.
>
> john
>
>
>
> *From:* Martin, Nick [mailto:NiMartin@pssd.com <Ni...@pssd.com>]
> *Sent:* Tuesday, July 08, 2014 10:53 AM
>
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Have you looked @ Lingual?
>
>
>
> *From:* John Lilley [mailto:john.lilley@redpoint.net
> <jo...@redpoint.net>]
> *Sent:* Tuesday, July 08, 2014 12:43 PM
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Those look intriguing. But what do people actually use today? Is it all
> application-specific coding? Hive?
>
> John
>
>
>
>
>
> *From:* Mirko Kämpf [mailto:mirko.kaempf@gmail.com
> <mi...@gmail.com>]
> *Sent:* Tuesday, July 08, 2014 10:12 AM
> *To:* user@hadoop.apache.org
> *Subject:* Re: HBase metadata
>
>
>
> Hi John,
>
> I suggest the project: http://www.kiji.org/
>
>
>
> or even the brand new: http://phoenix.apache.org/
>
> Cheers,
>
> Mirko
>
>
>
>
> 2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>:
>
> Greetings!
>
>
>
> We would like to support HBase in a general manner, having our software
> connect to any HBase table and read/write it in a row-oriented fashion.
> However, as we explore HBase, the raw interface is at a very low level --
> basically a map from binary record keys to named columns. So my question
> about metadata standards. What do users mostly do to use HBase for
> row-oriented access? It is always going through Hive?
>
>
>
> Thanks
>
> john
>
>
>
>
>
Re: HBase metadata
Posted by Bryan Beaudreault <bb...@hubspot.com>.
At HubSpot we write all of our own code using the normal Java API for
Scans, Gets, etc. We built a lightweight internal framework around this to
enforce some standards.
Some people also use the Thrift interface and code in, for example, python.
I doubt many (or any) people use Hive as the interface.
On Tue, Jul 8, 2014 at 1:01 PM, Martin, Nick <Ni...@pssd.com> wrote:
> Can’t speak for the rest of the Hadoop community but we use Lingual. Not
> sure if that’s common or not.
>
>
>
> Maybe worth posting the same question to @hbase.
>
>
>
> *From:* John Lilley [mailto:john.lilley@redpoint.net]
> *Sent:* Tuesday, July 08, 2014 12:57 PM
>
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Sorry to be rude, but what does everyone actually use now? We are an ISV
> and need to support the most common access pattern.
>
> john
>
>
>
> *From:* Martin, Nick [mailto:NiMartin@pssd.com <Ni...@pssd.com>]
> *Sent:* Tuesday, July 08, 2014 10:53 AM
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Have you looked @ Lingual?
>
>
>
> *From:* John Lilley [mailto:john.lilley@redpoint.net
> <jo...@redpoint.net>]
> *Sent:* Tuesday, July 08, 2014 12:43 PM
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Those look intriguing. But what do people actually use today? Is it all
> application-specific coding? Hive?
>
> John
>
>
>
>
>
> *From:* Mirko Kämpf [mailto:mirko.kaempf@gmail.com
> <mi...@gmail.com>]
> *Sent:* Tuesday, July 08, 2014 10:12 AM
> *To:* user@hadoop.apache.org
> *Subject:* Re: HBase metadata
>
>
>
> Hi John,
>
> I suggest the project: http://www.kiji.org/
>
>
>
> or even the brand new: http://phoenix.apache.org/
>
> Cheers,
>
> Mirko
>
>
>
>
> 2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>:
>
> Greetings!
>
>
>
> We would like to support HBase in a general manner, having our software
> connect to any HBase table and read/write it in a row-oriented fashion.
> However, as we explore HBase, the raw interface is at a very low level --
> basically a map from binary record keys to named columns. So my question
> about metadata standards. What do users mostly do to use HBase for
> row-oriented access? It is always going through Hive?
>
>
>
> Thanks
>
> john
>
>
>
>
>
Re: HBase metadata
Posted by Bryan Beaudreault <bb...@hubspot.com>.
At HubSpot we write all of our own code using the normal Java API for
Scans, Gets, etc. We built a lightweight internal framework around this to
enforce some standards.
Some people also use the Thrift interface and code in, for example, python.
I doubt many (or any) people use Hive as the interface.
On Tue, Jul 8, 2014 at 1:01 PM, Martin, Nick <Ni...@pssd.com> wrote:
> Can’t speak for the rest of the Hadoop community but we use Lingual. Not
> sure if that’s common or not.
>
>
>
> Maybe worth posting the same question to @hbase.
>
>
>
> *From:* John Lilley [mailto:john.lilley@redpoint.net]
> *Sent:* Tuesday, July 08, 2014 12:57 PM
>
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Sorry to be rude, but what does everyone actually use now? We are an ISV
> and need to support the most common access pattern.
>
> john
>
>
>
> *From:* Martin, Nick [mailto:NiMartin@pssd.com <Ni...@pssd.com>]
> *Sent:* Tuesday, July 08, 2014 10:53 AM
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Have you looked @ Lingual?
>
>
>
> *From:* John Lilley [mailto:john.lilley@redpoint.net
> <jo...@redpoint.net>]
> *Sent:* Tuesday, July 08, 2014 12:43 PM
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Those look intriguing. But what do people actually use today? Is it all
> application-specific coding? Hive?
>
> John
>
>
>
>
>
> *From:* Mirko Kämpf [mailto:mirko.kaempf@gmail.com
> <mi...@gmail.com>]
> *Sent:* Tuesday, July 08, 2014 10:12 AM
> *To:* user@hadoop.apache.org
> *Subject:* Re: HBase metadata
>
>
>
> Hi John,
>
> I suggest the project: http://www.kiji.org/
>
>
>
> or even the brand new: http://phoenix.apache.org/
>
> Cheers,
>
> Mirko
>
>
>
>
> 2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>:
>
> Greetings!
>
>
>
> We would like to support HBase in a general manner, having our software
> connect to any HBase table and read/write it in a row-oriented fashion.
> However, as we explore HBase, the raw interface is at a very low level --
> basically a map from binary record keys to named columns. So my question
> about metadata standards. What do users mostly do to use HBase for
> row-oriented access? It is always going through Hive?
>
>
>
> Thanks
>
> john
>
>
>
>
>
Re: HBase metadata
Posted by Ted Yu <yu...@gmail.com>.
I have forwarded the original post to user@hbase
FYI
On Tue, Jul 8, 2014 at 10:01 AM, Martin, Nick <Ni...@pssd.com> wrote:
> Can’t speak for the rest of the Hadoop community but we use Lingual. Not
> sure if that’s common or not.
>
>
>
> Maybe worth posting the same question to @hbase.
>
>
>
> *From:* John Lilley [mailto:john.lilley@redpoint.net]
> *Sent:* Tuesday, July 08, 2014 12:57 PM
>
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Sorry to be rude, but what does everyone actually use now? We are an ISV
> and need to support the most common access pattern.
>
> john
>
>
>
> *From:* Martin, Nick [mailto:NiMartin@pssd.com <Ni...@pssd.com>]
> *Sent:* Tuesday, July 08, 2014 10:53 AM
>
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Have you looked @ Lingual?
>
>
>
> *From:* John Lilley [mailto:john.lilley@redpoint.net
> <jo...@redpoint.net>]
> *Sent:* Tuesday, July 08, 2014 12:43 PM
> *To:* user@hadoop.apache.org
> *Subject:* RE: HBase metadata
>
>
>
> Those look intriguing. But what do people actually use today? Is it all
> application-specific coding? Hive?
>
> John
>
>
>
>
>
> *From:* Mirko Kämpf [mailto:mirko.kaempf@gmail.com
> <mi...@gmail.com>]
> *Sent:* Tuesday, July 08, 2014 10:12 AM
> *To:* user@hadoop.apache.org
> *Subject:* Re: HBase metadata
>
>
>
> Hi John,
>
> I suggest the project: http://www.kiji.org/
>
>
>
> or even the brand new: http://phoenix.apache.org/
>
> Cheers,
>
> Mirko
>
>
>
>
> 2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>:
>
> Greetings!
>
>
>
> We would like to support HBase in a general manner, having our software
> connect to any HBase table and read/write it in a row-oriented fashion.
> However, as we explore HBase, the raw interface is at a very low level --
> basically a map from binary record keys to named columns. So my question
> about metadata standards. What do users mostly do to use HBase for
> row-oriented access? It is always going through Hive?
>
>
>
> Thanks
>
> john
>
>
>
>
>
Re[2]: HBase metadata
Posted by Alexander Alten-Lorenz <wg...@gmail.com>.
http://docs.cascading.org/tutorials/lingual-hbase/
is the most common, I guess. Phoenix is quite new, and Kiji was to much
overhead in my case.
- Alex
mapredit.blogspot.com
------ Originalnachricht ------
Von: "Martin, Nick" <Ni...@pssd.com>
An: "user@hadoop.apache.org" <us...@hadoop.apache.org>
Gesendet: 08.07.2014 19:01:27
Betreff: RE: HBase metadata
>Can’t speak for the rest of the Hadoop community but we use Lingual.
>Not sure if that’s common or not.
>
>
>
>Maybe worth posting the same question to @hbase.
>
>
>
>From: John Lilley [mailto:john.lilley@redpoint.net]
>Sent: Tuesday, July 08, 2014 12:57 PM
>To:user@hadoop.apache.org
>Subject: RE: HBase metadata
>
>
>
>Sorry to be rude, but what does everyone actually use now? We are an
>ISV and need to support the most common access pattern.
>
>john
>
>
>
>From: Martin, Nick [mailto:NiMartin@pssd.com]
>Sent: Tuesday, July 08, 2014 10:53 AM
>To:user@hadoop.apache.org
>Subject: RE: HBase metadata
>
>
>
>Have you looked @ Lingual?
>
>
>
>From: John Lilley [mailto:john.lilley@redpoint.net]
>Sent: Tuesday, July 08, 2014 12:43 PM
>To:user@hadoop.apache.org
>Subject: RE: HBase metadata
>
>
>
>Those look intriguing. But what do people actually use today? Is it
>all application-specific coding? Hive?
>
>John
>
>
>
>
>
>From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
>Sent: Tuesday, July 08, 2014 10:12 AM
>To:user@hadoop.apache.org
>Subject: Re: HBase metadata
>
>
>
>Hi John,
>
>I suggest the project: http://www.kiji.org/
>
>
>
>or even the brand new: http://phoenix.apache.org/
>
>Cheers,
>
>Mirko
>
>
>
>
>2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>:
>
>Greetings!
>
>
>
>We would like to support HBase in a general manner, having our software
>connect to any HBase table and read/write it in a row-oriented fashion.
> However, as we explore HBase, the raw interface is at a very low level
>-- basically a map from binary record keys to named columns. So my
>question about metadata standards. What do users mostly do to use
>HBase for row-oriented access? It is always going through Hive?
>
>
>
>Thanks
>
>john
>
>
>
>
>
Re[2]: HBase metadata
Posted by Alexander Alten-Lorenz <wg...@gmail.com>.
http://docs.cascading.org/tutorials/lingual-hbase/
is the most common, I guess. Phoenix is quite new, and Kiji was to much
overhead in my case.
- Alex
mapredit.blogspot.com
------ Originalnachricht ------
Von: "Martin, Nick" <Ni...@pssd.com>
An: "user@hadoop.apache.org" <us...@hadoop.apache.org>
Gesendet: 08.07.2014 19:01:27
Betreff: RE: HBase metadata
>Can’t speak for the rest of the Hadoop community but we use Lingual.
>Not sure if that’s common or not.
>
>
>
>Maybe worth posting the same question to @hbase.
>
>
>
>From: John Lilley [mailto:john.lilley@redpoint.net]
>Sent: Tuesday, July 08, 2014 12:57 PM
>To:user@hadoop.apache.org
>Subject: RE: HBase metadata
>
>
>
>Sorry to be rude, but what does everyone actually use now? We are an
>ISV and need to support the most common access pattern.
>
>john
>
>
>
>From: Martin, Nick [mailto:NiMartin@pssd.com]
>Sent: Tuesday, July 08, 2014 10:53 AM
>To:user@hadoop.apache.org
>Subject: RE: HBase metadata
>
>
>
>Have you looked @ Lingual?
>
>
>
>From: John Lilley [mailto:john.lilley@redpoint.net]
>Sent: Tuesday, July 08, 2014 12:43 PM
>To:user@hadoop.apache.org
>Subject: RE: HBase metadata
>
>
>
>Those look intriguing. But what do people actually use today? Is it
>all application-specific coding? Hive?
>
>John
>
>
>
>
>
>From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
>Sent: Tuesday, July 08, 2014 10:12 AM
>To:user@hadoop.apache.org
>Subject: Re: HBase metadata
>
>
>
>Hi John,
>
>I suggest the project: http://www.kiji.org/
>
>
>
>or even the brand new: http://phoenix.apache.org/
>
>Cheers,
>
>Mirko
>
>
>
>
>2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>:
>
>Greetings!
>
>
>
>We would like to support HBase in a general manner, having our software
>connect to any HBase table and read/write it in a row-oriented fashion.
> However, as we explore HBase, the raw interface is at a very low level
>-- basically a map from binary record keys to named columns. So my
>question about metadata standards. What do users mostly do to use
>HBase for row-oriented access? It is always going through Hive?
>
>
>
>Thanks
>
>john
>
>
>
>
>
Re[2]: HBase metadata
Posted by Alexander Alten-Lorenz <wg...@gmail.com>.
http://docs.cascading.org/tutorials/lingual-hbase/
is the most common, I guess. Phoenix is quite new, and Kiji was to much
overhead in my case.
- Alex
mapredit.blogspot.com
------ Originalnachricht ------
Von: "Martin, Nick" <Ni...@pssd.com>
An: "user@hadoop.apache.org" <us...@hadoop.apache.org>
Gesendet: 08.07.2014 19:01:27
Betreff: RE: HBase metadata
>Can’t speak for the rest of the Hadoop community but we use Lingual.
>Not sure if that’s common or not.
>
>
>
>Maybe worth posting the same question to @hbase.
>
>
>
>From: John Lilley [mailto:john.lilley@redpoint.net]
>Sent: Tuesday, July 08, 2014 12:57 PM
>To:user@hadoop.apache.org
>Subject: RE: HBase metadata
>
>
>
>Sorry to be rude, but what does everyone actually use now? We are an
>ISV and need to support the most common access pattern.
>
>john
>
>
>
>From: Martin, Nick [mailto:NiMartin@pssd.com]
>Sent: Tuesday, July 08, 2014 10:53 AM
>To:user@hadoop.apache.org
>Subject: RE: HBase metadata
>
>
>
>Have you looked @ Lingual?
>
>
>
>From: John Lilley [mailto:john.lilley@redpoint.net]
>Sent: Tuesday, July 08, 2014 12:43 PM
>To:user@hadoop.apache.org
>Subject: RE: HBase metadata
>
>
>
>Those look intriguing. But what do people actually use today? Is it
>all application-specific coding? Hive?
>
>John
>
>
>
>
>
>From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
>Sent: Tuesday, July 08, 2014 10:12 AM
>To:user@hadoop.apache.org
>Subject: Re: HBase metadata
>
>
>
>Hi John,
>
>I suggest the project: http://www.kiji.org/
>
>
>
>or even the brand new: http://phoenix.apache.org/
>
>Cheers,
>
>Mirko
>
>
>
>
>2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>:
>
>Greetings!
>
>
>
>We would like to support HBase in a general manner, having our software
>connect to any HBase table and read/write it in a row-oriented fashion.
> However, as we explore HBase, the raw interface is at a very low level
>-- basically a map from binary record keys to named columns. So my
>question about metadata standards. What do users mostly do to use
>HBase for row-oriented access? It is always going through Hive?
>
>
>
>Thanks
>
>john
>
>
>
>
>
Re[2]: HBase metadata
Posted by Alexander Alten-Lorenz <wg...@gmail.com>.
http://docs.cascading.org/tutorials/lingual-hbase/
is the most common, I guess. Phoenix is quite new, and Kiji was to much
overhead in my case.
- Alex
mapredit.blogspot.com
------ Originalnachricht ------
Von: "Martin, Nick" <Ni...@pssd.com>
An: "user@hadoop.apache.org" <us...@hadoop.apache.org>
Gesendet: 08.07.2014 19:01:27
Betreff: RE: HBase metadata
>Can’t speak for the rest of the Hadoop community but we use Lingual.
>Not sure if that’s common or not.
>
>
>
>Maybe worth posting the same question to @hbase.
>
>
>
>From: John Lilley [mailto:john.lilley@redpoint.net]
>Sent: Tuesday, July 08, 2014 12:57 PM
>To:user@hadoop.apache.org
>Subject: RE: HBase metadata
>
>
>
>Sorry to be rude, but what does everyone actually use now? We are an
>ISV and need to support the most common access pattern.
>
>john
>
>
>
>From: Martin, Nick [mailto:NiMartin@pssd.com]
>Sent: Tuesday, July 08, 2014 10:53 AM
>To:user@hadoop.apache.org
>Subject: RE: HBase metadata
>
>
>
>Have you looked @ Lingual?
>
>
>
>From: John Lilley [mailto:john.lilley@redpoint.net]
>Sent: Tuesday, July 08, 2014 12:43 PM
>To:user@hadoop.apache.org
>Subject: RE: HBase metadata
>
>
>
>Those look intriguing. But what do people actually use today? Is it
>all application-specific coding? Hive?
>
>John
>
>
>
>
>
>From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
>Sent: Tuesday, July 08, 2014 10:12 AM
>To:user@hadoop.apache.org
>Subject: Re: HBase metadata
>
>
>
>Hi John,
>
>I suggest the project: http://www.kiji.org/
>
>
>
>or even the brand new: http://phoenix.apache.org/
>
>Cheers,
>
>Mirko
>
>
>
>
>2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>:
>
>Greetings!
>
>
>
>We would like to support HBase in a general manner, having our software
>connect to any HBase table and read/write it in a row-oriented fashion.
> However, as we explore HBase, the raw interface is at a very low level
>-- basically a map from binary record keys to named columns. So my
>question about metadata standards. What do users mostly do to use
>HBase for row-oriented access? It is always going through Hive?
>
>
>
>Thanks
>
>john
>
>
>
>
>
RE: HBase metadata
Posted by "Martin, Nick" <Ni...@pssd.com>.
Can’t speak for the rest of the Hadoop community but we use Lingual. Not sure if that’s common or not.
Maybe worth posting the same question to @hbase.
From: John Lilley [mailto:john.lilley@redpoint.net]
Sent: Tuesday, July 08, 2014 12:57 PM
To: user@hadoop.apache.org
Subject: RE: HBase metadata
Sorry to be rude, but what does everyone actually use now? We are an ISV and need to support the most common access pattern.
john
From: Martin, Nick [mailto:NiMartin@pssd.com]
Sent: Tuesday, July 08, 2014 10:53 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Have you looked @ Lingual?
From: John Lilley [mailto:john.lilley@redpoint.net]
Sent: Tuesday, July 08, 2014 12:43 PM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Those look intriguing. But what do people actually use today? Is it all application-specific coding? Hive?
John
From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
Sent: Tuesday, July 08, 2014 10:12 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Re: HBase metadata
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>>:
Greetings!
We would like to support HBase in a general manner, having our software connect to any HBase table and read/write it in a row-oriented fashion. However, as we explore HBase, the raw interface is at a very low level -- basically a map from binary record keys to named columns. So my question about metadata standards. What do users mostly do to use HBase for row-oriented access? It is always going through Hive?
Thanks
john
RE: HBase metadata
Posted by "Martin, Nick" <Ni...@pssd.com>.
Can’t speak for the rest of the Hadoop community but we use Lingual. Not sure if that’s common or not.
Maybe worth posting the same question to @hbase.
From: John Lilley [mailto:john.lilley@redpoint.net]
Sent: Tuesday, July 08, 2014 12:57 PM
To: user@hadoop.apache.org
Subject: RE: HBase metadata
Sorry to be rude, but what does everyone actually use now? We are an ISV and need to support the most common access pattern.
john
From: Martin, Nick [mailto:NiMartin@pssd.com]
Sent: Tuesday, July 08, 2014 10:53 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Have you looked @ Lingual?
From: John Lilley [mailto:john.lilley@redpoint.net]
Sent: Tuesday, July 08, 2014 12:43 PM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Those look intriguing. But what do people actually use today? Is it all application-specific coding? Hive?
John
From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
Sent: Tuesday, July 08, 2014 10:12 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Re: HBase metadata
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>>:
Greetings!
We would like to support HBase in a general manner, having our software connect to any HBase table and read/write it in a row-oriented fashion. However, as we explore HBase, the raw interface is at a very low level -- basically a map from binary record keys to named columns. So my question about metadata standards. What do users mostly do to use HBase for row-oriented access? It is always going through Hive?
Thanks
john
RE: HBase metadata
Posted by "Martin, Nick" <Ni...@pssd.com>.
Can’t speak for the rest of the Hadoop community but we use Lingual. Not sure if that’s common or not.
Maybe worth posting the same question to @hbase.
From: John Lilley [mailto:john.lilley@redpoint.net]
Sent: Tuesday, July 08, 2014 12:57 PM
To: user@hadoop.apache.org
Subject: RE: HBase metadata
Sorry to be rude, but what does everyone actually use now? We are an ISV and need to support the most common access pattern.
john
From: Martin, Nick [mailto:NiMartin@pssd.com]
Sent: Tuesday, July 08, 2014 10:53 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Have you looked @ Lingual?
From: John Lilley [mailto:john.lilley@redpoint.net]
Sent: Tuesday, July 08, 2014 12:43 PM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Those look intriguing. But what do people actually use today? Is it all application-specific coding? Hive?
John
From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
Sent: Tuesday, July 08, 2014 10:12 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Re: HBase metadata
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>>:
Greetings!
We would like to support HBase in a general manner, having our software connect to any HBase table and read/write it in a row-oriented fashion. However, as we explore HBase, the raw interface is at a very low level -- basically a map from binary record keys to named columns. So my question about metadata standards. What do users mostly do to use HBase for row-oriented access? It is always going through Hive?
Thanks
john
RE: HBase metadata
Posted by "Martin, Nick" <Ni...@pssd.com>.
Can’t speak for the rest of the Hadoop community but we use Lingual. Not sure if that’s common or not.
Maybe worth posting the same question to @hbase.
From: John Lilley [mailto:john.lilley@redpoint.net]
Sent: Tuesday, July 08, 2014 12:57 PM
To: user@hadoop.apache.org
Subject: RE: HBase metadata
Sorry to be rude, but what does everyone actually use now? We are an ISV and need to support the most common access pattern.
john
From: Martin, Nick [mailto:NiMartin@pssd.com]
Sent: Tuesday, July 08, 2014 10:53 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Have you looked @ Lingual?
From: John Lilley [mailto:john.lilley@redpoint.net]
Sent: Tuesday, July 08, 2014 12:43 PM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Those look intriguing. But what do people actually use today? Is it all application-specific coding? Hive?
John
From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
Sent: Tuesday, July 08, 2014 10:12 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Re: HBase metadata
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>>:
Greetings!
We would like to support HBase in a general manner, having our software connect to any HBase table and read/write it in a row-oriented fashion. However, as we explore HBase, the raw interface is at a very low level -- basically a map from binary record keys to named columns. So my question about metadata standards. What do users mostly do to use HBase for row-oriented access? It is always going through Hive?
Thanks
john
RE: HBase metadata
Posted by John Lilley <jo...@redpoint.net>.
Sorry to be rude, but what does everyone actually use now? We are an ISV and need to support the most common access pattern.
john
From: Martin, Nick [mailto:NiMartin@pssd.com]
Sent: Tuesday, July 08, 2014 10:53 AM
To: user@hadoop.apache.org
Subject: RE: HBase metadata
Have you looked @ Lingual?
From: John Lilley [mailto:john.lilley@redpoint.net]
Sent: Tuesday, July 08, 2014 12:43 PM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Those look intriguing. But what do people actually use today? Is it all application-specific coding? Hive?
John
From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
Sent: Tuesday, July 08, 2014 10:12 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Re: HBase metadata
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>>:
Greetings!
We would like to support HBase in a general manner, having our software connect to any HBase table and read/write it in a row-oriented fashion. However, as we explore HBase, the raw interface is at a very low level -- basically a map from binary record keys to named columns. So my question about metadata standards. What do users mostly do to use HBase for row-oriented access? It is always going through Hive?
Thanks
john
RE: HBase metadata
Posted by John Lilley <jo...@redpoint.net>.
Sorry to be rude, but what does everyone actually use now? We are an ISV and need to support the most common access pattern.
john
From: Martin, Nick [mailto:NiMartin@pssd.com]
Sent: Tuesday, July 08, 2014 10:53 AM
To: user@hadoop.apache.org
Subject: RE: HBase metadata
Have you looked @ Lingual?
From: John Lilley [mailto:john.lilley@redpoint.net]
Sent: Tuesday, July 08, 2014 12:43 PM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Those look intriguing. But what do people actually use today? Is it all application-specific coding? Hive?
John
From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
Sent: Tuesday, July 08, 2014 10:12 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Re: HBase metadata
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>>:
Greetings!
We would like to support HBase in a general manner, having our software connect to any HBase table and read/write it in a row-oriented fashion. However, as we explore HBase, the raw interface is at a very low level -- basically a map from binary record keys to named columns. So my question about metadata standards. What do users mostly do to use HBase for row-oriented access? It is always going through Hive?
Thanks
john
RE: HBase metadata
Posted by John Lilley <jo...@redpoint.net>.
Sorry to be rude, but what does everyone actually use now? We are an ISV and need to support the most common access pattern.
john
From: Martin, Nick [mailto:NiMartin@pssd.com]
Sent: Tuesday, July 08, 2014 10:53 AM
To: user@hadoop.apache.org
Subject: RE: HBase metadata
Have you looked @ Lingual?
From: John Lilley [mailto:john.lilley@redpoint.net]
Sent: Tuesday, July 08, 2014 12:43 PM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Those look intriguing. But what do people actually use today? Is it all application-specific coding? Hive?
John
From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
Sent: Tuesday, July 08, 2014 10:12 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Re: HBase metadata
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>>:
Greetings!
We would like to support HBase in a general manner, having our software connect to any HBase table and read/write it in a row-oriented fashion. However, as we explore HBase, the raw interface is at a very low level -- basically a map from binary record keys to named columns. So my question about metadata standards. What do users mostly do to use HBase for row-oriented access? It is always going through Hive?
Thanks
john
RE: HBase metadata
Posted by John Lilley <jo...@redpoint.net>.
Sorry to be rude, but what does everyone actually use now? We are an ISV and need to support the most common access pattern.
john
From: Martin, Nick [mailto:NiMartin@pssd.com]
Sent: Tuesday, July 08, 2014 10:53 AM
To: user@hadoop.apache.org
Subject: RE: HBase metadata
Have you looked @ Lingual?
From: John Lilley [mailto:john.lilley@redpoint.net]
Sent: Tuesday, July 08, 2014 12:43 PM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: HBase metadata
Those look intriguing. But what do people actually use today? Is it all application-specific coding? Hive?
John
From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
Sent: Tuesday, July 08, 2014 10:12 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Re: HBase metadata
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>>:
Greetings!
We would like to support HBase in a general manner, having our software connect to any HBase table and read/write it in a row-oriented fashion. However, as we explore HBase, the raw interface is at a very low level -- basically a map from binary record keys to named columns. So my question about metadata standards. What do users mostly do to use HBase for row-oriented access? It is always going through Hive?
Thanks
john
RE: HBase metadata
Posted by "Martin, Nick" <Ni...@pssd.com>.
Have you looked @ Lingual?
From: John Lilley [mailto:john.lilley@redpoint.net]
Sent: Tuesday, July 08, 2014 12:43 PM
To: user@hadoop.apache.org
Subject: RE: HBase metadata
Those look intriguing. But what do people actually use today? Is it all application-specific coding? Hive?
John
From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
Sent: Tuesday, July 08, 2014 10:12 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Re: HBase metadata
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>>:
Greetings!
We would like to support HBase in a general manner, having our software connect to any HBase table and read/write it in a row-oriented fashion. However, as we explore HBase, the raw interface is at a very low level -- basically a map from binary record keys to named columns. So my question about metadata standards. What do users mostly do to use HBase for row-oriented access? It is always going through Hive?
Thanks
john
RE: HBase metadata
Posted by "Martin, Nick" <Ni...@pssd.com>.
Have you looked @ Lingual?
From: John Lilley [mailto:john.lilley@redpoint.net]
Sent: Tuesday, July 08, 2014 12:43 PM
To: user@hadoop.apache.org
Subject: RE: HBase metadata
Those look intriguing. But what do people actually use today? Is it all application-specific coding? Hive?
John
From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
Sent: Tuesday, July 08, 2014 10:12 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Re: HBase metadata
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>>:
Greetings!
We would like to support HBase in a general manner, having our software connect to any HBase table and read/write it in a row-oriented fashion. However, as we explore HBase, the raw interface is at a very low level -- basically a map from binary record keys to named columns. So my question about metadata standards. What do users mostly do to use HBase for row-oriented access? It is always going through Hive?
Thanks
john
RE: HBase metadata
Posted by "Martin, Nick" <Ni...@pssd.com>.
Have you looked @ Lingual?
From: John Lilley [mailto:john.lilley@redpoint.net]
Sent: Tuesday, July 08, 2014 12:43 PM
To: user@hadoop.apache.org
Subject: RE: HBase metadata
Those look intriguing. But what do people actually use today? Is it all application-specific coding? Hive?
John
From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
Sent: Tuesday, July 08, 2014 10:12 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Re: HBase metadata
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>>:
Greetings!
We would like to support HBase in a general manner, having our software connect to any HBase table and read/write it in a row-oriented fashion. However, as we explore HBase, the raw interface is at a very low level -- basically a map from binary record keys to named columns. So my question about metadata standards. What do users mostly do to use HBase for row-oriented access? It is always going through Hive?
Thanks
john
RE: HBase metadata
Posted by "Martin, Nick" <Ni...@pssd.com>.
Have you looked @ Lingual?
From: John Lilley [mailto:john.lilley@redpoint.net]
Sent: Tuesday, July 08, 2014 12:43 PM
To: user@hadoop.apache.org
Subject: RE: HBase metadata
Those look intriguing. But what do people actually use today? Is it all application-specific coding? Hive?
John
From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
Sent: Tuesday, July 08, 2014 10:12 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Re: HBase metadata
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>>:
Greetings!
We would like to support HBase in a general manner, having our software connect to any HBase table and read/write it in a row-oriented fashion. However, as we explore HBase, the raw interface is at a very low level -- basically a map from binary record keys to named columns. So my question about metadata standards. What do users mostly do to use HBase for row-oriented access? It is always going through Hive?
Thanks
john
RE: HBase metadata
Posted by John Lilley <jo...@redpoint.net>.
Those look intriguing. But what do people actually use today? Is it all application-specific coding? Hive?
John
From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
Sent: Tuesday, July 08, 2014 10:12 AM
To: user@hadoop.apache.org
Subject: Re: HBase metadata
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>>:
Greetings!
We would like to support HBase in a general manner, having our software connect to any HBase table and read/write it in a row-oriented fashion. However, as we explore HBase, the raw interface is at a very low level -- basically a map from binary record keys to named columns. So my question about metadata standards. What do users mostly do to use HBase for row-oriented access? It is always going through Hive?
Thanks
john
RE: HBase metadata
Posted by John Lilley <jo...@redpoint.net>.
Those look intriguing. But what do people actually use today? Is it all application-specific coding? Hive?
John
From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
Sent: Tuesday, July 08, 2014 10:12 AM
To: user@hadoop.apache.org
Subject: Re: HBase metadata
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>>:
Greetings!
We would like to support HBase in a general manner, having our software connect to any HBase table and read/write it in a row-oriented fashion. However, as we explore HBase, the raw interface is at a very low level -- basically a map from binary record keys to named columns. So my question about metadata standards. What do users mostly do to use HBase for row-oriented access? It is always going through Hive?
Thanks
john
RE: HBase metadata
Posted by John Lilley <jo...@redpoint.net>.
Those look intriguing. But what do people actually use today? Is it all application-specific coding? Hive?
John
From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
Sent: Tuesday, July 08, 2014 10:12 AM
To: user@hadoop.apache.org
Subject: Re: HBase metadata
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>>:
Greetings!
We would like to support HBase in a general manner, having our software connect to any HBase table and read/write it in a row-oriented fashion. However, as we explore HBase, the raw interface is at a very low level -- basically a map from binary record keys to named columns. So my question about metadata standards. What do users mostly do to use HBase for row-oriented access? It is always going through Hive?
Thanks
john
RE: HBase metadata
Posted by John Lilley <jo...@redpoint.net>.
Those look intriguing. But what do people actually use today? Is it all application-specific coding? Hive?
John
From: Mirko Kämpf [mailto:mirko.kaempf@gmail.com]
Sent: Tuesday, July 08, 2014 10:12 AM
To: user@hadoop.apache.org
Subject: Re: HBase metadata
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>>:
Greetings!
We would like to support HBase in a general manner, having our software connect to any HBase table and read/write it in a row-oriented fashion. However, as we explore HBase, the raw interface is at a very low level -- basically a map from binary record keys to named columns. So my question about metadata standards. What do users mostly do to use HBase for row-oriented access? It is always going through Hive?
Thanks
john
Re: HBase metadata
Posted by Mirko Kämpf <mi...@gmail.com>.
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>:
> Greetings!
>
>
>
> We would like to support HBase in a general manner, having our software
> connect to any HBase table and read/write it in a row-oriented fashion.
> However, as we explore HBase, the raw interface is at a very low level --
> basically a map from binary record keys to named columns. So my question
> about metadata standards. What do users mostly do to use HBase for
> row-oriented access? It is always going through Hive?
>
>
>
> Thanks
>
> john
>
>
>
Re: HBase metadata
Posted by Mirko Kämpf <mi...@gmail.com>.
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>:
> Greetings!
>
>
>
> We would like to support HBase in a general manner, having our software
> connect to any HBase table and read/write it in a row-oriented fashion.
> However, as we explore HBase, the raw interface is at a very low level --
> basically a map from binary record keys to named columns. So my question
> about metadata standards. What do users mostly do to use HBase for
> row-oriented access? It is always going through Hive?
>
>
>
> Thanks
>
> john
>
>
>
Re: HBase metadata
Posted by Mirko Kämpf <mi...@gmail.com>.
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>:
> Greetings!
>
>
>
> We would like to support HBase in a general manner, having our software
> connect to any HBase table and read/write it in a row-oriented fashion.
> However, as we explore HBase, the raw interface is at a very low level --
> basically a map from binary record keys to named columns. So my question
> about metadata standards. What do users mostly do to use HBase for
> row-oriented access? It is always going through Hive?
>
>
>
> Thanks
>
> john
>
>
>
Re: HBase metadata
Posted by Amit Tewari <am...@gmail.com>.
Depending on what you really need you can explore Apache Phoenix or HP trafodion (open sourced recently by HP labs)
Amit
Sent from my mobile device, please excuse the typos
> On Jul 8, 2014, at 9:08 AM, Ted Yu <yu...@gmail.com> wrote:
>
> Forwarding to hbase user mailing list.
>
> ---------- Forwarded message ----------
> From: John Lilley <jo...@redpoint.net>
> Date: Tue, Jul 8, 2014 at 9:05 AM
> Subject: HBase metadata
> To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
>
>
> Greetings!
>
>
>
> We would like to support HBase in a general manner, having our software
> connect to any HBase table and read/write it in a row-oriented fashion.
> However, as we explore HBase, the raw interface is at a very low level --
> basically a map from binary record keys to named columns. So my question
> about metadata standards. What do users mostly do to use HBase for
> row-oriented access? It is always going through Hive?
>
>
>
> Thanks
>
> john
Fwd: HBase metadata
Posted by Ted Yu <yu...@gmail.com>.
Forwarding to hbase user mailing list.
---------- Forwarded message ----------
From: John Lilley <jo...@redpoint.net>
Date: Tue, Jul 8, 2014 at 9:05 AM
Subject: HBase metadata
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
Greetings!
We would like to support HBase in a general manner, having our software
connect to any HBase table and read/write it in a row-oriented fashion.
However, as we explore HBase, the raw interface is at a very low level --
basically a map from binary record keys to named columns. So my question
about metadata standards. What do users mostly do to use HBase for
row-oriented access? It is always going through Hive?
Thanks
john
Re: HBase metadata
Posted by Mirko Kämpf <mi...@gmail.com>.
Hi John,
I suggest the project: http://www.kiji.org/
or even the brand new: http://phoenix.apache.org/
Cheers,
Mirko
2014-07-08 16:05 GMT+00:00 John Lilley <jo...@redpoint.net>:
> Greetings!
>
>
>
> We would like to support HBase in a general manner, having our software
> connect to any HBase table and read/write it in a row-oriented fashion.
> However, as we explore HBase, the raw interface is at a very low level --
> basically a map from binary record keys to named columns. So my question
> about metadata standards. What do users mostly do to use HBase for
> row-oriented access? It is always going through Hive?
>
>
>
> Thanks
>
> john
>
>
>