You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Guo Leitao <le...@gmail.com> on 2008/09/01 10:07:50 UTC
Re: Unofficial HBase Blog
Hi J-D,
Thanks for your blog!
We have an application running on Sybase, and now, we want to migrate this
application onto HBase. I'd like to know whether there is a plan for HBase
to develop a stardard(subset) ODBC/JDBC API?
Cheers!
Leitao Guo from ChinaMobile
2008/8/30 Jean-Daniel Cryans <jd...@apache.org>
> Hi community,
>
> In a move to better inform the new and current users of HBase, I decided to
> start a blog. For the moment, this will be personal project where I will
> share my thoughts, tricks and other useful stuff. You can find it here:
>
> http://jdcryans.blogspot.com/
>
> Happy hbasing!
>
> J-D
>
RE: Unofficial HBase Blog
Posted by Jim Kellerman <ji...@powerset.com>.
The closest that HBase will come to implementing joins, etc., will be a connector to PIG which will then be able to use HBase as a source and a sink.
---
Jim Kellerman, Senior Software Development Engineer
Powerset (Live Search, Microsoft Corporation)
> -----Original Message-----
> From: Guo Leitao [mailto:leitao.guo@gmail.com]
> Sent: Monday, September 01, 2008 6:37 PM
> To: hbase-user@hadoop.apache.org
> Subject: Re: Unofficial HBase Blog
>
> Hi J-D,
>
> Sorry to hear that there is no plan for HBase to develop JDBC/ODBC API.
> Actually, we are now trying to implement some SQL function on Bigtable
> (HBase or Hypertable implementation, not deceide which one is suitable for
> us), such as JOIN/GROUP/SORT/COUNT.
>
> Is there any plan for Hbase to implement such functions?
>
> Many thanks!
>
> Leitao
>
>
> 2008/9/1 Jean-Daniel Cryans <jd...@apache.org>
>
> > Leitao,
> >
> > A JDBC plugin is not currently planned and I'm not sure that it would be in
> > the best interest for HBase users. The shift in paradigm requires moving
> > OLAP (or any complicated query) to MapReduce which is offline and where
> > JDBC
> > won't be of any use. It may also mislead new users into thinking that HBase
> > is relational.
> >
> > But, if anyone in the community did code a JDBC plugin, I'm sure we could
> > put it in a "contrib" folder in HBase distribution.
> >
> > I think that a nice alternative for you would be to abstract database
> > interactions behind some database access objects (DAO) if it's not already
> > your situation. This way your developers unfamiliar with HBase would be
> > shielded from the new API.
> >
> > Regards,
> >
> > J-D
> >
> > On Mon, Sep 1, 2008 at 4:07 AM, Guo Leitao <le...@gmail.com> wrote:
> >
> > > Hi J-D,
> > >
> > > Thanks for your blog!
> > >
> > > We have an application running on Sybase, and now, we want to migrate
> > this
> > > application onto HBase. I'd like to know whether there is a plan for
> > HBase
> > > to develop a stardard(subset) ODBC/JDBC API?
> > >
> > > Cheers!
> > >
> > > Leitao Guo from ChinaMobile
> > >
> > > 2008/8/30 Jean-Daniel Cryans <jd...@apache.org>
> > >
> > > > Hi community,
> > > >
> > > > In a move to better inform the new and current users of HBase, I
> > decided
> > > to
> > > > start a blog. For the moment, this will be personal project where I
> > will
> > > > share my thoughts, tricks and other useful stuff. You can find it here:
> > > >
> > > > http://jdcryans.blogspot.com/
> > > >
> > > > Happy hbasing!
> > > >
> > > > J-D
> > > >
> > >
> >
RE: Unofficial HBase Blog
Posted by Jonathan Gray <jl...@streamy.com>.
Leitao,
That type of functionality can and is being used with HBase, but not at all
as a fully integrated part of HBase. Joins and sorts are not part of
BigTable or HBase "out of the box" because that type of functionality is not
what the column-oriented data model is about.
There was a discussion on this list last week that went into detail about
the differences of HBase and relational databases. Reading those posts
might give some clarity as to why this is.
Of course this functionality is what many want/need, so there are some
solutions today (Lucene indexing, etc) with more likely down the road as the
number of contributors and users grow.
The solution for many is to build an logic layer on top of HBase that can
perform these joins/sorts/etc, often combined with some type of cache to
compensate for HBase's relatively poor random-read performance.
Jonathan Gray
-----Original Message-----
From: Guo Leitao [mailto:leitao.guo@gmail.com]
Sent: Monday, September 01, 2008 6:37 PM
To: hbase-user@hadoop.apache.org
Subject: Re: Unofficial HBase Blog
Hi J-D,
Sorry to hear that there is no plan for HBase to develop JDBC/ODBC API.
Actually, we are now trying to implement some SQL function on Bigtable
(HBase or Hypertable implementation, not deceide which one is suitable for
us), such as JOIN/GROUP/SORT/COUNT.
Is there any plan for Hbase to implement such functions?
Many thanks!
Leitao
2008/9/1 Jean-Daniel Cryans <jd...@apache.org>
> Leitao,
>
> A JDBC plugin is not currently planned and I'm not sure that it would be
in
> the best interest for HBase users. The shift in paradigm requires moving
> OLAP (or any complicated query) to MapReduce which is offline and where
> JDBC
> won't be of any use. It may also mislead new users into thinking that
HBase
> is relational.
>
> But, if anyone in the community did code a JDBC plugin, I'm sure we could
> put it in a "contrib" folder in HBase distribution.
>
> I think that a nice alternative for you would be to abstract database
> interactions behind some database access objects (DAO) if it's not already
> your situation. This way your developers unfamiliar with HBase would be
> shielded from the new API.
>
> Regards,
>
> J-D
>
> On Mon, Sep 1, 2008 at 4:07 AM, Guo Leitao <le...@gmail.com> wrote:
>
> > Hi J-D,
> >
> > Thanks for your blog!
> >
> > We have an application running on Sybase, and now, we want to migrate
> this
> > application onto HBase. I'd like to know whether there is a plan for
> HBase
> > to develop a stardard(subset) ODBC/JDBC API?
> >
> > Cheers!
> >
> > Leitao Guo from ChinaMobile
> >
> > 2008/8/30 Jean-Daniel Cryans <jd...@apache.org>
> >
> > > Hi community,
> > >
> > > In a move to better inform the new and current users of HBase, I
> decided
> > to
> > > start a blog. For the moment, this will be personal project where I
> will
> > > share my thoughts, tricks and other useful stuff. You can find it
here:
> > >
> > > http://jdcryans.blogspot.com/
> > >
> > > Happy hbasing!
> > >
> > > J-D
> > >
> >
>
Re: Unofficial HBase Blog
Posted by Andrew Purtell <ap...@yahoo.com>.
Guo,
> From: Guo Leitao <le...@gmail.com>
> Subject: Re: Unofficial HBase Blog
> To: hbase-user@hadoop.apache.org
> Date: Monday, September 1, 2008, 6:37 PM
[...]
> Actually, we are now trying to implement some SQL function
> on Bigtable (HBase or Hypertable implementation, not deceide
> which one is suitable for us), such as JOIN/GROUP/SORT/COUNT.
You may wish to look at JAQL (www.jaql.org) -- It implements
the functions you list on top of HBase among other options.
May I humbly suggest that rather than reimplement these
functions again perhaps you may consider contacting the JAQL
folks at IBM and inquiring if they can use your assistance.
There is also HIVE, from Facebook, contributed to Hadoop. See
https://issues.apache.org/jira/browse/HADOOP-3601 . From the
issue: "HIVE is a data Warehouse built on top of Hadoop that
enables structuring Hadoop files as tables and partitions and
allows users to query this data through a SQL like language
using a command line interface."
- Andy
Re: Unofficial HBase Blog
Posted by Guo Leitao <le...@gmail.com>.
Hi J-D,
Sorry to hear that there is no plan for HBase to develop JDBC/ODBC API.
Actually, we are now trying to implement some SQL function on Bigtable
(HBase or Hypertable implementation, not deceide which one is suitable for
us), such as JOIN/GROUP/SORT/COUNT.
Is there any plan for Hbase to implement such functions?
Many thanks!
Leitao
2008/9/1 Jean-Daniel Cryans <jd...@apache.org>
> Leitao,
>
> A JDBC plugin is not currently planned and I'm not sure that it would be in
> the best interest for HBase users. The shift in paradigm requires moving
> OLAP (or any complicated query) to MapReduce which is offline and where
> JDBC
> won't be of any use. It may also mislead new users into thinking that HBase
> is relational.
>
> But, if anyone in the community did code a JDBC plugin, I'm sure we could
> put it in a "contrib" folder in HBase distribution.
>
> I think that a nice alternative for you would be to abstract database
> interactions behind some database access objects (DAO) if it's not already
> your situation. This way your developers unfamiliar with HBase would be
> shielded from the new API.
>
> Regards,
>
> J-D
>
> On Mon, Sep 1, 2008 at 4:07 AM, Guo Leitao <le...@gmail.com> wrote:
>
> > Hi J-D,
> >
> > Thanks for your blog!
> >
> > We have an application running on Sybase, and now, we want to migrate
> this
> > application onto HBase. I'd like to know whether there is a plan for
> HBase
> > to develop a stardard(subset) ODBC/JDBC API?
> >
> > Cheers!
> >
> > Leitao Guo from ChinaMobile
> >
> > 2008/8/30 Jean-Daniel Cryans <jd...@apache.org>
> >
> > > Hi community,
> > >
> > > In a move to better inform the new and current users of HBase, I
> decided
> > to
> > > start a blog. For the moment, this will be personal project where I
> will
> > > share my thoughts, tricks and other useful stuff. You can find it here:
> > >
> > > http://jdcryans.blogspot.com/
> > >
> > > Happy hbasing!
> > >
> > > J-D
> > >
> >
>
Re: Unofficial HBase Blog
Posted by Jean-Daniel Cryans <jd...@apache.org>.
Leitao,
A JDBC plugin is not currently planned and I'm not sure that it would be in
the best interest for HBase users. The shift in paradigm requires moving
OLAP (or any complicated query) to MapReduce which is offline and where JDBC
won't be of any use. It may also mislead new users into thinking that HBase
is relational.
But, if anyone in the community did code a JDBC plugin, I'm sure we could
put it in a "contrib" folder in HBase distribution.
I think that a nice alternative for you would be to abstract database
interactions behind some database access objects (DAO) if it's not already
your situation. This way your developers unfamiliar with HBase would be
shielded from the new API.
Regards,
J-D
On Mon, Sep 1, 2008 at 4:07 AM, Guo Leitao <le...@gmail.com> wrote:
> Hi J-D,
>
> Thanks for your blog!
>
> We have an application running on Sybase, and now, we want to migrate this
> application onto HBase. I'd like to know whether there is a plan for HBase
> to develop a stardard(subset) ODBC/JDBC API?
>
> Cheers!
>
> Leitao Guo from ChinaMobile
>
> 2008/8/30 Jean-Daniel Cryans <jd...@apache.org>
>
> > Hi community,
> >
> > In a move to better inform the new and current users of HBase, I decided
> to
> > start a blog. For the moment, this will be personal project where I will
> > share my thoughts, tricks and other useful stuff. You can find it here:
> >
> > http://jdcryans.blogspot.com/
> >
> > Happy hbasing!
> >
> > J-D
> >
>