You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by 刘祥龙 <sa...@hotmail.com> on 2009/09/03 10:53:01 UTC
questions about hbase tables operations
Hi, I want to make sure which tools can be used to query HBase tables, like HBase shell. Is pig integrated with Hbase, so it can support some query and other operations like create\write\append to HBase tables.
I found PIG6(http://issues.apache.org/jira/browse/PIG-6) tried to solve similar problems, but I don't know when this new feature and more similar features will be released in new version of pig.
Also I want to be clear that how powerful of HBase shell. It seems that there are not many operations, so if lots of data expected to store into HBase, does it can work effectively. I am surveying on this problems. Does anyone can help me? Thanks a lot!
Best Wishes!
_____________________________________________________________
Liu Xianglong
Re: questions about hbase tables operations
Posted by Liu Xianglong <sa...@hotmail.com>.
Hi, Jean-Daniel Cryans. Thanks for you reply. You mean live web sites use
three APIs. So I wander that how a search engine like Google works to
correspond to the query. Do engineers implement a Map-Reduce program based
these APIs to search in HBase and return the results to the user?
Thanks
--------------------------------------------------
From: "Jean-Daniel Cryans" <jd...@apache.org>
Sent: Thursday, September 03, 2009 11:52 PM
To: <hb...@hadoop.apache.org>
Subject: Re: questions about hbase tables operations
> I know that PS use the REST API, probably others, and they have MR
> jobs. Stack could tell more.
>
> So a typical system using HBase has a lot of data that doesn't fit
> will inside a RDBMS. You have to shard, denormalize, break the joins,
> etc. So HBase can be used for a live web site via one of its API: the
> native Java, the Thrift and the REST API. You can do operations like
> increments, gets, puts, deletes and scans. If you need to batch
> process your data, you do it with MR. The Bigtable paper gives good
> examples of that kind of usage.
>
> J-D
>
> 2009/9/3 刘祥龙 <sa...@hotmail.com>:
>> I want to find out how the applications like powerset use HBase? Should
>> these applications work based on HBase's API and map-reduce or they use
>> other tools like pig/hive to process data?
>> Furthermore, what about live queries?
>>
>> --------------------------------------------------
>> From: "Jean-Daniel Cryans" <jd...@apache.org>
>> Sent: Thursday, September 03, 2009 11:38 PM
>> To: <hb...@hadoop.apache.org>; <hb...@hadoop.apache.org>
>> Subject: Re: questions about hbase tables operations
>>
>>> This questions belongs to the user mailing list btw.
>>>
>>> I do not use Pig so I can't comment on it, but what will really do
>>> with HBase is making it easy to do batch processing on HBase tables.
>>> No live queries.
>>>
>>> What do you want to do with the shell? The commands proposed there are
>>> for admin purposes. What operations are you searching for?
>>>
>>> J-D
>>>
>>> 2009/9/3 刘祥龙 <sa...@hotmail.com>:
>>>>
>>>> Hi, I want to make sure which tools can be used to query HBase tables,
>>>> like HBase shell. Is pig integrated with Hbase, so it can support some
>>>> query and other operations like create\write\append to HBase tables.
>>>> I found PIG6(http://issues.apache.org/jira/browse/PIG-6) tried to solve
>>>> similar problems, but I don't know when this new feature and more
>>>> similar
>>>> features will be released in new version of pig.
>>>>
>>>> Also I want to be clear that how powerful of HBase shell. It seems that
>>>> there are not many operations, so if lots of data expected to store
>>>> into
>>>> HBase, does it can work effectively. I am surveying on this problems.
>>>> Does
>>>> anyone can help me? Thanks a lot!
>>>>
>>>> Best Wishes!
>>>> _____________________________________________________________
>>>>
>>>> Liu Xianglong
>>>>
>>>>
>>>
>>
>
Re: questions about hbase tables operations
Posted by Jean-Daniel Cryans <jd...@apache.org>.
The native Java API, but if you are, let's say, building a site in
ruby, then you need to use the other ones (unless you fancy jruby).
J-D
2009/9/3 刘祥龙 <sa...@hotmail.com>:
> I am more clear about HBase, thanks a lot. So which API of the
> native Java, the Thrift and the REST API is used more widely or which is
> more powerful?
>
> --------------------------------------------------
> From: "Jean-Daniel Cryans" <jd...@apache.org>
> Sent: Thursday, September 03, 2009 11:52 PM
> To: <hb...@hadoop.apache.org>
> Subject: Re: questions about hbase tables operations
>
>> I know that PS use the REST API, probably others, and they have MR
>> jobs. Stack could tell more.
>>
>> So a typical system using HBase has a lot of data that doesn't fit
>> will inside a RDBMS. You have to shard, denormalize, break the joins,
>> etc. So HBase can be used for a live web site via one of its API: the
>> native Java, the Thrift and the REST API. You can do operations like
>> increments, gets, puts, deletes and scans. If you need to batch
>> process your data, you do it with MR. The Bigtable paper gives good
>> examples of that kind of usage.
>>
>> J-D
>>
>> 2009/9/3 刘祥龙 <sa...@hotmail.com>:
>>>
>>> I want to find out how the applications like powerset use HBase? Should
>>> these applications work based on HBase's API and map-reduce or they use
>>> other tools like pig/hive to process data?
>>> Furthermore, what about live queries?
>>>
>>> --------------------------------------------------
>>> From: "Jean-Daniel Cryans" <jd...@apache.org>
>>> Sent: Thursday, September 03, 2009 11:38 PM
>>> To: <hb...@hadoop.apache.org>; <hb...@hadoop.apache.org>
>>> Subject: Re: questions about hbase tables operations
>>>
>>>> This questions belongs to the user mailing list btw.
>>>>
>>>> I do not use Pig so I can't comment on it, but what will really do
>>>> with HBase is making it easy to do batch processing on HBase tables.
>>>> No live queries.
>>>>
>>>> What do you want to do with the shell? The commands proposed there are
>>>> for admin purposes. What operations are you searching for?
>>>>
>>>> J-D
>>>>
>>>> 2009/9/3 刘祥龙 <sa...@hotmail.com>:
>>>>>
>>>>> Hi, I want to make sure which tools can be used to query HBase tables,
>>>>> like HBase shell. Is pig integrated with Hbase, so it can support some
>>>>> query and other operations like create\write\append to HBase tables.
>>>>> I found PIG6(http://issues.apache.org/jira/browse/PIG-6) tried to solve
>>>>> similar problems, but I don't know when this new feature and more
>>>>> similar
>>>>> features will be released in new version of pig.
>>>>>
>>>>> Also I want to be clear that how powerful of HBase shell. It seems that
>>>>> there are not many operations, so if lots of data expected to store
>>>>> into
>>>>> HBase, does it can work effectively. I am surveying on this problems.
>>>>> Does
>>>>> anyone can help me? Thanks a lot!
>>>>>
>>>>> Best Wishes!
>>>>> _____________________________________________________________
>>>>>
>>>>> Liu Xianglong
>>>>>
>>>>>
>>>>
>>>
>>
>
Re: questions about hbase tables operations
Posted by 刘祥龙 <sa...@hotmail.com>.
I am more clear about HBase, thanks a lot. So which API of the
native Java, the Thrift and the REST API is used more widely or which is
more powerful?
--------------------------------------------------
From: "Jean-Daniel Cryans" <jd...@apache.org>
Sent: Thursday, September 03, 2009 11:52 PM
To: <hb...@hadoop.apache.org>
Subject: Re: questions about hbase tables operations
> I know that PS use the REST API, probably others, and they have MR
> jobs. Stack could tell more.
>
> So a typical system using HBase has a lot of data that doesn't fit
> will inside a RDBMS. You have to shard, denormalize, break the joins,
> etc. So HBase can be used for a live web site via one of its API: the
> native Java, the Thrift and the REST API. You can do operations like
> increments, gets, puts, deletes and scans. If you need to batch
> process your data, you do it with MR. The Bigtable paper gives good
> examples of that kind of usage.
>
> J-D
>
> 2009/9/3 刘祥龙 <sa...@hotmail.com>:
>> I want to find out how the applications like powerset use HBase? Should
>> these applications work based on HBase's API and map-reduce or they use
>> other tools like pig/hive to process data?
>> Furthermore, what about live queries?
>>
>> --------------------------------------------------
>> From: "Jean-Daniel Cryans" <jd...@apache.org>
>> Sent: Thursday, September 03, 2009 11:38 PM
>> To: <hb...@hadoop.apache.org>; <hb...@hadoop.apache.org>
>> Subject: Re: questions about hbase tables operations
>>
>>> This questions belongs to the user mailing list btw.
>>>
>>> I do not use Pig so I can't comment on it, but what will really do
>>> with HBase is making it easy to do batch processing on HBase tables.
>>> No live queries.
>>>
>>> What do you want to do with the shell? The commands proposed there are
>>> for admin purposes. What operations are you searching for?
>>>
>>> J-D
>>>
>>> 2009/9/3 刘祥龙 <sa...@hotmail.com>:
>>>>
>>>> Hi, I want to make sure which tools can be used to query HBase tables,
>>>> like HBase shell. Is pig integrated with Hbase, so it can support some
>>>> query and other operations like create\write\append to HBase tables.
>>>> I found PIG6(http://issues.apache.org/jira/browse/PIG-6) tried to solve
>>>> similar problems, but I don't know when this new feature and more
>>>> similar
>>>> features will be released in new version of pig.
>>>>
>>>> Also I want to be clear that how powerful of HBase shell. It seems that
>>>> there are not many operations, so if lots of data expected to store
>>>> into
>>>> HBase, does it can work effectively. I am surveying on this problems.
>>>> Does
>>>> anyone can help me? Thanks a lot!
>>>>
>>>> Best Wishes!
>>>> _____________________________________________________________
>>>>
>>>> Liu Xianglong
>>>>
>>>>
>>>
>>
>
Re: questions about hbase tables operations
Posted by Jean-Daniel Cryans <jd...@apache.org>.
I know that PS use the REST API, probably others, and they have MR
jobs. Stack could tell more.
So a typical system using HBase has a lot of data that doesn't fit
will inside a RDBMS. You have to shard, denormalize, break the joins,
etc. So HBase can be used for a live web site via one of its API: the
native Java, the Thrift and the REST API. You can do operations like
increments, gets, puts, deletes and scans. If you need to batch
process your data, you do it with MR. The Bigtable paper gives good
examples of that kind of usage.
J-D
2009/9/3 刘祥龙 <sa...@hotmail.com>:
> I want to find out how the applications like powerset use HBase? Should
> these applications work based on HBase's API and map-reduce or they use
> other tools like pig/hive to process data?
> Furthermore, what about live queries?
>
> --------------------------------------------------
> From: "Jean-Daniel Cryans" <jd...@apache.org>
> Sent: Thursday, September 03, 2009 11:38 PM
> To: <hb...@hadoop.apache.org>; <hb...@hadoop.apache.org>
> Subject: Re: questions about hbase tables operations
>
>> This questions belongs to the user mailing list btw.
>>
>> I do not use Pig so I can't comment on it, but what will really do
>> with HBase is making it easy to do batch processing on HBase tables.
>> No live queries.
>>
>> What do you want to do with the shell? The commands proposed there are
>> for admin purposes. What operations are you searching for?
>>
>> J-D
>>
>> 2009/9/3 刘祥龙 <sa...@hotmail.com>:
>>>
>>> Hi, I want to make sure which tools can be used to query HBase tables,
>>> like HBase shell. Is pig integrated with Hbase, so it can support some
>>> query and other operations like create\write\append to HBase tables.
>>> I found PIG6(http://issues.apache.org/jira/browse/PIG-6) tried to solve
>>> similar problems, but I don't know when this new feature and more similar
>>> features will be released in new version of pig.
>>>
>>> Also I want to be clear that how powerful of HBase shell. It seems that
>>> there are not many operations, so if lots of data expected to store into
>>> HBase, does it can work effectively. I am surveying on this problems. Does
>>> anyone can help me? Thanks a lot!
>>>
>>> Best Wishes!
>>> _____________________________________________________________
>>>
>>> Liu Xianglong
>>>
>>>
>>
>
Re: questions about hbase tables operations
Posted by 刘祥龙 <sa...@hotmail.com>.
I want to find out how the applications like powerset use HBase? Should
these applications work based on HBase's API and map-reduce or they use
other tools like pig/hive to process data?
Furthermore, what about live queries?
--------------------------------------------------
From: "Jean-Daniel Cryans" <jd...@apache.org>
Sent: Thursday, September 03, 2009 11:38 PM
To: <hb...@hadoop.apache.org>; <hb...@hadoop.apache.org>
Subject: Re: questions about hbase tables operations
> This questions belongs to the user mailing list btw.
>
> I do not use Pig so I can't comment on it, but what will really do
> with HBase is making it easy to do batch processing on HBase tables.
> No live queries.
>
> What do you want to do with the shell? The commands proposed there are
> for admin purposes. What operations are you searching for?
>
> J-D
>
> 2009/9/3 刘祥龙 <sa...@hotmail.com>:
>> Hi, I want to make sure which tools can be used to query HBase tables,
>> like HBase shell. Is pig integrated with Hbase, so it can support some
>> query and other operations like create\write\append to HBase tables.
>> I found PIG6(http://issues.apache.org/jira/browse/PIG-6) tried to solve
>> similar problems, but I don't know when this new feature and more similar
>> features will be released in new version of pig.
>>
>> Also I want to be clear that how powerful of HBase shell. It seems that
>> there are not many operations, so if lots of data expected to store into
>> HBase, does it can work effectively. I am surveying on this problems.
>> Does anyone can help me? Thanks a lot!
>>
>> Best Wishes!
>> _____________________________________________________________
>>
>> Liu Xianglong
>>
>>
>
Re: questions about hbase tables operations
Posted by Jean-Daniel Cryans <jd...@apache.org>.
This questions belongs to the user mailing list btw.
I do not use Pig so I can't comment on it, but what will really do
with HBase is making it easy to do batch processing on HBase tables.
No live queries.
What do you want to do with the shell? The commands proposed there are
for admin purposes. What operations are you searching for?
J-D
2009/9/3 刘祥龙 <sa...@hotmail.com>:
> Hi, I want to make sure which tools can be used to query HBase tables, like HBase shell. Is pig integrated with Hbase, so it can support some query and other operations like create\write\append to HBase tables.
> I found PIG6(http://issues.apache.org/jira/browse/PIG-6) tried to solve similar problems, but I don't know when this new feature and more similar features will be released in new version of pig.
>
> Also I want to be clear that how powerful of HBase shell. It seems that there are not many operations, so if lots of data expected to store into HBase, does it can work effectively. I am surveying on this problems. Does anyone can help me? Thanks a lot!
>
> Best Wishes!
> _____________________________________________________________
>
> Liu Xianglong
>
>
Re: questions about hbase tables operations
Posted by Jean-Daniel Cryans <jd...@apache.org>.
This questions belongs to the user mailing list btw.
I do not use Pig so I can't comment on it, but what will really do
with HBase is making it easy to do batch processing on HBase tables.
No live queries.
What do you want to do with the shell? The commands proposed there are
for admin purposes. What operations are you searching for?
J-D
2009/9/3 刘祥龙 <sa...@hotmail.com>:
> Hi, I want to make sure which tools can be used to query HBase tables, like HBase shell. Is pig integrated with Hbase, so it can support some query and other operations like create\write\append to HBase tables.
> I found PIG6(http://issues.apache.org/jira/browse/PIG-6) tried to solve similar problems, but I don't know when this new feature and more similar features will be released in new version of pig.
>
> Also I want to be clear that how powerful of HBase shell. It seems that there are not many operations, so if lots of data expected to store into HBase, does it can work effectively. I am surveying on this problems. Does anyone can help me? Thanks a lot!
>
> Best Wishes!
> _____________________________________________________________
>
> Liu Xianglong
>
>