You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Dingding Ye <ye...@gmail.com> on 2008/10/14 18:36:30 UTC
Possible to paginate the cells in row?
Hi.
There are many cells which shares the same column family in a row. I want to
do the pagination, is it possible?
Can i add the limit and offset options?
I have used the scanner but it paginated based on the row which returns the
whole cells in the row.
Thanks for the help.
Best regards.
sishen
RE: Possible to paginate the cells in row?
Posted by Jonathan Gray <jl...@streamy.com>.
You're correct. Unfortunately this is not yet possible, as far as I know.
If you have a need for it, all contributions are welcome! :)
-----Original Message-----
From: Dingding Ye [mailto:yedingding@gmail.com]
Sent: Wednesday, October 15, 2008 10:59 AM
To: hbase-user@hadoop.apache.org
Subject: Re: Possible to paginate the cells in row?
Thanks for the comment.
On Thu, Oct 16, 2008 at 12:45 AM, Jonathan Gray <jl...@streamy.com> wrote:
> There is not currently a way to page/scan/iterate through an individual
> column family, though this can certainly be emulated in your client code.
>
> Part of the reason for that is that a single row, single family is stored
> within a single file. So there would be no significant savings in only
Got it.
>
> retrieving part of the family at a time (besides network traffic).
yeah. But I think get parts of data at one time can save much memory usage
in the client side.
>
>
> Looking forward, once we have our own storage format, like TFile, we will
> be
> able to do real/optimized scanning through a family of columns by
> retrieving
> them in chunks rather than all at once.
>
> Support of millions of columns within a single row, single family is one
of
> the priorities but there are some other changes necessary before we can
> really get there.
>
>
> JG
>
> -----Original Message-----
> From: Dingding Ye [mailto:yedingding@gmail.com]
> Sent: Wednesday, October 15, 2008 8:45 AM
> To: hbase-user@hadoop.apache.org
> Subject: Re: Possible to paginate the cells in row?
>
> Is this an abuse way to use hbase?
>
> On Wed, Oct 15, 2008 at 12:36 AM, Dingding Ye <ye...@gmail.com>
> wrote:
>
> > Hi.
> >
> > There are many cells which shares the same column family in a row. I
want
> > to do the pagination, is it possible?
> > Can i add the limit and offset options?
> >
> > I have used the scanner but it paginated based on the row which returns
> the
> > whole cells in the row.
> >
> > Thanks for the help.
> >
> > Best regards.
> >
> > sishen
> >
>
>
Re: Possible to paginate the cells in row?
Posted by Dingding Ye <ye...@gmail.com>.
Thanks for the comment.
On Thu, Oct 16, 2008 at 12:45 AM, Jonathan Gray <jl...@streamy.com> wrote:
> There is not currently a way to page/scan/iterate through an individual
> column family, though this can certainly be emulated in your client code.
>
> Part of the reason for that is that a single row, single family is stored
> within a single file. So there would be no significant savings in only
Got it.
>
> retrieving part of the family at a time (besides network traffic).
yeah. But I think get parts of data at one time can save much memory usage
in the client side.
>
>
> Looking forward, once we have our own storage format, like TFile, we will
> be
> able to do real/optimized scanning through a family of columns by
> retrieving
> them in chunks rather than all at once.
>
> Support of millions of columns within a single row, single family is one of
> the priorities but there are some other changes necessary before we can
> really get there.
>
>
> JG
>
> -----Original Message-----
> From: Dingding Ye [mailto:yedingding@gmail.com]
> Sent: Wednesday, October 15, 2008 8:45 AM
> To: hbase-user@hadoop.apache.org
> Subject: Re: Possible to paginate the cells in row?
>
> Is this an abuse way to use hbase?
>
> On Wed, Oct 15, 2008 at 12:36 AM, Dingding Ye <ye...@gmail.com>
> wrote:
>
> > Hi.
> >
> > There are many cells which shares the same column family in a row. I want
> > to do the pagination, is it possible?
> > Can i add the limit and offset options?
> >
> > I have used the scanner but it paginated based on the row which returns
> the
> > whole cells in the row.
> >
> > Thanks for the help.
> >
> > Best regards.
> >
> > sishen
> >
>
>
RE: Possible to paginate the cells in row?
Posted by Jonathan Gray <jl...@streamy.com>.
There is not currently a way to page/scan/iterate through an individual
column family, though this can certainly be emulated in your client code.
Part of the reason for that is that a single row, single family is stored
within a single file. So there would be no significant savings in only
retrieving part of the family at a time (besides network traffic).
Looking forward, once we have our own storage format, like TFile, we will be
able to do real/optimized scanning through a family of columns by retrieving
them in chunks rather than all at once.
Support of millions of columns within a single row, single family is one of
the priorities but there are some other changes necessary before we can
really get there.
JG
-----Original Message-----
From: Dingding Ye [mailto:yedingding@gmail.com]
Sent: Wednesday, October 15, 2008 8:45 AM
To: hbase-user@hadoop.apache.org
Subject: Re: Possible to paginate the cells in row?
Is this an abuse way to use hbase?
On Wed, Oct 15, 2008 at 12:36 AM, Dingding Ye <ye...@gmail.com> wrote:
> Hi.
>
> There are many cells which shares the same column family in a row. I want
> to do the pagination, is it possible?
> Can i add the limit and offset options?
>
> I have used the scanner but it paginated based on the row which returns
the
> whole cells in the row.
>
> Thanks for the help.
>
> Best regards.
>
> sishen
>
Re: Possible to paginate the cells in row?
Posted by Dingding Ye <ye...@gmail.com>.
Is this an abuse way to use hbase?
On Wed, Oct 15, 2008 at 12:36 AM, Dingding Ye <ye...@gmail.com> wrote:
> Hi.
>
> There are many cells which shares the same column family in a row. I want
> to do the pagination, is it possible?
> Can i add the limit and offset options?
>
> I have used the scanner but it paginated based on the row which returns the
> whole cells in the row.
>
> Thanks for the help.
>
> Best regards.
>
> sishen
>