You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Mrudula Madiraju <mr...@yahoo.com> on 2013/12/02 08:28:45 UTC
Consequent deletes more than ~256 rows not working
Hi,
I have a simple hbase table of approx. 1000 rows.
If I invoke the htable.delete() on this table in a while loop - it doesn't throw any error or exception.
But at the end of operation - I see that it has actually deleted only about 256 rows.
Repeating the operation deletes another 256 or so. And finally after 3 or 4 runs , all rows finally get deleted.
This is true of htable.batch API or even htable.delete API.
Have tried changing ulimit/nproc settings, invoking flush, setting autocommit, invoking major Compact
Also waited out - That is to see if after 5 minutes of first run delete will complete in background. Nothing works.
Searched the mailing list and see that there are threads on delete followed by put not working etc.
But this is a different case.
Anyone who knows what's happening? Looking forward to any pointers!
Regards,
Mrudula
Re: Consequent deletes more than ~256 rows not working
Posted by Mrudula Madiraju <mr...@yahoo.com>.
The issue is with my code. Something to do with cache that I was using to store the rowkeys.
Thanks Anyway!
Regards,
Mrudula
On Tuesday, 3 December 2013 4:34 AM, Ted Yu <yu...@gmail.com> wrote:
Which HBase release are you using ?
In your while loop, you used the same set of row keys for each attempt ?
Thanks
On Sun, Dec 1, 2013 at 11:28 PM, Mrudula Madiraju <mr...@yahoo.com> wrote:
Hi,
>
>I have a simple hbase table of approx. 1000 rows.
>If I invoke the htable.delete() on this table in a while loop - it doesn't throw any error or exception.
>But at the end of operation - I see that it has actually deleted only about 256 rows.
>Repeating the operation deletes another 256 or so. And finally after 3 or 4 runs , all rows finally get deleted.
>
>This is true of htable.batch API or even htable.delete API.
>
>Have tried changing ulimit/nproc settings, invoking flush, setting autocommit, invoking major Compact
>Also waited out - That is to see if after 5 minutes of first run delete will complete in background. Nothing works.
>
>Searched the mailing list and see that there are threads on delete followed by put not working etc.
>But this is a different case.
>
>Anyone who knows what's happening? Looking forward to any pointers!
>
>Regards,
>Mrudula
Re: Consequent deletes more than ~256 rows not working
Posted by Azuryy Yu <az...@gmail.com>.
It would be better paste a piece of your code.
On Tue, Dec 3, 2013 at 7:04 AM, Ted Yu <yu...@gmail.com> wrote:
> Which HBase release are you using ?
>
> In your while loop, you used the same set of row keys for each attempt ?
>
> Thanks
>
>
> On Sun, Dec 1, 2013 at 11:28 PM, Mrudula Madiraju <
> mrudulamadiraju@yahoo.com
> > wrote:
>
> > Hi,
> >
> > I have a simple hbase table of approx. 1000 rows.
> > If I invoke the htable.delete() on this table in a while loop - it
> doesn't
> > throw any error or exception.
> > But at the end of operation - I see that it has actually deleted only
> > about 256 rows.
> > Repeating the operation deletes another 256 or so. And finally after 3 or
> > 4 runs , all rows finally get deleted.
> >
> > This is true of htable.batch API or even htable.delete API.
> >
> > Have tried changing ulimit/nproc settings, invoking flush, setting
> > autocommit, invoking major Compact
> > Also waited out - That is to see if after 5 minutes of first run delete
> > will complete in background. Nothing works.
> >
> > Searched the mailing list and see that there are threads on delete
> > followed by put not working etc.
> > But this is a different case.
> >
> > Anyone who knows what's happening? Looking forward to any pointers!
> >
> > Regards,
> > Mrudula
>
Re: Consequent deletes more than ~256 rows not working
Posted by Ted Yu <yu...@gmail.com>.
Which HBase release are you using ?
In your while loop, you used the same set of row keys for each attempt ?
Thanks
On Sun, Dec 1, 2013 at 11:28 PM, Mrudula Madiraju <mrudulamadiraju@yahoo.com
> wrote:
> Hi,
>
> I have a simple hbase table of approx. 1000 rows.
> If I invoke the htable.delete() on this table in a while loop - it doesn't
> throw any error or exception.
> But at the end of operation - I see that it has actually deleted only
> about 256 rows.
> Repeating the operation deletes another 256 or so. And finally after 3 or
> 4 runs , all rows finally get deleted.
>
> This is true of htable.batch API or even htable.delete API.
>
> Have tried changing ulimit/nproc settings, invoking flush, setting
> autocommit, invoking major Compact
> Also waited out - That is to see if after 5 minutes of first run delete
> will complete in background. Nothing works.
>
> Searched the mailing list and see that there are threads on delete
> followed by put not working etc.
> But this is a different case.
>
> Anyone who knows what's happening? Looking forward to any pointers!
>
> Regards,
> Mrudula