You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@accumulo.apache.org by Konstantin Pelykh <kp...@gmail.com> on 2015/06/17 00:26:52 UTC
RowDeletingIterator returns deleted records when cq is specified
It seem that there might be a bug in RowDeletingIterator:
after using RowDeletingIterator I get expected results when querying by
rowId and CF, e.g.
scan -b myrowid -c field/abc -t table <---- doesn't return deleted rows as
expected
however if I add column qualified to the query, I see deleted items.
scan -b myrowid -c field/abc:sample_qualifier -t table <-- returns deleted
rows
After major compaction the problem goes away.
Is it expected behavior?
Konstantin
Re: RowDeletingIterator returns deleted records when cq is specified
Posted by Eric Newton <er...@gmail.com>.
I've created ACCUMULO-3905
<https://issues.apache.org/jira/browse/ACCUMULO-3905> based on your
description.
-Eric
On Tue, Jun 16, 2015 at 6:26 PM, Konstantin Pelykh <kp...@gmail.com>
wrote:
> It seem that there might be a bug in RowDeletingIterator:
>
> after using RowDeletingIterator I get expected results when querying by
> rowId and CF, e.g.
>
> scan -b myrowid -c field/abc -t table <---- doesn't return deleted rows
> as expected
>
> however if I add column qualified to the query, I see deleted items.
>
> scan -b myrowid -c field/abc:sample_qualifier -t table <-- returns
> deleted rows
>
> After major compaction the problem goes away.
>
> Is it expected behavior?
>
> Konstantin
>
Re: RowDeletingIterator returns deleted records when cq is specified
Posted by Christopher <ct...@apache.org>.
I made a suggestion on the issue. It involves a change to the
underlying system iterator that I think might work. No change to
RowDeletingIterator will work, because it has no ability to inform the
underlying system iterator outside of changing the column families.
--
Christopher L Tubbs II
http://gravatar.com/ctubbsii
On Wed, Jun 17, 2015 at 4:02 PM, Josh Elser <jo...@gmail.com> wrote:
> Keith Turner wrote:
>>
>>
>>
>> On Wed, Jun 17, 2015 at 12:28 PM, Christopher <ctubbsii@apache.org
>> <ma...@apache.org>> wrote:
>>
>> Can you provide sample data which corresponds to these scan commands
>> to help reproduce it? Also, are you using any other iterators which
>> might be hiding the delete markers from this iterator at scan time?
>>
>>
>> I think an Accumulo system iterator is hiding the delete markers. I
>> made a comment on ACCUMULO-3905 about this.
>
>
> Assuming that this is the case (perhaps boldly assuming this), that would
> make the second user to be bitten by this. How can we improve this iterator
> to prevent this from happening in the future?
>
> Change RowDeletingIterator so that it always includes the empty cf/cq column
> in the fetched list?
Re: RowDeletingIterator returns deleted records when cq is specified
Posted by Josh Elser <jo...@gmail.com>.
Keith Turner wrote:
>
>
> On Wed, Jun 17, 2015 at 12:28 PM, Christopher <ctubbsii@apache.org
> <ma...@apache.org>> wrote:
>
> Can you provide sample data which corresponds to these scan commands
> to help reproduce it? Also, are you using any other iterators which
> might be hiding the delete markers from this iterator at scan time?
>
>
> I think an Accumulo system iterator is hiding the delete markers. I
> made a comment on ACCUMULO-3905 about this.
Assuming that this is the case (perhaps boldly assuming this), that
would make the second user to be bitten by this. How can we improve this
iterator to prevent this from happening in the future?
Change RowDeletingIterator so that it always includes the empty cf/cq
column in the fetched list?
Re: RowDeletingIterator returns deleted records when cq is specified
Posted by Keith Turner <ke...@deenlo.com>.
On Wed, Jun 17, 2015 at 12:28 PM, Christopher <ct...@apache.org> wrote:
> Can you provide sample data which corresponds to these scan commands
> to help reproduce it? Also, are you using any other iterators which
> might be hiding the delete markers from this iterator at scan time?
>
I think an Accumulo system iterator is hiding the delete markers. I made a
comment on ACCUMULO-3905 about this.
>
> --
> Christopher L Tubbs II
> http://gravatar.com/ctubbsii
>
>
> On Tue, Jun 16, 2015 at 6:26 PM, Konstantin Pelykh <kp...@gmail.com>
> wrote:
> > It seem that there might be a bug in RowDeletingIterator:
> >
> > after using RowDeletingIterator I get expected results when querying by
> > rowId and CF, e.g.
> >
> > scan -b myrowid -c field/abc -t table <---- doesn't return deleted rows
> as
> > expected
> >
> > however if I add column qualified to the query, I see deleted items.
> >
> > scan -b myrowid -c field/abc:sample_qualifier -t table <-- returns
> deleted
> > rows
> >
> > After major compaction the problem goes away.
> >
> > Is it expected behavior?
> >
> > Konstantin
>
Re: RowDeletingIterator returns deleted records when cq is specified
Posted by Christopher <ct...@apache.org>.
Can you provide sample data which corresponds to these scan commands
to help reproduce it? Also, are you using any other iterators which
might be hiding the delete markers from this iterator at scan time?
--
Christopher L Tubbs II
http://gravatar.com/ctubbsii
On Tue, Jun 16, 2015 at 6:26 PM, Konstantin Pelykh <kp...@gmail.com> wrote:
> It seem that there might be a bug in RowDeletingIterator:
>
> after using RowDeletingIterator I get expected results when querying by
> rowId and CF, e.g.
>
> scan -b myrowid -c field/abc -t table <---- doesn't return deleted rows as
> expected
>
> however if I add column qualified to the query, I see deleted items.
>
> scan -b myrowid -c field/abc:sample_qualifier -t table <-- returns deleted
> rows
>
> After major compaction the problem goes away.
>
> Is it expected behavior?
>
> Konstantin