You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@accumulo.apache.org by "John Vines (Created) (JIRA)" <ji...@apache.org> on 2012/01/20 19:56:40 UTC
[jira] [Created] (ACCUMULO-338) Combiners lose data when reading
off of disk
Combiners lose data when reading off of disk
--------------------------------------------
Key: ACCUMULO-338
URL: https://issues.apache.org/jira/browse/ACCUMULO-338
Project: Accumulo
Issue Type: Bug
Affects Versions: 1.4.0
Reporter: John Vines
Assignee: Billie Rinaldi
Fix For: 1.4.0
There is a bug with Combiners in 1.4 resulting in bad data-
to recreate-
createtable test;
config -t test -s table.iterator.minc.vers=10
config -t test -s table.iterator.majc.vers=10
config -t test -s table.iterator.scan.vers=10
insert r f q 1
insert r f q 2
insert r f q 3
setiter -class org.apache.accumulo.core.iterators.user.SummingCombiner -scan -n summer -p 60 -t test
true
STRING
scan
flush
scan
deleteiter -t test -n summer -scan
scan
You will see all three values the first scan, 6 for the second scan, 4 for the third scan, and all three values for the 4th scan. In debug I saw teh values 2, 1, and 1 in that order in the Viterator.next method.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (ACCUMULO-338) Combiners lose data when reading
off of disk
Posted by "Billie Rinaldi (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/ACCUMULO-338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13190024#comment-13190024 ]
Billie Rinaldi commented on ACCUMULO-338:
-----------------------------------------
We tracked this down to reuse of Value objects by the RFile. Combiner should make a copy of the Values. I'll make a functional test for this, too. Nice catch, John!
> Combiners lose data when reading off of disk
> --------------------------------------------
>
> Key: ACCUMULO-338
> URL: https://issues.apache.org/jira/browse/ACCUMULO-338
> Project: Accumulo
> Issue Type: Bug
> Affects Versions: 1.4.0
> Reporter: John Vines
> Assignee: Billie Rinaldi
> Fix For: 1.4.0
>
>
> There is a bug with Combiners in 1.4 resulting in bad data-
> to recreate-
> createtable test;
> config -t test -s table.iterator.minc.vers=10
> config -t test -s table.iterator.majc.vers=10
> config -t test -s table.iterator.scan.vers=10
> insert r f q 1
> insert r f q 2
> insert r f q 3
> setiter -class org.apache.accumulo.core.iterators.user.SummingCombiner -scan -n summer -p 60 -t test
> true
> STRING
> scan
> flush
> scan
> deleteiter -t test -n summer -scan
> scan
> You will see all three values the first scan, 6 for the second scan, 4 for the third scan, and all three values for the 4th scan. In debug I saw teh values 2, 1, and 1 in that order in the Viterator.next method.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (ACCUMULO-338) Combiners lose data when reading
off of disk
Posted by "Billie Rinaldi (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/ACCUMULO-338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Billie Rinaldi updated ACCUMULO-338:
------------------------------------
Affects Version/s: (was: 1.4.0)
> Combiners lose data when reading off of disk
> --------------------------------------------
>
> Key: ACCUMULO-338
> URL: https://issues.apache.org/jira/browse/ACCUMULO-338
> Project: Accumulo
> Issue Type: Bug
> Reporter: John Vines
> Assignee: Billie Rinaldi
> Fix For: 1.4.0
>
>
> There is a bug with Combiners in 1.4 resulting in bad data-
> to recreate-
> createtable test;
> config -t test -s table.iterator.minc.vers=10
> config -t test -s table.iterator.majc.vers=10
> config -t test -s table.iterator.scan.vers=10
> insert r f q 1
> insert r f q 2
> insert r f q 3
> setiter -class org.apache.accumulo.core.iterators.user.SummingCombiner -scan -n summer -p 60 -t test
> true
> STRING
> scan
> flush
> scan
> deleteiter -t test -n summer -scan
> scan
> You will see all three values the first scan, 6 for the second scan, 4 for the third scan, and all three values for the 4th scan. In debug I saw teh values 2, 1, and 1 in that order in the Viterator.next method.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (ACCUMULO-338) Combiners lose data when reading
off of disk
Posted by "Billie Rinaldi (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/ACCUMULO-338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Billie Rinaldi resolved ACCUMULO-338.
-------------------------------------
Resolution: Fixed
> Combiners lose data when reading off of disk
> --------------------------------------------
>
> Key: ACCUMULO-338
> URL: https://issues.apache.org/jira/browse/ACCUMULO-338
> Project: Accumulo
> Issue Type: Bug
> Reporter: John Vines
> Assignee: Billie Rinaldi
> Fix For: 1.4.0
>
>
> There is a bug with Combiners in 1.4 resulting in bad data-
> to recreate-
> createtable test;
> config -t test -s table.iterator.minc.vers=10
> config -t test -s table.iterator.majc.vers=10
> config -t test -s table.iterator.scan.vers=10
> insert r f q 1
> insert r f q 2
> insert r f q 3
> setiter -class org.apache.accumulo.core.iterators.user.SummingCombiner -scan -n summer -p 60 -t test
> true
> STRING
> scan
> flush
> scan
> deleteiter -t test -n summer -scan
> scan
> You will see all three values the first scan, 6 for the second scan, 4 for the third scan, and all three values for the 4th scan. In debug I saw teh values 2, 1, and 1 in that order in the Viterator.next method.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira