You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@accumulo.apache.org by "Josh Elser (Commented) (JIRA)" <ji...@apache.org> on 2012/01/31 05:38:10 UTC

[jira] [Commented] (ACCUMULO-354) Create combiners for wikisearch example

    [ https://issues.apache.org/jira/browse/ACCUMULO-354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13196693#comment-13196693 ] 

Josh Elser commented on ACCUMULO-354:
-------------------------------------

Tried to run the wikipedia ingest example on a single node Accumulo instance. Got the following error during the first minor compaction:

{code}
java.util.NoSuchElementException
	java.util.NoSuchElementException
		at org.apache.accumulo.core.iterators.TypedValueCombiner$VIterator.next(TypedValueCombiner.java:94)
		at org.apache.accumulo.examples.wikisearch.iterator.TextIndexCombiner.typedReduce(TextIndexCombiner.java:49)
		at org.apache.accumulo.examples.wikisearch.iterator.TextIndexCombiner.typedReduce(TextIndexCombiner.java:39)
		at org.apache.accumulo.core.iterators.TypedValueCombiner.reduce(TypedValueCombiner.java:187)
		at org.apache.accumulo.core.iterators.Combiner.findTop(Combiner.java:164)
		at org.apache.accumulo.core.iterators.Combiner.next(Combiner.java:145)
		at org.apache.accumulo.core.iterators.WrappingIterator.next(WrappingIterator.java:87)
		at org.apache.accumulo.core.iterators.user.VersioningIterator.skipRowColumn(VersioningIterator.java:103)
		at org.apache.accumulo.core.iterators.user.VersioningIterator.next(VersioningIterator.java:53)
		at org.apache.accumulo.server.tabletserver.Compactor.compactLocalityGroup(Compactor.java:276)
		at org.apache.accumulo.server.tabletserver.Compactor.call(Compactor.java:139)
		at org.apache.accumulo.server.tabletserver.MinorCompactor.call(MinorCompactor.java:80)
		at org.apache.accumulo.server.tabletserver.Tablet.minorCompact(Tablet.java:2135)
		at org.apache.accumulo.server.tabletserver.Tablet.access$4300(Tablet.java:141)
		at org.apache.accumulo.server.tabletserver.Tablet$MinorCompactionTask.run(Tablet.java:2214)
		at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
		at cloudtrace.instrument.TraceRunnable.run(TraceRunnable.java:47)
		at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
		at java.lang.Thread.run(Thread.java:

MinC failed (null) to create /accumulo/tables/2/default_tablet/F0000001.rf_tmp retrying ...
	java.util.NoSuchElementException
		at org.apache.accumulo.core.iterators.TypedValueCombiner$VIterator.next(TypedValueCombiner.java:94)
		at org.apache.accumulo.examples.wikisearch.iterator.TextIndexCombiner.typedReduce(TextIndexCombiner.java:49)
		at org.apache.accumulo.examples.wikisearch.iterator.TextIndexCombiner.typedReduce(TextIndexCombiner.java:39)
		at org.apache.accumulo.core.iterators.TypedValueCombiner.reduce(TypedValueCombiner.java:187)
		at org.apache.accumulo.core.iterators.Combiner.findTop(Combiner.java:164)
		at org.apache.accumulo.core.iterators.Combiner.next(Combiner.java:145)
		at org.apache.accumulo.core.iterators.WrappingIterator.next(WrappingIterator.java:87)
		at org.apache.accumulo.core.iterators.user.VersioningIterator.skipRowColumn(VersioningIterator.java:103)
		at org.apache.accumulo.core.iterators.user.VersioningIterator.next(VersioningIterator.java:53)
		at org.apache.accumulo.server.tabletserver.Compactor.compactLocalityGroup(Compactor.java:276)
		at org.apache.accumulo.server.tabletserver.Compactor.call(Compactor.java:139)
		at org.apache.accumulo.server.tabletserver.MinorCompactor.call(MinorCompactor.java:80)
		at org.apache.accumulo.server.tabletserver.Tablet.minorCompact(Tablet.java:2135)
		at org.apache.accumulo.server.tabletserver.Tablet.access$4300(Tablet.java:141)
		at org.apache.accumulo.server.tabletserver.Tablet$MinorCompactionTask.run(Tablet.java:2214)
		at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
		at cloudtrace.instrument.TraceRunnable.run(TraceRunnable.java:47)
		at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
		at java.lang.Thread.run(Thread.java:662)
{code}

Also, I'm running the current 1.4 branch. It's not readily apparent to me what's happening based on the stack trace alone, but I'll take a look at this tomorrow night if you don't figure it out before then, Billie. :)
                
> Create combiners for wikisearch example
> ---------------------------------------
>
>                 Key: ACCUMULO-354
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-354
>             Project: Accumulo
>          Issue Type: Improvement
>          Components: contrib
>            Reporter: Billie Rinaldi
>            Assignee: Billie Rinaldi
>              Labels: combiner, example
>             Fix For: 1.4.0
>
>
> The wikisearch example uses aggregators, which are deprecated in 1.4.  Since this is a new example in 1.4, they should be combiners.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira