[jira] [Commented] (RYA-469) Rya Streams - Join iterator bug.

["Kevin Chilton (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/RYA-469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16402639#comment-16402639 ] 

Kevin Chilton commented on RYA-469:
-----------------------------------

I think we've figured out what is causing this. It seems to only happen when you are processing multiple queries whose join variables match each-other. I think the stream jobs are all using the same RocksDB instance, and there may be a problem with key overlap or something. We should add some debug logs that write out everything that happens after the bad state has been discovered before throwing the exception.

> Rya Streams - Join iterator bug.
> --------------------------------
>
>                 Key: RYA-469
>                 URL: https://issues.apache.org/jira/browse/RYA-469
>             Project: Rya
>          Issue Type: Bug
>            Reporter: Kevin Chilton
>            Assignee: Eric White
>            Priority: Major
>
> {code:java}
> Exception in thread "StreamThread-3" java.lang.RuntimeException: Problem encountered while iterating over the other side's values within the state store.
> at org.apache.rya.streams.kafka.processors.join.JoinProcessorSupplier$JoinProcessor.process(JoinProcessorSupplier.java:178)
> at org.apache.rya.streams.kafka.processors.join.JoinProcessorSupplier$JoinProcessor.process(JoinProcessorSupplier.java:95)
> at org.apache.kafka.streams.processor.internals.ProcessorNode.process(ProcessorNode.java:68)
> at org.apache.kafka.streams.processor.internals.StreamTask.forward(StreamTask.java:343)
> at org.apache.kafka.streams.processor.internals.ProcessorContextImpl.forward(ProcessorContextImpl.java:187)
> at org.apache.rya.streams.kafka.processors.StatementPatternProcessorSupplier$StatementPatternProcessor.process(StatementPatternProcessorSupplier.java:112)
> at org.apache.rya.streams.kafka.processors.StatementPatternProcessorSupplier$StatementPatternProcessor.process(StatementPatternProcessorSupplier.java:70)
> at org.apache.kafka.streams.processor.internals.ProcessorNode.process(ProcessorNode.java:68)
> at org.apache.kafka.streams.processor.internals.StreamTask.forward(StreamTask.java:343)
> at org.apache.kafka.streams.processor.internals.ProcessorContextImpl.forward(ProcessorContextImpl.java:187)
> at org.apache.kafka.streams.processor.internals.SourceNode.process(SourceNode.java:64)
> at org.apache.kafka.streams.processor.internals.StreamTask.process(StreamTask.java:174)
> at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:320)
> at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:218)
> Caused by: java.lang.IllegalStateException: The end of range marker must be the last key in the iterator.
> at org.apache.rya.streams.kafka.processors.join.KeyValueJoinStateStore$1.readNext(KeyValueJoinStateStore.java:221)
> at org.apache.rya.streams.kafka.processors.join.KeyValueJoinStateStore$1.next(KeyValueJoinStateStore.java:188)
> at org.apache.rya.streams.kafka.processors.join.KeyValueJoinStateStore$1.next(KeyValueJoinStateStore.java:158)
> at org.apache.rya.api.function.join.LazyJoiningIterator.next(LazyJoiningIterator.java:77)
> at org.apache.rya.api.function.join.LazyJoiningIterator.next(LazyJoiningIterator.java:41)
> at org.apache.rya.streams.kafka.processors.join.JoinProcessorSupplier$JoinProcessor.process(JoinProcessorSupplier.java:170)
> ... 13 more{code}
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)