You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@uima.apache.org by "Tommaso Teofili (Created) (JIRA)" <de...@uima.apache.org> on 2012/02/15 17:14:59 UTC

[jira] [Created] (UIMA-2373) Possible bug in FixedFlowController

Possible bug in FixedFlowController
-----------------------------------

                 Key: UIMA-2373
                 URL: https://issues.apache.org/jira/browse/UIMA-2373
             Project: UIMA
          Issue Type: Bug
    Affects Versions: 2.4.0SDK
            Reporter: Tommaso Teofili


I am developing a series of Lucene tokenizers which can use UIMA for creating tokens via extracted annotations.
While doing a stress test with lots of different strings I experienced the following:

{noformat}
[junit] Testsuite: org.apache.lucene.analysis.uima.UIMATypeAwareAnalyzerTest
    [junit] Tests run: 2, Failures: 0, Errors: 1, Time elapsed: 92,061 sec
    [junit] 
    [junit] ------------- Standard Error -----------------
    [junit] The following exceptions were thrown by threads:
    [junit] *** Thread: Thread-9 ***
    [junit] java.lang.RuntimeException: java.io.IOException: org.apache.uima.analysis_engine.AnalysisEngineProcessException
    [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(BaseTokenStreamTestCase.java:289)
    [junit] Caused by: java.io.IOException: org.apache.uima.analysis_engine.AnalysisEngineProcessException
    [junit] 	at org.apache.lucene.analysis.uima.UIMATypeAwareAnnotationsTokenizer.incrementToken(UIMATypeAwareAnnotationsTokenizer.java:87)
    [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:121)
    [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:371)
    [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:295)
    [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(BaseTokenStreamTestCase.java:287)
    [junit] Caused by: org.apache.uima.analysis_engine.AnalysisEngineProcessException
    [junit] 	at org.apache.uima.analysis_engine.asb.impl.ASB_impl$AggregateCasIterator.processUntilNextOutputCas(ASB_impl.java:701)
    [junit] 	at org.apache.uima.analysis_engine.asb.impl.ASB_impl$AggregateCasIterator.<init>(ASB_impl.java:409)
    [junit] 	at org.apache.uima.analysis_engine.asb.impl.ASB_impl.process(ASB_impl.java:342)
    [junit] 	at org.apache.uima.analysis_engine.impl.AggregateAnalysisEngine_impl.processAndOutputNewCASes(AggregateAnalysisEngine_impl.java:267)
    [junit] 	at org.apache.uima.analysis_engine.impl.AnalysisEngineImplBase.process(AnalysisEngineImplBase.java:267)
    [junit] 	at org.apache.lucene.analysis.uima.BaseUIMATokenizer.analyzeInput(BaseUIMATokenizer.java:57)
    [junit] 	at org.apache.lucene.analysis.uima.UIMATypeAwareAnnotationsTokenizer.analyzeText(UIMATypeAwareAnnotationsTokenizer.java:73)
    [junit] 	at org.apache.lucene.analysis.uima.UIMATypeAwareAnnotationsTokenizer.incrementToken(UIMATypeAwareAnnotationsTokenizer.java:85)
    [junit] 	... 4 more
    [junit] Caused by: java.lang.IndexOutOfBoundsException: Index: 1, Size: 2
    [junit] 	at java.util.ArrayList.RangeCheck(ArrayList.java:547)
    [junit] 	at java.util.ArrayList.get(ArrayList.java:322)
    [junit] 	at org.apache.uima.flow.impl.FixedFlowController$FixedFlowObject.next(FixedFlowController.java:216)
    [junit] 	at org.apache.uima.analysis_engine.asb.impl.FlowContainer.next(FlowContainer.java:98)
    [junit] 	at org.apache.uima.analysis_engine.asb.impl.ASB_impl$AggregateCasIterator.processUntilNextOutputCas(ASB_impl.java:667)
    [junit] 	... 11 more
{noformat}

I'm debugging it and see if I can come up with the exact bug (and fix) :)


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (UIMA-2373) Possible bug in FixedFlowController

Posted by "Marshall Schor (Commented) (JIRA)" <de...@uima.apache.org>.
    [ https://issues.apache.org/jira/browse/UIMA-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13209646#comment-13209646 ] 

Marshall Schor commented on UIMA-2373:
--------------------------------------

This is a strange error - the root cause message says an Array List of size 2 is being asked to get(..) the element at location 1.  Which certainly isn't out of bounds.
                
> Possible bug in FixedFlowController
> -----------------------------------
>
>                 Key: UIMA-2373
>                 URL: https://issues.apache.org/jira/browse/UIMA-2373
>             Project: UIMA
>          Issue Type: Bug
>    Affects Versions: 2.4.0SDK
>            Reporter: Tommaso Teofili
>
> I am developing a series of Lucene tokenizers which can use UIMA for creating tokens via extracted annotations.
> While doing a stress test with lots of different strings I experienced the following:
> {noformat}
> [junit] Testsuite: org.apache.lucene.analysis.uima.UIMATypeAwareAnalyzerTest
>     [junit] Tests run: 2, Failures: 0, Errors: 1, Time elapsed: 92,061 sec
>     [junit] 
>     [junit] ------------- Standard Error -----------------
>     [junit] The following exceptions were thrown by threads:
>     [junit] *** Thread: Thread-9 ***
>     [junit] java.lang.RuntimeException: java.io.IOException: org.apache.uima.analysis_engine.AnalysisEngineProcessException
>     [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(BaseTokenStreamTestCase.java:289)
>     [junit] Caused by: java.io.IOException: org.apache.uima.analysis_engine.AnalysisEngineProcessException
>     [junit] 	at org.apache.lucene.analysis.uima.UIMATypeAwareAnnotationsTokenizer.incrementToken(UIMATypeAwareAnnotationsTokenizer.java:87)
>     [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:121)
>     [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:371)
>     [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:295)
>     [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(BaseTokenStreamTestCase.java:287)
>     [junit] Caused by: org.apache.uima.analysis_engine.AnalysisEngineProcessException
>     [junit] 	at org.apache.uima.analysis_engine.asb.impl.ASB_impl$AggregateCasIterator.processUntilNextOutputCas(ASB_impl.java:701)
>     [junit] 	at org.apache.uima.analysis_engine.asb.impl.ASB_impl$AggregateCasIterator.<init>(ASB_impl.java:409)
>     [junit] 	at org.apache.uima.analysis_engine.asb.impl.ASB_impl.process(ASB_impl.java:342)
>     [junit] 	at org.apache.uima.analysis_engine.impl.AggregateAnalysisEngine_impl.processAndOutputNewCASes(AggregateAnalysisEngine_impl.java:267)
>     [junit] 	at org.apache.uima.analysis_engine.impl.AnalysisEngineImplBase.process(AnalysisEngineImplBase.java:267)
>     [junit] 	at org.apache.lucene.analysis.uima.BaseUIMATokenizer.analyzeInput(BaseUIMATokenizer.java:57)
>     [junit] 	at org.apache.lucene.analysis.uima.UIMATypeAwareAnnotationsTokenizer.analyzeText(UIMATypeAwareAnnotationsTokenizer.java:73)
>     [junit] 	at org.apache.lucene.analysis.uima.UIMATypeAwareAnnotationsTokenizer.incrementToken(UIMATypeAwareAnnotationsTokenizer.java:85)
>     [junit] 	... 4 more
>     [junit] Caused by: java.lang.IndexOutOfBoundsException: Index: 1, Size: 2
>     [junit] 	at java.util.ArrayList.RangeCheck(ArrayList.java:547)
>     [junit] 	at java.util.ArrayList.get(ArrayList.java:322)
>     [junit] 	at org.apache.uima.flow.impl.FixedFlowController$FixedFlowObject.next(FixedFlowController.java:216)
>     [junit] 	at org.apache.uima.analysis_engine.asb.impl.FlowContainer.next(FlowContainer.java:98)
>     [junit] 	at org.apache.uima.analysis_engine.asb.impl.ASB_impl$AggregateCasIterator.processUntilNextOutputCas(ASB_impl.java:667)
>     [junit] 	... 11 more
> {noformat}
> I'm debugging it and see if I can come up with the exact bug (and fix) :)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Re: [jira] [Commented] (UIMA-2373) Possible bug in FixedFlowController

Posted by Tommaso Teofili <to...@gmail.com>.
Hi Marshall,

2012/2/17 Marshall Schor <ms...@schor.com>

> Our docs say that AE's are run in a single thread model (see
> http://uima.apache.org/d/**uimaj-2.4.0/tutorials_and_**
> users_guides.html#ugr.tug.aae.**contract_for_annotator_methods<http://uima.apache.org/d/uimaj-2.4.0/tutorials_and_users_guides.html#ugr.tug.aae.contract_for_annotator_methods>
> **).  If multiple threads are wanted, the framework supports this by
> making multiple instances of the AE's implementation class.  This limits
> "thread-safety" issues to only "static" or class-level fields.
>
> The reason for this was an observation that the people writing annotators,
> although skilled in their particular discipline and able to write code that
> extracted information from Unstructured data, did not typically have the
> skills needed to write correct multi-threaded implementations in Java.  So
> the framework "helped" here, by insuring that any parallelism the framework
> supported created multiple instances of the annotator class, for each
> thread.
>
> I believe, however, that it is currently possible to use the framework in
> ways in which the application writer creates multiple threads and calls the
> same annotator instance on multiple threads at the same time.  Perhaps a
> proper approach here would be to have the framework detect this, and signal
> some kind of error.


I agree with this latest sentence, detection of such situations would be
very helpful in my opinion.
Tommaso



>
>
> -Marshall
>
>
> On 2/17/2012 4:09 AM, Tommaso Teofili (Commented) (JIRA) wrote:
>
>>     [ https://issues.apache.org/**jira/browse/UIMA-2373?page=**
>> com.atlassian.jira.plugin.**system.issuetabpanels:comment-**
>> tabpanel&focusedCommentId=**13210151#comment-13210151<https://issues.apache.org/jira/browse/UIMA-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13210151#comment-13210151>]
>>
>> Tommaso Teofili commented on UIMA-2373:
>> ------------------------------**---------
>>
>> bq. Possibly a concurrency issue?
>>
>> Yes, I think so.
>> That came out when an AE is used from different clients which execute in
>> parallel, so I wonder if is the usage which is wrong  or we should allow
>> that and thus made a fix for it.
>>
>>  Possible bug in FixedFlowController
>>> ------------------------------**-----
>>>
>>>                 Key: UIMA-2373
>>>                 URL: https://issues.apache.org/**jira/browse/UIMA-2373<https://issues.apache.org/jira/browse/UIMA-2373>
>>>             Project: UIMA
>>>          Issue Type: Bug
>>>    Affects Versions: 2.4.0SDK
>>>            Reporter: Tommaso Teofili
>>>
>>> I am developing a series of Lucene tokenizers which can use UIMA for
>>> creating tokens via extracted annotations.
>>> While doing a stress test with lots of different strings I experienced
>>> the following:
>>> {noformat}
>>> [junit] Testsuite: org.apache.lucene.analysis.**
>>> uima.UIMATypeAwareAnalyzerTest
>>>     [junit] Tests run: 2, Failures: 0, Errors: 1, Time elapsed: 92,061
>>> sec
>>>     [junit]
>>>     [junit] ------------- Standard Error -----------------
>>>     [junit] The following exceptions were thrown by threads:
>>>     [junit] *** Thread: Thread-9 ***
>>>     [junit] java.lang.RuntimeException: java.io.IOException:
>>> org.apache.uima.analysis_**engine.**AnalysisEngineProcessException
>>>     [junit]    at org.apache.lucene.analysis.**BaseTokenStreamTestCase$*
>>> *AnalysisThread.run(**BaseTokenStreamTestCase.java:**289)
>>>     [junit] Caused by: java.io.IOException: org.apache.uima.analysis_**
>>> engine.**AnalysisEngineProcessException
>>>     [junit]    at org.apache.lucene.analysis.**uima.**
>>> UIMATypeAwareAnnotationsTokeni**zer.incrementToken(**
>>> UIMATypeAwareAnnotationsTokeni**zer.java:87)
>>>     [junit]    at org.apache.lucene.analysis.**BaseTokenStreamTestCase.*
>>> *assertTokenStreamContents(**BaseTokenStreamTestCase.java:**121)
>>>     [junit]    at org.apache.lucene.analysis.**BaseTokenStreamTestCase.*
>>> *checkRandomData(**BaseTokenStreamTestCase.java:**371)
>>>     [junit]    at org.apache.lucene.analysis.**BaseTokenStreamTestCase.*
>>> *checkRandomData(**BaseTokenStreamTestCase.java:**295)
>>>     [junit]    at org.apache.lucene.analysis.**BaseTokenStreamTestCase$*
>>> *AnalysisThread.run(**BaseTokenStreamTestCase.java:**287)
>>>     [junit] Caused by: org.apache.uima.analysis_**engine.**
>>> AnalysisEngineProcessException
>>>     [junit]    at org.apache.uima.analysis_**engine.asb.impl.ASB_impl$**
>>> AggregateCasIterator.**processUntilNextOutputCas(ASB_**impl.java:701)
>>>     [junit]    at org.apache.uima.analysis_**engine.asb.impl.ASB_impl$**
>>> AggregateCasIterator.<init>(**ASB_impl.java:409)
>>>     [junit]    at org.apache.uima.analysis_**engine.asb.impl.ASB_impl.**
>>> process(ASB_impl.java:342)
>>>     [junit]    at org.apache.uima.analysis_**engine.impl.**
>>> AggregateAnalysisEngine_impl.**processAndOutputNewCASes(**
>>> AggregateAnalysisEngine_impl.**java:267)
>>>     [junit]    at org.apache.uima.analysis_**engine.impl.**
>>> AnalysisEngineImplBase.**process(**AnalysisEngineImplBase.java:**267)
>>>     [junit]    at org.apache.lucene.analysis.**uima.BaseUIMATokenizer.**
>>> analyzeInput(**BaseUIMATokenizer.java:57)
>>>     [junit]    at org.apache.lucene.analysis.**uima.**
>>> UIMATypeAwareAnnotationsTokeni**zer.analyzeText(**
>>> UIMATypeAwareAnnotationsTokeni**zer.java:73)
>>>     [junit]    at org.apache.lucene.analysis.**uima.**
>>> UIMATypeAwareAnnotationsTokeni**zer.incrementToken(**
>>> UIMATypeAwareAnnotationsTokeni**zer.java:85)
>>>     [junit]    ... 4 more
>>>     [junit] Caused by: java.lang.**IndexOutOfBoundsException: Index: 1,
>>> Size: 2
>>>     [junit]    at java.util.ArrayList.**RangeCheck(ArrayList.java:547)
>>>     [junit]    at java.util.ArrayList.get(**ArrayList.java:322)
>>>     [junit]    at org.apache.uima.flow.impl.**FixedFlowController$**
>>> FixedFlowObject.next(**FixedFlowController.java:216)
>>>     [junit]    at org.apache.uima.analysis_**
>>> engine.asb.impl.FlowContainer.**next(FlowContainer.java:98)
>>>     [junit]    at org.apache.uima.analysis_**engine.asb.impl.ASB_impl$**
>>> AggregateCasIterator.**processUntilNextOutputCas(ASB_**impl.java:667)
>>>     [junit]    ... 11 more
>>> {noformat}
>>> I'm debugging it and see if I can come up with the exact bug (and fix) :)
>>>
>> --
>> This message is automatically generated by JIRA.
>> If you think it was sent incorrectly, please contact your JIRA
>> administrators: https://issues.apache.org/**jira/secure/**
>> ContactAdministrators!default.**jspa<https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa>
>> For more information on JIRA, see: http://www.atlassian.com/**
>> software/jira <http://www.atlassian.com/software/jira>
>>
>>
>>
>>

Re: [jira] [Commented] (UIMA-2373) Possible bug in FixedFlowController

Posted by Marshall Schor <ms...@schor.com>.
Our docs say that AE's are run in a single thread model (see 
http://uima.apache.org/d/uimaj-2.4.0/tutorials_and_users_guides.html#ugr.tug.aae.contract_for_annotator_methods).  
If multiple threads are wanted, the framework supports this by making multiple 
instances of the AE's implementation class.  This limits "thread-safety" issues 
to only "static" or class-level fields.

The reason for this was an observation that the people writing annotators, 
although skilled in their particular discipline and able to write code that 
extracted information from Unstructured data, did not typically have the skills 
needed to write correct multi-threaded implementations in Java.  So the 
framework "helped" here, by insuring that any parallelism the framework 
supported created multiple instances of the annotator class, for each thread.

I believe, however, that it is currently possible to use the framework in ways 
in which the application writer creates multiple threads and calls the same 
annotator instance on multiple threads at the same time.  Perhaps a proper 
approach here would be to have the framework detect this, and signal some kind 
of error.

-Marshall

On 2/17/2012 4:09 AM, Tommaso Teofili (Commented) (JIRA) wrote:
>      [ https://issues.apache.org/jira/browse/UIMA-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13210151#comment-13210151 ]
>
> Tommaso Teofili commented on UIMA-2373:
> ---------------------------------------
>
> bq. Possibly a concurrency issue?
>
> Yes, I think so.
> That came out when an AE is used from different clients which execute in parallel, so I wonder if is the usage which is wrong  or we should allow that and thus made a fix for it.
>
>> Possible bug in FixedFlowController
>> -----------------------------------
>>
>>                  Key: UIMA-2373
>>                  URL: https://issues.apache.org/jira/browse/UIMA-2373
>>              Project: UIMA
>>           Issue Type: Bug
>>     Affects Versions: 2.4.0SDK
>>             Reporter: Tommaso Teofili
>>
>> I am developing a series of Lucene tokenizers which can use UIMA for creating tokens via extracted annotations.
>> While doing a stress test with lots of different strings I experienced the following:
>> {noformat}
>> [junit] Testsuite: org.apache.lucene.analysis.uima.UIMATypeAwareAnalyzerTest
>>      [junit] Tests run: 2, Failures: 0, Errors: 1, Time elapsed: 92,061 sec
>>      [junit]
>>      [junit] ------------- Standard Error -----------------
>>      [junit] The following exceptions were thrown by threads:
>>      [junit] *** Thread: Thread-9 ***
>>      [junit] java.lang.RuntimeException: java.io.IOException: org.apache.uima.analysis_engine.AnalysisEngineProcessException
>>      [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(BaseTokenStreamTestCase.java:289)
>>      [junit] Caused by: java.io.IOException: org.apache.uima.analysis_engine.AnalysisEngineProcessException
>>      [junit] 	at org.apache.lucene.analysis.uima.UIMATypeAwareAnnotationsTokenizer.incrementToken(UIMATypeAwareAnnotationsTokenizer.java:87)
>>      [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:121)
>>      [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:371)
>>      [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:295)
>>      [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(BaseTokenStreamTestCase.java:287)
>>      [junit] Caused by: org.apache.uima.analysis_engine.AnalysisEngineProcessException
>>      [junit] 	at org.apache.uima.analysis_engine.asb.impl.ASB_impl$AggregateCasIterator.processUntilNextOutputCas(ASB_impl.java:701)
>>      [junit] 	at org.apache.uima.analysis_engine.asb.impl.ASB_impl$AggregateCasIterator.<init>(ASB_impl.java:409)
>>      [junit] 	at org.apache.uima.analysis_engine.asb.impl.ASB_impl.process(ASB_impl.java:342)
>>      [junit] 	at org.apache.uima.analysis_engine.impl.AggregateAnalysisEngine_impl.processAndOutputNewCASes(AggregateAnalysisEngine_impl.java:267)
>>      [junit] 	at org.apache.uima.analysis_engine.impl.AnalysisEngineImplBase.process(AnalysisEngineImplBase.java:267)
>>      [junit] 	at org.apache.lucene.analysis.uima.BaseUIMATokenizer.analyzeInput(BaseUIMATokenizer.java:57)
>>      [junit] 	at org.apache.lucene.analysis.uima.UIMATypeAwareAnnotationsTokenizer.analyzeText(UIMATypeAwareAnnotationsTokenizer.java:73)
>>      [junit] 	at org.apache.lucene.analysis.uima.UIMATypeAwareAnnotationsTokenizer.incrementToken(UIMATypeAwareAnnotationsTokenizer.java:85)
>>      [junit] 	... 4 more
>>      [junit] Caused by: java.lang.IndexOutOfBoundsException: Index: 1, Size: 2
>>      [junit] 	at java.util.ArrayList.RangeCheck(ArrayList.java:547)
>>      [junit] 	at java.util.ArrayList.get(ArrayList.java:322)
>>      [junit] 	at org.apache.uima.flow.impl.FixedFlowController$FixedFlowObject.next(FixedFlowController.java:216)
>>      [junit] 	at org.apache.uima.analysis_engine.asb.impl.FlowContainer.next(FlowContainer.java:98)
>>      [junit] 	at org.apache.uima.analysis_engine.asb.impl.ASB_impl$AggregateCasIterator.processUntilNextOutputCas(ASB_impl.java:667)
>>      [junit] 	... 11 more
>> {noformat}
>> I'm debugging it and see if I can come up with the exact bug (and fix) :)
> --
> This message is automatically generated by JIRA.
> If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
> For more information on JIRA, see: http://www.atlassian.com/software/jira
>
>
>

[jira] [Commented] (UIMA-2373) Possible bug in FixedFlowController

Posted by "Tommaso Teofili (Commented) (JIRA)" <de...@uima.apache.org>.
    [ https://issues.apache.org/jira/browse/UIMA-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13210151#comment-13210151 ] 

Tommaso Teofili commented on UIMA-2373:
---------------------------------------

bq. Possibly a concurrency issue?

Yes, I think so.
That came out when an AE is used from different clients which execute in parallel, so I wonder if is the usage which is wrong  or we should allow that and thus made a fix for it.
                
> Possible bug in FixedFlowController
> -----------------------------------
>
>                 Key: UIMA-2373
>                 URL: https://issues.apache.org/jira/browse/UIMA-2373
>             Project: UIMA
>          Issue Type: Bug
>    Affects Versions: 2.4.0SDK
>            Reporter: Tommaso Teofili
>
> I am developing a series of Lucene tokenizers which can use UIMA for creating tokens via extracted annotations.
> While doing a stress test with lots of different strings I experienced the following:
> {noformat}
> [junit] Testsuite: org.apache.lucene.analysis.uima.UIMATypeAwareAnalyzerTest
>     [junit] Tests run: 2, Failures: 0, Errors: 1, Time elapsed: 92,061 sec
>     [junit] 
>     [junit] ------------- Standard Error -----------------
>     [junit] The following exceptions were thrown by threads:
>     [junit] *** Thread: Thread-9 ***
>     [junit] java.lang.RuntimeException: java.io.IOException: org.apache.uima.analysis_engine.AnalysisEngineProcessException
>     [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(BaseTokenStreamTestCase.java:289)
>     [junit] Caused by: java.io.IOException: org.apache.uima.analysis_engine.AnalysisEngineProcessException
>     [junit] 	at org.apache.lucene.analysis.uima.UIMATypeAwareAnnotationsTokenizer.incrementToken(UIMATypeAwareAnnotationsTokenizer.java:87)
>     [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:121)
>     [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:371)
>     [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:295)
>     [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(BaseTokenStreamTestCase.java:287)
>     [junit] Caused by: org.apache.uima.analysis_engine.AnalysisEngineProcessException
>     [junit] 	at org.apache.uima.analysis_engine.asb.impl.ASB_impl$AggregateCasIterator.processUntilNextOutputCas(ASB_impl.java:701)
>     [junit] 	at org.apache.uima.analysis_engine.asb.impl.ASB_impl$AggregateCasIterator.<init>(ASB_impl.java:409)
>     [junit] 	at org.apache.uima.analysis_engine.asb.impl.ASB_impl.process(ASB_impl.java:342)
>     [junit] 	at org.apache.uima.analysis_engine.impl.AggregateAnalysisEngine_impl.processAndOutputNewCASes(AggregateAnalysisEngine_impl.java:267)
>     [junit] 	at org.apache.uima.analysis_engine.impl.AnalysisEngineImplBase.process(AnalysisEngineImplBase.java:267)
>     [junit] 	at org.apache.lucene.analysis.uima.BaseUIMATokenizer.analyzeInput(BaseUIMATokenizer.java:57)
>     [junit] 	at org.apache.lucene.analysis.uima.UIMATypeAwareAnnotationsTokenizer.analyzeText(UIMATypeAwareAnnotationsTokenizer.java:73)
>     [junit] 	at org.apache.lucene.analysis.uima.UIMATypeAwareAnnotationsTokenizer.incrementToken(UIMATypeAwareAnnotationsTokenizer.java:85)
>     [junit] 	... 4 more
>     [junit] Caused by: java.lang.IndexOutOfBoundsException: Index: 1, Size: 2
>     [junit] 	at java.util.ArrayList.RangeCheck(ArrayList.java:547)
>     [junit] 	at java.util.ArrayList.get(ArrayList.java:322)
>     [junit] 	at org.apache.uima.flow.impl.FixedFlowController$FixedFlowObject.next(FixedFlowController.java:216)
>     [junit] 	at org.apache.uima.analysis_engine.asb.impl.FlowContainer.next(FlowContainer.java:98)
>     [junit] 	at org.apache.uima.analysis_engine.asb.impl.ASB_impl$AggregateCasIterator.processUntilNextOutputCas(ASB_impl.java:667)
>     [junit] 	... 11 more
> {noformat}
> I'm debugging it and see if I can come up with the exact bug (and fix) :)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (UIMA-2373) Possible bug in FixedFlowController

Posted by "Thilo Goetz (Commented) (JIRA)" <de...@uima.apache.org>.
    [ https://issues.apache.org/jira/browse/UIMA-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13210146#comment-13210146 ] 

Thilo Goetz commented on UIMA-2373:
-----------------------------------

Possibly a concurrency issue?

                
> Possible bug in FixedFlowController
> -----------------------------------
>
>                 Key: UIMA-2373
>                 URL: https://issues.apache.org/jira/browse/UIMA-2373
>             Project: UIMA
>          Issue Type: Bug
>    Affects Versions: 2.4.0SDK
>            Reporter: Tommaso Teofili
>
> I am developing a series of Lucene tokenizers which can use UIMA for creating tokens via extracted annotations.
> While doing a stress test with lots of different strings I experienced the following:
> {noformat}
> [junit] Testsuite: org.apache.lucene.analysis.uima.UIMATypeAwareAnalyzerTest
>     [junit] Tests run: 2, Failures: 0, Errors: 1, Time elapsed: 92,061 sec
>     [junit] 
>     [junit] ------------- Standard Error -----------------
>     [junit] The following exceptions were thrown by threads:
>     [junit] *** Thread: Thread-9 ***
>     [junit] java.lang.RuntimeException: java.io.IOException: org.apache.uima.analysis_engine.AnalysisEngineProcessException
>     [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(BaseTokenStreamTestCase.java:289)
>     [junit] Caused by: java.io.IOException: org.apache.uima.analysis_engine.AnalysisEngineProcessException
>     [junit] 	at org.apache.lucene.analysis.uima.UIMATypeAwareAnnotationsTokenizer.incrementToken(UIMATypeAwareAnnotationsTokenizer.java:87)
>     [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:121)
>     [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:371)
>     [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:295)
>     [junit] 	at org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(BaseTokenStreamTestCase.java:287)
>     [junit] Caused by: org.apache.uima.analysis_engine.AnalysisEngineProcessException
>     [junit] 	at org.apache.uima.analysis_engine.asb.impl.ASB_impl$AggregateCasIterator.processUntilNextOutputCas(ASB_impl.java:701)
>     [junit] 	at org.apache.uima.analysis_engine.asb.impl.ASB_impl$AggregateCasIterator.<init>(ASB_impl.java:409)
>     [junit] 	at org.apache.uima.analysis_engine.asb.impl.ASB_impl.process(ASB_impl.java:342)
>     [junit] 	at org.apache.uima.analysis_engine.impl.AggregateAnalysisEngine_impl.processAndOutputNewCASes(AggregateAnalysisEngine_impl.java:267)
>     [junit] 	at org.apache.uima.analysis_engine.impl.AnalysisEngineImplBase.process(AnalysisEngineImplBase.java:267)
>     [junit] 	at org.apache.lucene.analysis.uima.BaseUIMATokenizer.analyzeInput(BaseUIMATokenizer.java:57)
>     [junit] 	at org.apache.lucene.analysis.uima.UIMATypeAwareAnnotationsTokenizer.analyzeText(UIMATypeAwareAnnotationsTokenizer.java:73)
>     [junit] 	at org.apache.lucene.analysis.uima.UIMATypeAwareAnnotationsTokenizer.incrementToken(UIMATypeAwareAnnotationsTokenizer.java:85)
>     [junit] 	... 4 more
>     [junit] Caused by: java.lang.IndexOutOfBoundsException: Index: 1, Size: 2
>     [junit] 	at java.util.ArrayList.RangeCheck(ArrayList.java:547)
>     [junit] 	at java.util.ArrayList.get(ArrayList.java:322)
>     [junit] 	at org.apache.uima.flow.impl.FixedFlowController$FixedFlowObject.next(FixedFlowController.java:216)
>     [junit] 	at org.apache.uima.analysis_engine.asb.impl.FlowContainer.next(FlowContainer.java:98)
>     [junit] 	at org.apache.uima.analysis_engine.asb.impl.ASB_impl$AggregateCasIterator.processUntilNextOutputCas(ASB_impl.java:667)
>     [junit] 	... 11 more
> {noformat}
> I'm debugging it and see if I can come up with the exact bug (and fix) :)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira