You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@uima.apache.org by William Surowiec <ws...@gmail.com> on 2007/03/29 19:24:33 UTC
something seems strange in the build process
Well, at least it does to me :) and I am not sure what to make of it.
There are two "unusual" situations I encounter. First, testing issues
SEVERE messages, with Java exceptions, yet the test summary appears
fine. The second problem is eventually one test seems to go to sleep and
never wakes up - ergo I cannot complete the build.
I am running Windows XpPro with Java 1.6 and a recent svn update of the
project (revision 523768).
The rest of this message is a sample of the gory details:
tests are running fine, some warnings, then this set of messages:
Running org.apache.uima.analysis_engine.impl.AnalysisEngine_implTest
Mar 29, 2007 12:37:03 PM
org.apache.uima.analysis_engine.impl.TaeDescription_impl
checkForInvalidParameterOverrides
WARNING: The aggregate text analysis engine "Aggregate TAE with
Configuration Parameter Overrides" has declared the parameter
StringArrayParam, but has not declared any overrides.This usage is
deprecated.
Mar 29, 2007 12:37:03 PM
org.apache.uima.analysis_engine.impl.TaeDescription_impl
checkForInvalidParameterOverrides
WARNING: The aggregate text analysis engine "Aggregate TAE with
Configuration Parameter Overrides" has declared the parameter
StringArrayParam, but has not declared any overrides.This usage is
deprecated.
Mar 29, 2007 12:37:04 PM
org.apache.uima.analysis_engine.impl.TaeDescription_impl
checkForInvalidParameterOverrides
WARNING: The aggregate text analysis engine "Test Aggregate TAE" has
declared the parameter StringParam, but has not declared any
overrides.This usage is deprecated.
Mar 29, 2007 12:37:04 PM
org.apache.uima.analysis_engine.impl.TaeDescription_impl
checkForInvalidParameterOverrides
WARNING: The aggregate text analysis engine "Test Aggregate TAE" has
declared the parameter IntParam, but has not declared any overrides.This
usage is deprecated.
Mar 29, 2007 12:37:06 PM
org.apache.uima.analysis_engine.impl.PrimitiveAnalysisEngine_impl
callAnalysisComponentProcess(397)
SEVERE: Exception occurred
org.apache.uima.analysis_engine.AnalysisEngineProcessException:
Annotator processing failed.
at
org.apache.uima.analysis_engine.impl.PrimitiveAnalysisEngine_impl.callAnalysisComponentProcess(PrimitiveAnalysisEngine_impl.java:384)
at
org.apache.uima.analysis_engine.impl.PrimitiveAnalysisEngine_impl.processAndOutputNewCASes(PrimitiveAnalysisEngine_impl.java:292)
at
org.apache.uima.analysis_engine.asb.impl.ASB_impl$AggregateCasIterator.processUntilNextOutputCas(ASB_impl.java:547)
at
org.apache.uima.analysis_engine.asb.impl.ASB_impl$AggregateCasIterator.hasNext(ASB_impl.java:411)
at
org.apache.uima.analysis_engine.impl.AnalysisEngine_implTest.testProcessAndOutputNewCASesWithError(AnalysisEngine_implTest.java:1026)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at junit.framework.TestCase.runTest(TestCase.java:154)
at junit.framework.TestCase.runBare(TestCase.java:127)
at junit.framework.TestResult$1.protect(TestResult.java:106)
at junit.framework.TestResult.runProtected(TestResult.java:124)
at junit.framework.TestResult.run(TestResult.java:109)
at junit.framework.TestCase.run(TestCase.java:118)
at junit.framework.TestSuite.runTest(TestSuite.java:208)
at junit.framework.TestSuite.run(TestSuite.java:203)
at sun.reflect.GeneratedMethodAccessor180.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at
org.apache.maven.surefire.junit.JUnitTestSet.execute(JUnitTestSet.java:210)
at
org.apache.maven.surefire.suite.AbstractDirectoryTestSuite.executeTestSet(AbstractDirectoryTestSuite.java:135)
at
org.apache.maven.surefire.suite.AbstractDirectoryTestSuite.execute(AbstractDirectoryTestSuite.java:122)
at org.apache.maven.surefire.Surefire.run(Surefire.java:129)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at
org.apache.maven.surefire.booter.SurefireBooter.runSuitesInProcess(SurefireBooter.java:225)
at
org.apache.maven.surefire.booter.SurefireBooter.main(SurefireBooter.java:747)
Caused by: java.lang.RuntimeException: Test Error
at
org.apache.uima.analysis_engine.impl.ErrorAnnotator.process(ErrorAnnotator.java:38)
at
org.apache.uima.analysis_engine.impl.compatibility.AnnotatorAdapter.process(AnnotatorAdapter.java:142)
at
org.apache.uima.analysis_engine.impl.PrimitiveAnalysisEngine_impl.callAnalysisComponentProcess(PrimitiveAnalysisEngine_impl.java:373)
... 29 more
This is followed by the next 11 tests, which all fail with a SEVERE msg,
and then
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.531 sec
And then testing resumes (for a while):
Running org.apache.uima.cas.test.IntArrayFSTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec
Testing continues till:
Running org.apache.uima.impl.UimaContext_implTest
Mar 29, 2007 12:37:18 PM org.apache.uima.impl.RootUimaContext_impl
getResourceURL
WARNING: The unmanaged resource
org/apache/uima/analysis_engine/impl/testDataFile3.dat was accessed.This
feature is deprecated, and support may be removed in future versions.
(I've clipped off a number of similar warnings)
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.625 sec
Running
org.apache.uima.analysis_engine.impl.MultiprocessingAnalysisEngine_implTest
And that is where things appear to go to sleep - my machine is
responsive, nothing is exercising the cpu, but also nothing appears to
happen for at least 30 minutes, and then I kill the command processor.
Bill
Re: migration utility
Posted by Frank Schilder <fr...@thomson.com>.
>> I downloaded the binaries as well as the source, but I didn't follow through
>> with the binary distribution. But I built everything from the source, as
>> described in the link you mention.
>> <snip/>
>
> The migration tool was designed to be run from the binaries (perhaps
> we should have made it easier to run from the source dist too, sorry
> about that).
>
> It should of course be possible to build the binaries from the source.
> When you followed the instructions, did you also include the "How to
> build the full Apache UIMA Distribution" part? The steps are as
> follows:
>
Nope, I didn't do that. I thought that step was only optional for building
the docbooks and such.
In the meantime, I downloaded the binaries and used the migration tool
successfully.
I will try building from source another time.
Thanks,
Frank
Re: migration utility
Posted by Adam Lally <al...@alum.rpi.edu>.
On 3/30/07, Frank Schilder <fr...@thomson.com> wrote:
> I downloaded the binaries as well as the source, but I didn't follow through
> with the binary distribution. But I built everything from the source, as
> described in the link you mention.
> <snip/>
The migration tool was designed to be run from the binaries (perhaps
we should have made it easier to run from the source dist too, sorry
about that).
It should of course be possible to build the binaries from the source.
When you followed the instructions, did you also include the "How to
build the full Apache UIMA Distribution" part? The steps are as
follows:
First do a build as described in "Building from the command line".
Then execute the following:
$>cd ../uimaj-distr
$>mvn assembly:assembly
This will build the javadocs and the manual (using docbooks, as
described below), and will create .zip, .tar.gz, and .tar.bz2 archives
of the full UIMA distribution in the uimaj-distr/target directory.
This should create you a zip file that's equivalent to the binary
distribution.
In this zip file is the elusive lib directory. :)
-Adam
Re: Problems with building from subversion
Posted by Thilo Goetz <tw...@gmx.de>.
Frank Schilder wrote:
> I double-checked whether I actually downloaded the binaries and it seems
> like that I didn't. After downloading them, I now see the jar files (and
> also the eclipse plugins which were also missing from my installation).
>
> I did, however, follow all the steps for building with subversion in
> eclipse. It seems to me that that way of building UIMA is missing some
> steps (e.g. Generating jar files and the eclipse plugin).
If you look on the "Building with Maven" page in the section "How to
build the full Apache UIMA distribution", you'll see how to create the
distribution and where the files end up.
HTH,
Thilo
Problems with building from subversion
Posted by Frank Schilder <fr...@thomson.com>.
I double-checked whether I actually downloaded the binaries and it seems
like that I didn't. After downloading them, I now see the jar files (and
also the eclipse plugins which were also missing from my installation).
I did, however, follow all the steps for building with subversion in
eclipse. It seems to me that that way of building UIMA is missing some
steps (e.g. Generating jar files and the eclipse plugin).
I'll try the binaries now...
Frank
BTW: Because I still have the UIMA 2.0.2 eclipse plugins, changing the
descriptor files for the openNLP wrappers resulted into 2.0.2 files with the
old header <analysisEngineDescription
xmlns="http://uima.watson.ibm.com/resourceSpecifier">
Does that mean it's not possible to have UIMA 2.0.2 and Apache UIMA in one
Eclipse installation?
> From: Frank Schilder <fr...@thomson.com>
> Reply-To: <ui...@incubator.apache.org>
> Date: Fri, 30 Mar 2007 09:04:19 -0500
> To: <ui...@incubator.apache.org>
> Conversation: migration utility
> Subject: Re: migration utility
>
> I downloaded the binaries as well as the source, but I didn't follow through
> with the binary distribution. But I built everything from the source, as
> described in the link you mention.
>
> Still I don't see any lib sub dir in the workspace where I installed
> everything:
> uimaj-cpe
> uimaj-distr
> uimaj-document-annotation
> uimaj-ep-configurator
> uimaj-ep-debug
> uimaj-ep-jcasgen
> uimaj-ep-pear-packager
> jVinci uimaj-ep-runtime
> uima-docbooks uimaj-examples
> uimaj uimaj-internal-tools
> uimaj-adapter-soap uimaj-jet-expander
> uimaj-adapter-vinci uimaj-test-util
> uimaj-component-test-util uimaj-tools
> uimaj-core
>
> The sub dir uimaj-core also doesn't contain a lib dir nor can I find a
> org.apache.uima.tools.migration.IbmUimaToApacheUima class in the source.
> (I found the class in uima-tools).
>
>
> I ran all the junit tests. (Only one failed (testFindRelativePath), because
> the relative path information assumed a c-drive and I installed on a Mac).
> I, however, have some error messages in the MANIFEST.mf file from
> uimaj-ep-runtime (packages not found in this plugin), but that doesn't seem
> to affect the rest of the UIMA system.
>
> I also ran the openNLP wrapper. It seems like my UIMA installation is up and
> running. I just couldn't find the migration tool. That's why I ran the
> script from the binary distribution wondering where these jar files could
> be. According to my spotlight search, there is no uima-core.jar file on my
> computer even though I downloaded the binaries and built everything from
> source.
>
> Could it be that something went wrong while building everything?
>
> Thanks,
> Frank
>
>
>> From: Adam Lally <al...@alum.rpi.edu>
>> Reply-To: <ui...@incubator.apache.org>
>> Date: Fri, 30 Mar 2007 08:06:40 -0500
>> To: <ui...@incubator.apache.org>
>> Subject: Re: migration utility
>>
>> Did you download the UIMA binary distribution?
>>
(http://people.apache.org/dist/incubator/uima/2.1.0-incubating/uimaj-2.1.0-in>>
c
>> ubating-bin.zip)?
>>
>> It sounds like you may be using the source distribution (or an svn
>> extract) in which case you would have to build it first.
>> (http://incubator.apache.org/uima/svn.html#building.with.maven).
>>
>> And you need to set the UIMA_HOME to the top-level ("apache-uima")
>> directory of the 2.1 distribution, not 2.0.2.
>>
>> -Adam
>>
>> On 3/29/07, Frank.Schilder@thomson.com <Fr...@thomson.com> wrote:
>>> Hi Adam,
>>>
>>> You're right about the missing lib dir. I removed those while testing.
>>>
>>> But I'm a little bit confused about the jars, because I can't find them on
>>> my
>>> computer at all (I did a spotlight search with no results).
>>>
>>> I'm also not sure whether I have the correct path information for UIMA_HOME.
>>> UIMA_HOME is currently set to the UIMA 2.0.2 directory. That seems to be
>>> wrong. Could you tell me which path it should be set to? /uimaj, perhaps?
>>> But
>>> I can't see a lib dir anywhere..
>>> Thasnk,
>>> Frank
>>>
>>> -----Original Message-----
>>> From: lally.adam@gmail.com on behalf of Adam Lally
>>> Sent: Thu 3/29/2007 5:47 PM
>>> To: uima-user@incubator.apache.org
>>> Subject: Re: migration utility
>>>
>>> On 3/29/07, Frank Schilder <fr...@thomson.com> wrote:
>>>> I wasn't able to run the script to migrate to apache UIMA.
>>>> I also couldn't find the jar file used by the script:
>>>>
>>>> $UIMA_JAVA_CALL" -cp "$UIMA_HOME/uima-core.jar:$UIMA_HOME/uima-tools.jar"
>>>> org.apache.uima.tools.migration.IbmUimaToApacheUima %1 -ext
>>>> java,xml,xmi,wsdd,properties,launch,bat,cmd,sh,ksh,csh,
>>>>
>>>>
>>>
>>> Hi Frank,
>>>
>>> I'm a bit confused because I just doublechecked svn and the script says:
>>> "$UIMA_JAVA_CALL" -cp
>>> "$UIMA_HOME/lib/uima-core.jar:$UIMA_HOME/lib/uima-tools.jar"
>>> org.apache.uima.tools.migration.IbmUimaToApacheUima %1 -ext
>>> java,xml,xmi,wsdd,properties,launch,bat,cmd,sh,ksh,csh,
>>>
>>> Which isn't the same as what you posted (yours is missing the "lib",
>>> which is necessary).
>>>
>>> All that should be necessary for the script to find the files is for
>>> your UIMA_HOME
>>> environment variable to be set to your install location. Is it?
>>>
>>> The jar files (uima-core.jar and uima-tools.jar) are in the lib
>>> directory of the UIMA distribution.
>>>
>>> -Adam
>>>
>>>
>
Re: migration utility
Posted by Frank Schilder <fr...@thomson.com>.
I downloaded the binaries as well as the source, but I didn't follow through
with the binary distribution. But I built everything from the source, as
described in the link you mention.
Still I don't see any lib sub dir in the workspace where I installed
everything:
uimaj-cpe
uimaj-distr
uimaj-document-annotation
uimaj-ep-configurator
uimaj-ep-debug
uimaj-ep-jcasgen
uimaj-ep-pear-packager
jVinci uimaj-ep-runtime
uima-docbooks uimaj-examples
uimaj uimaj-internal-tools
uimaj-adapter-soap uimaj-jet-expander
uimaj-adapter-vinci uimaj-test-util
uimaj-component-test-util uimaj-tools
uimaj-core
The sub dir uimaj-core also doesn't contain a lib dir nor can I find a
org.apache.uima.tools.migration.IbmUimaToApacheUima class in the source.
(I found the class in uima-tools).
I ran all the junit tests. (Only one failed (testFindRelativePath), because
the relative path information assumed a c-drive and I installed on a Mac).
I, however, have some error messages in the MANIFEST.mf file from
uimaj-ep-runtime (packages not found in this plugin), but that doesn't seem
to affect the rest of the UIMA system.
I also ran the openNLP wrapper. It seems like my UIMA installation is up and
running. I just couldn't find the migration tool. That's why I ran the
script from the binary distribution wondering where these jar files could
be. According to my spotlight search, there is no uima-core.jar file on my
computer even though I downloaded the binaries and built everything from
source.
Could it be that something went wrong while building everything?
Thanks,
Frank
> From: Adam Lally <al...@alum.rpi.edu>
> Reply-To: <ui...@incubator.apache.org>
> Date: Fri, 30 Mar 2007 08:06:40 -0500
> To: <ui...@incubator.apache.org>
> Subject: Re: migration utility
>
> Did you download the UIMA binary distribution?
> (http://people.apache.org/dist/incubator/uima/2.1.0-incubating/uimaj-2.1.0-inc
> ubating-bin.zip)?
>
> It sounds like you may be using the source distribution (or an svn
> extract) in which case you would have to build it first.
> (http://incubator.apache.org/uima/svn.html#building.with.maven).
>
> And you need to set the UIMA_HOME to the top-level ("apache-uima")
> directory of the 2.1 distribution, not 2.0.2.
>
> -Adam
>
> On 3/29/07, Frank.Schilder@thomson.com <Fr...@thomson.com> wrote:
>> Hi Adam,
>>
>> You're right about the missing lib dir. I removed those while testing.
>>
>> But I'm a little bit confused about the jars, because I can't find them on my
>> computer at all (I did a spotlight search with no results).
>>
>> I'm also not sure whether I have the correct path information for UIMA_HOME.
>> UIMA_HOME is currently set to the UIMA 2.0.2 directory. That seems to be
>> wrong. Could you tell me which path it should be set to? /uimaj, perhaps? But
>> I can't see a lib dir anywhere..
>> Thasnk,
>> Frank
>>
>> -----Original Message-----
>> From: lally.adam@gmail.com on behalf of Adam Lally
>> Sent: Thu 3/29/2007 5:47 PM
>> To: uima-user@incubator.apache.org
>> Subject: Re: migration utility
>>
>> On 3/29/07, Frank Schilder <fr...@thomson.com> wrote:
>>> I wasn't able to run the script to migrate to apache UIMA.
>>> I also couldn't find the jar file used by the script:
>>>
>>> $UIMA_JAVA_CALL" -cp "$UIMA_HOME/uima-core.jar:$UIMA_HOME/uima-tools.jar"
>>> org.apache.uima.tools.migration.IbmUimaToApacheUima %1 -ext
>>> java,xml,xmi,wsdd,properties,launch,bat,cmd,sh,ksh,csh,
>>>
>>>
>>
>> Hi Frank,
>>
>> I'm a bit confused because I just doublechecked svn and the script says:
>> "$UIMA_JAVA_CALL" -cp
>> "$UIMA_HOME/lib/uima-core.jar:$UIMA_HOME/lib/uima-tools.jar"
>> org.apache.uima.tools.migration.IbmUimaToApacheUima %1 -ext
>> java,xml,xmi,wsdd,properties,launch,bat,cmd,sh,ksh,csh,
>>
>> Which isn't the same as what you posted (yours is missing the "lib",
>> which is necessary).
>>
>> All that should be necessary for the script to find the files is for
>> your UIMA_HOME
>> environment variable to be set to your install location. Is it?
>>
>> The jar files (uima-core.jar and uima-tools.jar) are in the lib
>> directory of the UIMA distribution.
>>
>> -Adam
>>
>>
Re: migration utility
Posted by Adam Lally <al...@alum.rpi.edu>.
Did you download the UIMA binary distribution?
(http://people.apache.org/dist/incubator/uima/2.1.0-incubating/uimaj-2.1.0-incubating-bin.zip)?
It sounds like you may be using the source distribution (or an svn
extract) in which case you would have to build it first.
(http://incubator.apache.org/uima/svn.html#building.with.maven).
And you need to set the UIMA_HOME to the top-level ("apache-uima")
directory of the 2.1 distribution, not 2.0.2.
-Adam
On 3/29/07, Frank.Schilder@thomson.com <Fr...@thomson.com> wrote:
> Hi Adam,
>
> You're right about the missing lib dir. I removed those while testing.
>
> But I'm a little bit confused about the jars, because I can't find them on my computer at all (I did a spotlight search with no results).
>
> I'm also not sure whether I have the correct path information for UIMA_HOME. UIMA_HOME is currently set to the UIMA 2.0.2 directory. That seems to be wrong. Could you tell me which path it should be set to? /uimaj, perhaps? But I can't see a lib dir anywhere..
> Thasnk,
> Frank
>
> -----Original Message-----
> From: lally.adam@gmail.com on behalf of Adam Lally
> Sent: Thu 3/29/2007 5:47 PM
> To: uima-user@incubator.apache.org
> Subject: Re: migration utility
>
> On 3/29/07, Frank Schilder <fr...@thomson.com> wrote:
> > I wasn't able to run the script to migrate to apache UIMA.
> > I also couldn't find the jar file used by the script:
> >
> > $UIMA_JAVA_CALL" -cp "$UIMA_HOME/uima-core.jar:$UIMA_HOME/uima-tools.jar"
> > org.apache.uima.tools.migration.IbmUimaToApacheUima %1 -ext
> > java,xml,xmi,wsdd,properties,launch,bat,cmd,sh,ksh,csh,
> >
> >
>
> Hi Frank,
>
> I'm a bit confused because I just doublechecked svn and the script says:
> "$UIMA_JAVA_CALL" -cp
> "$UIMA_HOME/lib/uima-core.jar:$UIMA_HOME/lib/uima-tools.jar"
> org.apache.uima.tools.migration.IbmUimaToApacheUima %1 -ext
> java,xml,xmi,wsdd,properties,launch,bat,cmd,sh,ksh,csh,
>
> Which isn't the same as what you posted (yours is missing the "lib",
> which is necessary).
>
> All that should be necessary for the script to find the files is for
> your UIMA_HOME
> environment variable to be set to your install location. Is it?
>
> The jar files (uima-core.jar and uima-tools.jar) are in the lib
> directory of the UIMA distribution.
>
> -Adam
>
>
RE: migration utility
Posted by Fr...@thomson.com.
Hi Adam,
You're right about the missing lib dir. I removed those while testing.
But I'm a little bit confused about the jars, because I can't find them on my computer at all (I did a spotlight search with no results).
I'm also not sure whether I have the correct path information for UIMA_HOME. UIMA_HOME is currently set to the UIMA 2.0.2 directory. That seems to be wrong. Could you tell me which path it should be set to? /uimaj, perhaps? But I can't see a lib dir anywhere..
Thasnk,
Frank
-----Original Message-----
From: lally.adam@gmail.com on behalf of Adam Lally
Sent: Thu 3/29/2007 5:47 PM
To: uima-user@incubator.apache.org
Subject: Re: migration utility
On 3/29/07, Frank Schilder <fr...@thomson.com> wrote:
> I wasn't able to run the script to migrate to apache UIMA.
> I also couldn't find the jar file used by the script:
>
> $UIMA_JAVA_CALL" -cp "$UIMA_HOME/uima-core.jar:$UIMA_HOME/uima-tools.jar"
> org.apache.uima.tools.migration.IbmUimaToApacheUima %1 -ext
> java,xml,xmi,wsdd,properties,launch,bat,cmd,sh,ksh,csh,
>
>
Hi Frank,
I'm a bit confused because I just doublechecked svn and the script says:
"$UIMA_JAVA_CALL" -cp
"$UIMA_HOME/lib/uima-core.jar:$UIMA_HOME/lib/uima-tools.jar"
org.apache.uima.tools.migration.IbmUimaToApacheUima %1 -ext
java,xml,xmi,wsdd,properties,launch,bat,cmd,sh,ksh,csh,
Which isn't the same as what you posted (yours is missing the "lib",
which is necessary).
All that should be necessary for the script to find the files is for
your UIMA_HOME
environment variable to be set to your install location. Is it?
The jar files (uima-core.jar and uima-tools.jar) are in the lib
directory of the UIMA distribution.
-Adam
Re: migration utility
Posted by Adam Lally <al...@alum.rpi.edu>.
On 3/29/07, Frank Schilder <fr...@thomson.com> wrote:
> I wasn't able to run the script to migrate to apache UIMA.
> I also couldn't find the jar file used by the script:
>
> $UIMA_JAVA_CALL" -cp "$UIMA_HOME/uima-core.jar:$UIMA_HOME/uima-tools.jar"
> org.apache.uima.tools.migration.IbmUimaToApacheUima %1 -ext
> java,xml,xmi,wsdd,properties,launch,bat,cmd,sh,ksh,csh,
>
>
Hi Frank,
I'm a bit confused because I just doublechecked svn and the script says:
"$UIMA_JAVA_CALL" -cp
"$UIMA_HOME/lib/uima-core.jar:$UIMA_HOME/lib/uima-tools.jar"
org.apache.uima.tools.migration.IbmUimaToApacheUima %1 -ext
java,xml,xmi,wsdd,properties,launch,bat,cmd,sh,ksh,csh,
Which isn't the same as what you posted (yours is missing the "lib",
which is necessary).
All that should be necessary for the script to find the files is for
your UIMA_HOME
environment variable to be set to your install location. Is it?
The jar files (uima-core.jar and uima-tools.jar) are in the lib
directory of the UIMA distribution.
-Adam
migration utility
Posted by Frank Schilder <fr...@thomson.com>.
I wasn't able to run the script to migrate to apache UIMA.
I also couldn't find the jar file used by the script:
$UIMA_JAVA_CALL" -cp "$UIMA_HOME/uima-core.jar:$UIMA_HOME/uima-tools.jar"
org.apache.uima.tools.migration.IbmUimaToApacheUima %1 -ext
java,xml,xmi,wsdd,properties,launch,bat,cmd,sh,ksh,csh,
Thanks,
Frank
> From: William Surowiec <ws...@gmail.com>
> Reply-To: <ui...@incubator.apache.org>
> Date: Thu, 29 Mar 2007 17:20:47 -0400
> To: <ui...@incubator.apache.org>
> Subject: Re: something seems strange in the build process
>
> Ok, reporting that the code is suspended at your own breakpoint may be
> humorous but is not useful (my last post.)
>
> The problem is trying to catch the little bugger. If I turn all the
> breakpoints off, I do sometimes encounter the problem, such as
>
> MultiprocessingAnalysisEngine_implTest [JUnit]
> org.eclipse.jdt.internal.junit.runner.RemoteTestRunner at
> localhost:1734
> Thread [main] (Running)
> Thread [ReaderThread] (Running)
> Thread [Thread-2] (Running)
> Thread [Thread-3] (Running)
> Thread [Thread-4] (Running)
> E:\Program Files\Java\jre1.6.0\bin\javaw.exe (Mar 29, 2007 5:10:40
> PM)
>
> and it sits there.
>
> I will try to be more careful, and hopefully, useful.
>
> Bill
>
Re: something seems strange in the build process
Posted by William Surowiec <ws...@gmail.com>.
Ok, reporting that the code is suspended at your own breakpoint may be
humorous but is not useful (my last post.)
The problem is trying to catch the little bugger. If I turn all the
breakpoints off, I do sometimes encounter the problem, such as
MultiprocessingAnalysisEngine_implTest [JUnit]
org.eclipse.jdt.internal.junit.runner.RemoteTestRunner at
localhost:1734
Thread [main] (Running)
Thread [ReaderThread] (Running)
Thread [Thread-2] (Running)
Thread [Thread-3] (Running)
Thread [Thread-4] (Running)
E:\Program Files\Java\jre1.6.0\bin\javaw.exe (Mar 29, 2007 5:10:40
PM)
and it sits there.
I will try to be more careful, and hopefully, useful.
Bill
Re: something seems strange in the build process
Posted by William Surowiec <ws...@gmail.com>.
Adam,
While tracing through a debug session (I had to turn a number of
breakpoints on to catch this - may be coincidental) I obtained the
following eclipse debug stack:
MultiprocessingAnalysisEngine_implTest [JUnit]
org.eclipse.jdt.internal.junit.runner.RemoteTestRunner at
localhost:1633
Thread [main] (Stepping)
Thread [ReaderThread] (Running)
Thread [Thread-1] (Suspended (breakpoint at line 353 in
MultiprocessingAnalysisEngine_implTest$ProcessThread))
MultiprocessingAnalysisEngine_implTest$ProcessThread.run()
line: 353
Thread [Thread-3] (Suspended (breakpoint at line 353 in
MultiprocessingAnalysisEngine_implTest$ProcessThread))
MultiprocessingAnalysisEngine_implTest$ProcessThread.run()
line: 353
Thread [Thread-4] (Suspended (breakpoint at line 353 in
MultiprocessingAnalysisEngine_implTest$ProcessThread))
MultiprocessingAnalysisEngine_implTest$ProcessThread.run()
line: 353
E:\Program Files\Java\jre1.6.0\bin\javaw.exe (Mar 29, 2007 4:08:55
PM)
and while eclipse was alive, the application was "hung."
Hope this is of some help.
Bill
Adam Lally wrote:
> Bill,
>
> On 3/29/07, William Surowiec <ws...@gmail.com> wrote:
>> Well, at least it does to me :) and I am not sure what to make of it.
>>
>> There are two "unusual" situations I encounter. First, testing issues
>> SEVERE messages, with Java exceptions, yet the test summary appears
>> fine.
>
> This is actually expected. Some of our unit tests are testing error
> conditions which cause the framework to log SEVERE messages. In your
> case the error message is "Test Error" which tells me this is expected
> (also the test case that's running has "ErrorTest" in the name).
>
>
>> The second problem is eventually one test seems to go to sleep and
>> never wakes up - ergo I cannot complete the build.
>> <snip/>
>
> That's certainly a problem. There may be some race condition (that
> particular testcase is multithreaded) that you see but we don't due to
> different hardware characteristics or whatnot.
>
> For now, to get the build to complete you can pass the parameter
> -Dmaven.test.skip=true when you call "mvn install", which will make it
> skip the unit tests entirely.
>
> When I get a chance I can eyeball that test case to see if I can think
> of what race condition might be there (hopefully it's in the test
> case, not the framework - we've seen that in a few other test cases
> before).
>
> Any other debug support you could provide would be great, for example
> if you can find out what line of the test is hung at.
>
> -Adam
>
Re: something seems strange in the build process
Posted by William Surowiec <ws...@gmail.com>.
Adam,
First - duh (
Adam Lally wrote:
> This is actually expected. Some of our unit tests are testing error
> conditions which cause the framework to log SEVERE messages.
) - the person who invents an automated, programmers' dope slap will
make a fortune
http://www.cartalk.com/content/read-on/2003/08.30-1.html
Second, using the -Dmaven.test.skip=true allows the build to complete.
Third, I have been "looking" more closely at class
MultiprocessingAnalysisEngine_implTest. I've run this test a number of
ways, all within Eclipse, and have seen different results. Here is a
summary:
1) running just this test as a junit test - it completes
2) running it under a code coverage tool - it completes
3) running it through the debugger - with multiple breakpoints - I
encountered a "hang up" on the third time through the loop for the code
(starting on line number 201) - sorry, I do not remember if it was the
creation or the start:
for (int i = 0; i < NUM_THREADS; i++) {
threads[i] = new ProcessThread(ae);
threads[i].start();
}
4) running it under the same code coverage tool - it hangs up.
I have not been able to reliably replicate the problem - I understand it
is a symptom of a race condition. I will continue trying to catch it
under the debugger and closer to "where" it is happening.
Bill
Re: something seems strange in the build process
Posted by Adam Lally <al...@alum.rpi.edu>.
On 4/4/07, William Surowiec <ws...@gmail.com> wrote:
> I believe the JIRA issue system is becoming increasingly important to
> developers. Given the nature of this problem I feel it would be
> presumptuous of me to categorize it properly - it might be best if you
> do so.
>
OK, I have opened an issue.
-Adam
Re: something seems strange in the build process
Posted by William Surowiec <ws...@gmail.com>.
Adam,
Thank you for the update. I am pleased the information I forwarded was
helpful even if I was barking up the wrong tree :)
I believe the JIRA issue system is becoming increasingly important to
developers. Given the nature of this problem I feel it would be
presumptuous of me to categorize it properly - it might be best if you
do so.
I would like to note some tools I discovered while following up on
Marshall's suggestions (an earlier email.) I am using Java6, in a
Windows XpPro environment, and it comes with two useful tools. Quoting
one of the links I found "Those tools are jps (a ps for Java processes)
and jstack (a tool to dump the threads of a specified Java process)".
With these tools I was able to "discover" and then "see" from the
command line into an Eclipse Debug session. They may be of use to others.
Thank you again Adam,
Bill
Adam Lally wrote:
> <snip/>
> Bill,
>
> I think I see where the problem is, thanks to your stack trace:
>
<snip/>
> I took a look at the code for
> AnalysisEnginePool.setResultSpecification. It tries to set the result
> specification of all AEs in the pool. To do this it attempts to check
> out all instances from the pool, set their result spec, and then
> releases them all. If this method is executed simultaneously from two
> threads, it can easily result in deadlock (each thread has some
> portion of the instances checked out and is trying to check out the
> remainder of them, and both will wait forever).
>
> And this method is called from the process(CAS, ResultSpecification)
> method, called in this test case from multiple threads.
>
> This design is broken and I'll need some time to figure out what to
> do. In the mean time feel free to open a JIRA issue.
>
> Thanks for helping debug this,
> -Adam
>
Re: something seems strange in the build process
Posted by Adam Lally <al...@alum.rpi.edu>.
On 4/4/07, William Surowiec <ws...@gmail.com> wrote:
> Marshall.
>
> Thank you, as I am using it I will pursue the Java 6 link.
>
> I fear I may not be seeing a deadlock but rather the absence (because it
> has already happened) of a notification to proceed - and not because a
> process has died, but rather it has completed and sent the notifyAll()
> message but the intended receivers were not at the wait() stage. In
> short, the receivers will now be waiting for a message that will not arrive.
>
> I admit to not knowing enough about Java concurrency to say this with
> any conviction that it is even plausible let alone likely. But I am
> reading several books and the source code and trying to arrive at a
> hypothesis.
>
Bill,
I think I see where the problem is, thanks to your stack trace:
----------
Object.wait(long) line: not available [native method]
ResourcePool.getResource(long) line: 166
AnalysisEnginePool.setResultSpecification(ResultSpecification) line:
155
MultiprocessingAnalysisEngine_impl.setResultSpecification(ResultSpecification)
line: 122
MultiprocessingAnalysisEngine_impl(AnalysisEngineImplBase).process(CAS,
ResultSpecification) line: 200
---------
I took a look at the code for
AnalysisEnginePool.setResultSpecification. It tries to set the result
specification of all AEs in the pool. To do this it attempts to check
out all instances from the pool, set their result spec, and then
releases them all. If this method is executed simultaneously from two
threads, it can easily result in deadlock (each thread has some
portion of the instances checked out and is trying to check out the
remainder of them, and both will wait forever).
And this method is called from the process(CAS, ResultSpecification)
method, called in this test case from multiple threads.
This design is broken and I'll need some time to figure out what to
do. In the mean time feel free to open a JIRA issue.
Thanks for helping debug this,
-Adam
Re: something seems strange in the build process
Posted by William Surowiec <ws...@gmail.com>.
Marshall.
Thank you, as I am using it I will pursue the Java 6 link.
I fear I may not be seeing a deadlock but rather the absence (because it
has already happened) of a notification to proceed - and not because a
process has died, but rather it has completed and sent the notifyAll()
message but the intended receivers were not at the wait() stage. In
short, the receivers will now be waiting for a message that will not arrive.
I admit to not knowing enough about Java concurrency to say this with
any conviction that it is even plausible let alone likely. But I am
reading several books and the source code and trying to arrive at a
hypothesis.
Bill
Marshall Schor wrote:
> Hi William -
>
> This behavior could be due to a deadlock, or it could be due to
> something as simple as sending a request to a process and waiting for
> the response, but the process died for some reason.
>
> For deadlocks, many Java implementations have tools that can help
> diagnose this by printing out what locks are being held. For
> instance, the IBM Java 1.4.x has info about creating a "Javadump"
> which includes information about locks; see
> http://publib.boulder.ibm.com/infocenter/javasdk/v1r4m2/topic/com.ibm.java.doc.diagnostics.142/html/interpretjavadump.html#interpretjavadump
>
>
> and in general, look here:
> http://www-1.ibm.com/support/docview.wss?rs=3182&uid=swg27007948
>
> If you're using Java 6 from Sun, this page may be helpful:
> http://java.sun.com/developer/technicalArticles/J2SE/monitoring/
>
> Look at the tools for diagnosis of common problems - Deadlocks
>
> -Marshall Schor
>
> William Surowiec wrote:
>> Adam,
>>
>> I've spent some time with the code in the eclipse debugger and can
>> consistently cause a condition where all the threads are running but
>> no work happens. When you then suspend one of the application threads
>> it consistently stops at line 166 in
>> org.apache.uima.internal.util.ResourcePool (the statement
>> "wait(aTimeout);" I have extracted the method and list it below.)
>>
>> This is the call stack when I suspend one of the running, but not
>> advancing the execution, threads:
>>
>> Thread [Thread-1] (Suspended) Object.wait(long) line: not
>> available [native method] ResourcePool.getResource(long) line:
>> 166
>> AnalysisEnginePool.setResultSpecification(ResultSpecification) line:
>> 155
>> MultiprocessingAnalysisEngine_impl.setResultSpecification(ResultSpecification)
>> line: 122
>> MultiprocessingAnalysisEngine_impl(AnalysisEngineImplBase).process(CAS,
>> ResultSpecification) line: 200
>> MultiprocessingAnalysisEngine_implTest$ProcessThread.run() line: 363
>> The extracted method in ResourcePool:
>>
>> public synchronized Resource getResource(long aTimeout) {
>> long startTime = new Date().getTime();
>> Resource resource;
>> while ((resource = getResource()) == null) {
>> try {
>> wait(aTimeout);
>> } catch (InterruptedException e) {
>> }
>> if (aTimeout > 0 && (new Date().getTime() - startTime) >=
>> aTimeout) {
>> // Timeout has expired
>> return null;
>> }
>> }
>> return resource;
>> }
>>
>> I will continue puzzling over this problem but admit to re-opening
>> several of Doug Lea's books to renew my (never really put to use)
>> acquaintance with the concepts,
>>
>> Bill
> <snip/>
Re: something seems strange in the build process
Posted by Marshall Schor <ms...@schor.com>.
Hi William -
This behavior could be due to a deadlock, or it could be due to
something as simple as sending a request to a process and waiting for
the response, but the process died for some reason.
For deadlocks, many Java implementations have tools that can help
diagnose this by printing out what locks are being held. For instance,
the IBM Java 1.4.x has info about creating a "Javadump" which includes
information about locks; see
http://publib.boulder.ibm.com/infocenter/javasdk/v1r4m2/topic/com.ibm.java.doc.diagnostics.142/html/interpretjavadump.html#interpretjavadump
and in general, look here:
http://www-1.ibm.com/support/docview.wss?rs=3182&uid=swg27007948
If you're using Java 6 from Sun, this page may be helpful:
http://java.sun.com/developer/technicalArticles/J2SE/monitoring/
Look at the tools for diagnosis of common problems - Deadlocks
-Marshall Schor
William Surowiec wrote:
> Adam,
>
> I've spent some time with the code in the eclipse debugger and can
> consistently cause a condition where all the threads are running but
> no work happens. When you then suspend one of the application threads
> it consistently stops at line 166 in
> org.apache.uima.internal.util.ResourcePool (the statement
> "wait(aTimeout);" I have extracted the method and list it below.)
>
> This is the call stack when I suspend one of the running, but not
> advancing the execution, threads:
>
> Thread [Thread-1] (Suspended) Object.wait(long) line: not
> available [native method] ResourcePool.getResource(long) line:
> 166
> AnalysisEnginePool.setResultSpecification(ResultSpecification) line:
> 155
> MultiprocessingAnalysisEngine_impl.setResultSpecification(ResultSpecification)
> line: 122
> MultiprocessingAnalysisEngine_impl(AnalysisEngineImplBase).process(CAS,
> ResultSpecification) line: 200
> MultiprocessingAnalysisEngine_implTest$ProcessThread.run() line: 363
> The extracted method in ResourcePool:
>
> public synchronized Resource getResource(long aTimeout) {
> long startTime = new Date().getTime();
> Resource resource;
> while ((resource = getResource()) == null) {
> try {
> wait(aTimeout);
> } catch (InterruptedException e) {
> }
> if (aTimeout > 0 && (new Date().getTime() - startTime) >=
> aTimeout) {
> // Timeout has expired
> return null;
> }
> }
> return resource;
> }
>
> I will continue puzzling over this problem but admit to re-opening
> several of Doug Lea's books to renew my (never really put to use)
> acquaintance with the concepts,
>
> Bill
>
> Adam Lally wrote:
>> <snip/>
>>> The second problem is eventually one test seems to go to sleep and
>>> never wakes up - ergo I cannot complete the build.
>>> <snip/>
>>
>> That's certainly a problem. There may be some race condition (that
>> particular testcase is multithreaded) that you see but we don't due to
>> different hardware characteristics or whatnot.
>>
>> <snip/>
>> Any other debug support you could provide would be great, for example
>> if you can find out what line of the test is hung at.
>>
>> -Adam
>>
>
>
Re: something seems strange in the build process
Posted by William Surowiec <ws...@gmail.com>.
Adam,
I've spent some time with the code in the eclipse debugger and can
consistently cause a condition where all the threads are running but no
work happens. When you then suspend one of the application threads it
consistently stops at line 166 in
org.apache.uima.internal.util.ResourcePool (the statement
"wait(aTimeout);" I have extracted the method and list it below.)
This is the call stack when I suspend one of the running, but not
advancing the execution, threads:
Thread [Thread-1] (Suspended)
Object.wait(long) line: not available [native method]
ResourcePool.getResource(long) line: 166
AnalysisEnginePool.setResultSpecification(ResultSpecification) line:
155
MultiprocessingAnalysisEngine_impl.setResultSpecification(ResultSpecification)
line: 122
MultiprocessingAnalysisEngine_impl(AnalysisEngineImplBase).process(CAS,
ResultSpecification) line: 200
MultiprocessingAnalysisEngine_implTest$ProcessThread.run() line: 363
The extracted method in ResourcePool:
public synchronized Resource getResource(long aTimeout) {
long startTime = new Date().getTime();
Resource resource;
while ((resource = getResource()) == null) {
try {
wait(aTimeout);
} catch (InterruptedException e) {
}
if (aTimeout > 0 && (new Date().getTime() - startTime) >= aTimeout) {
// Timeout has expired
return null;
}
}
return resource;
}
I will continue puzzling over this problem but admit to re-opening
several of Doug Lea's books to renew my (never really put to use)
acquaintance with the concepts,
Bill
Adam Lally wrote:
> <snip/>
>> The second problem is eventually one test seems to go to sleep and
>> never wakes up - ergo I cannot complete the build.
>> <snip/>
>
> That's certainly a problem. There may be some race condition (that
> particular testcase is multithreaded) that you see but we don't due to
> different hardware characteristics or whatnot.
>
> <snip/>
> Any other debug support you could provide would be great, for example
> if you can find out what line of the test is hung at.
>
> -Adam
>
Re: something seems strange in the build process
Posted by Adam Lally <al...@alum.rpi.edu>.
Bill,
On 3/29/07, William Surowiec <ws...@gmail.com> wrote:
> Well, at least it does to me :) and I am not sure what to make of it.
>
> There are two "unusual" situations I encounter. First, testing issues
> SEVERE messages, with Java exceptions, yet the test summary appears
> fine.
This is actually expected. Some of our unit tests are testing error
conditions which cause the framework to log SEVERE messages. In your
case the error message is "Test Error" which tells me this is expected
(also the test case that's running has "ErrorTest" in the name).
> The second problem is eventually one test seems to go to sleep and
> never wakes up - ergo I cannot complete the build.
> <snip/>
That's certainly a problem. There may be some race condition (that
particular testcase is multithreaded) that you see but we don't due to
different hardware characteristics or whatnot.
For now, to get the build to complete you can pass the parameter
-Dmaven.test.skip=true when you call "mvn install", which will make it
skip the unit tests entirely.
When I get a chance I can eyeball that test case to see if I can think
of what race condition might be there (hopefully it's in the test
case, not the framework - we've seen that in a few other test cases
before).
Any other debug support you could provide would be great, for example
if you can find out what line of the test is hung at.
-Adam