You are viewing a plain text version of this content. The canonical link for it is here.
Posted to batik-users@xmlgraphics.apache.org by Dwayne Schultz <dw...@schultz.net> on 2003/12/15 23:14:44 UTC
Problems running tests (regard)
I'm still having problems running the tests but I am getting further
now that I have the right test files. Also I don't see any mention of
which tests are run. Before you said I need to write a test like
xml-batik/test-sources/org/apache/batik/transcoder/image/
GenericDocumentTest.java. How do I tell if these tests are successful?
Here is the result of my 'ant regard':
$ ant regard
Buildfile: build.xml
init-args:
init:
compile:
debug off, optimize on, deprecation on
compiletest:
debug off, optimize on, deprecation on
testdirs:
compiletestjars:
debug off, optimize on, deprecation on
security2.jar:
IWasLoaded.jar:
IWasLoadedToo.jar:
JarCheckPermissionsGranted.jar:
JarCheckPermissionsDenied.jar:
java-binding.jar:
testjars:
regard:
Loading document ...
Running test run...
Running samplesRendering
Running samples
Running samples/anne.svg
Running samples/asf-logo.svg
Running samples/barChart.svg
Running samples/batik3D.svg
Running samples/batik70.svg
Running samples/batikBatik.svg
Running samples/batikFX.svg
Running samples/batikLogo.svg
Running samples/batikYin.svg
Running samples/chessboard.svg
Running samples/gradients.svg
Running samples/GVT.svg
Running samples/henryV.svg
Running samples/logoShadowOffset.svg
Running samples/logoTexture.svg
Running samples/mapSpain.svg
Running samples/mapWaadt.svg
Running samples/mathMetal.svg
Running samples/moonPhases.svg
Running samples/sizeOfSun.svg
Running samples/sunRise.svg
Running samples/sydney.svg
Running samples/textRotate.svg
Running samples/textRotateShadows.svg
Running extensions
Running samples/extensions/colorSwitch.svg
Running samples/extensions/histogramNormalization.svg
Running samples/extensions/flowText.svg
Running samples/extensions/multi.svg
Running samples/extensions/regularPolygon.svg
Running samples/extensions/solidColor.svg
Running samples/extensions/solidColor2.svg
Running samples/extensions/star.svg
Running samples/extensions/filterRegion.svg
Running samples/extensions/filterRegionDetailed.svg
Running samples/extensions/opera/opera-subImage.svg
Running samples/extensions/opera/opera-subImageRef.svg
Running tests.spec.color
Running samples/tests/spec/color/colorProfile.svg
Exception in thread "main" JavaAWT: Assertion failure: Java exception
thrown
JavaAWT: File src/macosx/native/apple/awt/util/AWTException.m; Line 40
JavaAWT: Assertion failure: _javaException
JavaAWT: File src/macosx/native/apple/awt/util/AWTException.m; Line 48
JavaAWT: Assertion failure: _javaException != 0
JavaAWT: File src/macosx/native/apple/awt/util/AWTException.m; Line 148
Exception in thread "main" Exception in thread "Thread-1" JavaAWT:
Assertion failure: Java exception thrown
JavaAWT: File src/macosx/native/apple/awt/util/AWTException.m; Line 40
JavaAWT: Assertion failure: _javaException
JavaAWT: File src/macosx/native/apple/awt/util/AWTException.m; Line 48
2003-12-15 15:02:19.984 java[6033] See Java exception object
Exception in thread "Thread-1" JavaAWT: Assertion failure: Java
exception thrown
JavaAWT: File src/macosx/native/apple/awt/util/AWTException.m; Line 40
JavaAWT: Assertion failure: _javaException
JavaAWT: File src/macosx/native/apple/awt/util/AWTException.m; Line 48
2003-12-15 15:02:20.000 java[6033] *** NSThread: ignoring exception
'AwtException' (reason 'See Java exception object') that raised during
delayed perform of target 0x31b170 and selector 'runAppKit:'
Java Result: 9
BUILD SUCCESSFUL
Total time: 28 minutes 34 seconds
It stalled on the last test and I had to kill the java process.
Dwayne
---------------------------------------------------------------------
To unsubscribe, e-mail: batik-users-unsubscribe@xml.apache.org
For additional commands, e-mail: batik-users-help@xml.apache.org
Re: Problems running tests (regard)
Posted by Thomas DeWeese <Th...@Kodak.com>.
Dwayne Schultz wrote:
> I'm almost set on my testing environment. Thanks! I think the HTML
> report says everything has failed for the transcoder.image tests. The
> top of the report says 'Failed Leaf Tests' and list all the tests. Most
> test look like this:
>
> >>>>start<<<<<
> transcoder.image.uri (AbstractImageTranscoderTest.error.image.differ)
> (org.apache.batik.transcoder.image.URITest)
>
> AbstractImageTranscoderTest.error.image.differ
> >>>>end<<<<<
This ussually indicates that the test failed completely.
Do you have anything in
test-references/org/apache/batik/transcoder/image/candidate-reference?
It should have an entry for each failed test (unless the
transcode operation totally aborted - in which case you
should have gotten some sort of message - either in the
test report or during the test run).
Unfortunately unlike the 'main line' rendering tests
the transcoder tests don't support an 'accepted-variation'
directory (normally when you are rendering on an alternate
platform you run regard once check that the output is correct
and then move all the candidate-variation images to the
accepted-variation directory - from then on it will accept your
'divergent' rendering as long as it is consistently divergent).
In this case you will have to copy over the 'standard' reference
files to get a clean regard run.
> One test looks like this (with a big grey box at the end:
>
> >>>>start<<<<<
> transcoder.image.dom (AbstractImageTranscoderTest.error.image.differ)
> (org.apache.batik.transcoder.image.DOMTest)
>
> AbstractImageTranscoderTest.error.image.differ
>
> AbstractImageTranscoderTest.error.difference.image
> >>>>end<<<<<
I would have expected all the tests to do this. If you look
carefully at the grey box (you can click on it to get a full sized
version) there should be some white/grey pixels scattered around.
> BTW, build.sh assumes I have ant 1.4.1 installed so I am typing 'ant
> -Dargs=transcoder.image regard' or 'ant regard' for all tests.
Batik actually includes a copy of ant so if ANT_HOME isn't set
it will automatically use the bundled one. I don't think any of
this has any effect on this issue however.
---------------------------------------------------------------------
To unsubscribe, e-mail: batik-users-unsubscribe@xml.apache.org
For additional commands, e-mail: batik-users-help@xml.apache.org
Re: Problems running tests (regard)
Posted by Dwayne Schultz <dw...@schultz.net>.
On Dec 15, 2003, at 15:32, Thomas DeWeese wrote:
> It looks like Mac OSX does not like color profiles!
> The simplest thing to do is either just run the transcoder.image
> tests (build regard transcoder.image). Or remove tests that fail
> hard like this one from your local copy of the regard test "manifest"
> files. This file would be in samplesRendering.xml.
I'm almost set on my testing environment. Thanks! I think the HTML
report says everything has failed for the transcoder.image tests. The
top of the report says 'Failed Leaf Tests' and list all the tests.
Most test look like this:
>>>>start<<<<<
transcoder.image.uri (AbstractImageTranscoderTest.error.image.differ)
(org.apache.batik.transcoder.image.URITest)
AbstractImageTranscoderTest.error.image.differ
>>>>end<<<<<
One test looks like this (with a big grey box at the end:
>>>>start<<<<<
transcoder.image.dom (AbstractImageTranscoderTest.error.image.differ)
(org.apache.batik.transcoder.image.DOMTest)
AbstractImageTranscoderTest.error.image.differ
AbstractImageTranscoderTest.error.difference.image
>>>>end<<<<<
BTW, build.sh assumes I have ant 1.4.1 installed so I am typing 'ant
-Dargs=transcoder.image regard' or 'ant regard' for all tests.
Dwayne
---------------------------------------------------------------------
To unsubscribe, e-mail: batik-users-unsubscribe@xml.apache.org
For additional commands, e-mail: batik-users-help@xml.apache.org
Re: Problems running tests (regard)
Posted by Thomas DeWeese <Th...@Kodak.com>.
Dwayne Schultz wrote:
> I'm still having problems running the tests but I am getting further
> now that I have the right test files. Also I don't see any mention of
> which tests are run.
Running just regard essentially runs all tests (over a thousand).
> Before you said I need to write a test like
> xml-batik/test-sources/org/apache/batik/transcoder/image/
> GenericDocumentTest.java.
Regard creates/populates a directory called 'test-reports' at the
top level. This directory should contain directories with the current
date/time (when regard completed). These directories then contain
html and xml subdirs, you want 'html' and that has regardReport.html
which has the test results for the tests run.
> How do I tell if these tests are successful?
Read the report. :)
It summarizes pass/total then gives an index of all the
failed tests with a link to the test results for that test.
You can run subsets of tests by giving a string to regard like:
./build.sh regard text
Will run all the tests with 'text' in their 'id'.
The top-level 'manifest' of tests is located in:
test-resources/org/apache/batik/test/regard.xml
This then references lots of other test suites. Like
.../batik/test/samplesRendering.xml, or
.../batik/transcoder/image/unitTesting.xml which has the
Generic Document test.
> Here is the result of my 'ant regard':
> regard:
> Loading document ...
> Running test run...
> Running samplesRendering
> Running samples
> Running samples/anne.svg
[...]
You are running on MacOSX?
I am very surprised that these pass this means that the MacOSX
renderer is pixel & sample accurate with Windows. Which I was
distinctly under the impression it wasn't...
> Running tests.spec.color
> Running samples/tests/spec/color/colorProfile.svg
> Exception in thread "main" JavaAWT: Assertion failure: Java exception
> thrown
It looks like Mac OSX does not like color profiles!
The simplest thing to do is either just run the transcoder.image
tests (build regard transcoder.image). Or remove tests that fail
hard like this one from your local copy of the regard test "manifest"
files. This file would be in samplesRendering.xml.
> It stalled on the last test and I had to kill the java process.
Yah if the test hoses the JVM we are SOL. Otherwise the
tests are very good about catching errors and reporting them in
the test report.
---------------------------------------------------------------------
To unsubscribe, e-mail: batik-users-unsubscribe@xml.apache.org
For additional commands, e-mail: batik-users-help@xml.apache.org