QA harness output - where is it?

[Greg Trasuk <tr...@stratuscom.com>]

Hi all:

I have a probably very dumb question about running the qa framework. 
When I checkout a rev, I run Ant, which does a build.  Then I run 'ant
qa.run', and it works away for many hours, finally giving a short report
saying "xxx" tests failed.  So far, so good.

My question is where can I find some details about what tests failed and
why?  Do I have to change the logging file setup, or am I just not
seeing where the results are currently stored?  Is that final report
even written to a file by default, or do I have to run it with some
different options?

Thanks in advance,

Greg

-- 
Greg Trasuk, President
StratusCom Manufacturing Systems Inc. - We use information technology to
solve business problems on your plant floor.
http://stratuscom.com

Re: QA harness output - where is it?

[Dan Creswell <da...@gmail.com>]

Before running, you'll also need to edit build.properties and tweak
river.home and log.config...

On 6 April 2013 01:04, Peter Firmstone <ji...@zeus.net.au> wrote:

> Greg,
>
> Copy the attached logging.properties file to your home directory.
> Copy the build.properties file to your trunk directory.
>
> Then edit run.tests= in your build.properties file to run the failed tests
> again.
>
> Execute ant qa.run-tests from the command line.
>
> Then depending on your output, edit logging.properties to find out more.
>
> When you want to perform debugging with jdb, append the following to the
> test.td file your having problems with, it will wait for the debugger
> before it starts.
>
> testjvmargs=\
> -Xdebug,\
> -Xrunjdwp:transport=dt_socket+**,address=8000+,server=y+,**suspend=y,\
> ${testjvmargs}
>
> If it's a concurrency problem, you'll have better luck with jstack.
>
> Regards,
>
> Peter.
>
>
> Greg Trasuk wrote:
>
>> Hi all:
>>
>> I have a probably very dumb question about running the qa framework. When
>> I checkout a rev, I run Ant, which does a build.  Then I run 'ant
>> qa.run', and it works away for many hours, finally giving a short report
>> saying "xxx" tests failed.  So far, so good.
>>
>> My question is where can I find some details about what tests failed and
>> why?  Do I have to change the logging file setup, or am I just not
>> seeing where the results are currently stored?  Is that final report
>> even written to a file by default, or do I have to run it with some
>> different options?
>>
>> Thanks in advance,
>>
>> Greg
>>
>>
>>
>
>
> ############################################################
> # Common Logging Configuration File that can be used
> # for logging in the ServiceStarter as well as any and
> # all services started by the ServiceStarter.
> #
> # To turn on logging, specify the name of this file as the
> # following system property of the associated VM:
> #
> # -Djava.util.logging.config.file=<appHome>/example/common/jini.logging
> #
> -Djava.util.logging.config.file=Drive:\\<appHome>\\example\\common\\jini.logging
> #
> # In order to specify the symbolic names for the
> # custom-defined levels (FAILED and HANDLED), the
> # following system property should be set:
> #
> # -Djava.util.logging.manager=com.sun.jini.logging.LogManager
> #
> ############################################################
>
> ############################################################
> #       Global properties
> ############################################################
>
> # "handlers" specifies a comma separated list of log Handler
> # classes.  These handlers will be installed during VM
> # startup. Note that these classes must be on the system
> # classpath. By default we only configure a ConsoleHandler,
> # which will show messages at the given level as well as
> # higher levels.
>
> handlers = java.util.logging.ConsoleHandler
> #handlers = java.util.logging.FileHandler, java.util.logging.ConsoleHandler
>
> # Default global logging level.
> # This specifies which kinds of events are logged across
> # ALL loggers.  For any given facility, this global level
> # can be overriden by a facility-specific level.
> # Note that below, the ConsoleHandler also has a separate
> # level setting (set below) to limit messages printed to
> # the console.
>
> .level = SEVERE
>
> ############################################################
> # Handler specific properties: formatters and logger levels
> ############################################################
>
> # For messages printed to the console, use a standard
> # formatter, and limit the messages that are printed
> # to the given level and above.
>
> java.util.logging.ConsoleHandler.formatter =
> java.util.logging.SimpleFormatter
> java.util.logging.ConsoleHandler.level = SEVERE
>
> # For messages printed to a file, do the following:
> # - use either a standard or XML formatter
> # - limit the number of bytes to write to any one file to
> #   the given number of bytes (limit)
> # - limit the number of files to cycle through to the
> #   given number of files (count)
> # - generate the name of the file to write to using
> #   the given pattern
> # - limit the messages that are written to the file
> #   to the given level and above (if the level is not
> #   specifically set for the file handler, it will
> #   default to Level.ALL),
>
> java.util.logging.FileHandler.formatter = java.util.logging.SimpleFormatter
> #java.util.logging.FileHandler.formatter = java.util.logging.XMLFormatter
> java.util.logging.FileHandler.limit = 100000
> java.util.logging.FileHandler.count = 1
> #java.util.logging.FileHandler.pattern = %h/java%u.log
> java.util.logging.FileHandler.pattern = %t/jini-service%u.log.%g
> java.util.logging.FileHandler.level = SEVERE
>
> ############################################################
> # Facility specific properties: logger levels
> ############################################################
>
> # Default all loggers to a high level, and then
> # turn the individual loggers 'on/off' by setting their
> # levels to a lower (finer) value. For example, if a
> # logger's level is set to INFO, then only  those log
> # records that are at the levels INFO, WARNING, or SEVERE
> # will be written. Whereas, if that logger's level is
> # set to FINE, then all log records that are at the levels
> # FINE, CONFIG, INFO, WARNING, or SEVERE will be written.
> #
> # Note that in order to use the custom-defined levels
> # FAILED (600) and HANDLED (550), do the following:
> # 1. import com.sun.jini.logging.levels in your application
> # 2. set the following system property on the VM of your
> #    application:
> # -Djava.util.logging.manager=com.sun.jini.logging.LogManager
> #
> #  SEVERE (highest value)
> #  WARNING
> #  INFO
> #  CONFIG
> #  600 (= FAILED  custom-defined)
> #  550 (= HANDLED custom-defined)
> #  FINE
> #  FINER
> #  FINEST (lowest value)
>
> # For Everything
> sun.rmi.level = FINEST
> net.jini.level = FINEST
> com.sun.jini.level = FINEST
> org.apache.river.level = FINEST
>
> # For the LogManager
> com.sun.jini.logging.LogManager.level = SEVERE
>
> # For Configuration
> net.jini.config.level = SEVERE
>
> # For activation
> net.jini.activation.ActivatableInvocationHandler.level = SEVERE
>
> # For JRMP
> net.jini.jrmp.JrmpExporter.level = SEVERE
>
> # For Jini ERI
> net.jini.jeri.level = SEVERE
> net.jini.jeri.BasicInvocationDispatcher.level = SEVERE
> net.jini.jeri.BasicInvocationHandler.level = SEVERE
> #net.jini.jeri.BasicJeriExporter.level = SEVERE
> #net.jini.jeri.BasicObjectEndpoint.level = SEVERE
>
> # For Jini ERI connection
> #net.jini.jeri.connection.level = SEVERE
> #net.jini.jeri.connection.ConnectionManager.level = SEVERE
> #net.jini.jeri.connection.ServerConnectionManager.level = SEVERE
> #net.jini.jeri.connection.mux.level = SEVERE
>
> # For HttpEndpoint and HttpServerEndpoint
> #net.jini.jeri.http.level = SEVERE
> #net.jini.jeri.http.client.level = SEVERE
> #net.jini.jeri.http.server.level = SEVERE
>
> # For TcpEndpoint and TcpServerEndpoint
> #net.jini.jeri.tcp.level = SEVERE
> #net.jini.jeri.tcp.client.level = SEVERE
> #net.jini.jeri.tcp.server.level = SEVERE
>
> # For SSL
> #net.jini.jeri.ssl.level = SEVERE
> #net.jini.jeri.ssl.client.level = SEVERE
> #net.jini.jeri.ssl.server.level = SEVERE
> #net.jini.jeri.ssl.init.level = SEVERE
>
> # For Kerberos
> #net.jini.jeri.kerberos.level = SEVERE
> #net.jini.jeri.kerberos.client.level = SEVERE
> #net.jini.jeri.kerberos.server.level = SEVERE
>
> # For IIOP
> net.jini.iiop.IiopExporter.level = SEVERE
>
> # For Preferred Classes
> net.jini.loader.level = SEVERE
> net.jini.loader.pref.PreferredClassLoader.level = SEVERE
> net.jini.loader.pref.PreferredClassLoader.preferred.level = SEVERE
> net.jini.loader.pref.PreferredClassLoader.exception.level = SEVERE
> net.jini.loader.pref.PreferredClassProvider.level = SEVERE
>
> # For Security: trust, integrity, policy and permission granting,
> #               proxy trust verification
> net.jini.security.level = SEVERE
> #net.jini.security.trust.level = SEVERE
> #net.jini.security.integrity.level = SEVERE
> net.jini.security.policy.level = SEVERE
> org.apache.river.api.security.DelegateCombinerSecurityManager.level =
> SEVERE
>
> # For HTTPMD
> net.jini.url.httpmd.level = SEVERE
>
> # For Discovery
> com.sun.jini.discovery.level = SEVERE
> #com.sun.jini.discovery.DiscoveryV1.level = SEVERE
> #com.sun.jini.discovery.DiscoveryV2.level = SEVERE
> #com.sun.jini.discovery.x500.level = SEVERE
>
> # For the Helper Utilities
> net.jini.discovery.LookupDiscovery.level = SEVERE
> net.jini.discovery.LookupLocatorDiscovery.level = SEVERE
> net.jini.lookup.JoinManager.level = SEVERE
> net.jini.lookup.ServiceDiscoveryManager.level = SEVERE
> net.jini.lease.LeaseRenewalManager.level = SEVERE
>
> # For Thread Pool Utilities
> com.sun.jini.thread.RetryTask.level = SEVERE
> com.sun.jini.thread.WakeupManager.level = SEVERE
> com.sun.jini.thread.ThreadPool.level = SEVERE
>
> # For Starting the Services
> com.sun.jini.start.level = FINEST
> #com.sun.jini.start.ClassLoaderUtil.level = SEVERE
> #com.sun.jini.start.proxy.level = SEVERE
> #com.sun.jini.start.resources.service.level = SEVERE
> #com.sun.jini.start.service.starter.level = SEVERE
> #com.sun.jini.start.sharedGroup.level = SEVERE
> #com.sun.jini.start.wrapper.level = SEVERE
>
> # For Reggie
> com.sun.jini.reggie.level = SEVERE
>
> # For Mahalo
> com.sun.jini.mahalo.destroy.level = SEVERE
> com.sun.jini.mahalo.init.level = SEVERE
> com.sun.jini.mahalo.operations.level = SEVERE
> com.sun.jini.mahalo.participant.level = SEVERE
> com.sun.jini.mahalo.persistence.level = SEVERE
> com.sun.jini.mahalo.startup.level = SEVERE
> com.sun.jini.mahalo.transactions.level = SEVERE
>
> # For Fiddler
> com.sun.jini.fiddler.discard.level = SEVERE
> com.sun.jini.fiddler.events.level = SEVERE
> com.sun.jini.fiddler.groups.level = SEVERE
> com.sun.jini.fiddler.lease.level = SEVERE
> com.sun.jini.fiddler.locators.level = SEVERE
> com.sun.jini.fiddler.persist.level = SEVERE
> com.sun.jini.fiddler.problem.level = SEVERE
> com.sun.jini.fiddler.registration.level = SEVERE
> com.sun.jini.fiddler.startup.level = SEVERE
> com.sun.jini.fiddler.tasks.level = SEVERE
>
> # For Mercury
> com.sun.jini.mercury.admin.level = SEVERE
> com.sun.jini.mercury.delivery.level = SEVERE
> com.sun.jini.mercury.expiration.level = SEVERE
> com.sun.jini.mercury.init.level = SEVERE
> com.sun.jini.mercury.lease.level = SEVERE
> com.sun.jini.mercury.operations.level = SEVERE
> com.sun.jini.mercury.persistence.level = SEVERE
> com.sun.jini.mercury.receive.level = SEVERE
> com.sun.jini.mercury.recovery.level = SEVERE
> com.sun.jini.mercury.startup.level = SEVERE
>
> # For Norm
> com.sun.jini.norm.level = SEVERE
>
> # For Outrigger
> com.sun.jini.outrigger.entryMatching.level = SEVERE
> com.sun.jini.outrigger.event.level = SEVERE
> com.sun.jini.outrigger.iterator.level = SEVERE
> com.sun.jini.outrigger.join.level = SEVERE
> com.sun.jini.outrigger.leases.level = SEVERE
> com.sun.jini.outrigger.lifecycle.level = SEVERE
> com.sun.jini.outrigger.operations.level = SEVERE
> com.sun.jini.outrigger.store.level = SEVERE
> com.sun.jini.outrigger.transactions.level = SEVERE
>
> # For the Browser Client
> com.sun.jini.example.browser.level = SEVERE
>
> # For the test harness, tests, and infrastructure.
> com.sun.jini.qa.harness.test.level = SEVERE
> com.sun.jini.qa.harness.service.level = SEVERE
> com.sun.jini.qa.harness.config.level = SEVERE
> com.sun.jini.test.spec.jeri.mux.level = SEVERE
>
> river.home=/opt/src/River_Fixed/peterConcurrentPolicy
> log.config=/home/peter/logging.properties
> debug=true
> debuglevel=lines,source,vars
>
> #run.tests=com/sun/jini/test/impl/servicediscovery/event/DiscardDownReDiscover.td,\
> #com/sun/jini/test/spec/servicediscovery/event/SetAttrServiceChanged.td,\
> #com/sun/jini/test/impl/servicediscovery/event/DiscardServiceDown.td,\
>
> #com/sun/jini/test/impl/servicediscovery/event/LookupTaskServiceIdMapRace.td,\
>
> #com/sun/jini/test/impl/servicediscovery/event/NotifyEventDropProxyTaskRace.td,\
> #com/sun/jini/test/impl/servicediscovery/event/ReRegisterBadEquals.td,\
> #com/sun/jini/test/impl/servicediscovery/event/ReRegisterGoodEquals.td,\
> #com/sun/jini/test/spec/servicediscovery/event/AddAttrServiceChanged.td,\
>
> #com/sun/jini/test/spec/servicediscovery/event/ModifyAttrServiceChanged.td,\
> #com/sun/jini/test/spec/lookupdiscovery/MulticastMonitorAllChange.td,\
> #com/sun/jini/test/spec/id/uuid/ConstructorAccessorTest.td,\
>
> #com/sun/jini/test/impl/start/ServiceStarterCreateBadTransientServiceTest.td
> #run.tests=com/sun/jini/test/impl/joinmanager/LeaseRenewDurRFE.td
>
> #run.tests=com/sun/jini/test/spec/policyprovider/dynamicPolicyProvider/GrantNoPrincipalCase01.td,\
>
> #com/sun/jini/test/spec/policyprovider/dynamicPolicyProvider/GrantNoPrincipalCase02.td,\
>
> #com/sun/jini/test/spec/policyprovider/dynamicPolicyProvider/GrantPrincipal.td
>
> #run.tests=com/sun/jini/test/spec/policyprovider/dynamicPolicyProvider/SecurityExceptionConstructorNoAccessClass.td
> #com/sun/jini/test/spec/security/security/DoPrivilegedExceptionTest.td,\
> #com/sun/jini/test/spec/security/security/DoPrivilegedTest.td
>
> #run.tests=com/sun/jini/test/impl/start/loadersplitpolicyprovider/LoaderSplitPolicyProviderTest.td
> #run.categories=policyprovider,security,loader
> #run.categories=discoveryservice
> #run.categories=jeri,reliability,activation,iiop,jrmp,start
> #run.categories=lookupservice
> #run.categories=iiop,jrmp
> #run.categories=start,start_impl
>
> #run.categories=lookupdiscovery,locatordiscovery,discoverymanager,discoveryservice
> #run.categories=lookupservice,eventmailbox
> #run.categories=javaspace,activation,start
> #run.categories=loader,policyprovider,security,jeri,reliability
> run.categories=loader
> #run.tests =
> com/sun/jini/test/spec/policyprovider/dynamicPolicyProvider/RefreshNoPrincipal.td,\
>
> #com/sun/jini/test/spec/policyprovider/dynamicPolicyProvider/GetGrantsNoPrincipal.td,\
> #run.tests =
> com/sun/jini/test/spec/policyprovider/policyFileProvider/BasicGrants.td,\
> #com/sun/jini/test/spec/policyprovider/policyFileProvider/UmbrellaGrants.td
> #run.tests =
> com/sun/jini/test/spec/policyprovider/dynamicPolicyProvider/GrantPrincipal.td,\
>
> #com/sun/jini/test/spec/policyprovider/dynamicPolicyProvider/GrantNoPrincipalCase02.td
> #run.tests=com/sun/jini/test/spec/jeri/https/HttpsRobustnessTest.td
>
> #run.tests=com/sun/jini/test/spec/policyprovider/policyFileProvider/UmbrellaGrants.td
>
> #com/sun/jini/test/spec/policyprovider/policyFileProvider/SecurityExceptionConstructorNoAccessClass.td,\
> #com/sun/jini/test/spec/security/security/DoPrivilegedExceptionTest.td,\
> #com/sun/jini/test/spec/security/security/DoPrivilegedTest.td
>
> #run.tests=com/sun/jini/test/spec/security/basicproxypreparer/PrepareProxy_Test.td
>
> #run.tests=com/sun/jini/test/spec/loader/pref/preferredClassLoader/NewInstance.td,\
> #run.tests=com/sun/jini/test/spec/policyprovider/dynamicPolicyProvider/SecurityExceptionConstructorNoAccessClass.td
> --fix this one
>
> #run.tests=com/sun/jini/test/spec/lookupservice/test_set00/MultipleEvntLeaseRenewals.td,\
> #com/sun/jini/test/spec/lookupservice/test_set00/NotifyOnAttrAdd.td,\
> #com/sun/jini/test/spec/lookupservice/test_set00/NotifyOnAttrDel.td,\
> #com/sun/jini/test/spec/lookupservice/test_set00/NotifyOnAttrMod.td,\
> #com/sun/jini/test/spec/lookupservice/test_set02/NotifyOnAttrSet.td
>
> #run.tests=com/sun/jini/test/impl/start/aggregatepolicyprovider/GetContextTest.td
>
> #run.tests=com/sun/jini/test/spec/security/security/VerifyCodebaseIntegrityTest.td
>
> #run.tests=com/sun/jini/test/spec/policyprovider/dynamicPolicyProvider/NullCases.td
>
> #run.tests=com/sun/jini/test/spec/security/accesspermission/ConstructorExceptionsTest.td
>
> #run.tests=com/sun/jini/test/spec/security/security/DoPrivilegedExceptionTest.td,\
> #com/sun/jini/test/spec/security/security/DoPrivilegedTest.td
> #run.tests=com/sun/jini/test/impl/joinmanager/ZRegisterStorm.td,\
> #com/sun/jini/test/spec/renewalmanager/EventTest.td
> #
>
> #run.tests=com/sun/jini/test/spec/io/marshaloutputstream/ConstructorAccessorTest.td,\
> #com/sun/jini/test/spec/io/marshalinputstream/ConstructorAccessorTest.td,\
> #com/sun/jini/test/impl/joinmanager/LeaseRenewDurRFE.td,\
> #com/sun/jini/test/impl/start/ActivateWrapperActivateDescTest.td,\
> #com/sun/jini/test/impl/start/ActivateWrapperActivateDescTest2.td,\
> #com/sun/jini/test/impl/start/ActivateWrapperActivateDescTest3.td,\
> #com/sun/jini/test/impl/start/ActivateWrapperRegisterBadCodebase.td,\
> #com/sun/jini/test/impl/start/ActivateWrapperRegisterBadGroup.td,\
> #com/sun/jini/test/impl/start/ActivateWrapperRegisterBadImplClass.td,\
> #com/sun/jini/test/impl/start/ActivateWrapperRegisterBadStubCodebase.td,\
> #com/sun/jini/test/impl/start/ActivateWrapperRegisterUnsharedImpl.td,\
> #run.tests=com/sun/jini/test/impl/start/ClassLoaderTest.td,\
> #com/sun/jini/test/impl/start/ClassLoaderUtilTest.td,\
> #com/sun/jini/test/impl/start/ClasspathTest.td
> #com/sun/jini/test/impl/start/CodebaseTest.td,\
> #com/sun/jini/test/impl/start/DestroySharedGroupCreateBadDesc.td,\
> #com/sun/jini/test/impl/start/DestroySharedGroupCreateEmptyTest.td,\
> #com/sun/jini/test/impl/start/DestroySharedGroupMainEmptyArgs.td,\
> #com/sun/jini/test/impl/start/DestroySharedGroupMainEmptyConfig.td,\
> #com/sun/jini/test/impl/start/DestroySharedGroupMainMissingConfig.td,\
> #com/sun/jini/test/impl/start/ExportClassLoaderTest.td,\
> #com/sun/jini/test/impl/start/MultipleClasspathComponentTest.td,\
> #com/sun/jini/test/impl/start/NonActivatableServiceDescriptorTest.td,\
> #com/sun/jini/test/impl/start/NonActivatableServiceDescriptorTest2.td,\
> #com/sun/jini/test/impl/start/SecurityTest.td,\
> #com/sun/jini/test/impl/start/SecurityTestNonActivatable.td,\
> #run.tests=com/sun/jini/test/impl/start/SerializedServiceDescriptors.td
>
> #run.tests=com/sun/jini/test/spec/lookupservice/test_set01/NotifyOnComboAttrAddNonNull.td
>
> #com/sun/jini/test/impl/start/ServiceStarterCreateActivatableNoConsServiceTest.td,\
> #com/sun/jini/test/impl/start/ServiceStarterCreateBadDesc.td,\
>
> #com/sun/jini/test/impl/start/ServiceStarterCreateBadServiceProxyAccessorTest.td,\
> #com/sun/jini/test/impl/start/ServiceStarterCreateEmptyTest.td,\
>
> #com/sun/jini/test/impl/start/ServiceStarterCreateSharedBadActServiceTest.td,\
> #com/sun/jini/test/impl/start/ServiceStarterCreateSharedGroupTest.td,\
>
> #com/sun/jini/test/impl/start/ServiceStarterCreateTransientNoConsServiceTest.td,\
> #com/sun/jini/test/impl/start/ServiceStarterCreateTransientServiceTest.td,\
> #com/sun/jini/test/impl/start/ServiceStarterMainEmptyArgs.td,\
> #com/sun/jini/test/impl/start/ServiceStarterMainEmptyConfig.td,\
> #com/sun/jini/test/impl/start/ServiceStarterMainMissingConfig.td,\
> #com/sun/jini/test/impl/start/SharedActivatableServiceDescriptorTest.td,\
> #com/sun/jini/test/impl/start/SharedActivatableServiceDescriptorTest2.td,\
> #com/sun/jini/test/impl/start/SharedActivatableServiceDescriptorTest3.td,\
> #com/sun/jini/test/impl/start/SharedActivationGroupDescriptorTest.td,\
>
> #com/sun/jini/test/impl/start/SharedActivationPolicyPermissionActionsTest.td,\
>
> #com/sun/jini/test/impl/start/SharedActivationPolicyPermissionCollectionTest.td,\
>
> #com/sun/jini/test/impl/start/SharedActivationPolicyPermissionEqualsTest.td,\
>
> #com/sun/jini/test/impl/start/SharedActivationPolicyPermissionHTTPEqualsTest.td,\
>
> #com/sun/jini/test/impl/start/SharedActivationPolicyPermissionHTTPImpliesTest.td,\
>
> #com/sun/jini/test/impl/start/SharedActivationPolicyPermissionImpliesTest.td,\
> #com/sun/jini/test/impl/start/SharedGroupNullConfigEntries.td,\
> #com/sun/jini/test/impl/start/SharedGroupProxyEqualityTest.td,\
> #com/sun/jini/test/impl/start/StartAllServicesTest.td,\
>
> #run.tests=com/sun/jini/test/impl/start/loadersplitpolicyprovider/LoaderSplitPolicyProviderTest.td,\
> #com/sun/jini/test/impl/start/aggregatepolicyprovider/SubPoliciesTest.td
> #com/sun/jini/test/impl/start/aggregatepolicyprovider/GetContextTest.td,\
>
> #run.tests=com/sun/jini/test/impl/start/aggregatepolicyprovider/SubPoliciesTest.td
>
> #com/sun/jini/test/impl/start/ServiceStarterCreateBadTransientServiceTest.td,\
> #com/sun/jini/test/impl/start/ServiceDescriptorProxyPreparationTest.td,\
> #com/sun/jini/test/spec/jeri/https/HttpsServerConstructorAccessor.td,\
> #com/sun/jini/test/spec/jeri/ssl/SslServerConstructorAccessor.td,\
> #com/sun/jini/test/impl/outrigger/matching/StressTestWithShutdown.td
> #com/sun/jini/test/impl/scalability/DemoScalabilityTest.td - Doesn't work.
> #run.tests=com/sun/jini/test/impl/mahalo/AdminIFShutdownTest.td,\
> #com/sun/jini/test/impl/start/ClassLoaderTest.td,\
> #com/sun/jini/test/impl/start/ClasspathTest.td
>
> #run.tests=com/sun/jini/test/spec/security/basicproxypreparer/PrepareProxy_Test.td
>
> #run.tests=com/sun/jini/test/impl/discoverymanager/BadDiscoveryListener.td,\
> #com/sun/jini/test/impl/discoverymanager/RemoveGroupsLocsDiscard.td
>
> #run.tests=com/sun/jini/test/impl/start/aggregatepolicyprovider/SubPoliciesTest.td,\
>
> #com/sun/jini/test/impl/start/SharedActivationPolicyPermissionHTTPImpliesTest.td
>
> #run.tests=com/sun/jini/test/spec/lookupdiscovery/MulticastMonitorStopReplace.td
> #com/sun/jini/test/spec/lookupdiscovery/MulticastMonitorTerminate.td,\
> #com/sun/jini/test/impl/mercury/AdminIFShutdownTest.td,\
> #com/sun/jini/test/impl/mercury/AdminIFTest.td,\
> #com/sun/jini/test/impl/mercury/PullAdminIFShutdownTest.td,\
> #com/sun/jini/test/impl/mercury/PullAdminIFTest.td,\
> #com/sun/jini/test/spec/discoveryservice/event/DiscardUnreachable.td,\
> #com/sun/jini/test/spec/discoveryservice/event/MulticastMonitorStop.td,\
>
> #com/sun/jini/test/spec/discoveryservice/event/MulticastMonitorTerminate.td,\
> #com/sun/jini/test/impl/mahalo/AdminIFShutdownTest.td,\
> #com/sun/jini/test/impl/mahalo/AdminIFTest.td
> # Test failed on sparc
>
> #run.tests=com/sun/jini/test/impl/outrigger/matching/StressTestWithShutdown.td
>
> #run.tests=com/sun/jini/test/impl/outrigger/transaction/SimpleTransactionTest2.td,\
>
> #com/sun/jini/test/impl/outrigger/leasing/UseTxnMgrSpaceLeaseTestRenewCancel.td,\
>
> #com/sun/jini/test/impl/outrigger/transaction/BlockingOnDeadTransactionTest.td,\
>
> #run.tests=com/sun/jini/test/impl/outrigger/leasing/UseNotifyLeaseTestRenewShutdown.td,\
>
> #run.tests=com/sun/jini/test/spec/javaspace/conformance/ExpirationNotifyTest.td,\
>
> run.tests=com/sun/jini/test/spec/javaspace/conformance/snapshot/SnapshotExpirationNotifyTest.td
> #com/sun/jini/test/impl/outrigger/leasing/UseNotifyLeaseTestRenew.td,\
>
> #com/sun/jini/test/impl/outrigger/leasing/UseNotifyLeaseTestRenewShutdown.td,\
> #com/sun/jini/test/impl/outrigger/matching/StressTestWithShutdown.td
> #com/sun/jini/test/impl/reggie/MultihomedClientTest.td
> #run.tests=com/sun/jini/test/spec/lookupdiscovery/DiscoveredStagger.td,\
> #com/sun/jini/test/impl/locatordiscovery/BadLocatorDiscoveryListener.td,\
> #com/sun/jini/test/spec/lookupdiscovery/RemoveDiscoveryListener.td,\
> #com/sun/jini/test/spec/joinmanager/GetLeaseRenewalManager.td,\
> #com/sun/jini/test/spec/lookupdiscovery/MulticastMonitorAllChange.td,\
> #com/sun/jini/test/spec/lookupdiscovery/MulticastMonitorChange.td,\
> #com/sun/jini/test/spec/lookupdiscovery/MulticastMonitorReplace.td,\
> #com/sun/jini/test/spec/lookupdiscovery/MulticastMonitorReplaceNone.td,\
> #com/sun/jini/test/spec/lookupdiscovery/MulticastMonitorStopReplace.td,\
> #com/sun/jini/test/spec/lookupdiscovery/MulticastMonitorTerminate.td,\
> #com/sun/jini/test/spec/lookupdiscovery/SetGroupsNoGroups.td,\
> #com/sun/jini/test/spec/joinmanager/GetDiscoveryManager.td,\
> #com/sun/jini/test/spec/locatordiscovery/SetLocatorsReplaceAll.td,\
> #com/sun/jini/test/spec/locatordiscovery/RemoveLocatorsSome.td,\
> #com/sun/jini/test/spec/locatordiscovery/RemoveLocatorsDups.td,\
> #com/sun/jini/test/spec/locatordiscovery/RemoveLocatorsAll.td,\
> #com/sun/jini/test/spec/lookupdiscovery/AddGroups.td,\
> #com/sun/jini/test/spec/lookupdiscovery/AddGroupsDups.td,\
> #com/sun/jini/test/spec/lookupdiscovery/DiscoveredDelay.td,\
> #com/sun/jini/test/spec/lookupdiscovery/RemoveGroupsDups.td,\
> #com/sun/jini/test/spec/lookupdiscovery/RemoveGroupsRemoveAll.td,\
> #com/sun/jini/test/spec/lookupdiscovery/RemoveGroupsRemoveSome.td,\
>
> #com/sun/jini/test/spec/lookupdiscovery/DiscoveryBeginsOnAddGroupsAfterEmpty.td,\
>
> #com/sun/jini/test/spec/lookupdiscovery/DiscoveryBeginsOnSetGroupsAfterEmpty.td,\
>
> #com/sun/jini/test/spec/lookupdiscovery/DiscoveryBeginsOnSetGroupsAllAfterEmpty.td,\
> #com/sun/jini/test/spec/lookupservice/test_set01/ReturnOnLookupByType.td,\
>
> #com/sun/jini/test/spec/discoveryservice/event/LateRegsNotifiedOn2SetGroups.td,\
>
> #com/sun/jini/test/spec/discoveryservice/event/LateRegsNotifiedOnAddGroups.td,\
> #com/sun/jini/test/spec/discoveryservice/event/MulticastMonitorStop.td,\
> #com/sun/jini/test/spec/discoveryservice/event/MulticastMonitorTerminate.td
> #com/sun/jini/test/spec/eventmailbox/EMSLST4.td,\
> #com/sun/jini/test/spec/eventmailbox/EMSLST3_PULL.td,\
> #com/sun/jini/test/spec/eventmailbox/EMSLST3.td,\
> #com/sun/jini/test/spec/eventmailbox/EMSLST2_PULL.td,\
> #com/sun/jini/test/spec/eventmailbox/EMSLST2.td,\
> #com/sun/jini/test/spec/eventmailbox/EMSLST.td
>

Re: QA harness output - where is it?

[Peter Firmstone <ji...@zeus.net.au>]

Greg,

Copy the attached logging.properties file to your home directory.
Copy the build.properties file to your trunk directory.

Then edit run.tests= in your build.properties file to run the failed 
tests again.

Execute ant qa.run-tests from the command line.

Then depending on your output, edit logging.properties to find out more.

When you want to perform debugging with jdb, append the following to the 
test.td file your having problems with, it will wait for the debugger 
before it starts.

testjvmargs=\
-Xdebug,\
-Xrunjdwp:transport=dt_socket+,address=8000+,server=y+,suspend=y,\
${testjvmargs}

If it's a concurrency problem, you'll have better luck with jstack.

Regards,

Peter.

Greg Trasuk wrote:
> Hi all:
>
> I have a probably very dumb question about running the qa framework. 
> When I checkout a rev, I run Ant, which does a build.  Then I run 'ant
> qa.run', and it works away for many hours, finally giving a short report
> saying "xxx" tests failed.  So far, so good.
>
> My question is where can I find some details about what tests failed and
> why?  Do I have to change the logging file setup, or am I just not
> seeing where the results are currently stored?  Is that final report
> even written to a file by default, or do I have to run it with some
> different options?
>
> Thanks in advance,
>
> Greg
>
>