You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2015/02/25 01:54:40 UTC
Failed: YARN-3031 PreCommit Build #6717
Jira: https://issues.apache.org/jira/browse/YARN-3031
Build: https://builds.apache.org/job/PreCommit-YARN-Build/6717/
###################################################################################
########################## LAST 60 LINES OF THE CONSOLE ###########################
[...truncated 3182 lines...]
{color:red}-1 overall{color}. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12700617/YARN-3031.02.patch
against trunk revision ac3468a.
{color:green}+1 @author{color}. The patch does not contain any @author tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api.
Test results: https://builds.apache.org/job/PreCommit-YARN-Build/6717//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/6717//console
This message is automatically generated.
======================================================================
======================================================================
Adding comment to Jira.
======================================================================
======================================================================
Comment added.
65bb2a8dbd24a42825494d451066e218aaeaa827 logged out
======================================================================
======================================================================
Finished build.
======================================================================
======================================================================
Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to PreCommit-YARN-Build #6713
Archived 15 artifacts
Archive block size is 32768
Received 51 blocks and 7423325 bytes
Compression is 18.4%
Took 2.3 sec
[description-setter] Could not determine description.
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
###################################################################################
############################## FAILED TESTS (if any) ##############################
No tests ran.
Failed: YARN-1809 PreCommit Build #6719
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Jira: https://issues.apache.org/jira/browse/YARN-1809
Build: https://builds.apache.org/job/PreCommit-YARN-Build/6719/
###################################################################################
########################## LAST 60 LINES OF THE CONSOLE ###########################
[...truncated 3946 lines...]
{color:green}+1 @author{color}. The patch does not contain any @author tags.
{color:green}+1 tests included{color}. The patch appears to include 5 new or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse.
{color:red}-1 findbugs{color}. The patch appears to introduce 8 new Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager:
org.apache.hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices
org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebAppFairScheduler
org.apache.hadoop.yarn.server.resourcemanager.webapp.TestAppPage
org.apache.hadoop.yarn.server.resourcemanager.recovery.TestFSRMStateStore
Test results: https://builds.apache.org/job/PreCommit-YARN-Build/6719//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-YARN-Build/6719//artifact/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-YARN-Build/6719//artifact/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/6719//console
This message is automatically generated.
======================================================================
======================================================================
Adding comment to Jira.
======================================================================
======================================================================
Comment added.
ee999638dc8ef048c9d32eb99068700af4f26f0c logged out
======================================================================
======================================================================
Finished build.
======================================================================
======================================================================
Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to PreCommit-YARN-Build #6713
Archived 30 artifacts
Archive block size is 32768
Received 46 blocks and 8157651 bytes
Compression is 15.6%
Took 2 sec
[description-setter] Could not determine description.
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
###################################################################################
############################## FAILED TESTS (if any) ##############################
7 tests failed.
FAILED: org.apache.hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices.testSingleContainer[0]
Error Message:
JSONObject["logUrl"] not found.
Stack Trace:
org.codehaus.jettison.json.JSONException: JSONObject["logUrl"] not found.
at org.codehaus.jettison.json.JSONObject.get(JSONObject.java:360)
at org.codehaus.jettison.json.JSONObject.getString(JSONObject.java:487)
at org.apache.hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices.testSingleContainer(TestAHSWebServices.java:367)
FAILED: org.apache.hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices.testSingleAttempt[1]
Error Message:
expected:<Forbidden> but was:<Internal Server Error>
Stack Trace:
java.lang.AssertionError: expected:<Forbidden> but was:<Internal Server Error>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:144)
at org.apache.hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices.testSingleAttempt(TestAHSWebServices.java:292)
FAILED: org.apache.hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices.testSingleContainer[1]
Error Message:
expected:<Forbidden> but was:<Internal Server Error>
Stack Trace:
java.lang.AssertionError: expected:<Forbidden> but was:<Internal Server Error>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:144)
at org.apache.hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices.testSingleContainer(TestAHSWebServices.java:351)
REGRESSION: org.apache.hadoop.yarn.server.resourcemanager.recovery.TestFSRMStateStore.testFSRMStateStoreClientRetry
Error Message:
null
Stack Trace:
java.lang.AssertionError: null
at org.junit.Assert.fail(Assert.java:86)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.junit.Assert.assertFalse(Assert.java:64)
at org.junit.Assert.assertFalse(Assert.java:74)
at org.apache.hadoop.yarn.server.resourcemanager.recovery.TestFSRMStateStore.testFSRMStateStoreClientRetry(TestFSRMStateStore.java:289)
REGRESSION: org.apache.hadoop.yarn.server.resourcemanager.webapp.TestAppPage.testAppBlockRenderWithNullCurrentAppAttempt
Error Message:
Guice configuration errors:
1) No implementation for org.apache.hadoop.yarn.api.ApplicationBaseProtocol was bound.
while locating org.apache.hadoop.yarn.api.ApplicationBaseProtocol
for parameter 0 at org.apache.hadoop.yarn.server.webapp.AppBlock.<init>(AppBlock.java:62)
while locating org.apache.hadoop.yarn.server.webapp.AppBlock
1 error
Stack Trace:
com.google.inject.ConfigurationException: Guice configuration errors:
1) No implementation for org.apache.hadoop.yarn.api.ApplicationBaseProtocol was bound.
while locating org.apache.hadoop.yarn.api.ApplicationBaseProtocol
for parameter 0 at org.apache.hadoop.yarn.server.webapp.AppBlock.<init>(AppBlock.java:62)
while locating org.apache.hadoop.yarn.server.webapp.AppBlock
1 error
at com.google.inject.internal.InjectorImpl.getProvider(InjectorImpl.java:1004)
at com.google.inject.internal.InjectorImpl.getProvider(InjectorImpl.java:961)
at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1013)
at org.apache.hadoop.yarn.server.resourcemanager.webapp.TestAppPage.testAppBlockRenderWithNullCurrentAppAttempt(TestAppPage.java:87)
REGRESSION: org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebAppFairScheduler.testFairSchedulerWebAppPageInInconsistentState
Error Message:
Failed to render FairSchedulerPage: com.google.inject.ConfigurationException: Guice configuration errors:
1) No implementation for org.apache.hadoop.yarn.api.ApplicationBaseProtocol was bound.
while locating org.apache.hadoop.yarn.api.ApplicationBaseProtocol
for parameter 1 at org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerAppsBlock.<init>(FairSchedulerAppsBlock.java:64)
while locating org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerAppsBlock
1 error
at com.google.inject.internal.InjectorImpl.getProvider(InjectorImpl.java:1004)
at com.google.inject.internal.InjectorImpl.getProvider(InjectorImpl.java:961)
at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1013)
at org.apache.hadoop.yarn.webapp.View.getInstance(View.java:108)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
at org.apache.hadoop.yarn.webapp.view.HtmlBlock$Block.subView(HtmlBlock.java:41)
at org.apache.hadoop.yarn.webapp.hamlet.Hamlet._(Hamlet.java:30347)
at org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerPage$QueuesBlock.render(FairSchedulerPage.java:190)
at org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:67)
at org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:77)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
at org.apache.hadoop.yarn.webapp.view.HtmlPage$Page.subView(HtmlPage.java:49)
at org.apache.hadoop.yarn.webapp.hamlet.HamletImpl$EImp._v(HamletImpl.java:117)
at org.apache.hadoop.yarn.webapp.hamlet.Hamlet$TD._(Hamlet.java:845)
at org.apache.hadoop.yarn.webapp.view.TwoColumnLayout.render(TwoColumnLayout.java:56)
at org.apache.hadoop.yarn.webapp.view.HtmlPage.render(HtmlPage.java:82)
at org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebAppFairScheduler.testFairSchedulerWebAppPageInInconsistentState(TestRMWebAppFairScheduler.java:123)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
Stack Trace:
java.lang.AssertionError: Failed to render FairSchedulerPage: com.google.inject.ConfigurationException: Guice configuration errors:
1) No implementation for org.apache.hadoop.yarn.api.ApplicationBaseProtocol was bound.
while locating org.apache.hadoop.yarn.api.ApplicationBaseProtocol
for parameter 1 at org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerAppsBlock.<init>(FairSchedulerAppsBlock.java:64)
while locating org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerAppsBlock
1 error
at com.google.inject.internal.InjectorImpl.getProvider(InjectorImpl.java:1004)
at com.google.inject.internal.InjectorImpl.getProvider(InjectorImpl.java:961)
at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1013)
at org.apache.hadoop.yarn.webapp.View.getInstance(View.java:108)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
at org.apache.hadoop.yarn.webapp.view.HtmlBlock$Block.subView(HtmlBlock.java:41)
at org.apache.hadoop.yarn.webapp.hamlet.Hamlet._(Hamlet.java:30347)
at org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerPage$QueuesBlock.render(FairSchedulerPage.java:190)
at org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:67)
at org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:77)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
at org.apache.hadoop.yarn.webapp.view.HtmlPage$Page.subView(HtmlPage.java:49)
at org.apache.hadoop.yarn.webapp.hamlet.HamletImpl$EImp._v(HamletImpl.java:117)
at org.apache.hadoop.yarn.webapp.hamlet.Hamlet$TD._(Hamlet.java:845)
at org.apache.hadoop.yarn.webapp.view.TwoColumnLayout.render(TwoColumnLayout.java:56)
at org.apache.hadoop.yarn.webapp.view.HtmlPage.render(HtmlPage.java:82)
at org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebAppFairScheduler.testFairSchedulerWebAppPageInInconsistentState(TestRMWebAppFairScheduler.java:123)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
at org.junit.Assert.fail(Assert.java:88)
at org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebAppFairScheduler.testFairSchedulerWebAppPageInInconsistentState(TestRMWebAppFairScheduler.java:125)
REGRESSION: org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebAppFairScheduler.testFairSchedulerWebAppPage
Error Message:
Guice configuration errors:
1) No implementation for org.apache.hadoop.yarn.api.ApplicationBaseProtocol was bound.
while locating org.apache.hadoop.yarn.api.ApplicationBaseProtocol
for parameter 1 at org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerAppsBlock.<init>(FairSchedulerAppsBlock.java:64)
while locating org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerAppsBlock
1 error
Stack Trace:
com.google.inject.ConfigurationException: Guice configuration errors:
1) No implementation for org.apache.hadoop.yarn.api.ApplicationBaseProtocol was bound.
while locating org.apache.hadoop.yarn.api.ApplicationBaseProtocol
for parameter 1 at org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerAppsBlock.<init>(FairSchedulerAppsBlock.java:64)
while locating org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerAppsBlock
1 error
at com.google.inject.internal.InjectorImpl.getProvider(InjectorImpl.java:1004)
at com.google.inject.internal.InjectorImpl.getProvider(InjectorImpl.java:961)
at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1013)
at org.apache.hadoop.yarn.webapp.View.getInstance(View.java:108)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
at org.apache.hadoop.yarn.webapp.view.HtmlBlock$Block.subView(HtmlBlock.java:41)
at org.apache.hadoop.yarn.webapp.hamlet.Hamlet._(Hamlet.java:30347)
at org.apache.hadoop.yarn.server.resourcemanager.webapp.FairSchedulerPage$QueuesBlock.render(FairSchedulerPage.java:190)
at org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:67)
at org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:77)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
at org.apache.hadoop.yarn.webapp.view.HtmlPage$Page.subView(HtmlPage.java:49)
at org.apache.hadoop.yarn.webapp.hamlet.HamletImpl$EImp._v(HamletImpl.java:117)
at org.apache.hadoop.yarn.webapp.hamlet.Hamlet$TD._(Hamlet.java:845)
at org.apache.hadoop.yarn.webapp.view.TwoColumnLayout.render(TwoColumnLayout.java:56)
at org.apache.hadoop.yarn.webapp.view.HtmlPage.render(HtmlPage.java:82)
at org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebAppFairScheduler.testFairSchedulerWebAppPage(TestRMWebAppFairScheduler.java:83)
Failed: YARN-2190 PreCommit Build #6718
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Jira: https://issues.apache.org/jira/browse/YARN-2190
Build: https://builds.apache.org/job/PreCommit-YARN-Build/6718/
###################################################################################
########################## LAST 60 LINES OF THE CONSOLE ###########################
[...truncated 23 lines...]
======================================================================
======================================================================
Testing patch for YARN-2190.
======================================================================
======================================================================
HEAD is now at 1a625b8 HADOOP-11480. Typo in hadoop-aws/index.md uses wrong scheme for test.fs.s3.name. Contributed by Ted Yu.
Previous HEAD position was 1a625b8... HADOOP-11480. Typo in hadoop-aws/index.md uses wrong scheme for test.fs.s3.name. Contributed by Ted Yu.
Switched to branch 'trunk'
Your branch is behind 'origin/trunk' by 2 commits, and can be fast-forwarded.
(use "git pull" to update your local branch)
First, rewinding head to replay your work on top of it...
Fast-forwarded trunk to 1a625b8158ab1cf765fbda962ba725503409d9fe.
YARN-2190 patch is being downloaded at Wed Feb 25 01:50:23 UTC 2015 from
http://issues.apache.org/jira/secure/attachment/12700646/YARN-2190.8.patch
cp: cannot stat '/home/jenkins/buildSupport/lib/*': No such file or directory
The patch does not appear to apply with p0 to p2
PATCH APPLICATION FAILED
{color:red}-1 overall{color}. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12700646/YARN-2190.8.patch
against trunk revision 1a625b8.
{color:red}-1 patch{color}. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/6718//console
This message is automatically generated.
======================================================================
======================================================================
Adding comment to Jira.
======================================================================
======================================================================
Comment added.
2b4d51fe1049229ae159b94d3af9370161cc7426 logged out
======================================================================
======================================================================
Finished build.
======================================================================
======================================================================
Build step 'Execute shell' marked build as failure
Archiving artifacts
[description-setter] Could not determine description.
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
###################################################################################
############################## FAILED TESTS (if any) ##############################
No tests ran.