You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Zhiyuan Yang (JIRA)" <ji...@apache.org> on 2017/06/28 00:50:03 UTC
[jira] [Comment Edited] (TEZ-3617)
TestHistoryParser#testParserWithSuccessfulJob fails intermittently
[ https://issues.apache.org/jira/browse/TEZ-3617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065738#comment-16065738 ]
Zhiyuan Yang edited comment on TEZ-3617 at 6/28/17 12:49 AM:
-------------------------------------------------------------
[~jeagles] It doesn't seems a port conflict issue. If port 8188 is already occupied, ATS fail to start and throw exception. I tried 'nc -l 8188' before running this test and get following error, different from the one attached to this jira.
{noformat}
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException: ApplicationHistoryServer failed to start. Final state is STOPPED
at org.apache.hadoop.yarn.server.MiniYARNCluster$ApplicationHistoryServerWrapper.serviceStart(MiniYARNCluster.java:717)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
at org.apache.tez.tests.MiniTezClusterWithTimeline.serviceStart(MiniTezClusterWithTimeline.java:202)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.tez.history.TestHistoryParser.setupTezCluster(TestHistoryParser.java:174)
at org.apache.tez.history.TestHistoryParser.setupCluster(TestHistoryParser.java:133)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.junit.runner.JUnitCore.run(JUnitCore.java:160)
at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:69)
at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:234)
at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:74)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.intellij.rt.execution.application.AppMain.main(AppMain.java:144)
Caused by: java.io.IOException: ApplicationHistoryServer failed to start. Final state is STOPPED
at org.apache.hadoop.yarn.server.MiniYARNCluster$ApplicationHistoryServerWrapper.serviceStart(MiniYARNCluster.java:713)
...
{noformat}
I suspect there are other fixes in 2.7.2 related to this. [~skanekar]] Could you please try Jon's patch partially, i.e.,bumping hadoop version only? This help us to identify the root cause.
was (Author: aplusplus):
[~jeagles] It doesn't seems a port conflict issue. If port 8188 is already occupied, ATS fail to start and throw exception. I tried 'nc -l 8188' before running this test and get following error, different from the one attached to this jira.
{noformat}
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.io.IOException: ApplicationHistoryServer failed to start. Final state is STOPPED
at org.apache.hadoop.yarn.server.MiniYARNCluster$ApplicationHistoryServerWrapper.serviceStart(MiniYARNCluster.java:717)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
at org.apache.tez.tests.MiniTezClusterWithTimeline.serviceStart(MiniTezClusterWithTimeline.java:202)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.tez.history.TestHistoryParser.setupTezCluster(TestHistoryParser.java:174)
at org.apache.tez.history.TestHistoryParser.setupCluster(TestHistoryParser.java:133)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.junit.runner.JUnitCore.run(JUnitCore.java:160)
at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:69)
at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:234)
at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:74)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.intellij.rt.execution.application.AppMain.main(AppMain.java:144)
Caused by: java.io.IOException: ApplicationHistoryServer failed to start. Final state is STOPPED
at org.apache.hadoop.yarn.server.MiniYARNCluster$ApplicationHistoryServerWrapper.serviceStart(MiniYARNCluster.java:713)
...
{noformat}
> TestHistoryParser#testParserWithSuccessfulJob fails intermittently
> ------------------------------------------------------------------
>
> Key: TEZ-3617
> URL: https://issues.apache.org/jira/browse/TEZ-3617
> Project: Apache Tez
> Issue Type: Bug
> Affects Versions: 0.9.0
> Environment: Ubuntu 14.04
> Reporter: Sonia Garudi
> Assignee: Jonathan Eagles
> Labels: ppc64le, x86
> Attachments: org.apache.tez.history.TestHistoryParser-output.txt, TEZ-3617.1.patch
>
>
> The TestHistoryParser#testParserWithSuccessfulJob test fails intermittently in tez-history-parser project.
> Error message :
> testParserWithSuccessfulJob(org.apache.tez.history.TestHistoryParser) Time elapsed: 29.952 sec <<< FAILURE!
> java.lang.AssertionError: null
> at org.junit.Assert.fail(Assert.java:86)
> at org.junit.Assert.assertTrue(Assert.java:41)
> at org.junit.Assert.assertTrue(Assert.java:52)
> at org.apache.tez.history.TestHistoryParser.verifyJobSpecificInfo(TestHistoryParser.java:266)
> at org.apache.tez.history.TestHistoryParser.testParserWithSuccessfulJob(TestHistoryParser.java:212)
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)