You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Prabhu Joseph (JIRA)" <ji...@apache.org> on 2019/03/02 17:05:00 UTC

[jira] [Commented] (YARN-9338) Timeline related testcases are failing

    [ https://issues.apache.org/jira/browse/YARN-9338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16782449#comment-16782449 ] 

Prabhu Joseph commented on YARN-9338:
-------------------------------------

Hi [~abmodi], The fix works fine for all reported failing test cases. Have found one more test {{TestResourceTrackerService}} is also failing. 

{code}
[ERROR] Error occurred in starting fork, check output in log
[ERROR] Process Exit Code: 255
[ERROR] Crashed tests:
[ERROR] org.apache.hadoop.yarn.server.resourcemanager.TestResourceTrackerService
[ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:670)
[ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.access$600(ForkStarter.java:116)
[ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter$2.call(ForkStarter.java:445)
[ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter$2.call(ForkStarter.java:421)
[ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[ERROR] at java.lang.Thread.run(Thread.java:745)
[ERROR] -> [Help 1]
{code}

It fails as empty flowName is not handled.

{code}
2019-03-02 22:04:24,521 FATAL [RM Timeline dispatcher] event.AsyncDispatcher (AsyncDispatcher.java:dispatch(203)) - Error in dispatcher thread
java.lang.IllegalArgumentException: Can not create a Path from an empty string
	at org.apache.hadoop.fs.Path.checkPathArg(Path.java:168)
	at org.apache.hadoop.fs.Path.<init>(Path.java:180)
	at org.apache.hadoop.fs.Path.<init>(Path.java:125)
	at org.apache.hadoop.yarn.server.timelineservice.storage.FileSystemTimelineWriterImpl.writeInternal(FileSystemTimelineWriterImpl.java:132)
	at org.apache.hadoop.yarn.server.timelineservice.storage.FileSystemTimelineWriterImpl.write(FileSystemTimelineWriterImpl.java:106)
	at org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollector.writeTimelineEntities(TimelineCollector.java:192)
	at org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollector.putEntities(TimelineCollector.java:150)
	at org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV2Publisher.putEntity(TimelineServiceV2Publisher.java:476)
	at org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV2Publisher.access$100(TimelineServiceV2Publisher.java:73)
	at org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV2Publisher$TimelineV2EventHandler.handle(TimelineServiceV2Publisher.java:511)
	at org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV2Publisher$TimelineV2EventHandler.handle(TimelineServiceV2Publisher.java:500)
	at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:197)
	at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:126)
	at java.lang.Thread.run(Thread.java:745)
{code}



> Timeline related testcases are failing
> --------------------------------------
>
>                 Key: YARN-9338
>                 URL: https://issues.apache.org/jira/browse/YARN-9338
>             Project: Hadoop YARN
>          Issue Type: Test
>            Reporter: Prabhu Joseph
>            Assignee: Abhishek Modi
>            Priority: Major
>         Attachments: YARN-9338.001.patch
>
>
> Timeline related testcases are failing
> {code}
> [ERROR] Failures: 
> [ERROR]   TestCombinedSystemMetricsPublisher.testTimelineServiceEventPublishingV2Enabled:262->runTest:245->validateV2:382->verifyEntity:417 Expected 2 events to be published expected:<2> but was:<1>
> [ERROR]   TestSystemMetricsPublisherForV2.testPublishAppAttemptMetrics:259->verifyEntity:332 Expected 2 events to be published expected:<2> but was:<1>
> [ERROR]   TestSystemMetricsPublisherForV2.testPublishApplicationMetrics:224->verifyEntity:332 Expected 4 events to be published expected:<4> but was:<1>
> [ERROR]   TestSystemMetricsPublisherForV2.testPublishContainerMetrics:291->verifyEntity:332 Expected 2 events to be published expected:<2> but was:<1>
> [ERROR] Errors: 
> [ERROR]   TestCombinedSystemMetricsPublisher.testTimelineServiceEventPublishingV1V2Enabled:252->runTest:242->testSetup:123 » YarnRuntime
> [ERROR] Failures: 
> [ERROR]   TestTimelineAuthFilterForV2.testPutTimelineEntities:343->access$000:87->publishAndVerifyEntity:307 expected:<1> but was:<2>
> [ERROR]   TestTimelineAuthFilterForV2.testPutTimelineEntities:352->publishWithRetries:320->publishAndVerifyEntity:307 expected:<1> but was:<2>
> [ERROR]   TestTimelineAuthFilterForV2.testPutTimelineEntities:352->publishWithRetries:320->publishAndVerifyEntity:307 expected:<1> but was:<2>
> [ERROR]   TestTimelineAuthFilterForV2.testPutTimelineEntities:343->access$000:87->publishAndVerifyEntity:307 expected:<1> but was:<2>
> [INFO] 
> [ERROR] Failures: 
> [ERROR]   TestDistributedShell.testDSShellWithoutDomainV2:313->testDSShell:317->testDSShell:458->checkTimelineV2:557->verifyEntityForTimelineV2:710 Unexpected number of DS_APP_ATTEMPT_START event published. expected:<1> but was:<0>
> [ERROR]   TestDistributedShell.testDSShellWithoutDomainV2CustomizedFlow:329->testDSShell:458->checkTimelineV2:557->verifyEntityForTimelineV2:710 Unexpected number of DS_APP_ATTEMPT_START event published. expected:<1> but was:<0>
> [ERROR]   TestDistributedShell.testDSShellWithoutDomainV2DefaultFlow:323->testDSShell:458->checkTimelineV2:557->verifyEntityForTimelineV2:710 Unexpected number of DS_APP_ATTEMPT_START event published. expected:<1> but was:<0>
> [ERROR] Failures: 
> [ERROR]   TestMRTimelineEventHandling.testMRNewTimelineServiceEventHandling:240->checkNewTimelineEvent:304->verifyEntity:462
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org