You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Prabhu Joseph (JIRA)" <ji...@apache.org> on 2019/02/20 06:48:00 UTC
[jira] [Comment Edited] (YARN-8132) Final Status of applications
shown as UNDEFINED in ATS app queries
[ https://issues.apache.org/jira/browse/YARN-8132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16772665#comment-16772665 ]
Prabhu Joseph edited comment on YARN-8132 at 2/20/19 6:47 AM:
--------------------------------------------------------------
[~bibinchundatt] The existing test case {{TestRMAppTransitions#testAppNewKill}} covers the scenario. The {{currentAttempt}} is not created (Null) and the {{RMAppImpl}} StateMachine currentState is transitioned properly to KILLED. The issue happens only when the job is killed after attempt is created as the attempt's {{finalStatus}} is not updated.
was (Author: prabhu joseph):
[~bibinchundatt] The existing test case TestRMAppTransitions#testAppNewKill covers the scenario. The currentAttempt is not created (Null) and the StateMachine currentState is transitioned properly to KILLED. The issue happens only when the job is killed after attempt is created as the attempt finalStatus is not updated.
> Final Status of applications shown as UNDEFINED in ATS app queries
> ------------------------------------------------------------------
>
> Key: YARN-8132
> URL: https://issues.apache.org/jira/browse/YARN-8132
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: ATSv2, timelineservice
> Reporter: Charan Hebri
> Assignee: Prabhu Joseph
> Priority: Major
> Attachments: YARN-8132-001.patch, YARN-8132-002.patch, YARN-8132-003.patch, YARN-8132-004.patch
>
>
> Final Status is shown as UNDEFINED for applications that are KILLED/FAILED. A sample request/response with INFO field for an application,
> {noformat}
> 2018-04-09 13:10:02,126 INFO reader.TimelineReaderWebServices (TimelineReaderWebServices.java:getApp(1693)) - Received URL /ws/v2/timeline/apps/application_1523259757659_0003?fields=INFO from user hrt_qa
> 2018-04-09 13:10:02,156 INFO reader.TimelineReaderWebServices (TimelineReaderWebServices.java:getApp(1716)) - Processed URL /ws/v2/timeline/apps/application_1523259757659_0003?fields=INFO (Took 30 ms.){noformat}
> {noformat}
> {
> "metrics": [],
> "events": [],
> "createdtime": 1523263360719,
> "idprefix": 0,
> "id": "application_1523259757659_0003",
> "type": "YARN_APPLICATION",
> "info": {
> "YARN_APPLICATION_CALLER_CONTEXT": "CLI",
> "YARN_APPLICATION_DIAGNOSTICS_INFO": "Application application_1523259757659_0003 was killed by user xxx_xx at XXX.XXX.XXX.XXX",
> "YARN_APPLICATION_FINAL_STATUS": "UNDEFINED",
> "YARN_APPLICATION_NAME": "Sleep job",
> "YARN_APPLICATION_USER": "hrt_qa",
> "YARN_APPLICATION_UNMANAGED_APPLICATION": false,
> "FROM_ID": "yarn-cluster!hrt_qa!test_flow!1523263360719!application_1523259757659_0003",
> "UID": "yarn-cluster!application_1523259757659_0003",
> "YARN_APPLICATION_VIEW_ACLS": " ",
> "YARN_APPLICATION_SUBMITTED_TIME": 1523263360718,
> "YARN_AM_CONTAINER_LAUNCH_COMMAND": [
> "$JAVA_HOME/bin/java -Djava.io.tmpdir=$PWD/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog -Dhdp.version=3.0.0.0-1163 -Xmx819m -Dhdp.version=3.0.0.0-1163 org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr "
> ],
> "YARN_APPLICATION_QUEUE": "default",
> "YARN_APPLICATION_TYPE": "MAPREDUCE",
> "YARN_APPLICATION_PRIORITY": 0,
> "YARN_APPLICATION_LATEST_APP_ATTEMPT": "appattempt_1523259757659_0003_000001",
> "YARN_APPLICATION_TAGS": [
> "timeline_flow_name_tag:test_flow"
> ],
> "YARN_APPLICATION_STATE": "KILLED"
> },
> "configs": {},
> "isrelatedto": {},
> "relatesto": {}
> }{noformat}
> This is different to what the Resource Manager reports. For KILLED applications the final status is KILLED and for FAILED applications it is FAILED. This behavior is seen in ATSv2 as well as older versions of ATS.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org