[jira] [Commented] (YARN-2363) Submitted applications occasionally lack a tracking URL

["Jason Lowe (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YARN-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14076292#comment-14076292 ] 

Jason Lowe commented on YARN-2363:
----------------------------------

Most application submits result in a proxy tracking URL, but occasionally the client sees a transient "N/A" URL.  Here's a snippet of Pig client output where a MapReduce job was submitted with no tracking URL received:

{noformat}
2014-07-23 19:19:16,658 [JobControl] INFO org.apache.hadoop.mapred.ResourceMgrDelegate - Submitted application application_1403199204249_357708 to ResourceManager at
xx/xx:xx
2014-07-23 19:19:16,660 [JobControl] INFO  org.apache.hadoop.mapreduce.Job - The url to track the job: N/A
{noformat}

I believe this can occur if the client tries to get an application report just as the app is submitted.  YarnClientImpl.submitApplication won't return until the app is past the NEW_SAVING state, but if the client slips in while the app is in the SUBMITTED state then I think we could end up with no tracking URL due to the lack of a current attempt.  From RMAppImpl.createAndGetApplicationReport:

{code}
      String trackingUrl = UNAVAILABLE;
      String host = UNAVAILABLE;
      String origTrackingUrl = UNAVAILABLE;
[...]
      if (allowAccess) {
        if (this.currentAttempt != null) {
          currentApplicationAttemptId = this.currentAttempt.getAppAttemptId();
          trackingUrl = this.currentAttempt.getTrackingUrl();
          origTrackingUrl = this.currentAttempt.getOriginalTrackingUrl();
{code}

So if we don't have a current attempt we'll return "N/A" as the tracking URL.  Arguably we should return the proxied URL which will redirect to the RM app page if there is no tracking URL set yet so at least the client/user has a URL that can be used to track the application.


> Submitted applications occasionally lack a tracking URL
> -------------------------------------------------------
>
>                 Key: YARN-2363
>                 URL: https://issues.apache.org/jira/browse/YARN-2363
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 2.4.0
>            Reporter: Jason Lowe
>
> Sometimes when an application is submitted the client receives no tracking URL.  More details in the first comment.



--
This message was sent by Atlassian JIRA
(v6.2#6252)