You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Jeffrey Naisbitt (JIRA)" <ji...@apache.org> on 2011/07/25 19:34:09 UTC

[jira] [Created] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

MR-279: Add the jobFile to the web UI
-------------------------------------

                 Key: MAPREDUCE-2726
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: mrv2
    Affects Versions: 0.23.0
            Reporter: Jeffrey Naisbitt
            Assignee: Jeffrey Naisbitt
             Fix For: 0.23.0


MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13107888#comment-13107888 ] 

Hadoop QA commented on MAPREDUCE-2726:
--------------------------------------

+1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12495080/MAPREDUCE-2726.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed unit tests in .

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/782//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/782//console

This message is automatically generated.

> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>            Priority: Blocker
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch, MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13105725#comment-13105725 ] 

Mahadev konar commented on MAPREDUCE-2726:
------------------------------------------

Jeff,
 Why did you remove the job file from the HSController? How is the jobconf being displayed on the history UI?

> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "Vinod Kumar Vavilapalli (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vinod Kumar Vavilapalli updated MAPREDUCE-2726:
-----------------------------------------------

      Resolution: Fixed
    Hadoop Flags: [Reviewed]
          Status: Resolved  (was: Patch Available)

I just committed this to trunk and branch-0.23. Thanks Jeffrey!

> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>            Priority: Blocker
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch, MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13105622#comment-13105622 ] 

Hadoop QA commented on MAPREDUCE-2726:
--------------------------------------

+1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12494677/MAPREDUCE-2726.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed unit tests in .

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/753//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/753//console

This message is automatically generated.

> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "jiraposter@reviews.apache.org (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13106801#comment-13106801 ] 

jiraposter@reviews.apache.org commented on MAPREDUCE-2726:
----------------------------------------------------------


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/1920/#review1943
-----------------------------------------------------------

Ship it!


+1

- Jonathan


On 2011-09-15 19:14:46, Jeffrey Naisbitt wrote:
bq.  
bq.  -----------------------------------------------------------
bq.  This is an automatically generated e-mail. To reply, visit:
bq.  https://reviews.apache.org/r/1920/
bq.  -----------------------------------------------------------
bq.  
bq.  (Updated 2011-09-15 19:14:46)
bq.  
bq.  
bq.  Review request for Tom Graves, Robert Evans, Ravi Prakash, and Jonathan Eagles.
bq.  
bq.  
bq.  Summary
bq.  -------
bq.  
bq.  Add the jobfile configuration to the ApplicationMaster UI (mr-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/) and the history UI (mr-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/webapp/).
bq.  
bq.  
bq.  This addresses bug MAPREDUCE-2726.
bq.      http://issues.apache.org/jira/browse/MAPREDUCE-2726
bq.  
bq.  
bq.  Diffs
bq.  -----
bq.  
bq.    hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AMWebApp.java f74c409 
bq.    hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java cb9bfa7 
bq.    hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/JobConfPage.java PRE-CREATION 
bq.    hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/NavBlock.java 5bbfc24 
bq.    hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAMWebApp.java c5938e8 
bq.    hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/webapp/HsController.java 13f7b71 
bq.  
bq.  Diff: https://reviews.apache.org/r/1920/diff
bq.  
bq.  
bq.  Testing
bq.  -------
bq.  
bq.  
bq.  Thanks,
bq.  
bq.  Jeffrey
bq.  
bq.



> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "Jeffrey Naisbitt (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jeffrey Naisbitt updated MAPREDUCE-2726:
----------------------------------------

        Fix Version/s: 0.24.0
    Affects Version/s:     (was: 0.23.0)
               Status: Patch Available  (was: Open)

> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13108652#comment-13108652 ] 

Hudson commented on MAPREDUCE-2726:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk #806 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/806/])
    MAPREDUCE-2726. Added job-file to the AM and JobHistoryServer web interfaces. Contributed by Jeffrey Naisbitt.

vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1172704
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AMWebApp.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/JobConfPage.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/NavBlock.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAMWebApp.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/webapp/HsController.java


> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>            Priority: Blocker
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch, MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13108696#comment-13108696 ] 

Hudson commented on MAPREDUCE-2726:
-----------------------------------

Integrated in Hadoop-Hdfs-0.23-Build #14 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/14/])
    MAPREDUCE-2726. svn merge -c r1172704 --ignore-ancestry ../../trunk/

vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1172708
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AMWebApp.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/JobConfPage.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/NavBlock.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAMWebApp.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/webapp/HsController.java


> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>            Priority: Blocker
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch, MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "Jeffrey Naisbitt (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13106558#comment-13106558 ] 

Jeffrey Naisbitt commented on MAPREDUCE-2726:
---------------------------------------------

@Vinod:  I see that the Tools->Configuration is standard throughout, so it probably doesn't make sense to remove that.  I still like the dynamic table though and will wait to hear your opinion on that.

@Tom: It looks like you're correct.  That line is probably not needed.

> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "Jeffrey Naisbitt (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jeffrey Naisbitt updated MAPREDUCE-2726:
----------------------------------------

    Attachment: MAPREDUCE-2726.patch

Removed line per Tom's comment.  

@Vinod: I would still like your opinion on leaving the nicer, more professional-looking table.

> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>            Priority: Blocker
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch, MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13107992#comment-13107992 ] 

Hudson commented on MAPREDUCE-2726:
-----------------------------------

Integrated in Hadoop-Common-trunk-Commit #913 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/913/])
    MAPREDUCE-2726. Added job-file to the AM and JobHistoryServer web interfaces. Contributed by Jeffrey Naisbitt.

vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1172704
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AMWebApp.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/JobConfPage.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/NavBlock.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAMWebApp.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/webapp/HsController.java


> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>            Priority: Blocker
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch, MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13107993#comment-13107993 ] 

Hudson commented on MAPREDUCE-2726:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk-Commit #990 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/990/])
    MAPREDUCE-2726. Added job-file to the AM and JobHistoryServer web interfaces. Contributed by Jeffrey Naisbitt.

vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1172704
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AMWebApp.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/JobConfPage.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/NavBlock.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAMWebApp.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/webapp/HsController.java


> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>            Priority: Blocker
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch, MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "Vinod Kumar Vavilapalli (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13070927#comment-13070927 ] 

Vinod Kumar Vavilapalli commented on MAPREDUCE-2726:
----------------------------------------------------

As commented [here|https://issues.apache.org/jira/browse/MAPREDUCE-2716?focusedCommentId=13070924&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13070924], job-file is a mapreduce only concept. So we should add this link to ApplicationMaster UI (mr-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/) and the history UI (mr-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/webapp/).

> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>             Fix For: 0.23.0
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "jiraposter@reviews.apache.org (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13105617#comment-13105617 ] 

jiraposter@reviews.apache.org commented on MAPREDUCE-2726:
----------------------------------------------------------


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/1920/
-----------------------------------------------------------

Review request for Tom Graves, Robert Evans, Ravi Prakash, and Jonathan Eagles.


Summary
-------

Add the jobfile configuration to the ApplicationMaster UI (mr-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/) and the history UI (mr-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/webapp/).


This addresses bug MAPREDUCE-2726.
    http://issues.apache.org/jira/browse/MAPREDUCE-2726


Diffs
-----

  hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AMWebApp.java f74c409 
  hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java cb9bfa7 
  hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/JobConfPage.java PRE-CREATION 
  hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/NavBlock.java 5bbfc24 
  hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAMWebApp.java c5938e8 
  hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/webapp/HsController.java 13f7b71 

Diff: https://reviews.apache.org/r/1920/diff


Testing
-------


Thanks,

Jeffrey



> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "Jeffrey Naisbitt (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jeffrey Naisbitt updated MAPREDUCE-2726:
----------------------------------------

    Status: Patch Available  (was: Open)

> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>            Priority: Blocker
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch, MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13108679#comment-13108679 ] 

Hudson commented on MAPREDUCE-2726:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk #836 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/836/])
    MAPREDUCE-2726. Added job-file to the AM and JobHistoryServer web interfaces. Contributed by Jeffrey Naisbitt.

vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1172704
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AMWebApp.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/JobConfPage.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/NavBlock.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAMWebApp.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/webapp/HsController.java


> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>            Priority: Blocker
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch, MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "Vinod Kumar Vavilapalli (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13107982#comment-13107982 ] 

Vinod Kumar Vavilapalli commented on MAPREDUCE-2726:
----------------------------------------------------

bq. First, we're not actually masking the /conf servlet since this code is going through the default /yarn route (and will therefore be at /yarn/conf).
Ouch, yeah, you are right.

bq.[..] Therefore, I would prefer to file a separate Jira for adding links and support for getting the actual XML (and leave this patch as is). What do you think?
okay. +1

> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>            Priority: Blocker
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch, MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "Jeffrey Naisbitt (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jeffrey Naisbitt updated MAPREDUCE-2726:
----------------------------------------

    Attachment: MAPREDUCE-2726.patch

> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "Jeffrey Naisbitt (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13107953#comment-13107953 ] 

Jeffrey Naisbitt commented on MAPREDUCE-2726:
---------------------------------------------

@Vinod:
First, we're not actually masking the /conf servlet since this code is going through the default /yarn route (and will therefore be at /yarn/conf).

Second, it seems weird to associate the AppMaster's /conf servlet with the job itself (even though right now there is basically a 1-to-1 mapping) - /conf is still technically the configuration for the AppMaster itself.  Additionally, the JobHistory won't work in this way anyway.  So, I would prefer to find a common and consistent way to handle the job config in both the AppMaster and the JobHistory (perhaps adding a /conf-xml or maybe looking at making it more REST-like and having some ability to specify whether you want XML or HTML).  Therefore, I would prefer to file a separate Jira for adding links and support for getting the actual XML (and leave this patch as is).  What do you think?

> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>            Priority: Blocker
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch, MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "jiraposter@reviews.apache.org (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13106533#comment-13106533 ] 

jiraposter@reviews.apache.org commented on MAPREDUCE-2726:
----------------------------------------------------------


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/1920/#review1928
-----------------------------------------------------------



hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/JobConfPage.java
<https://reviews.apache.org/r/1920/#comment4417>

    isn't this the exact default in AppView common PreHead already?


- Tom


On 2011-09-15 19:14:46, Jeffrey Naisbitt wrote:
bq.  
bq.  -----------------------------------------------------------
bq.  This is an automatically generated e-mail. To reply, visit:
bq.  https://reviews.apache.org/r/1920/
bq.  -----------------------------------------------------------
bq.  
bq.  (Updated 2011-09-15 19:14:46)
bq.  
bq.  
bq.  Review request for Tom Graves, Robert Evans, Ravi Prakash, and Jonathan Eagles.
bq.  
bq.  
bq.  Summary
bq.  -------
bq.  
bq.  Add the jobfile configuration to the ApplicationMaster UI (mr-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/) and the history UI (mr-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/webapp/).
bq.  
bq.  
bq.  This addresses bug MAPREDUCE-2726.
bq.      http://issues.apache.org/jira/browse/MAPREDUCE-2726
bq.  
bq.  
bq.  Diffs
bq.  -----
bq.  
bq.    hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AMWebApp.java f74c409 
bq.    hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java cb9bfa7 
bq.    hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/JobConfPage.java PRE-CREATION 
bq.    hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/NavBlock.java 5bbfc24 
bq.    hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAMWebApp.java c5938e8 
bq.    hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/webapp/HsController.java 13f7b71 
bq.  
bq.  Diff: https://reviews.apache.org/r/1920/diff
bq.  
bq.  
bq.  Testing
bq.  -------
bq.  
bq.  
bq.  Thanks,
bq.  
bq.  Jeffrey
bq.  
bq.



> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "Jeffrey Naisbitt (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13106094#comment-13106094 ] 

Jeffrey Naisbitt commented on MAPREDUCE-2726:
---------------------------------------------

@Mahadev: I removed the conf() method from the HsController.java because I had to add it to AppController.java, and HsController inherits from AppController.  No need to duplicate the same function.
The jobconf is still displayed the same way on the history UI (just using the base class conf() method along with the overrided confPage() method).

@Vinod: I do see a Configuration option under the "Tools" section on the sidebar (which I didn't see before).  However, I also think it makes more sense to have the job's configuration under the "Job" section rather than "Tools".  I also prefer the professional-looking dynamically searchable/sortable table over the xml display.  That said, I would prefer to keep the nice table and either get rid of the xml page or leave the xml page so that people could download the actual xml if they wanted.  What do you think?


> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13108008#comment-13108008 ] 

Hudson commented on MAPREDUCE-2726:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #930 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/930/])
    MAPREDUCE-2726. Added job-file to the AM and JobHistoryServer web interfaces. Contributed by Jeffrey Naisbitt.

vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1172704
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AMWebApp.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/JobConfPage.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/NavBlock.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAMWebApp.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/webapp/HsController.java


> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>            Priority: Blocker
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch, MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13108687#comment-13108687 ] 

Hudson commented on MAPREDUCE-2726:
-----------------------------------

Integrated in Hadoop-Mapreduce-0.23-Build #12 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/12/])
    MAPREDUCE-2726. svn merge -c r1172704 --ignore-ancestry ../../trunk/

vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1172708
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AMWebApp.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/AppController.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/JobConfPage.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/webapp/NavBlock.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAMWebApp.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/webapp/HsController.java


> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>            Priority: Blocker
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch, MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy updated MAPREDUCE-2726:
-------------------------------------

    Priority: Blocker  (was: Major)

> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>            Priority: Blocker
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "Vinod Kumar Vavilapalli (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13107926#comment-13107926 ] 

Vinod Kumar Vavilapalli commented on MAPREDUCE-2726:
----------------------------------------------------

I was waiting for getting a cluster up so that I could look at how the output of the default servlet looks like. I got one now, so it's plain XML.

+1 for having a sortable/searchable conf page. Patch looks good too.

But I do think we shouldn't be masking the /conf servlet which is useful for downloading the config file. Can you change the new path to be /config or something such and link it from everywere. Also, I think it makes sense to add a link on the new /config page to the old /conf so that one can download xml/json.

> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>            Priority: Blocker
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch, MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2726) MR-279: Add the jobFile to the web UI

Posted by "Vinod Kumar Vavilapalli (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vinod Kumar Vavilapalli updated MAPREDUCE-2726:
-----------------------------------------------

    Status: Open  (was: Patch Available)

I just realized something - for the AM web UI at least, you don't need to do any of this. The core WebApp(and the wrapped HttpServer), which AMWebapp inherits from, already has this configuration servlet, a generic servlet for all daemons. In fact, IIRC you can navigate to the job-configuration on the AM web-UI from the side-bar. Not sure why ConfBlock was added in the MR AM module.

But we still need to do something similar to what the patch does for the HistoryUI case. Because on JobHistoryServer(JHS), history-url/conf will point us to the JHS' configuration itself and not to individual jobs'.

> MR-279: Add the jobFile to the web UI
> -------------------------------------
>
>                 Key: MAPREDUCE-2726
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2726
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Jeffrey Naisbitt
>            Assignee: Jeffrey Naisbitt
>             Fix For: 0.23.0, 0.24.0
>
>         Attachments: MAPREDUCE-2726.patch
>
>
> MAPREDUCE:2716 adds the jobfile information to the ApplicationReport.  With that information available, we should add the jobfile to the web UI as well.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira