You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Robert Joseph Evans (Created) (JIRA)" <ji...@apache.org> on 2011/11/09 16:21:51 UTC
[jira] [Created] (MAPREDUCE-3387) A tracking URL of N/A before the
app master is launched breaks oozie
A tracking URL of N/A before the app master is launched breaks oozie
--------------------------------------------------------------------
Key: MAPREDUCE-3387
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Robert Joseph Evans
Priority: Critical
When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3387) A tracking URL of N/A before the
app master is launched breaks oozie
Posted by "Robert Joseph Evans (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans updated MAPREDUCE-3387:
-------------------------------------------
Attachment: MR-3387.txt
I updated the code to remove the usage of TestAppId, as Vinod suggested. I could not determine what the javadoc errors were. I rerna test-patch and looked at all javadoc erros, and none of them have anything to do with this patch.
I did run sanity tests. I brought the WebUI up and I verified that it still showed the correct link after the state changed. I also verified that I could get the correct link before the ApplicationMaster was up an running.
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Attachments: MR-3387.txt, MR-3387.txt, MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3387) A tracking URL of N/A before
the app master is launched breaks oozie
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13171369#comment-13171369 ]
Hudson commented on MAPREDUCE-3387:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Commit #311 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/311/])
MAPREDUCE-3387. Fixed AM's tracking URL to always go through the proxy, even before the job started, so that it works properly with oozie throughout the job execution. Contributed by Robert Joseph Evans.
svn merge -c 1215345 --ignore-ancestry ../../trunk/
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215347
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/AppInfo.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/TestRMAppAttemptTransitions.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/main/java/org/apache/hadoop/yarn/server/webproxy/ProxyUriUtils.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/TestProxyUriUtils.java
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: MR-3387.txt, MR-3387.txt, MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3387) A tracking URL of N/A before
the app master is launched breaks oozie
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13169496#comment-13169496 ]
Hadoop QA commented on MAPREDUCE-3387:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12507371/MR-3387.txt
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 6 new or modified tests.
-1 javadoc. The javadoc tool appears to have generated 1 warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1446//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1446//console
This message is automatically generated.
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Attachments: MR-3387.txt, MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3387) A tracking URL of N/A before
the app master is launched breaks oozie
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168618#comment-13168618 ]
Hadoop QA commented on MAPREDUCE-3387:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12507216/MR-3387.txt
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 6 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1434//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1434//console
This message is automatically generated.
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Attachments: MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3387) A tracking URL of N/A before the
app master is launched breaks oozie
Posted by "Vinod Kumar Vavilapalli (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod Kumar Vavilapalli updated MAPREDUCE-3387:
-----------------------------------------------
Status: Open (was: Patch Available)
This seems to be broken after MAPREDUCE-2863. Robert, can you please update this?
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Attachments: MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3387) A tracking URL of N/A before
the app master is launched breaks oozie
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13171300#comment-13171300 ]
Hadoop QA commented on MAPREDUCE-3387:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12507736/MR-3387.txt
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 6 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1471//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1471//console
This message is automatically generated.
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Attachments: MR-3387.txt, MR-3387.txt, MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3387) A tracking URL of N/A before
the app master is launched breaks oozie
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13171331#comment-13171331 ]
Hudson commented on MAPREDUCE-3387:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #1517 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1517/])
MAPREDUCE-3387. Fixed AM's tracking URL to always go through the proxy, even before the job started, so that it works properly with oozie throughout the job execution. Contributed by Robert Joseph Evans.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215345
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/AppInfo.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/TestRMAppAttemptTransitions.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/main/java/org/apache/hadoop/yarn/server/webproxy/ProxyUriUtils.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/TestProxyUriUtils.java
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: MR-3387.txt, MR-3387.txt, MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3387) A tracking URL of N/A before
the app master is launched breaks oozie
Posted by "Vinod Kumar Vavilapalli (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13171309#comment-13171309 ]
Vinod Kumar Vavilapalli commented on MAPREDUCE-3387:
----------------------------------------------------
Cool, this looks good. +1.
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Attachments: MR-3387.txt, MR-3387.txt, MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3387) A tracking URL of N/A before the
app master is launched breaks oozie
Posted by "Robert Joseph Evans (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans updated MAPREDUCE-3387:
-------------------------------------------
Target Version/s: 0.23.1, 0.24.0 (was: 0.24.0, 0.23.1)
Status: Patch Available (was: Open)
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Attachments: MR-3387.txt, MR-3387.txt, MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3387) A tracking URL of N/A before the
app master is launched breaks oozie
Posted by "Robert Joseph Evans (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans updated MAPREDUCE-3387:
-------------------------------------------
Attachment: MR-3387.txt
You are totally right that there were merge conflicts. I have upmerged and fixed the issues.
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Attachments: MR-3387.txt, MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3387) A tracking URL of N/A before
the app master is launched breaks oozie
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13171556#comment-13171556 ]
Hudson commented on MAPREDUCE-3387:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Build #130 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/130/])
MAPREDUCE-3387. Fixed AM's tracking URL to always go through the proxy, even before the job started, so that it works properly with oozie throughout the job execution. Contributed by Robert Joseph Evans.
svn merge -c 1215345 --ignore-ancestry ../../trunk/
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215347
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/AppInfo.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/TestRMAppAttemptTransitions.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/main/java/org/apache/hadoop/yarn/server/webproxy/ProxyUriUtils.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/TestProxyUriUtils.java
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: MR-3387.txt, MR-3387.txt, MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3387) A tracking URL of N/A before
the app master is launched breaks oozie
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13171543#comment-13171543 ]
Hudson commented on MAPREDUCE-3387:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #897 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/897/])
MAPREDUCE-3387. Fixed AM's tracking URL to always go through the proxy, even before the job started, so that it works properly with oozie throughout the job execution. Contributed by Robert Joseph Evans.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215345
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/AppInfo.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/TestRMAppAttemptTransitions.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/main/java/org/apache/hadoop/yarn/server/webproxy/ProxyUriUtils.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/TestProxyUriUtils.java
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: MR-3387.txt, MR-3387.txt, MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3387) A tracking URL of N/A before
the app master is launched breaks oozie
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13171549#comment-13171549 ]
Hudson commented on MAPREDUCE-3387:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #110 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/110/])
MAPREDUCE-3387. Fixed AM's tracking URL to always go through the proxy, even before the job started, so that it works properly with oozie throughout the job execution. Contributed by Robert Joseph Evans.
svn merge -c 1215345 --ignore-ancestry ../../trunk/
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215347
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/AppInfo.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/TestRMAppAttemptTransitions.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/main/java/org/apache/hadoop/yarn/server/webproxy/ProxyUriUtils.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/TestProxyUriUtils.java
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: MR-3387.txt, MR-3387.txt, MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3387) A tracking URL of N/A before
the app master is launched breaks oozie
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13171337#comment-13171337 ]
Hudson commented on MAPREDUCE-3387:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Commit #288 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/288/])
MAPREDUCE-3387. Fixed AM's tracking URL to always go through the proxy, even before the job started, so that it works properly with oozie throughout the job execution. Contributed by Robert Joseph Evans.
svn merge -c 1215345 --ignore-ancestry ../../trunk/
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215347
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/AppInfo.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/TestRMAppAttemptTransitions.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/main/java/org/apache/hadoop/yarn/server/webproxy/ProxyUriUtils.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/TestProxyUriUtils.java
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: MR-3387.txt, MR-3387.txt, MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3387) A tracking URL of N/A before
the app master is launched breaks oozie
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13171330#comment-13171330 ]
Hudson commented on MAPREDUCE-3387:
-----------------------------------
Integrated in Hadoop-Common-0.23-Commit #299 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/299/])
MAPREDUCE-3387. Fixed AM's tracking URL to always go through the proxy, even before the job started, so that it works properly with oozie throughout the job execution. Contributed by Robert Joseph Evans.
svn merge -c 1215345 --ignore-ancestry ../../trunk/
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215347
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/AppInfo.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/TestRMAppAttemptTransitions.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/main/java/org/apache/hadoop/yarn/server/webproxy/ProxyUriUtils.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/TestProxyUriUtils.java
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: MR-3387.txt, MR-3387.txt, MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3387) A tracking URL of N/A before the
app master is launched breaks oozie
Posted by "Robert Joseph Evans (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans updated MAPREDUCE-3387:
-------------------------------------------
Target Version/s: 0.23.1, 0.24.0 (was: 0.23.1)
Status: Open (was: Patch Available)
Looking into the javadoc issue.
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Attachments: MR-3387.txt, MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3387) A tracking URL of N/A before the
app master is launched breaks oozie
Posted by "Robert Joseph Evans (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans updated MAPREDUCE-3387:
-------------------------------------------
Status: Patch Available (was: Open)
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Attachments: MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3387) A tracking URL of N/A before
the app master is launched breaks oozie
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13171342#comment-13171342 ]
Hudson commented on MAPREDUCE-3387:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #1444 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1444/])
MAPREDUCE-3387. Fixed AM's tracking URL to always go through the proxy, even before the job started, so that it works properly with oozie throughout the job execution. Contributed by Robert Joseph Evans.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215345
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/AppInfo.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/TestRMAppAttemptTransitions.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/main/java/org/apache/hadoop/yarn/server/webproxy/ProxyUriUtils.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/TestProxyUriUtils.java
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: MR-3387.txt, MR-3387.txt, MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3387) A tracking URL of N/A before the
app master is launched breaks oozie
Posted by "Vinod Kumar Vavilapalli (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod Kumar Vavilapalli updated MAPREDUCE-3387:
-----------------------------------------------
Resolution: Fixed
Fix Version/s: 0.23.1
Target Version/s: 0.23.1, 0.24.0 (was: 0.24.0, 0.23.1)
Release Note: Fixed AM's tracking URL to always go through the proxy, even before the job started, so that it works properly with oozie throughout the job execution.
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
I just committed this to trunk and branch-0.23. Thanks Robert!
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: MR-3387.txt, MR-3387.txt, MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-3387) A tracking URL of N/A before the
app master is launched breaks oozie
Posted by "Robert Joseph Evans (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans reassigned MAPREDUCE-3387:
----------------------------------------------
Assignee: Robert Joseph Evans
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3387) A tracking URL of N/A before
the app master is launched breaks oozie
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13171567#comment-13171567 ]
Hudson commented on MAPREDUCE-3387:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #930 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/930/])
MAPREDUCE-3387. Fixed AM's tracking URL to always go through the proxy, even before the job started, so that it works properly with oozie throughout the job execution. Contributed by Robert Joseph Evans.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215345
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/AppInfo.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/TestRMAppAttemptTransitions.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/main/java/org/apache/hadoop/yarn/server/webproxy/ProxyUriUtils.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/TestProxyUriUtils.java
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: MR-3387.txt, MR-3387.txt, MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3387) A tracking URL of N/A before the
app master is launched breaks oozie
Posted by "Robert Joseph Evans (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans updated MAPREDUCE-3387:
-------------------------------------------
Attachment: MR-3387.txt
This patch adds in a default URL which points to the proxy. It also updates the WebPage to not use "N/A" as a flag, but instead go off of the application's state.
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Attachments: MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3387) A tracking URL of N/A before
the app master is launched breaks oozie
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13171371#comment-13171371 ]
Hudson commented on MAPREDUCE-3387:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #1469 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1469/])
MAPREDUCE-3387. Fixed AM's tracking URL to always go through the proxy, even before the job started, so that it works properly with oozie throughout the job execution. Contributed by Robert Joseph Evans.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215345
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/RMAppAttemptImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/AppInfo.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/attempt/TestRMAppAttemptTransitions.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/main/java/org/apache/hadoop/yarn/server/webproxy/ProxyUriUtils.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/test/java/org/apache/hadoop/yarn/server/webproxy/TestProxyUriUtils.java
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Fix For: 0.23.1
>
> Attachments: MR-3387.txt, MR-3387.txt, MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3387) A tracking URL of N/A before
the app master is launched breaks oozie
Posted by "Vinod Kumar Vavilapalli (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13169768#comment-13169768 ]
Vinod Kumar Vavilapalli commented on MAPREDUCE-3387:
----------------------------------------------------
Patch looks good to me overall.
The javadoc problem perhaps is for the edits to java comments you made to ProxyUriUtils. getProxyUri() (Just in case you are still searching). Eclipse formatting suggest a bunch of tabs before 'a default path "/" can be used.'
Not related to your patch, but we don't need TestProxyUriUtils.TestAppId? Instead we can use the BuilderUtils.newApplicationId() method?
Oh, and can you please do a sanity run and verify the expected behavior? I don't have access to a cluster, so..
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Attachments: MR-3387.txt, MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3387) A tracking URL of N/A before the
app master is launched breaks oozie
Posted by "Robert Joseph Evans (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans updated MAPREDUCE-3387:
-------------------------------------------
Status: Patch Available (was: Open)
> A tracking URL of N/A before the app master is launched breaks oozie
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-3387
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3387
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Priority: Critical
> Attachments: MR-3387.txt, MR-3387.txt
>
>
> When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.
> Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira