You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by "Chris Riccomini (Created) (JIRA)" <ji...@apache.org> on 2011/09/28 19:10:46 UTC

[jira] [Created] (MAPREDUCE-3116) RM and NM fail to start (webapps/cluster is missing)

RM and NM fail to start (webapps/cluster is missing)
----------------------------------------------------

                 Key: MAPREDUCE-3116
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3116
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: nodemanager, resourcemanager
    Affects Versions: 0.24.0
         Environment: [criccomi@criccomi-ld trunk]$ svn info
Path: .
URL: http://svn.apache.org/repos/asf/hadoop/common/trunk
Repository Root: http://svn.apache.org/repos/asf
Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68
Revision: 1176955
Node Kind: directory
Schedule: normal
Last Changed Author: vinodkv
Last Changed Rev: 1176849
Last Changed Date: 2011-09-28 05:36:30 -0700 (Wed, 28 Sep 2011)

            Reporter: Chris Riccomini
            Priority: Critical


When I try to start the RM, I get:

2011-09-28 10:03:42,848 FATAL resourcemanager.ResourceManager (ResourceManager.java:main(514)) - Error starting ResourceManager
org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server
	at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:152)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startWepApp(ResourceManager.java:396)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.start(ResourceManager.java:411)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:512)
Caused by: java.io.FileNotFoundException: webapps/cluster not found in CLASSPATH
	at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:484)
	at org.apache.hadoop.http.HttpServer.<init>(HttpServer.java:184)
	at org.apache.hadoop.http.HttpServer.<init>(HttpServer.java:139)
	at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:144)
	... 3 more

When I try to start the NM, I get:

2011-09-28 09:40:52,330 ERROR webapp.WebServer (WebServer.java:start(65)) - NMWebapps failed to start.
org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server
	at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:152)
	at org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer.start(WebServer.java:59)
	at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
	at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:153)
	at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:202)
Caused by: java.io.FileNotFoundException: webapps/node not found in CLASSPATH
	at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:507)
	at org.apache.hadoop.http.HttpServer.<init>(HttpServer.java:207)
	at org.apache.hadoop.http.HttpServer.<init>(HttpServer.java:162)
	at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:144)
	... 4 more

I poked around a bit. When I jar -tvf my hadoop-yarn-common-0.24.0-SNAPSHOT.jar file, I see that it has:

     0 Mon Sep 19 09:41:18 PDT 2011 webapps/
     0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/
     0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/
     0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/
     0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/js/
     0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/css/
     0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/
     0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/jt/
     0 Mon Sep 19 09:41:18 PDT 2011 webapps/test/
     0 Mon Sep 19 09:41:18 PDT 2011 webapps/yarn/
   612 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/back_disabled.jpg
   260 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_desc.png
   263 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_asc.png
   807 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/back_enabled.jpg
   894 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/favicon.ico
   251 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_desc_disabled.png
   252 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_asc_disabled.png
 27490 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/Sorting icons.psd
   635 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/forward_disabled.jpg
   282 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_both.png
   852 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/forward_enabled.jpg
 18043 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/js/jquery.dataTables.min.js.gz
  1276 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/css/demo_page.css
  9689 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/css/demo_table.css
  6211 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/css/jui-dt.css
  4191 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_trontastic.png
  3259 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_humanity.png
  3260 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_start_menu.png
  8581 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_sunny.png
  2961 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_hot_sneaks.png
  3417 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_smoothness.png
  3309 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_black_matte.png
  3697 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_excite_bike.png
  8530 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_cupertino.png
  9041 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_eggplant.png
  5153 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_ui_light.png
  7533 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_blitzer.png
  9124 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_le_frog.png
  3166 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_dot_luv.png
  7103 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_overcast.png
 11553 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_pepper_grinder.png
  5367 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_swanky_purse.png
  6432 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_flick.png
 10481 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_dark_hive.png
  8760 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_ui_dark.png
  3370 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_windoze.png
  8417 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_south_street.png
  8620 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_mint_choco.png
  3623 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_black_tie.png
  1118 Mon Sep 19 09:41:18 PDT 2011 webapps/static/yarn.css
 23946 Mon Sep 19 09:41:18 PDT 2011 webapps/static/hadoop-st.png
  8821 Mon Sep 19 09:41:18 PDT 2011 webapps/static/themeswitcher.js.gz
  3494 Mon Sep 19 09:41:18 PDT 2011 webapps/static/busy.gif
 37540 Mon Sep 19 09:41:18 PDT 2011 webapps/static/jt/jquery.jstree.js.gz
  1628 Mon Sep 19 09:41:18 PDT 2011 webapps/static/yarn.dt.plugins.js
     0 Mon Sep 19 09:41:18 PDT 2011 webapps/test/.keep
     0 Mon Sep 19 09:41:18 PDT 2011 webapps/yarn/.keep

Clearly, this is missing the cluster/.keep path, which appears to be required by RM (as it specifies "cluster" as the webapp name when it starts).

I think that we need to get "cluster" and whatever NM's webapp name is back into the webapps directory in the jar.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Resolved] (MAPREDUCE-3116) RM and NM fail to start (webapps/cluster is missing)

Posted by "Chris Riccomini (Resolved) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chris Riccomini resolved MAPREDUCE-3116.
----------------------------------------

    Resolution: Not A Problem
    
> RM and NM fail to start (webapps/cluster is missing)
> ----------------------------------------------------
>
>                 Key: MAPREDUCE-3116
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3116
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: nodemanager, resourcemanager
>    Affects Versions: 0.24.0
>         Environment: [criccomi@criccomi-ld trunk]$ svn info
> Path: .
> URL: http://svn.apache.org/repos/asf/hadoop/common/trunk
> Repository Root: http://svn.apache.org/repos/asf
> Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68
> Revision: 1176955
> Node Kind: directory
> Schedule: normal
> Last Changed Author: vinodkv
> Last Changed Rev: 1176849
> Last Changed Date: 2011-09-28 05:36:30 -0700 (Wed, 28 Sep 2011)
>            Reporter: Chris Riccomini
>            Priority: Critical
>
> When I try to start the RM, I get:
> 2011-09-28 10:03:42,848 FATAL resourcemanager.ResourceManager (ResourceManager.java:main(514)) - Error starting ResourceManager
> org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server
> 	at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:152)
> 	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startWepApp(ResourceManager.java:396)
> 	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.start(ResourceManager.java:411)
> 	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:512)
> Caused by: java.io.FileNotFoundException: webapps/cluster not found in CLASSPATH
> 	at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:484)
> 	at org.apache.hadoop.http.HttpServer.<init>(HttpServer.java:184)
> 	at org.apache.hadoop.http.HttpServer.<init>(HttpServer.java:139)
> 	at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:144)
> 	... 3 more
> When I try to start the NM, I get:
> 2011-09-28 09:40:52,330 ERROR webapp.WebServer (WebServer.java:start(65)) - NMWebapps failed to start.
> org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server
> 	at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:152)
> 	at org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer.start(WebServer.java:59)
> 	at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
> 	at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:153)
> 	at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:202)
> Caused by: java.io.FileNotFoundException: webapps/node not found in CLASSPATH
> 	at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:507)
> 	at org.apache.hadoop.http.HttpServer.<init>(HttpServer.java:207)
> 	at org.apache.hadoop.http.HttpServer.<init>(HttpServer.java:162)
> 	at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:144)
> 	... 4 more
> I poked around a bit. When I jar -tvf my hadoop-yarn-common-0.24.0-SNAPSHOT.jar file, I see that it has:
>      0 Mon Sep 19 09:41:18 PDT 2011 webapps/
>      0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/
>      0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/
>      0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/
>      0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/js/
>      0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/css/
>      0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/
>      0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/jt/
>      0 Mon Sep 19 09:41:18 PDT 2011 webapps/test/
>      0 Mon Sep 19 09:41:18 PDT 2011 webapps/yarn/
>    612 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/back_disabled.jpg
>    260 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_desc.png
>    263 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_asc.png
>    807 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/back_enabled.jpg
>    894 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/favicon.ico
>    251 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_desc_disabled.png
>    252 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_asc_disabled.png
>  27490 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/Sorting icons.psd
>    635 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/forward_disabled.jpg
>    282 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_both.png
>    852 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/forward_enabled.jpg
>  18043 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/js/jquery.dataTables.min.js.gz
>   1276 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/css/demo_page.css
>   9689 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/css/demo_table.css
>   6211 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/css/jui-dt.css
>   4191 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_trontastic.png
>   3259 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_humanity.png
>   3260 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_start_menu.png
>   8581 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_sunny.png
>   2961 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_hot_sneaks.png
>   3417 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_smoothness.png
>   3309 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_black_matte.png
>   3697 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_excite_bike.png
>   8530 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_cupertino.png
>   9041 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_eggplant.png
>   5153 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_ui_light.png
>   7533 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_blitzer.png
>   9124 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_le_frog.png
>   3166 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_dot_luv.png
>   7103 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_overcast.png
>  11553 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_pepper_grinder.png
>   5367 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_swanky_purse.png
>   6432 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_flick.png
>  10481 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_dark_hive.png
>   8760 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_ui_dark.png
>   3370 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_windoze.png
>   8417 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_south_street.png
>   8620 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_mint_choco.png
>   3623 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_black_tie.png
>   1118 Mon Sep 19 09:41:18 PDT 2011 webapps/static/yarn.css
>  23946 Mon Sep 19 09:41:18 PDT 2011 webapps/static/hadoop-st.png
>   8821 Mon Sep 19 09:41:18 PDT 2011 webapps/static/themeswitcher.js.gz
>   3494 Mon Sep 19 09:41:18 PDT 2011 webapps/static/busy.gif
>  37540 Mon Sep 19 09:41:18 PDT 2011 webapps/static/jt/jquery.jstree.js.gz
>   1628 Mon Sep 19 09:41:18 PDT 2011 webapps/static/yarn.dt.plugins.js
>      0 Mon Sep 19 09:41:18 PDT 2011 webapps/test/.keep
>      0 Mon Sep 19 09:41:18 PDT 2011 webapps/yarn/.keep
> Clearly, this is missing the cluster/.keep path, which appears to be required by RM (as it specifies "cluster" as the webapp name when it starts).
> I think that we need to get "cluster" and whatever NM's webapp name is back into the webapps directory in the jar.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira