You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "Wing Yew Poon (Created) (JIRA)" <ji...@apache.org> on 2012/02/14 02:42:59 UTC
[jira] [Created] (BIGTOP-401) unable to run
hadoop-mapreduce-historyserver
unable to run hadoop-mapreduce-historyserver
--------------------------------------------
Key: BIGTOP-401
URL: https://issues.apache.org/jira/browse/BIGTOP-401
Project: Bigtop
Issue Type: Bug
Components: General
Affects Versions: 0.3.0
Reporter: Wing Yew Poon
Fix For: 0.3.0
I installed hadoop-conf-pseudo from http://bigtop01.cloudera.org:8080/view/Bigtop-hadoop-0.23/job/Bigtop-hadoop-0.23-Repository/label=centos5/5/artifact/repo/.
When I try to start hadoop-mapreduce-historyserver, I get:
Starting Hadoop historyserver daemon (hadoop-historyserver): starting historyserver, logging to /var/log/hadoop/hadoop--historyserver-localhost.localdomain.out
Exception in thread "main" java.lang.NoClassDefFoundError: historyserver
Caused by: java.lang.ClassNotFoundException: historyserver
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
Could not find the main class: historyserver. Program will exit.
historyserver is stopped
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (BIGTOP-401) unable to run
hadoop-mapreduce-historyserver
Posted by "Roman Shaposhnik (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Roman Shaposhnik updated BIGTOP-401:
------------------------------------
Attachment: BIGTOP-401.patch.txt
I'm attaching a patch that can be considered an overkill for this particular JIRA, but it actually paves the way for fixing BIGTOP-22.
The idea here is that all the common init.d logic will reside in init.d.tmp (we will promote it to a more common location) and the tweaks will be concentrated in little .svc files.
Basically this is a poor man's templating engine written in shell.
Why shell? Well, I've considered m4, but it would introduce an extra build time dependency (not a big deal, but still) and the quoting rules of m4 make it a little bit fragile for using as a templating mechanism for shell code.
I'm open to other suggestions of what to use as a templating engine but I think shell should be fine for now. Besides, once we do the refactoring substituting one templating engine with a different one will be a much more trivial exersize.
Finally, please review the content of init.d.tml very, very carefully. It is the amalgamation of various implementations that we've got in Bigtop but I haven't really tested how well it works.
> unable to run hadoop-mapreduce-historyserver
> --------------------------------------------
>
> Key: BIGTOP-401
> URL: https://issues.apache.org/jira/browse/BIGTOP-401
> Project: Bigtop
> Issue Type: Bug
> Components: General
> Affects Versions: 0.3.0
> Reporter: Wing Yew Poon
> Assignee: Roman Shaposhnik
> Fix For: 0.3.0
>
> Attachments: BIGTOP-401.patch.txt
>
>
> I installed hadoop-conf-pseudo from http://bigtop01.cloudera.org:8080/view/Bigtop-hadoop-0.23/job/Bigtop-hadoop-0.23-Repository/label=centos5/5/artifact/repo/.
> When I try to start hadoop-mapreduce-historyserver, I get:
> Starting Hadoop historyserver daemon (hadoop-historyserver): starting historyserver, logging to /var/log/hadoop/hadoop--historyserver-localhost.localdomain.out
> Exception in thread "main" java.lang.NoClassDefFoundError: historyserver
> Caused by: java.lang.ClassNotFoundException: historyserver
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> Could not find the main class: historyserver. Program will exit.
> historyserver is stopped
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-401) unable to run
hadoop-mapreduce-historyserver
Posted by "Peter Linnell (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13213970#comment-13213970 ]
Peter Linnell commented on BIGTOP-401:
--------------------------------------
LGTM and I like having things consistent. I also agree with Bruno's comments. Nice work!
> unable to run hadoop-mapreduce-historyserver
> --------------------------------------------
>
> Key: BIGTOP-401
> URL: https://issues.apache.org/jira/browse/BIGTOP-401
> Project: Bigtop
> Issue Type: Bug
> Components: General
> Affects Versions: 0.3.0
> Reporter: Wing Yew Poon
> Assignee: Roman Shaposhnik
> Fix For: 0.3.0
>
> Attachments: BIGTOP-401.patch.txt
>
>
> I installed hadoop-conf-pseudo from http://bigtop01.cloudera.org:8080/view/Bigtop-hadoop-0.23/job/Bigtop-hadoop-0.23-Repository/label=centos5/5/artifact/repo/.
> When I try to start hadoop-mapreduce-historyserver, I get:
> Starting Hadoop historyserver daemon (hadoop-historyserver): starting historyserver, logging to /var/log/hadoop/hadoop--historyserver-localhost.localdomain.out
> Exception in thread "main" java.lang.NoClassDefFoundError: historyserver
> Caused by: java.lang.ClassNotFoundException: historyserver
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> Could not find the main class: historyserver. Program will exit.
> historyserver is stopped
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (BIGTOP-401) unable to run
hadoop-mapreduce-historyserver
Posted by "Roman Shaposhnik (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Roman Shaposhnik reassigned BIGTOP-401:
---------------------------------------
Assignee: Roman Shaposhnik
> unable to run hadoop-mapreduce-historyserver
> --------------------------------------------
>
> Key: BIGTOP-401
> URL: https://issues.apache.org/jira/browse/BIGTOP-401
> Project: Bigtop
> Issue Type: Bug
> Components: General
> Affects Versions: 0.3.0
> Reporter: Wing Yew Poon
> Assignee: Roman Shaposhnik
> Fix For: 0.3.0
>
>
> I installed hadoop-conf-pseudo from http://bigtop01.cloudera.org:8080/view/Bigtop-hadoop-0.23/job/Bigtop-hadoop-0.23-Repository/label=centos5/5/artifact/repo/.
> When I try to start hadoop-mapreduce-historyserver, I get:
> Starting Hadoop historyserver daemon (hadoop-historyserver): starting historyserver, logging to /var/log/hadoop/hadoop--historyserver-localhost.localdomain.out
> Exception in thread "main" java.lang.NoClassDefFoundError: historyserver
> Caused by: java.lang.ClassNotFoundException: historyserver
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> Could not find the main class: historyserver. Program will exit.
> historyserver is stopped
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-401) unable to run
hadoop-mapreduce-historyserver
Posted by "Peter Linnell (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13214160#comment-13214160 ]
Peter Linnell commented on BIGTOP-401:
--------------------------------------
+1 LGTM.. nice this will close a few bugs once we have it all tested :)
> unable to run hadoop-mapreduce-historyserver
> --------------------------------------------
>
> Key: BIGTOP-401
> URL: https://issues.apache.org/jira/browse/BIGTOP-401
> Project: Bigtop
> Issue Type: Bug
> Components: General
> Affects Versions: 0.3.0
> Reporter: Wing Yew Poon
> Assignee: Roman Shaposhnik
> Fix For: 0.3.0
>
> Attachments: BIGTOP-401.2.patch.txt, BIGTOP-401.patch.txt
>
>
> I installed hadoop-conf-pseudo from http://bigtop01.cloudera.org:8080/view/Bigtop-hadoop-0.23/job/Bigtop-hadoop-0.23-Repository/label=centos5/5/artifact/repo/.
> When I try to start hadoop-mapreduce-historyserver, I get:
> Starting Hadoop historyserver daemon (hadoop-historyserver): starting historyserver, logging to /var/log/hadoop/hadoop--historyserver-localhost.localdomain.out
> Exception in thread "main" java.lang.NoClassDefFoundError: historyserver
> Caused by: java.lang.ClassNotFoundException: historyserver
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> Could not find the main class: historyserver. Program will exit.
> historyserver is stopped
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (BIGTOP-401) unable to run
hadoop-mapreduce-historyserver
Posted by "Roman Shaposhnik (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Roman Shaposhnik updated BIGTOP-401:
------------------------------------
Attachment: BIGTOP-401.2.patch.txt
Took care of the licensing concerns and provided the docs. Also tested on Debian and everything seems to work.
> unable to run hadoop-mapreduce-historyserver
> --------------------------------------------
>
> Key: BIGTOP-401
> URL: https://issues.apache.org/jira/browse/BIGTOP-401
> Project: Bigtop
> Issue Type: Bug
> Components: General
> Affects Versions: 0.3.0
> Reporter: Wing Yew Poon
> Assignee: Roman Shaposhnik
> Fix For: 0.3.0
>
> Attachments: BIGTOP-401.2.patch.txt, BIGTOP-401.patch.txt
>
>
> I installed hadoop-conf-pseudo from http://bigtop01.cloudera.org:8080/view/Bigtop-hadoop-0.23/job/Bigtop-hadoop-0.23-Repository/label=centos5/5/artifact/repo/.
> When I try to start hadoop-mapreduce-historyserver, I get:
> Starting Hadoop historyserver daemon (hadoop-historyserver): starting historyserver, logging to /var/log/hadoop/hadoop--historyserver-localhost.localdomain.out
> Exception in thread "main" java.lang.NoClassDefFoundError: historyserver
> Caused by: java.lang.ClassNotFoundException: historyserver
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> Could not find the main class: historyserver. Program will exit.
> historyserver is stopped
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-401) unable to run
hadoop-mapreduce-historyserver
Posted by "Bruno Mahé (Commented JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13214150#comment-13214150 ]
Bruno Mahé commented on BIGTOP-401:
-----------------------------------
+1 LGTM
Although, I would have loved something to attract the eye on the ". $1" (something like a comment). It's very easy to miss.
> unable to run hadoop-mapreduce-historyserver
> --------------------------------------------
>
> Key: BIGTOP-401
> URL: https://issues.apache.org/jira/browse/BIGTOP-401
> Project: Bigtop
> Issue Type: Bug
> Components: General
> Affects Versions: 0.3.0
> Reporter: Wing Yew Poon
> Assignee: Roman Shaposhnik
> Fix For: 0.3.0
>
> Attachments: BIGTOP-401.2.patch.txt, BIGTOP-401.patch.txt
>
>
> I installed hadoop-conf-pseudo from http://bigtop01.cloudera.org:8080/view/Bigtop-hadoop-0.23/job/Bigtop-hadoop-0.23-Repository/label=centos5/5/artifact/repo/.
> When I try to start hadoop-mapreduce-historyserver, I get:
> Starting Hadoop historyserver daemon (hadoop-historyserver): starting historyserver, logging to /var/log/hadoop/hadoop--historyserver-localhost.localdomain.out
> Exception in thread "main" java.lang.NoClassDefFoundError: historyserver
> Caused by: java.lang.ClassNotFoundException: historyserver
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> Could not find the main class: historyserver. Program will exit.
> historyserver is stopped
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-401) unable to run
hadoop-mapreduce-historyserver
Posted by "Bruno Mahé (Commented JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13213868#comment-13213868 ]
Bruno Mahé commented on BIGTOP-401:
-----------------------------------
Blocker:
* All the new files are missing Apache License header
Other than that:
* I would love to see a little bit more comments so I don't miss the . $1 and don't have to reverse engineer the whole process to figure it out. Or mark some separation between the function being declared (generate_start/stop/etc.) and the huge cat
Over all LGTM though. But if we go any further in templating we should look into using some real templating engines.
> unable to run hadoop-mapreduce-historyserver
> --------------------------------------------
>
> Key: BIGTOP-401
> URL: https://issues.apache.org/jira/browse/BIGTOP-401
> Project: Bigtop
> Issue Type: Bug
> Components: General
> Affects Versions: 0.3.0
> Reporter: Wing Yew Poon
> Assignee: Roman Shaposhnik
> Fix For: 0.3.0
>
> Attachments: BIGTOP-401.patch.txt
>
>
> I installed hadoop-conf-pseudo from http://bigtop01.cloudera.org:8080/view/Bigtop-hadoop-0.23/job/Bigtop-hadoop-0.23-Repository/label=centos5/5/artifact/repo/.
> When I try to start hadoop-mapreduce-historyserver, I get:
> Starting Hadoop historyserver daemon (hadoop-historyserver): starting historyserver, logging to /var/log/hadoop/hadoop--historyserver-localhost.localdomain.out
> Exception in thread "main" java.lang.NoClassDefFoundError: historyserver
> Caused by: java.lang.ClassNotFoundException: historyserver
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> Could not find the main class: historyserver. Program will exit.
> historyserver is stopped
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (BIGTOP-401) unable to run
hadoop-mapreduce-historyserver
Posted by "Roman Shaposhnik (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/BIGTOP-401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13212382#comment-13212382 ]
Roman Shaposhnik commented on BIGTOP-401:
-----------------------------------------
Turns out this is a bit more difficult than I thought. Upstream hadoop has changed how the history server daemon is started and we have to match those changes in Bigtop. At this point it feels like we're better off unifying our init.d scripts instead of introducing yet another copy of one. This will take a bit more time, though. In the meantime, please let me know if this is blocking you and if you can use a workaround of manually starting a history server via a daemon
management script located in /usr/lib/hadoop/sbin.
> unable to run hadoop-mapreduce-historyserver
> --------------------------------------------
>
> Key: BIGTOP-401
> URL: https://issues.apache.org/jira/browse/BIGTOP-401
> Project: Bigtop
> Issue Type: Bug
> Components: General
> Affects Versions: 0.3.0
> Reporter: Wing Yew Poon
> Fix For: 0.3.0
>
>
> I installed hadoop-conf-pseudo from http://bigtop01.cloudera.org:8080/view/Bigtop-hadoop-0.23/job/Bigtop-hadoop-0.23-Repository/label=centos5/5/artifact/repo/.
> When I try to start hadoop-mapreduce-historyserver, I get:
> Starting Hadoop historyserver daemon (hadoop-historyserver): starting historyserver, logging to /var/log/hadoop/hadoop--historyserver-localhost.localdomain.out
> Exception in thread "main" java.lang.NoClassDefFoundError: historyserver
> Caused by: java.lang.ClassNotFoundException: historyserver
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> Could not find the main class: historyserver. Program will exit.
> historyserver is stopped
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira