You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Ahmed Radwan (Created) (JIRA)" <ji...@apache.org> on 2011/10/17 11:02:11 UTC

[jira] [Created] (HADOOP-7752) Unable to start yarn services using the new hadoop-dist tar stitching module

Unable to start yarn services using the new hadoop-dist tar stitching module
----------------------------------------------------------------------------

                 Key: HADOOP-7752
                 URL: https://issues.apache.org/jira/browse/HADOOP-7752
             Project: Hadoop Common
          Issue Type: Bug
          Components: build
    Affects Versions: 0.23.0, 0.24.0
            Reporter: Ahmed Radwan


Using the maven target: $mvn package -Pdist -DskipTests
I am seeing the following error when trying to start the resourcemanager:

$ bin/yarn-daemon.sh start resourcemanager
starting resourcemanager, logging to /home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs/yarn-ahmed-resourcemanager-ubuntu.out
/usr/lib/jvm/java-6-sun/bin/java -Dproc_resourcemanager -Xmx1000m -Dhadoop.log.dir=/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs -Dyarn.log.dir=/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs -Dhadoop.log.file=yarn-ahmed-resourcemanager-ubuntu.log -Dyarn.log.file=yarn-ahmed-resourcemanager-ubuntu.log -Dyarn.home.dir=/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/.. -Dhadoop.root.logger=INFO,DRFA -Dyarn.root.logger=INFO,DRFA -classpath /home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/:~/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/::/usr/lib/jvm/java-6-sun/lib/tools.jar:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/common/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/common/lib/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/hdfs/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/hdfs/lib/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../modules/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../lib/*:~/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf//rm-config/log4j.properties org.apache.hadoop.yarn.server.resourcemanager.ResourceManager
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/server/resourcemanager/ResourceManager
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.yarn.server.resourcemanager.ResourceManager
	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
Could not find the main class: org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.  Program will exit.

Seems there are some missing jars in the modules directory in the dist:
$ ls -al modules/
total 476
drwxr-xr-x  2 ahmed ahmed   4096 2011-10-17 00:56 .
drwxr-xr-x 11 ahmed ahmed   4096 2011-10-17 00:58 ..
-rwxr-xr-x  1 ahmed ahmed 347941 2011-10-17 00:56 hadoop-mapreduce-client-app-0.24.0-SNAPSHOT.jar
-rwxr-xr-x  1 ahmed ahmed  79364 2011-10-17 00:56 hadoop-mapreduce-client-hs-0.24.0-SNAPSHOT.jar
-rwxr-xr-x  1 ahmed ahmed  30720 2011-10-17 00:56 hadoop-mapreduce-client-jobclient-0.24.0-SNAPSHOT.jar
-rwxr-xr-x  1 ahmed ahmed  15358 2011-10-17 00:56 hadoop-mapreduce-client-shuffle-0.24.0-SNAPSHOT.jar

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Resolved] (HADOOP-7752) Unable to start yarn services using the new hadoop-dist tar stitching module

Posted by "Ahmed Radwan (Resolved) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ahmed Radwan resolved HADOOP-7752.
----------------------------------

    Resolution: Cannot Reproduce

The problem seemed to disappear after pulling the new patches.
                
> Unable to start yarn services using the new hadoop-dist tar stitching module
> ----------------------------------------------------------------------------
>
>                 Key: HADOOP-7752
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7752
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.23.0, 0.24.0
>            Reporter: Ahmed Radwan
>
> Using the maven target: $mvn package -Pdist -DskipTests
> I am seeing the following error when trying to start the resourcemanager:
> {code}
> $ bin/yarn-daemon.sh start resourcemanager
> starting resourcemanager, logging to /home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs/yarn-ahmed-resourcemanager-ubuntu.out
> /usr/lib/jvm/java-6-sun/bin/java -Dproc_resourcemanager -Xmx1000m -Dhadoop.log.dir=/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs -Dyarn.log.dir=/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../logs -Dhadoop.log.file=yarn-ahmed-resourcemanager-ubuntu.log -Dyarn.log.file=yarn-ahmed-resourcemanager-ubuntu.log -Dyarn.home.dir=/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/.. -Dhadoop.root.logger=INFO,DRFA -Dyarn.root.logger=INFO,DRFA -classpath /home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/:~/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/::/usr/lib/jvm/java-6-sun/lib/tools.jar:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/common/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/common/lib/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/hdfs/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/share/hadoop/hdfs/lib/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../modules/*:/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/../lib/*:~/home/ahmed/apache/hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf//rm-config/log4j.properties org.apache.hadoop.yarn.server.resourcemanager.ResourceManager
> Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/server/resourcemanager/ResourceManager
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.yarn.server.resourcemanager.ResourceManager
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> Could not find the main class: org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.  Program will exit.
> {code}
> Seems there are some missing jars in the modules directory in the dist:
> {code}
> $ ls -al modules/
> total 476
> drwxr-xr-x  2 ahmed ahmed   4096 2011-10-17 00:56 .
> drwxr-xr-x 11 ahmed ahmed   4096 2011-10-17 00:58 ..
> -rwxr-xr-x  1 ahmed ahmed 347941 2011-10-17 00:56 hadoop-mapreduce-client-app-0.24.0-SNAPSHOT.jar
> -rwxr-xr-x  1 ahmed ahmed  79364 2011-10-17 00:56 hadoop-mapreduce-client-hs-0.24.0-SNAPSHOT.jar
> -rwxr-xr-x  1 ahmed ahmed  30720 2011-10-17 00:56 hadoop-mapreduce-client-jobclient-0.24.0-SNAPSHOT.jar
> -rwxr-xr-x  1 ahmed ahmed  15358 2011-10-17 00:56 hadoop-mapreduce-client-shuffle-0.24.0-SNAPSHOT.jar
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira