You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Lars George (JIRA)" <ji...@apache.org> on 2011/09/23 15:13:29 UTC
[jira] [Issue Comment Edited] (HBASE-4467) Handle inconsistencies
in Hadoop libraries naming in hbase script
[ https://issues.apache.org/jira/browse/HBASE-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13113406#comment-13113406 ]
Lars George edited comment on HBASE-4467 at 9/23/11 1:13 PM:
-------------------------------------------------------------
So the issue is this:
{noformat}
function append_path() {
if [ -z "$1" ]; then
echo $2
else
echo $1:$2
fi
}
in combination with
{noformat}
HADOOPCPPATH=$(append_path "${HADOOPCPPATH}" `ls ${HADOOP_HOME}/hadoop-*.jar`)
{noformat}
This "ls" emits multiple values and that screws up the classpath. This either needs a "sed" or a loop outside of the "append_path" call iterating over all dir entries and adding them one by one.
was (Author: larsgeorge):
So the issue is this:
> Handle inconsistencies in Hadoop libraries naming in hbase script
> -----------------------------------------------------------------
>
> Key: HBASE-4467
> URL: https://issues.apache.org/jira/browse/HBASE-4467
> Project: HBase
> Issue Type: Bug
> Components: scripts
> Reporter: Lars George
> Priority: Trivial
>
> When using an Hadoop tarball that has a library naming of "hadoop-x.y.z-core" as opposed to "hadoop-core-x.y.z" then the hbase script throws errors.
> {noformat}
> $ bin/start-hbase.sh
> ls: /projects/opensource/hadoop-0.20.2-append/hadoop-core*.jar: No such file or directory
> Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/util/PlatformName
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.PlatformName
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> ls: /projects/opensource/hadoop-0.20.2-append/hadoop-core*.jar: No such file or directory
> Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/util/PlatformName
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.PlatformName
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> localhost: starting zookeeper, logging to /projects/opensource/hbase-trunk-rw//logs/hbase-larsgeorge-zookeeper-de1-app-mbp-2.out
> localhost: /projects/opensource/hadoop-0.20.2-append
> localhost: ls: /projects/opensource/hadoop-0.20.2-append/hadoop-core*.jar: No such file or directory
> localhost: Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/util/PlatformName
> localhost: Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.PlatformName
> localhost: at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> localhost: at java.security.AccessController.doPrivileged(Native Method)
> localhost: at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> localhost: at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> localhost: at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> localhost: at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> starting master, logging to /projects/opensource/hbase-trunk-rw/bin/../logs/hbase-larsgeorge-master-de1-app-mbp-2.out
> /projects/opensource/hadoop-0.20.2-append
> ls: /projects/opensource/hadoop-0.20.2-append/hadoop-core*.jar: No such file or directory
> Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/util/PlatformName
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.PlatformName
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> localhost: starting regionserver, logging to /projects/opensource/hbase-trunk-rw//logs/hbase-larsgeorge-regionserver-de1-app-mbp-2.out
> localhost: /projects/opensource/hadoop-0.20.2-append
> localhost: ls: /projects/opensource/hadoop-0.20.2-append/hadoop-core*.jar: No such file or directory
> localhost: Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/util/PlatformName
> localhost: Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.PlatformName
> localhost: at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> localhost: at java.security.AccessController.doPrivileged(Native Method)
> localhost: at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> localhost: at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> localhost: at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> localhost: at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> {noformat}
> The naming in this case:
> {noformat}
> $ ll /projects/opensource/hadoop-0.20.2-append/
> total 14960
> drwxr-xr-x@ 26 larsgeorge staff 884 Apr 13 09:09 .
> drwxr-xr-x 114 larsgeorge staff 3876 Sep 22 19:42 ..
> -rw-r--r--@ 1 larsgeorge staff 348624 Apr 13 08:58 CHANGES.txt
> -rw-r--r--@ 1 larsgeorge staff 13366 Apr 13 08:58 LICENSE.txt
> -rw-r--r--@ 1 larsgeorge staff 101 Apr 13 08:58 NOTICE.txt
> -rw-r--r--@ 1 larsgeorge staff 1366 Apr 13 08:58 README.txt
> drwxr-xr-x@ 17 larsgeorge staff 578 Apr 13 08:58 bin
> -rw-r--r--@ 1 larsgeorge staff 74035 Apr 13 08:58 build.xml
> drwxr-xr-x@ 4 larsgeorge staff 136 Apr 13 08:58 c++
> drwxr-xr-x 18 larsgeorge staff 612 Aug 9 15:11 conf
> drwxr-xr-x@ 15 larsgeorge staff 510 Apr 13 08:58 conf.original
> drwxr-xr-x@ 13 larsgeorge staff 442 Apr 13 08:58 contrib
> drwxr-xr-x@ 63 larsgeorge staff 2142 Apr 13 08:58 docs
> -rw-r--r--@ 1 larsgeorge staff 6839 Apr 13 08:58 hadoop-0.20.2-ant.jar
> -rw-r--r-- 1 larsgeorge staff 2707920 Apr 13 09:06 hadoop-0.20.2-core.jar
> -rw-r--r--@ 1 larsgeorge staff 2689741 Apr 13 08:58 hadoop-0.20.2-core.jar.original
> -rw-r--r--@ 1 larsgeorge staff 142466 Apr 13 08:58 hadoop-0.20.2-examples.jar
> -rw-r--r--@ 1 larsgeorge staff 1563859 Apr 13 08:58 hadoop-0.20.2-test.jar
> -rw-r--r--@ 1 larsgeorge staff 69940 Apr 13 08:58 hadoop-0.20.2-tools.jar
> drwxr-xr-x@ 6 larsgeorge staff 204 Apr 13 08:58 ivy
> -rw-r--r--@ 1 larsgeorge staff 8852 Apr 13 08:58 ivy.xml
> drwxr-xr-x@ 30 larsgeorge staff 1020 Jul 13 10:20 lib
> drwxr-xr-x@ 3 larsgeorge staff 102 Apr 13 08:58 librecordio
> drwxr-xr-x 3 larsgeorge staff 102 May 16 09:56 logs
> drwxr-xr-x@ 17 larsgeorge staff 578 Apr 13 08:58 src
> drwxr-xr-x@ 8 larsgeorge staff 272 Apr 13 08:58 webapps
> {noformat}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira