You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@tez.apache.org by Jython <go...@gmail.com> on 2013/12/13 10:08:55 UTC
the setting of Tez
Hi, all! I got the error when run the basic example(tez-0.2.0-incubating):
[hd@master ~]$ hadoop jar tez-mapreduce-examples-0.2.0.jar
orderedwordcount /input /output
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/tez/dag/api/client/StatusGetOpts
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:270)
at org.apache.hadoop.util.RunJar.main(RunJar.java:205)
Caused by: java.lang.ClassNotFoundException:
org.apache.tez.dag.api.client.StatusGetOpts
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 3 more
here is my .bashrc:
PREFIX=~/local
JAVA_HOME=/opt/java/
PATH=$JAVA_HOME/bin:/home/hd/local/bin:$PATH
CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
export JAVA_HOME
export PATH
export CLASSPATH
export M3_HOME=~/local/maven
export PATH=${M3_HOME}/bin:${PATH}
export PATH=~/hadoop/sbin/:~/hadoop/bin/:${PATH}
export HADOOP_HOME=/home/hd/hadoop
export HADOOP_CONF_DIR=${HADOOP_HOME}/etc/hadoop
export TEZ_HOME=~/tez-0.2.0-incubating
export TEZ_CONF_DIR=~/tez
TEZ_JARS=/home/hd/tez-0.2.0-incubating/tez-dist/target/tez-0.2.0/tez-0.2.0
export HADOOP_CLASSPATH=$TEZ_CONF_DIR:$TEZ_JARS:$TEZ_JARS/lib
export CLASSPATH=$HADOOP_CLASSPATH:$CLASSPATH
hope you could give me some guide, thanks in advance !
RE: the setting of Tez
Posted by Bikas Saha <bi...@hortonworks.com>.
>>TEZ_JARS=/home/hd/tez-0.2.0-incubating/tez-dist/target/tez-0.2.0/tez-0.2
.0
<<export
TEZ_JARS=/home/hd/tez-0.2.0-incubating/tez-dist/target/tez-0.2.0/tez-0.2.0
>>export HADOOP_CLASSPATH=$TEZ_CONF_DIR:$TEZ_JARS:$TEZ_JARS/lib
<< export HADOOP_CLASSPATH=$TEZ_CONF_DIR:$TEZ_JARS/*:$TEZ_JARS/lib/*
-----Original Message-----
From: Jython [mailto:googcheng@gmail.com]
Sent: Friday, December 13, 2013 1:09 AM
To: user@tez.incubator.apache.org
Subject: the setting of Tez
Hi, all! I got the error when run the basic example(tez-0.2.0-incubating):
[hd@master ~]$ hadoop jar tez-mapreduce-examples-0.2.0.jar
orderedwordcount /input /output Exception in thread "main"
java.lang.NoClassDefFoundError:
org/apache/tez/dag/api/client/StatusGetOpts
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:270)
at org.apache.hadoop.util.RunJar.main(RunJar.java:205)
Caused by: java.lang.ClassNotFoundException:
org.apache.tez.dag.api.client.StatusGetOpts
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 3 more
here is my .bashrc:
PREFIX=~/local
JAVA_HOME=/opt/java/
PATH=$JAVA_HOME/bin:/home/hd/local/bin:$PATH
CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
export JAVA_HOME
export PATH
export CLASSPATH
export M3_HOME=~/local/maven
export PATH=${M3_HOME}/bin:${PATH}
export PATH=~/hadoop/sbin/:~/hadoop/bin/:${PATH}
export HADOOP_HOME=/home/hd/hadoop
export HADOOP_CONF_DIR=${HADOOP_HOME}/etc/hadoop
export TEZ_HOME=~/tez-0.2.0-incubating
export TEZ_CONF_DIR=~/tez
TEZ_JARS=/home/hd/tez-0.2.0-incubating/tez-dist/target/tez-0.2.0/tez-0.2.0
export HADOOP_CLASSPATH=$TEZ_CONF_DIR:$TEZ_JARS:$TEZ_JARS/lib
export CLASSPATH=$HADOOP_CLASSPATH:$CLASSPATH
hope you could give me some guide, thanks in advance !
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: the setting of Tez
Posted by Jython <go...@gmail.com>.
thanks , solved!
On Tue, Dec 17, 2013 at 4:58 AM, Hitesh Shah <hi...@apache.org> wrote:
> Hello Jython
>
> Could try the following:
>
> export HADOOP_CLASSPATH=$TEZ_CONF_DIR:$TEZ_JARS/*:$TEZ_JARS/lib/*
>
> For classpath, directories with jars require a "*" specified.
>
> thanks
> -- Hitesh
>
> On Dec 13, 2013, at 1:08 AM, Jython wrote:
>
> > Hi, all! I got the error when run the basic
> example(tez-0.2.0-incubating):
> >
> > [hd@master ~]$ hadoop jar tez-mapreduce-examples-0.2.0.jar
> > orderedwordcount /input /output
> > Exception in thread "main" java.lang.NoClassDefFoundError:
> > org/apache/tez/dag/api/client/StatusGetOpts
> > at java.lang.Class.forName0(Native Method)
> > at java.lang.Class.forName(Class.java:270)
> > at org.apache.hadoop.util.RunJar.main(RunJar.java:205)
> > Caused by: java.lang.ClassNotFoundException:
> > org.apache.tez.dag.api.client.StatusGetOpts
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> > ... 3 more
> >
> > here is my .bashrc:
> > PREFIX=~/local
> > JAVA_HOME=/opt/java/
> > PATH=$JAVA_HOME/bin:/home/hd/local/bin:$PATH
> > CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
> > export JAVA_HOME
> > export PATH
> > export CLASSPATH
> > export M3_HOME=~/local/maven
> > export PATH=${M3_HOME}/bin:${PATH}
> > export PATH=~/hadoop/sbin/:~/hadoop/bin/:${PATH}
> > export HADOOP_HOME=/home/hd/hadoop
> > export HADOOP_CONF_DIR=${HADOOP_HOME}/etc/hadoop
> > export TEZ_HOME=~/tez-0.2.0-incubating
> > export TEZ_CONF_DIR=~/tez
> >
> TEZ_JARS=/home/hd/tez-0.2.0-incubating/tez-dist/target/tez-0.2.0/tez-0.2.0
> > export HADOOP_CLASSPATH=$TEZ_CONF_DIR:$TEZ_JARS:$TEZ_JARS/lib
> > export CLASSPATH=$HADOOP_CLASSPATH:$CLASSPATH
> >
> > hope you could give me some guide, thanks in advance !
>
>
Re: the setting of Tez
Posted by Hitesh Shah <hi...@apache.org>.
Hello Jython
Could try the following:
export HADOOP_CLASSPATH=$TEZ_CONF_DIR:$TEZ_JARS/*:$TEZ_JARS/lib/*
For classpath, directories with jars require a "*" specified.
thanks
-- Hitesh
On Dec 13, 2013, at 1:08 AM, Jython wrote:
> Hi, all! I got the error when run the basic example(tez-0.2.0-incubating):
>
> [hd@master ~]$ hadoop jar tez-mapreduce-examples-0.2.0.jar
> orderedwordcount /input /output
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/tez/dag/api/client/StatusGetOpts
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:270)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:205)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.tez.dag.api.client.StatusGetOpts
> at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 3 more
>
> here is my .bashrc:
> PREFIX=~/local
> JAVA_HOME=/opt/java/
> PATH=$JAVA_HOME/bin:/home/hd/local/bin:$PATH
> CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
> export JAVA_HOME
> export PATH
> export CLASSPATH
> export M3_HOME=~/local/maven
> export PATH=${M3_HOME}/bin:${PATH}
> export PATH=~/hadoop/sbin/:~/hadoop/bin/:${PATH}
> export HADOOP_HOME=/home/hd/hadoop
> export HADOOP_CONF_DIR=${HADOOP_HOME}/etc/hadoop
> export TEZ_HOME=~/tez-0.2.0-incubating
> export TEZ_CONF_DIR=~/tez
> TEZ_JARS=/home/hd/tez-0.2.0-incubating/tez-dist/target/tez-0.2.0/tez-0.2.0
> export HADOOP_CLASSPATH=$TEZ_CONF_DIR:$TEZ_JARS:$TEZ_JARS/lib
> export CLASSPATH=$HADOOP_CLASSPATH:$CLASSPATH
>
> hope you could give me some guide, thanks in advance !