You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@oozie.apache.org by Dima Fadeyev <li...@gmail.com> on 2015/09/11 14:20:56 UTC
hadooplib is empty after building oozie
Hello, everyone,
I'm trying to build Oozie from trunk. The build finishes succesfully.
bin/mkdistro.sh -e -Phadoop-2 -DskipTests -Dhadoop.version=2.7.1
...
[INFO] Apache Oozie Main .................................. SUCCESS [
1.318 s]
[INFO] Apache Oozie Hadoop Utils hadoop-2-4.3.0-SNAPSHOT .. SUCCESS [
3.661 s]
[INFO] Apache Oozie Hadoop Distcp hadoop-2-4.3.0-SNAPSHOT . SUCCESS [
0.106 s]
[INFO] Apache Oozie Hadoop Auth hadoop-2-4.3.0-SNAPSHOT Test SUCCESS [
0.389 s]
[INFO] Apache Oozie Hadoop Libs ........................... SUCCESS [
0.022 s]
[INFO] Apache Oozie Client ................................ SUCCESS [
12.426 s]
[INFO] Apache Oozie Share Lib Oozie ....................... SUCCESS [
2.477 s]
[INFO] Apache Oozie Share Lib HCatalog .................... SUCCESS [
2.998 s]
[INFO] Apache Oozie Share Lib Distcp ...................... SUCCESS [
0.793 s]
[INFO] Apache Oozie Core .................................. SUCCESS [
39.905 s]
[INFO] Apache Oozie Share Lib Streaming ................... SUCCESS [
5.583 s]
[INFO] Apache Oozie Share Lib Pig ......................... SUCCESS [
6.754 s]
[INFO] Apache Oozie Share Lib Hive ........................ SUCCESS [
6.296 s]
[INFO] Apache Oozie Share Lib Hive 2 ...................... SUCCESS [
6.128 s]
[INFO] Apache Oozie Share Lib Sqoop ....................... SUCCESS [
3.045 s]
[INFO] Apache Oozie Examples .............................. SUCCESS [
25.159 s]
[INFO] Apache Oozie Share Lib Spark ....................... SUCCESS [01:00
min]
[INFO] Apache Oozie Share Lib ............................. SUCCESS [
19.944 s]
[INFO] Apache Oozie Docs .................................. SUCCESS [
20.630 s]
[INFO] Apache Oozie WebApp ................................ SUCCESS [
30.752 s]
[INFO] Apache Oozie Tools ................................. SUCCESS [
2.999 s]
[INFO] Apache Oozie MiniOozie ............................. SUCCESS [
1.565 s]
[INFO] Apache Oozie Distro ................................ SUCCESS [
24.443 s]
[INFO] Apache Oozie ZooKeeper Security Tests .............. SUCCESS [
2.892 s]
[INFO]
------------------------------------------------------------------------
[INFO] BUILD SUCCESS
The docs say that I have to extract hadooplibs archive to oozie target
directory. However there is no hadooplibs archive anywhere. Am I missing
some installation steps?
Re: hadooplib is empty after building oozie
Posted by Dima Fadeyev <li...@gmail.com>.
Hello, everyone,
Finally I was able to get rid of "java.lang.NoClassDefFoundError:
org/apache/commons/io/Charsets" exception by changing the commons-io
version in pom.xml from 2.1 to 2.4.
Regarding the error from oozie's web - The method
getJspApplicationContext(ServletContext) is undefined for the type
JspFactory - I've been able to resolve it removing the jsp-api-2.0 from the
oozie.war (zip -d oozie.war WEB-INF/lib/jsp-api-2.0.jar). Appearently after
this change oozie is running with no problem, however I couldn't find a
more "legitimate" way to resolve this.
Is there a way to build oozie without modifying the resulting war file, so
that the "method getJspApplicationContext(ServletContext) is undefined"
doesn't produce?
On Wed, Sep 16, 2015 at 10:32 AM, Akshay Rai <ak...@gmail.com> wrote:
> Dima, what does the below command return?
>
> oozie admin -oozie $OOZIE_URL -status
>
> Have you added the ext-2.2.zip to your libext directory?
>
> On Mon, Sep 14, 2015 at 6:34 PM, Dima Fadeyev <li...@gmail.com>
> wrote:
>
> > I think I'm still missing something. I've been able to start oozie daemon
> > successfully. But when I access its webpage, I get an exception in my web
> > browser:
> >
> > org.apache.jasper.JasperException: Unable to compile class for JSP:
> >
> > An error occurred at line: 25 in the generated java file
> > The method getJspApplicationContext(ServletContext) is undefined for the
> > type JspFactory
> >
> > Stacktrace:
> >
> >
> org.apache.jasper.compiler.DefaultErrorHandler.javacError(DefaultErrorHandler.java:92)
> >
> >
> org.apache.jasper.compiler.ErrorDispatcher.javacError(ErrorDispatcher.java:330)
> >
> org.apache.jasper.compiler.JDTCompiler.generateClass(JDTCompiler.java:460)
> > org.apache.jasper.compiler.Compiler.compile(Compiler.java:356)
> > org.apache.jasper.compiler.Compiler.compile(Compiler.java:334)
> > org.apache.jasper.compiler.Compiler.compile(Compiler.java:321)
> >
> >
> org.apache.jasper.JspCompilationContext.compile(JspCompilationContext.java:592)
> >
> >
> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:328)
> > org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:313)
> > org.apache.jasper.servlet.JspServlet.service(JspServlet.java:260)
> > javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
> > org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:171)
> >
> >
> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:595)
> >
> >
> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:554)
> > org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:176)
> > org.apache.oozie.servlet.HostnameFilter.doFilter(HostnameFilter.java:86)
> >
> >
> >
> > On Fri, Sep 11, 2015 at 6:54 PM, Akshay Rai <ak...@gmail.com> wrote:
> >
> > > Dima, I'm not sure why this error occured even after specifying -Puber.
> > > Could you try adding the commons-io jar to libext, run prepare-war and
> > > restart oozie.
> > >
> > > Also make sure you have configured
> > > oozie.service.HadoopAccessorService.hadoop.configurations
> > > to your hadoop conf dir path in oozie-site.xml.
> > >
> > > -Akshay
> > >
> > >
> > > On Fri, Sep 11, 2015 at 6:31 PM, Dima Fadeyev <li...@gmail.com>
> > > wrote:
> > >
> > > > Hello, Akshay,
> > > >
> > > > Thanks for your reply. I've been able to build with -Puber
> > > (bin/mkdistro.sh
> > > > -e -Puber -Phadoop-2 -DskipTests -Dhadoop.version=2.7.1)
> > > >
> > > > When I try to execute bin/oozie-run.sh, server startup fails with
> > > > ClassNotFound Exception:
> > > >
> > > > java.lang.NoClassDefFoundError: org/apache/commons/io/Charsets
> > > > at
> > org.apache.hadoop.security.Credentials.<clinit>(Credentials.java:222)
> > > > at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:334)
> > > > at
> > > >
> > > >
> > >
> >
> org.apache.oozie.service.HadoopAccessorService.init(HadoopAccessorService.java:150)
> > > > at
> > > >
> > > >
> > >
> >
> org.apache.oozie.service.HadoopAccessorService.init(HadoopAccessorService.java:107)
> > > >
> > > >
> > > > On Fri, Sep 11, 2015 at 2:32 PM, Akshay Rai <ak...@gmail.com>
> > wrote:
> > > >
> > > > > Hi Dima,
> > > > >
> > > > > Try building oozie by specifying *-Puber* with your mkdistro
> command.
> > > > > *-Puber
> > > > > *with bundle the required jars to the war.
> > > > >
> > > > > Regards,
> > > > > Akshay
> > > > >
> > > > > On Fri, Sep 11, 2015 at 5:50 PM, Dima Fadeyev <
> linuxremote@gmail.com
> > >
> > > > > wrote:
> > > > >
> > > > > > Hello, everyone,
> > > > > >
> > > > > > I'm trying to build Oozie from trunk. The build finishes
> > succesfully.
> > > > > >
> > > > > > bin/mkdistro.sh -e -Phadoop-2 -DskipTests -Dhadoop.version=2.7.1
> > > > > > ...
> > > > > > [INFO] Apache Oozie Main ..................................
> > SUCCESS [
> > > > > > 1.318 s]
> > > > > > [INFO] Apache Oozie Hadoop Utils hadoop-2-4.3.0-SNAPSHOT ..
> > SUCCESS [
> > > > > > 3.661 s]
> > > > > > [INFO] Apache Oozie Hadoop Distcp hadoop-2-4.3.0-SNAPSHOT .
> > SUCCESS [
> > > > > > 0.106 s]
> > > > > > [INFO] Apache Oozie Hadoop Auth hadoop-2-4.3.0-SNAPSHOT Test
> > SUCCESS
> > > [
> > > > > > 0.389 s]
> > > > > > [INFO] Apache Oozie Hadoop Libs ...........................
> > SUCCESS [
> > > > > > 0.022 s]
> > > > > > [INFO] Apache Oozie Client ................................
> > SUCCESS [
> > > > > > 12.426 s]
> > > > > > [INFO] Apache Oozie Share Lib Oozie .......................
> > SUCCESS [
> > > > > > 2.477 s]
> > > > > > [INFO] Apache Oozie Share Lib HCatalog ....................
> > SUCCESS [
> > > > > > 2.998 s]
> > > > > > [INFO] Apache Oozie Share Lib Distcp ......................
> > SUCCESS [
> > > > > > 0.793 s]
> > > > > > [INFO] Apache Oozie Core ..................................
> > SUCCESS [
> > > > > > 39.905 s]
> > > > > > [INFO] Apache Oozie Share Lib Streaming ...................
> > SUCCESS [
> > > > > > 5.583 s]
> > > > > > [INFO] Apache Oozie Share Lib Pig .........................
> > SUCCESS [
> > > > > > 6.754 s]
> > > > > > [INFO] Apache Oozie Share Lib Hive ........................
> > SUCCESS [
> > > > > > 6.296 s]
> > > > > > [INFO] Apache Oozie Share Lib Hive 2 ......................
> > SUCCESS [
> > > > > > 6.128 s]
> > > > > > [INFO] Apache Oozie Share Lib Sqoop .......................
> > SUCCESS [
> > > > > > 3.045 s]
> > > > > > [INFO] Apache Oozie Examples ..............................
> > SUCCESS [
> > > > > > 25.159 s]
> > > > > > [INFO] Apache Oozie Share Lib Spark .......................
> SUCCESS
> > > > > [01:00
> > > > > > min]
> > > > > > [INFO] Apache Oozie Share Lib .............................
> > SUCCESS [
> > > > > > 19.944 s]
> > > > > > [INFO] Apache Oozie Docs ..................................
> > SUCCESS [
> > > > > > 20.630 s]
> > > > > > [INFO] Apache Oozie WebApp ................................
> > SUCCESS [
> > > > > > 30.752 s]
> > > > > > [INFO] Apache Oozie Tools .................................
> > SUCCESS [
> > > > > > 2.999 s]
> > > > > > [INFO] Apache Oozie MiniOozie .............................
> > SUCCESS [
> > > > > > 1.565 s]
> > > > > > [INFO] Apache Oozie Distro ................................
> > SUCCESS [
> > > > > > 24.443 s]
> > > > > > [INFO] Apache Oozie ZooKeeper Security Tests ..............
> > SUCCESS [
> > > > > > 2.892 s]
> > > > > > [INFO]
> > > > > >
> > > >
> > ------------------------------------------------------------------------
> > > > > > [INFO] BUILD SUCCESS
> > > > > >
> > > > > >
> > > > > > The docs say that I have to extract hadooplibs archive to oozie
> > > target
> > > > > > directory. However there is no hadooplibs archive anywhere. Am I
> > > > missing
> > > > > > some installation steps?
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: hadooplib is empty after building oozie
Posted by Akshay Rai <ak...@gmail.com>.
Dima, what does the below command return?
oozie admin -oozie $OOZIE_URL -status
Have you added the ext-2.2.zip to your libext directory?
On Mon, Sep 14, 2015 at 6:34 PM, Dima Fadeyev <li...@gmail.com> wrote:
> I think I'm still missing something. I've been able to start oozie daemon
> successfully. But when I access its webpage, I get an exception in my web
> browser:
>
> org.apache.jasper.JasperException: Unable to compile class for JSP:
>
> An error occurred at line: 25 in the generated java file
> The method getJspApplicationContext(ServletContext) is undefined for the
> type JspFactory
>
> Stacktrace:
>
> org.apache.jasper.compiler.DefaultErrorHandler.javacError(DefaultErrorHandler.java:92)
>
> org.apache.jasper.compiler.ErrorDispatcher.javacError(ErrorDispatcher.java:330)
> org.apache.jasper.compiler.JDTCompiler.generateClass(JDTCompiler.java:460)
> org.apache.jasper.compiler.Compiler.compile(Compiler.java:356)
> org.apache.jasper.compiler.Compiler.compile(Compiler.java:334)
> org.apache.jasper.compiler.Compiler.compile(Compiler.java:321)
>
> org.apache.jasper.JspCompilationContext.compile(JspCompilationContext.java:592)
>
> org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:328)
> org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:313)
> org.apache.jasper.servlet.JspServlet.service(JspServlet.java:260)
> javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
> org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:171)
>
> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:595)
>
> org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:554)
> org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:176)
> org.apache.oozie.servlet.HostnameFilter.doFilter(HostnameFilter.java:86)
>
>
>
> On Fri, Sep 11, 2015 at 6:54 PM, Akshay Rai <ak...@gmail.com> wrote:
>
> > Dima, I'm not sure why this error occured even after specifying -Puber.
> > Could you try adding the commons-io jar to libext, run prepare-war and
> > restart oozie.
> >
> > Also make sure you have configured
> > oozie.service.HadoopAccessorService.hadoop.configurations
> > to your hadoop conf dir path in oozie-site.xml.
> >
> > -Akshay
> >
> >
> > On Fri, Sep 11, 2015 at 6:31 PM, Dima Fadeyev <li...@gmail.com>
> > wrote:
> >
> > > Hello, Akshay,
> > >
> > > Thanks for your reply. I've been able to build with -Puber
> > (bin/mkdistro.sh
> > > -e -Puber -Phadoop-2 -DskipTests -Dhadoop.version=2.7.1)
> > >
> > > When I try to execute bin/oozie-run.sh, server startup fails with
> > > ClassNotFound Exception:
> > >
> > > java.lang.NoClassDefFoundError: org/apache/commons/io/Charsets
> > > at
> org.apache.hadoop.security.Credentials.<clinit>(Credentials.java:222)
> > > at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:334)
> > > at
> > >
> > >
> >
> org.apache.oozie.service.HadoopAccessorService.init(HadoopAccessorService.java:150)
> > > at
> > >
> > >
> >
> org.apache.oozie.service.HadoopAccessorService.init(HadoopAccessorService.java:107)
> > >
> > >
> > > On Fri, Sep 11, 2015 at 2:32 PM, Akshay Rai <ak...@gmail.com>
> wrote:
> > >
> > > > Hi Dima,
> > > >
> > > > Try building oozie by specifying *-Puber* with your mkdistro command.
> > > > *-Puber
> > > > *with bundle the required jars to the war.
> > > >
> > > > Regards,
> > > > Akshay
> > > >
> > > > On Fri, Sep 11, 2015 at 5:50 PM, Dima Fadeyev <linuxremote@gmail.com
> >
> > > > wrote:
> > > >
> > > > > Hello, everyone,
> > > > >
> > > > > I'm trying to build Oozie from trunk. The build finishes
> succesfully.
> > > > >
> > > > > bin/mkdistro.sh -e -Phadoop-2 -DskipTests -Dhadoop.version=2.7.1
> > > > > ...
> > > > > [INFO] Apache Oozie Main ..................................
> SUCCESS [
> > > > > 1.318 s]
> > > > > [INFO] Apache Oozie Hadoop Utils hadoop-2-4.3.0-SNAPSHOT ..
> SUCCESS [
> > > > > 3.661 s]
> > > > > [INFO] Apache Oozie Hadoop Distcp hadoop-2-4.3.0-SNAPSHOT .
> SUCCESS [
> > > > > 0.106 s]
> > > > > [INFO] Apache Oozie Hadoop Auth hadoop-2-4.3.0-SNAPSHOT Test
> SUCCESS
> > [
> > > > > 0.389 s]
> > > > > [INFO] Apache Oozie Hadoop Libs ...........................
> SUCCESS [
> > > > > 0.022 s]
> > > > > [INFO] Apache Oozie Client ................................
> SUCCESS [
> > > > > 12.426 s]
> > > > > [INFO] Apache Oozie Share Lib Oozie .......................
> SUCCESS [
> > > > > 2.477 s]
> > > > > [INFO] Apache Oozie Share Lib HCatalog ....................
> SUCCESS [
> > > > > 2.998 s]
> > > > > [INFO] Apache Oozie Share Lib Distcp ......................
> SUCCESS [
> > > > > 0.793 s]
> > > > > [INFO] Apache Oozie Core ..................................
> SUCCESS [
> > > > > 39.905 s]
> > > > > [INFO] Apache Oozie Share Lib Streaming ...................
> SUCCESS [
> > > > > 5.583 s]
> > > > > [INFO] Apache Oozie Share Lib Pig .........................
> SUCCESS [
> > > > > 6.754 s]
> > > > > [INFO] Apache Oozie Share Lib Hive ........................
> SUCCESS [
> > > > > 6.296 s]
> > > > > [INFO] Apache Oozie Share Lib Hive 2 ......................
> SUCCESS [
> > > > > 6.128 s]
> > > > > [INFO] Apache Oozie Share Lib Sqoop .......................
> SUCCESS [
> > > > > 3.045 s]
> > > > > [INFO] Apache Oozie Examples ..............................
> SUCCESS [
> > > > > 25.159 s]
> > > > > [INFO] Apache Oozie Share Lib Spark ....................... SUCCESS
> > > > [01:00
> > > > > min]
> > > > > [INFO] Apache Oozie Share Lib .............................
> SUCCESS [
> > > > > 19.944 s]
> > > > > [INFO] Apache Oozie Docs ..................................
> SUCCESS [
> > > > > 20.630 s]
> > > > > [INFO] Apache Oozie WebApp ................................
> SUCCESS [
> > > > > 30.752 s]
> > > > > [INFO] Apache Oozie Tools .................................
> SUCCESS [
> > > > > 2.999 s]
> > > > > [INFO] Apache Oozie MiniOozie .............................
> SUCCESS [
> > > > > 1.565 s]
> > > > > [INFO] Apache Oozie Distro ................................
> SUCCESS [
> > > > > 24.443 s]
> > > > > [INFO] Apache Oozie ZooKeeper Security Tests ..............
> SUCCESS [
> > > > > 2.892 s]
> > > > > [INFO]
> > > > >
> > >
> ------------------------------------------------------------------------
> > > > > [INFO] BUILD SUCCESS
> > > > >
> > > > >
> > > > > The docs say that I have to extract hadooplibs archive to oozie
> > target
> > > > > directory. However there is no hadooplibs archive anywhere. Am I
> > > missing
> > > > > some installation steps?
> > > > >
> > > >
> > >
> >
>
Re: hadooplib is empty after building oozie
Posted by Dima Fadeyev <li...@gmail.com>.
I think I'm still missing something. I've been able to start oozie daemon
successfully. But when I access its webpage, I get an exception in my web
browser:
org.apache.jasper.JasperException: Unable to compile class for JSP:
An error occurred at line: 25 in the generated java file
The method getJspApplicationContext(ServletContext) is undefined for the
type JspFactory
Stacktrace:
org.apache.jasper.compiler.DefaultErrorHandler.javacError(DefaultErrorHandler.java:92)
org.apache.jasper.compiler.ErrorDispatcher.javacError(ErrorDispatcher.java:330)
org.apache.jasper.compiler.JDTCompiler.generateClass(JDTCompiler.java:460)
org.apache.jasper.compiler.Compiler.compile(Compiler.java:356)
org.apache.jasper.compiler.Compiler.compile(Compiler.java:334)
org.apache.jasper.compiler.Compiler.compile(Compiler.java:321)
org.apache.jasper.JspCompilationContext.compile(JspCompilationContext.java:592)
org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:328)
org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:313)
org.apache.jasper.servlet.JspServlet.service(JspServlet.java:260)
javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:171)
org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:595)
org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:554)
org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:176)
org.apache.oozie.servlet.HostnameFilter.doFilter(HostnameFilter.java:86)
On Fri, Sep 11, 2015 at 6:54 PM, Akshay Rai <ak...@gmail.com> wrote:
> Dima, I'm not sure why this error occured even after specifying -Puber.
> Could you try adding the commons-io jar to libext, run prepare-war and
> restart oozie.
>
> Also make sure you have configured
> oozie.service.HadoopAccessorService.hadoop.configurations
> to your hadoop conf dir path in oozie-site.xml.
>
> -Akshay
>
>
> On Fri, Sep 11, 2015 at 6:31 PM, Dima Fadeyev <li...@gmail.com>
> wrote:
>
> > Hello, Akshay,
> >
> > Thanks for your reply. I've been able to build with -Puber
> (bin/mkdistro.sh
> > -e -Puber -Phadoop-2 -DskipTests -Dhadoop.version=2.7.1)
> >
> > When I try to execute bin/oozie-run.sh, server startup fails with
> > ClassNotFound Exception:
> >
> > java.lang.NoClassDefFoundError: org/apache/commons/io/Charsets
> > at org.apache.hadoop.security.Credentials.<clinit>(Credentials.java:222)
> > at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:334)
> > at
> >
> >
> org.apache.oozie.service.HadoopAccessorService.init(HadoopAccessorService.java:150)
> > at
> >
> >
> org.apache.oozie.service.HadoopAccessorService.init(HadoopAccessorService.java:107)
> >
> >
> > On Fri, Sep 11, 2015 at 2:32 PM, Akshay Rai <ak...@gmail.com> wrote:
> >
> > > Hi Dima,
> > >
> > > Try building oozie by specifying *-Puber* with your mkdistro command.
> > > *-Puber
> > > *with bundle the required jars to the war.
> > >
> > > Regards,
> > > Akshay
> > >
> > > On Fri, Sep 11, 2015 at 5:50 PM, Dima Fadeyev <li...@gmail.com>
> > > wrote:
> > >
> > > > Hello, everyone,
> > > >
> > > > I'm trying to build Oozie from trunk. The build finishes succesfully.
> > > >
> > > > bin/mkdistro.sh -e -Phadoop-2 -DskipTests -Dhadoop.version=2.7.1
> > > > ...
> > > > [INFO] Apache Oozie Main .................................. SUCCESS [
> > > > 1.318 s]
> > > > [INFO] Apache Oozie Hadoop Utils hadoop-2-4.3.0-SNAPSHOT .. SUCCESS [
> > > > 3.661 s]
> > > > [INFO] Apache Oozie Hadoop Distcp hadoop-2-4.3.0-SNAPSHOT . SUCCESS [
> > > > 0.106 s]
> > > > [INFO] Apache Oozie Hadoop Auth hadoop-2-4.3.0-SNAPSHOT Test SUCCESS
> [
> > > > 0.389 s]
> > > > [INFO] Apache Oozie Hadoop Libs ........................... SUCCESS [
> > > > 0.022 s]
> > > > [INFO] Apache Oozie Client ................................ SUCCESS [
> > > > 12.426 s]
> > > > [INFO] Apache Oozie Share Lib Oozie ....................... SUCCESS [
> > > > 2.477 s]
> > > > [INFO] Apache Oozie Share Lib HCatalog .................... SUCCESS [
> > > > 2.998 s]
> > > > [INFO] Apache Oozie Share Lib Distcp ...................... SUCCESS [
> > > > 0.793 s]
> > > > [INFO] Apache Oozie Core .................................. SUCCESS [
> > > > 39.905 s]
> > > > [INFO] Apache Oozie Share Lib Streaming ................... SUCCESS [
> > > > 5.583 s]
> > > > [INFO] Apache Oozie Share Lib Pig ......................... SUCCESS [
> > > > 6.754 s]
> > > > [INFO] Apache Oozie Share Lib Hive ........................ SUCCESS [
> > > > 6.296 s]
> > > > [INFO] Apache Oozie Share Lib Hive 2 ...................... SUCCESS [
> > > > 6.128 s]
> > > > [INFO] Apache Oozie Share Lib Sqoop ....................... SUCCESS [
> > > > 3.045 s]
> > > > [INFO] Apache Oozie Examples .............................. SUCCESS [
> > > > 25.159 s]
> > > > [INFO] Apache Oozie Share Lib Spark ....................... SUCCESS
> > > [01:00
> > > > min]
> > > > [INFO] Apache Oozie Share Lib ............................. SUCCESS [
> > > > 19.944 s]
> > > > [INFO] Apache Oozie Docs .................................. SUCCESS [
> > > > 20.630 s]
> > > > [INFO] Apache Oozie WebApp ................................ SUCCESS [
> > > > 30.752 s]
> > > > [INFO] Apache Oozie Tools ................................. SUCCESS [
> > > > 2.999 s]
> > > > [INFO] Apache Oozie MiniOozie ............................. SUCCESS [
> > > > 1.565 s]
> > > > [INFO] Apache Oozie Distro ................................ SUCCESS [
> > > > 24.443 s]
> > > > [INFO] Apache Oozie ZooKeeper Security Tests .............. SUCCESS [
> > > > 2.892 s]
> > > > [INFO]
> > > >
> > ------------------------------------------------------------------------
> > > > [INFO] BUILD SUCCESS
> > > >
> > > >
> > > > The docs say that I have to extract hadooplibs archive to oozie
> target
> > > > directory. However there is no hadooplibs archive anywhere. Am I
> > missing
> > > > some installation steps?
> > > >
> > >
> >
>
Re: hadooplib is empty after building oozie
Posted by Akshay Rai <ak...@gmail.com>.
Dima, I'm not sure why this error occured even after specifying -Puber.
Could you try adding the commons-io jar to libext, run prepare-war and
restart oozie.
Also make sure you have configured
oozie.service.HadoopAccessorService.hadoop.configurations
to your hadoop conf dir path in oozie-site.xml.
-Akshay
On Fri, Sep 11, 2015 at 6:31 PM, Dima Fadeyev <li...@gmail.com> wrote:
> Hello, Akshay,
>
> Thanks for your reply. I've been able to build with -Puber (bin/mkdistro.sh
> -e -Puber -Phadoop-2 -DskipTests -Dhadoop.version=2.7.1)
>
> When I try to execute bin/oozie-run.sh, server startup fails with
> ClassNotFound Exception:
>
> java.lang.NoClassDefFoundError: org/apache/commons/io/Charsets
> at org.apache.hadoop.security.Credentials.<clinit>(Credentials.java:222)
> at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:334)
> at
>
> org.apache.oozie.service.HadoopAccessorService.init(HadoopAccessorService.java:150)
> at
>
> org.apache.oozie.service.HadoopAccessorService.init(HadoopAccessorService.java:107)
>
>
> On Fri, Sep 11, 2015 at 2:32 PM, Akshay Rai <ak...@gmail.com> wrote:
>
> > Hi Dima,
> >
> > Try building oozie by specifying *-Puber* with your mkdistro command.
> > *-Puber
> > *with bundle the required jars to the war.
> >
> > Regards,
> > Akshay
> >
> > On Fri, Sep 11, 2015 at 5:50 PM, Dima Fadeyev <li...@gmail.com>
> > wrote:
> >
> > > Hello, everyone,
> > >
> > > I'm trying to build Oozie from trunk. The build finishes succesfully.
> > >
> > > bin/mkdistro.sh -e -Phadoop-2 -DskipTests -Dhadoop.version=2.7.1
> > > ...
> > > [INFO] Apache Oozie Main .................................. SUCCESS [
> > > 1.318 s]
> > > [INFO] Apache Oozie Hadoop Utils hadoop-2-4.3.0-SNAPSHOT .. SUCCESS [
> > > 3.661 s]
> > > [INFO] Apache Oozie Hadoop Distcp hadoop-2-4.3.0-SNAPSHOT . SUCCESS [
> > > 0.106 s]
> > > [INFO] Apache Oozie Hadoop Auth hadoop-2-4.3.0-SNAPSHOT Test SUCCESS [
> > > 0.389 s]
> > > [INFO] Apache Oozie Hadoop Libs ........................... SUCCESS [
> > > 0.022 s]
> > > [INFO] Apache Oozie Client ................................ SUCCESS [
> > > 12.426 s]
> > > [INFO] Apache Oozie Share Lib Oozie ....................... SUCCESS [
> > > 2.477 s]
> > > [INFO] Apache Oozie Share Lib HCatalog .................... SUCCESS [
> > > 2.998 s]
> > > [INFO] Apache Oozie Share Lib Distcp ...................... SUCCESS [
> > > 0.793 s]
> > > [INFO] Apache Oozie Core .................................. SUCCESS [
> > > 39.905 s]
> > > [INFO] Apache Oozie Share Lib Streaming ................... SUCCESS [
> > > 5.583 s]
> > > [INFO] Apache Oozie Share Lib Pig ......................... SUCCESS [
> > > 6.754 s]
> > > [INFO] Apache Oozie Share Lib Hive ........................ SUCCESS [
> > > 6.296 s]
> > > [INFO] Apache Oozie Share Lib Hive 2 ...................... SUCCESS [
> > > 6.128 s]
> > > [INFO] Apache Oozie Share Lib Sqoop ....................... SUCCESS [
> > > 3.045 s]
> > > [INFO] Apache Oozie Examples .............................. SUCCESS [
> > > 25.159 s]
> > > [INFO] Apache Oozie Share Lib Spark ....................... SUCCESS
> > [01:00
> > > min]
> > > [INFO] Apache Oozie Share Lib ............................. SUCCESS [
> > > 19.944 s]
> > > [INFO] Apache Oozie Docs .................................. SUCCESS [
> > > 20.630 s]
> > > [INFO] Apache Oozie WebApp ................................ SUCCESS [
> > > 30.752 s]
> > > [INFO] Apache Oozie Tools ................................. SUCCESS [
> > > 2.999 s]
> > > [INFO] Apache Oozie MiniOozie ............................. SUCCESS [
> > > 1.565 s]
> > > [INFO] Apache Oozie Distro ................................ SUCCESS [
> > > 24.443 s]
> > > [INFO] Apache Oozie ZooKeeper Security Tests .............. SUCCESS [
> > > 2.892 s]
> > > [INFO]
> > >
> ------------------------------------------------------------------------
> > > [INFO] BUILD SUCCESS
> > >
> > >
> > > The docs say that I have to extract hadooplibs archive to oozie target
> > > directory. However there is no hadooplibs archive anywhere. Am I
> missing
> > > some installation steps?
> > >
> >
>
Re: hadooplib is empty after building oozie
Posted by Dima Fadeyev <li...@gmail.com>.
Hello, Akshay,
Thanks for your reply. I've been able to build with -Puber (bin/mkdistro.sh
-e -Puber -Phadoop-2 -DskipTests -Dhadoop.version=2.7.1)
When I try to execute bin/oozie-run.sh, server startup fails with
ClassNotFound Exception:
java.lang.NoClassDefFoundError: org/apache/commons/io/Charsets
at org.apache.hadoop.security.Credentials.<clinit>(Credentials.java:222)
at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:334)
at
org.apache.oozie.service.HadoopAccessorService.init(HadoopAccessorService.java:150)
at
org.apache.oozie.service.HadoopAccessorService.init(HadoopAccessorService.java:107)
On Fri, Sep 11, 2015 at 2:32 PM, Akshay Rai <ak...@gmail.com> wrote:
> Hi Dima,
>
> Try building oozie by specifying *-Puber* with your mkdistro command.
> *-Puber
> *with bundle the required jars to the war.
>
> Regards,
> Akshay
>
> On Fri, Sep 11, 2015 at 5:50 PM, Dima Fadeyev <li...@gmail.com>
> wrote:
>
> > Hello, everyone,
> >
> > I'm trying to build Oozie from trunk. The build finishes succesfully.
> >
> > bin/mkdistro.sh -e -Phadoop-2 -DskipTests -Dhadoop.version=2.7.1
> > ...
> > [INFO] Apache Oozie Main .................................. SUCCESS [
> > 1.318 s]
> > [INFO] Apache Oozie Hadoop Utils hadoop-2-4.3.0-SNAPSHOT .. SUCCESS [
> > 3.661 s]
> > [INFO] Apache Oozie Hadoop Distcp hadoop-2-4.3.0-SNAPSHOT . SUCCESS [
> > 0.106 s]
> > [INFO] Apache Oozie Hadoop Auth hadoop-2-4.3.0-SNAPSHOT Test SUCCESS [
> > 0.389 s]
> > [INFO] Apache Oozie Hadoop Libs ........................... SUCCESS [
> > 0.022 s]
> > [INFO] Apache Oozie Client ................................ SUCCESS [
> > 12.426 s]
> > [INFO] Apache Oozie Share Lib Oozie ....................... SUCCESS [
> > 2.477 s]
> > [INFO] Apache Oozie Share Lib HCatalog .................... SUCCESS [
> > 2.998 s]
> > [INFO] Apache Oozie Share Lib Distcp ...................... SUCCESS [
> > 0.793 s]
> > [INFO] Apache Oozie Core .................................. SUCCESS [
> > 39.905 s]
> > [INFO] Apache Oozie Share Lib Streaming ................... SUCCESS [
> > 5.583 s]
> > [INFO] Apache Oozie Share Lib Pig ......................... SUCCESS [
> > 6.754 s]
> > [INFO] Apache Oozie Share Lib Hive ........................ SUCCESS [
> > 6.296 s]
> > [INFO] Apache Oozie Share Lib Hive 2 ...................... SUCCESS [
> > 6.128 s]
> > [INFO] Apache Oozie Share Lib Sqoop ....................... SUCCESS [
> > 3.045 s]
> > [INFO] Apache Oozie Examples .............................. SUCCESS [
> > 25.159 s]
> > [INFO] Apache Oozie Share Lib Spark ....................... SUCCESS
> [01:00
> > min]
> > [INFO] Apache Oozie Share Lib ............................. SUCCESS [
> > 19.944 s]
> > [INFO] Apache Oozie Docs .................................. SUCCESS [
> > 20.630 s]
> > [INFO] Apache Oozie WebApp ................................ SUCCESS [
> > 30.752 s]
> > [INFO] Apache Oozie Tools ................................. SUCCESS [
> > 2.999 s]
> > [INFO] Apache Oozie MiniOozie ............................. SUCCESS [
> > 1.565 s]
> > [INFO] Apache Oozie Distro ................................ SUCCESS [
> > 24.443 s]
> > [INFO] Apache Oozie ZooKeeper Security Tests .............. SUCCESS [
> > 2.892 s]
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] BUILD SUCCESS
> >
> >
> > The docs say that I have to extract hadooplibs archive to oozie target
> > directory. However there is no hadooplibs archive anywhere. Am I missing
> > some installation steps?
> >
>
Re: hadooplib is empty after building oozie
Posted by Akshay Rai <ak...@gmail.com>.
Hi Dima,
Try building oozie by specifying *-Puber* with your mkdistro command. *-Puber
*with bundle the required jars to the war.
Regards,
Akshay
On Fri, Sep 11, 2015 at 5:50 PM, Dima Fadeyev <li...@gmail.com> wrote:
> Hello, everyone,
>
> I'm trying to build Oozie from trunk. The build finishes succesfully.
>
> bin/mkdistro.sh -e -Phadoop-2 -DskipTests -Dhadoop.version=2.7.1
> ...
> [INFO] Apache Oozie Main .................................. SUCCESS [
> 1.318 s]
> [INFO] Apache Oozie Hadoop Utils hadoop-2-4.3.0-SNAPSHOT .. SUCCESS [
> 3.661 s]
> [INFO] Apache Oozie Hadoop Distcp hadoop-2-4.3.0-SNAPSHOT . SUCCESS [
> 0.106 s]
> [INFO] Apache Oozie Hadoop Auth hadoop-2-4.3.0-SNAPSHOT Test SUCCESS [
> 0.389 s]
> [INFO] Apache Oozie Hadoop Libs ........................... SUCCESS [
> 0.022 s]
> [INFO] Apache Oozie Client ................................ SUCCESS [
> 12.426 s]
> [INFO] Apache Oozie Share Lib Oozie ....................... SUCCESS [
> 2.477 s]
> [INFO] Apache Oozie Share Lib HCatalog .................... SUCCESS [
> 2.998 s]
> [INFO] Apache Oozie Share Lib Distcp ...................... SUCCESS [
> 0.793 s]
> [INFO] Apache Oozie Core .................................. SUCCESS [
> 39.905 s]
> [INFO] Apache Oozie Share Lib Streaming ................... SUCCESS [
> 5.583 s]
> [INFO] Apache Oozie Share Lib Pig ......................... SUCCESS [
> 6.754 s]
> [INFO] Apache Oozie Share Lib Hive ........................ SUCCESS [
> 6.296 s]
> [INFO] Apache Oozie Share Lib Hive 2 ...................... SUCCESS [
> 6.128 s]
> [INFO] Apache Oozie Share Lib Sqoop ....................... SUCCESS [
> 3.045 s]
> [INFO] Apache Oozie Examples .............................. SUCCESS [
> 25.159 s]
> [INFO] Apache Oozie Share Lib Spark ....................... SUCCESS [01:00
> min]
> [INFO] Apache Oozie Share Lib ............................. SUCCESS [
> 19.944 s]
> [INFO] Apache Oozie Docs .................................. SUCCESS [
> 20.630 s]
> [INFO] Apache Oozie WebApp ................................ SUCCESS [
> 30.752 s]
> [INFO] Apache Oozie Tools ................................. SUCCESS [
> 2.999 s]
> [INFO] Apache Oozie MiniOozie ............................. SUCCESS [
> 1.565 s]
> [INFO] Apache Oozie Distro ................................ SUCCESS [
> 24.443 s]
> [INFO] Apache Oozie ZooKeeper Security Tests .............. SUCCESS [
> 2.892 s]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
>
>
> The docs say that I have to extract hadooplibs archive to oozie target
> directory. However there is no hadooplibs archive anywhere. Am I missing
> some installation steps?
>