You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by jun aoki <ju...@gmail.com> on 2013/01/03 20:00:53 UTC
quick start out-dated?
http://oozie.apache.org/docs/3.3.0/DG_QuickStart.html
seems a bit out-dated by following reasons;
1. it does not tell how to build oozie (mkdistro.sh)
2. Users do not have to do anything with hadooplibs tar.gz ?
3. Users do not have to create libext folder?
4. at least a few properties should be modified in oozie-site.xml?
(See my understanding here
https://github.com/jaoki/oozie-playground#oozie-setup)
5. bin/ooziedb.sh does not have to be called manually?
if anybody is interested, I can make a ticket and submit a patch. Let me
know.
Re: quick start out-dated?
Posted by jun aoki <ju...@gmail.com>.
Hi Rohini, thank you for your answer.
Now I understand that the sql file name is to let the ooziedb.sh generate
the sql file (I thought it was to generate schema FROM the sql file) so
that it can be used by other databases.
It looks like it is a good idea to add mkdistro.sh but the rest are
actually fine.
I made a ticket here https://issues.apache.org/jira/browse/OOZIE-1155
I learned a lot and thank you all for helping me understand!
jun
On Thu, Jan 3, 2013 at 2:25 PM, Rohini Palaniswamy
<ro...@gmail.com>wrote:
> Also do you know where I can find oozie.sql used for ooziedb.sh script?
>
> ooziedb.sh create <OPTIONS> : create Oozie DB schema
> -run Confirm the DB schema
> creation/upgrade
> -sqlfile <arg> Generate SQL script instead
> creating/upgrading the DB
> schema
>
> I guess you need to do ooziedb.sh create -sqlfile <sqlfile> to get the sql
> file created.
>
> Regards,
> Rohini
>
> On Thu, Jan 3, 2013 at 1:08 PM, jun aoki <ju...@gmail.com> wrote:
>
> > Hi Virag/Mona, thank you for clarifying.
> >
> > One last question; It looks like the database schema is created openjpa
> > through from the java classes.
> > (I thought oozie.sql is bundled in oozie when I saw Get started doc)
> > Could we also remove "-sqlfile oozie.sql" from ooziedb.sh example since
> new
> > users would have no idea where the sql file is?
> >
> >
> > (i also appending what I replied back mistakenly only Mona previously)
> > -------- What replied to Mona in my previous--------
> >
> > Hi Mona, thank you for responding.
> > So as I thought more after getting your comment, I found there are
> multiple
> > ways to setup oozie.
> >
> > For haddoplib and libext, you can use either one way
> > 1. bin/oozie-setup.sh -hadoop (specify a path to hadoop you use)
> > 2. OR , use hadooplibs
> >
> > For EXT-JS
> > 1. Store extjs under libext
> > 2. OR use oozie-setup.sh --extjs {path to extjs)
> >
> > For db creation,
> > 1. run ooziedb.sh
> > 2. OR set oozie.service.JPAService.create.db.schema
> >
> > Let me know if I get it right.
> >
> > Probably we can still refer mkdistro.sh ?
> >
> > Also do you know where I can find oozie.sql used for ooziedb.sh script?
> >
> >
> >
> >
> > On Thu, Jan 3, 2013 at 12:27 PM, Virag Kothari <vi...@yahoo-inc.com>
> > wrote:
> >
> > > Hi Jun,
> > >
> > > Thanks for taking a look at the quick start. Responses online
> > >
> > > 1. it does not tell how to build oozie (mkdistro.sh)
> > >
> > >
> > > Yes. I think we should make this as part of QuickStart. Currently, its
> at
> > > http://oozie.apache.org/docs/3.3.0/ENG_Building.html. In quick start,
> we
> > > should provide a link to this page and I think it will be a good idea
> to
> > > specify bin/mkdistro.sh for building oozie in Quickstart.
> > >
> > > 2. Users do not have to do anything with hadooplibs tar.gz ?
> > > 3. Users do not have to create libext folder?
> > >
> > > This two steps are required for injecting the required hadoop jars in
> > > Oozie's WEB-INF/lib. This can be done in a separate way by
> parameterizing
> > > the oozie-setup.sh (as in your github link). But libext is the
> > recommended
> > > way.
> > >
> > > 4) at least a few properties should be modified in oozie-site.xml?
> > > (See my understanding here
> > > https://github.com/jaoki/oozie-playground#oozie-setup)
> > >
> > > The whitelist and hadoop-configuration settings in oozie-site are not
> > > mandatory. If bin/ooziedb.sh is used, then setting
> > > 'oozie.service.JPAService.create.db.schema' to true is not required.
> > >
> > > 5. bin/ooziedb.sh does not have to be called manually?
> > >
> > >
> > > Answered above.
> > >
> > > Thanks,
> > > Virag
> > >
> > >
> > >
> > > On 1/3/13 11:00 AM, "jun aoki" <ju...@gmail.com> wrote:
> > >
> > > >http://oozie.apache.org/docs/3.3.0/DG_QuickStart.html
> > > >
> > > >seems a bit out-dated by following reasons;
> > > >
> > > >1. it does not tell how to build oozie (mkdistro.sh)
> > > >2. Users do not have to do anything with hadooplibs tar.gz ?
> > > >3. Users do not have to create libext folder?
> > > >4. at least a few properties should be modified in oozie-site.xml?
> > > > (See my understanding here
> > > >https://github.com/jaoki/oozie-playground#oozie-setup)
> > > >5. bin/ooziedb.sh does not have to be called manually?
> > > >
> > > >if anybody is interested, I can make a ticket and submit a patch. Let
> me
> > > >know.
> > >
> > >
> >
>
Re: quick start out-dated?
Posted by Rohini Palaniswamy <ro...@gmail.com>.
Also do you know where I can find oozie.sql used for ooziedb.sh script?
ooziedb.sh create <OPTIONS> : create Oozie DB schema
-run Confirm the DB schema
creation/upgrade
-sqlfile <arg> Generate SQL script instead
creating/upgrading the DB
schema
I guess you need to do ooziedb.sh create -sqlfile <sqlfile> to get the sql
file created.
Regards,
Rohini
On Thu, Jan 3, 2013 at 1:08 PM, jun aoki <ju...@gmail.com> wrote:
> Hi Virag/Mona, thank you for clarifying.
>
> One last question; It looks like the database schema is created openjpa
> through from the java classes.
> (I thought oozie.sql is bundled in oozie when I saw Get started doc)
> Could we also remove "-sqlfile oozie.sql" from ooziedb.sh example since new
> users would have no idea where the sql file is?
>
>
> (i also appending what I replied back mistakenly only Mona previously)
> -------- What replied to Mona in my previous--------
>
> Hi Mona, thank you for responding.
> So as I thought more after getting your comment, I found there are multiple
> ways to setup oozie.
>
> For haddoplib and libext, you can use either one way
> 1. bin/oozie-setup.sh -hadoop (specify a path to hadoop you use)
> 2. OR , use hadooplibs
>
> For EXT-JS
> 1. Store extjs under libext
> 2. OR use oozie-setup.sh --extjs {path to extjs)
>
> For db creation,
> 1. run ooziedb.sh
> 2. OR set oozie.service.JPAService.create.db.schema
>
> Let me know if I get it right.
>
> Probably we can still refer mkdistro.sh ?
>
> Also do you know where I can find oozie.sql used for ooziedb.sh script?
>
>
>
>
> On Thu, Jan 3, 2013 at 12:27 PM, Virag Kothari <vi...@yahoo-inc.com>
> wrote:
>
> > Hi Jun,
> >
> > Thanks for taking a look at the quick start. Responses online
> >
> > 1. it does not tell how to build oozie (mkdistro.sh)
> >
> >
> > Yes. I think we should make this as part of QuickStart. Currently, its at
> > http://oozie.apache.org/docs/3.3.0/ENG_Building.html. In quick start, we
> > should provide a link to this page and I think it will be a good idea to
> > specify bin/mkdistro.sh for building oozie in Quickstart.
> >
> > 2. Users do not have to do anything with hadooplibs tar.gz ?
> > 3. Users do not have to create libext folder?
> >
> > This two steps are required for injecting the required hadoop jars in
> > Oozie's WEB-INF/lib. This can be done in a separate way by parameterizing
> > the oozie-setup.sh (as in your github link). But libext is the
> recommended
> > way.
> >
> > 4) at least a few properties should be modified in oozie-site.xml?
> > (See my understanding here
> > https://github.com/jaoki/oozie-playground#oozie-setup)
> >
> > The whitelist and hadoop-configuration settings in oozie-site are not
> > mandatory. If bin/ooziedb.sh is used, then setting
> > 'oozie.service.JPAService.create.db.schema' to true is not required.
> >
> > 5. bin/ooziedb.sh does not have to be called manually?
> >
> >
> > Answered above.
> >
> > Thanks,
> > Virag
> >
> >
> >
> > On 1/3/13 11:00 AM, "jun aoki" <ju...@gmail.com> wrote:
> >
> > >http://oozie.apache.org/docs/3.3.0/DG_QuickStart.html
> > >
> > >seems a bit out-dated by following reasons;
> > >
> > >1. it does not tell how to build oozie (mkdistro.sh)
> > >2. Users do not have to do anything with hadooplibs tar.gz ?
> > >3. Users do not have to create libext folder?
> > >4. at least a few properties should be modified in oozie-site.xml?
> > > (See my understanding here
> > >https://github.com/jaoki/oozie-playground#oozie-setup)
> > >5. bin/ooziedb.sh does not have to be called manually?
> > >
> > >if anybody is interested, I can make a ticket and submit a patch. Let me
> > >know.
> >
> >
>
Re: quick start out-dated?
Posted by jun aoki <ju...@gmail.com>.
Hi Virag/Mona, thank you for clarifying.
One last question; It looks like the database schema is created openjpa
through from the java classes.
(I thought oozie.sql is bundled in oozie when I saw Get started doc)
Could we also remove "-sqlfile oozie.sql" from ooziedb.sh example since new
users would have no idea where the sql file is?
(i also appending what I replied back mistakenly only Mona previously)
-------- What replied to Mona in my previous--------
Hi Mona, thank you for responding.
So as I thought more after getting your comment, I found there are multiple
ways to setup oozie.
For haddoplib and libext, you can use either one way
1. bin/oozie-setup.sh -hadoop (specify a path to hadoop you use)
2. OR , use hadooplibs
For EXT-JS
1. Store extjs under libext
2. OR use oozie-setup.sh --extjs {path to extjs)
For db creation,
1. run ooziedb.sh
2. OR set oozie.service.JPAService.create.db.schema
Let me know if I get it right.
Probably we can still refer mkdistro.sh ?
Also do you know where I can find oozie.sql used for ooziedb.sh script?
On Thu, Jan 3, 2013 at 12:27 PM, Virag Kothari <vi...@yahoo-inc.com> wrote:
> Hi Jun,
>
> Thanks for taking a look at the quick start. Responses online
>
> 1. it does not tell how to build oozie (mkdistro.sh)
>
>
> Yes. I think we should make this as part of QuickStart. Currently, its at
> http://oozie.apache.org/docs/3.3.0/ENG_Building.html. In quick start, we
> should provide a link to this page and I think it will be a good idea to
> specify bin/mkdistro.sh for building oozie in Quickstart.
>
> 2. Users do not have to do anything with hadooplibs tar.gz ?
> 3. Users do not have to create libext folder?
>
> This two steps are required for injecting the required hadoop jars in
> Oozie's WEB-INF/lib. This can be done in a separate way by parameterizing
> the oozie-setup.sh (as in your github link). But libext is the recommended
> way.
>
> 4) at least a few properties should be modified in oozie-site.xml?
> (See my understanding here
> https://github.com/jaoki/oozie-playground#oozie-setup)
>
> The whitelist and hadoop-configuration settings in oozie-site are not
> mandatory. If bin/ooziedb.sh is used, then setting
> 'oozie.service.JPAService.create.db.schema' to true is not required.
>
> 5. bin/ooziedb.sh does not have to be called manually?
>
>
> Answered above.
>
> Thanks,
> Virag
>
>
>
> On 1/3/13 11:00 AM, "jun aoki" <ju...@gmail.com> wrote:
>
> >http://oozie.apache.org/docs/3.3.0/DG_QuickStart.html
> >
> >seems a bit out-dated by following reasons;
> >
> >1. it does not tell how to build oozie (mkdistro.sh)
> >2. Users do not have to do anything with hadooplibs tar.gz ?
> >3. Users do not have to create libext folder?
> >4. at least a few properties should be modified in oozie-site.xml?
> > (See my understanding here
> >https://github.com/jaoki/oozie-playground#oozie-setup)
> >5. bin/ooziedb.sh does not have to be called manually?
> >
> >if anybody is interested, I can make a ticket and submit a patch. Let me
> >know.
>
>
Re: quick start out-dated?
Posted by Mona Chitnis <ch...@yahoo-inc.com>.
Hi Jun,
I see the requisite steps on the Quick Start page starting from proxy user
settings, libext folder, getting the jars from hadooplibs to put into
libext, the ooziedb.sh DB setup script and then start. If this process is
followed, nothing else needs to be done. Is there any specific step which
is missing that you had to follow?
--
Mona
On 1/3/13 11:00 AM, "jun aoki" <ju...@gmail.com> wrote:
>http://oozie.apache.org/docs/3.3.0/DG_QuickStart.html
>
>seems a bit out-dated by following reasons;
>
>1. it does not tell how to build oozie (mkdistro.sh)
>2. Users do not have to do anything with hadooplibs tar.gz ?
>3. Users do not have to create libext folder?
>4. at least a few properties should be modified in oozie-site.xml?
> (See my understanding here
>https://github.com/jaoki/oozie-playground#oozie-setup)
>5. bin/ooziedb.sh does not have to be called manually?
>
>if anybody is interested, I can make a ticket and submit a patch. Let me
>know.
Re: quick start out-dated?
Posted by Virag Kothari <vi...@yahoo-inc.com>.
Hi Jun,
Thanks for taking a look at the quick start. Responses online
1. it does not tell how to build oozie (mkdistro.sh)
Yes. I think we should make this as part of QuickStart. Currently, its at
http://oozie.apache.org/docs/3.3.0/ENG_Building.html. In quick start, we
should provide a link to this page and I think it will be a good idea to
specify bin/mkdistro.sh for building oozie in Quickstart.
2. Users do not have to do anything with hadooplibs tar.gz ?
3. Users do not have to create libext folder?
This two steps are required for injecting the required hadoop jars in
Oozie's WEB-INF/lib. This can be done in a separate way by parameterizing
the oozie-setup.sh (as in your github link). But libext is the recommended
way.
4) at least a few properties should be modified in oozie-site.xml?
(See my understanding here
https://github.com/jaoki/oozie-playground#oozie-setup)
The whitelist and hadoop-configuration settings in oozie-site are not
mandatory. If bin/ooziedb.sh is used, then setting
'oozie.service.JPAService.create.db.schema' to true is not required.
5. bin/ooziedb.sh does not have to be called manually?
Answered above.
Thanks,
Virag
On 1/3/13 11:00 AM, "jun aoki" <ju...@gmail.com> wrote:
>http://oozie.apache.org/docs/3.3.0/DG_QuickStart.html
>
>seems a bit out-dated by following reasons;
>
>1. it does not tell how to build oozie (mkdistro.sh)
>2. Users do not have to do anything with hadooplibs tar.gz ?
>3. Users do not have to create libext folder?
>4. at least a few properties should be modified in oozie-site.xml?
> (See my understanding here
>https://github.com/jaoki/oozie-playground#oozie-setup)
>5. bin/ooziedb.sh does not have to be called manually?
>
>if anybody is interested, I can make a ticket and submit a patch. Let me
>know.