You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by Mona Chitnis <ch...@yahoo-inc.com> on 2013/12/23 22:30:06 UTC
Re: doing a oozie 4.0.1 release using hadoop 2.1.0-beta as the
hadoop-2 version
The 4.0.0 release has hadoop version 2.2.0-SNAPSHOT in the pom files.
Since these artifacts are no longer available on the maven repository, I
think we should do a 4.0.1 release ASAP since OOZIE-1551 updates the pom
versions to the released version 2.2.0.
--Mona
On 10/1/13 1:09 PM, "Robert Kanter" <rk...@cloudera.com> wrote:
>They recently put up the 2.1.1-beta jars in Maven, so I created a patch
>for
>OOZIE-1551. However, I haven't had a chance to try it yet and there were
>some test failures (mostly Pig action related). I don't have time to look
>into the failures now, but I uploaded the patch and listed the failed
>tests
>in case anyone else wants to look into it in the meantime.
>
>
>
>
>On Mon, Sep 23, 2013 at 11:03 AM, Alejandro Abdelnur
><tu...@cloudera.com>wrote:
>
>> I suggest we wait till Hadoop 2.1.1-beta is out, unless something nasty
>> creeps out it should be out quite soon.
>>
>>
>> On Mon, Sep 23, 2013 at 6:20 PM, Mona Chitnis <ch...@yahoo-inc.com>
>> wrote:
>>
>> > I'd suggest OOZIE-1448, 1513 and 1530 bug fixes go into 4.0.1 since
>>they
>> > contribute towards stability
>> >
>> > On 9/20/13 4:22 PM, "Robert Kanter" <rk...@cloudera.com> wrote:
>> >
>> > >Thanks Rohini. I just put OOZIE-1284 into branch-4.0 and trunk.
>> > >
>> > >I also created OOZIE-1551
>> > ><https://issues.apache.org/jira/browse/OOZIE-1551>to change the
>> > >hadoop-2 profile to use 2.1.0-beta. Is there anything else
>> > >we want to put in 4.0.1 besides these 3 things?
>> > >
>> > >
>> > >thanks
>> > >- Robert
>> > >
>> > >
>> > >On Fri, Sep 20, 2013 at 1:21 PM, Rohini Palaniswamy
>> > ><rohini.aditya@gmail.com
>> > >> wrote:
>> > >
>> > >> Thanks Robert. Created 4.0.1 branch. OOZIE-1549 is checked in as
>>part
>> of
>> > >> 4.0.1 in branch-4.0. Please go ahead and check in OOZIE-1284 in
>> > >>branch-4.0.
>> > >>
>> > >> Regards,
>> > >> Rohini
>> > >>
>> > >>
>> > >> On Fri, Sep 20, 2013 at 10:05 AM, Robert Kanter
>><rkanter@cloudera.com
>> > >> >wrote:
>> > >>
>> > >> > I guess we need to update the release-log.txt to have a 4.0.1
>> section
>> > >>in
>> > >> > trunk and branch-4.0, but I don't think we need to do anything
>>else.
>> > >> >
>> > >> > And for 4.0.1, according to
>> > >> > https://cwiki.apache.org/confluence/display/OOZIE/How+To+Release,
>> we
>> > >> just
>> > >> > keep using branch-4.0 so no need to create a new branch either.
>> > >> >
>> > >> > Also, I think we should put
>> > >> > OOZIE-1284<https://issues.apache.org/jira/browse/OOZIE-1284
>> > >> > >(oozie.service.SchemaService.wf.ext.schemas
>> > >> > in oozie-site is missing some
>> > >> > newer xsd files) in 4.0.1.
>> > >> >
>> > >> > thanks
>> > >> > - Robert
>> > >> >
>> > >> >
>> > >> > On Fri, Sep 20, 2013 at 9:44 AM, Rohini Palaniswamy <
>> > >> > rohini.aditya@gmail.com
>> > >> > > wrote:
>> > >> >
>> > >> > > I will create a 4.0.1 version in jira for this. Is there
>>anything
>> > >> > > additional that needs to be done than adding the version in
>> Versions
>> > >> tab?
>> > >> > >
>> > >> > > Regards,
>> > >> > > Rohini
>> > >> > >
>> > >> > >
>> > >> > > On Wed, Sep 4, 2013 at 11:27 AM, Robert Kanter
>> > >><rk...@cloudera.com>
>> > >> > > wrote:
>> > >> > >
>> > >> > > > That's a good idea; we can replace the unreleased
>>2.2.0-SNAPSHOT
>> > >>with
>> > >> > > > 2.1.0-beta for the "hadoop-2" profile. Is there anything
>>else
>> > >>that
>> > >> > would
>> > >> > > > be good (probably only critical or very minor things) to
>>include
>> > >>in
>> > >> > this
>> > >> > > > release?
>> > >> > > >
>> > >> > > > thanks
>> > >> > > > - Robert
>> > >> > > >
>> > >> > > >
>> > >> > > > On Wed, Sep 4, 2013 at 4:30 AM, Alejandro Abdelnur <
>> > >> tucu@cloudera.com
>> > >> > > > >wrote:
>> > >> > > >
>> > >> > > > > I think we should do a new Oozie release using Hadoop
>> > >>2.1.0-beta,
>> > >> > this
>> > >> > > > will
>> > >> > > > > help users and developers to start playing with Hadoop 2 .
>> > >> > > > >
>> > >> > > > > thx.
>> > >> > > > >
>> > >> > > > > --
>> > >> > > > > Alejandro
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >> >
>> > >>
>> >
>> >
>>
>>
>> --
>> Alejandro
>>
Re: doing a oozie 4.0.1 release using hadoop 2.1.0-beta as the hadoop-2 version
Posted by Alejandro Abdelnur <tu...@cloudera.com>.
+1
Alejandro
(phone typing)
> On Mar 6, 2014, at 14:39, Robert Kanter <rk...@cloudera.com> wrote:
>
> Reviving this thread. I guess we all got busy with other things at the end
> of the year. To reiterate what Mona said in the last email: we should do a
> 4.0.1 release ASAP because Oozie 4.0.0 doesn't even compile out-of-the-box.
>
>
> I'd like to volunteer to drive the 4.0.1 release.
> It currently has the following commits on top of 4.0.0:
>
> 1cce35c OZIE-1626 pig action pop-up is not working properly in UI (puru via
> rohini)
>
> b2858ab OOZIE-1670 Workflow kill command doesn't kill child job for
> map-reduce action (puru via rohini)
>
> cfba5e9 OOZIE-1626 pig action pop-up is not working properly in UI (puru
> via rohini)
>
> 901ca12 OOZIE-1630 <prepare> operations fail when path doesn't have scheme
> (ryota)
>
> 5050f69 OOZIE-1627 Rerun doesn't resolve workflow app name (puru via rohini)
>
> b1358a5 amending release-log.txt for OOZIE-1626
>
> d12edf9 OOZIE-1626 pig action pop-up is not working properly in UI (ryota)
>
> e4d4d66 [Doc]Update workflow specification for chgrp command (puru via
> rohini)
>
> b6376e9 OOZIE-1542 When extjs isn't installed, the web UI is unhelpfully
> blank (rkanter)
>
> 1f5d524 OOZIE-1565 OOZIE-1481 should only affect v2 of the API, not v1
> (rkanter)
>
> d657100 OOZIE-1551 Change hadoop-2 profile to use 2.2.0
> (rkanter,rohini,mona via rkanter)
>
> 572200a OOZIE-1573 coord:tzOffset() gives incorrect offset for daylight
> saving timezones (rohini)
>
> b67c500 OOZIE-1582 Bump up Tomcat version to 6.0.37 (rkanter)
>
> fd7a085 OOZIE-1563 colt jar includes GPL licence (rkanter)
>
> e30d6b9 OOZIE-1284 oozie.service.SchemaService.wf.ext.schemas in oozie-site
> is missing some newer xsd files (rkanter)
>
> e6d118a OOZIE-1549 Update hcat documentation to mention
> hcatalog-pig-adapter jar (bowenzhangusa via rohini)
>
> I'd also like to add the following on top of that:
>
> 14d040d OOZIE-1223 too many extjs cookies can cause the web UI to stop
> responding (puru via rkanter)
>
>
> Any other suggestions? Please keep in mind that this is 4.0.1 and not
> 4.1.0 so we don't want a lot of big or risky changes.
>
>
>
>
>
>> On Mon, Dec 23, 2013 at 1:30 PM, Mona Chitnis <ch...@yahoo-inc.com> wrote:
>>
>> The 4.0.0 release has hadoop version 2.2.0-SNAPSHOT in the pom files.
>> Since these artifacts are no longer available on the maven repository, I
>> think we should do a 4.0.1 release ASAP since OOZIE-1551 updates the pom
>> versions to the released version 2.2.0.
>>
>> --Mona
>>
>>> On 10/1/13 1:09 PM, "Robert Kanter" <rk...@cloudera.com> wrote:
>>>
>>> They recently put up the 2.1.1-beta jars in Maven, so I created a patch
>>> for
>>> OOZIE-1551. However, I haven't had a chance to try it yet and there were
>>> some test failures (mostly Pig action related). I don't have time to look
>>> into the failures now, but I uploaded the patch and listed the failed
>>> tests
>>> in case anyone else wants to look into it in the meantime.
>>>
>>>
>>>
>>>
>>> On Mon, Sep 23, 2013 at 11:03 AM, Alejandro Abdelnur
>>> <tu...@cloudera.com>wrote:
>>>
>>>> I suggest we wait till Hadoop 2.1.1-beta is out, unless something nasty
>>>> creeps out it should be out quite soon.
>>>>
>>>>
>>>> On Mon, Sep 23, 2013 at 6:20 PM, Mona Chitnis <ch...@yahoo-inc.com>
>>>> wrote:
>>>>
>>>>> I'd suggest OOZIE-1448, 1513 and 1530 bug fixes go into 4.0.1 since
>>>> they
>>>>> contribute towards stability
>>>>>
>>>>>> On 9/20/13 4:22 PM, "Robert Kanter" <rk...@cloudera.com> wrote:
>>>>>>
>>>>>> Thanks Rohini. I just put OOZIE-1284 into branch-4.0 and trunk.
>>>>>>
>>>>>> I also created OOZIE-1551
>>>>>> <https://issues.apache.org/jira/browse/OOZIE-1551>to change the
>>>>>> hadoop-2 profile to use 2.1.0-beta. Is there anything else
>>>>>> we want to put in 4.0.1 besides these 3 things?
>>>>>>
>>>>>>
>>>>>> thanks
>>>>>> - Robert
>>>>>>
>>>>>>
>>>>>> On Fri, Sep 20, 2013 at 1:21 PM, Rohini Palaniswamy
>>>>>> <rohini.aditya@gmail.com
>>>>>>> wrote:
>>>>>>
>>>>>>> Thanks Robert. Created 4.0.1 branch. OOZIE-1549 is checked in as
>>>> part
>>>> of
>>>>>>> 4.0.1 in branch-4.0. Please go ahead and check in OOZIE-1284 in
>>>>>>> branch-4.0.
>>>>>>>
>>>>>>> Regards,
>>>>>>> Rohini
>>>>>>>
>>>>>>>
>>>>>>> On Fri, Sep 20, 2013 at 10:05 AM, Robert Kanter
>>>> <rkanter@cloudera.com
>>>>>>>> wrote:
>>>>>>>
>>>>>>>> I guess we need to update the release-log.txt to have a 4.0.1
>>>> section
>>>>>>> in
>>>>>>>> trunk and branch-4.0, but I don't think we need to do anything
>>>> else.
>>>>>>>>
>>>>>>>> And for 4.0.1, according to
>>>>>>>> https://cwiki.apache.org/confluence/display/OOZIE/How+To+Release
>> ,
>>>> we
>>>>>>> just
>>>>>>>> keep using branch-4.0 so no need to create a new branch either.
>>>>>>>>
>>>>>>>> Also, I think we should put
>>>>>>>> OOZIE-1284<https://issues.apache.org/jira/browse/OOZIE-1284
>>>>>>>>> (oozie.service.SchemaService.wf.ext.schemas
>>>>>>>> in oozie-site is missing some
>>>>>>>> newer xsd files) in 4.0.1.
>>>>>>>>
>>>>>>>> thanks
>>>>>>>> - Robert
>>>>>>>>
>>>>>>>>
>>>>>>>> On Fri, Sep 20, 2013 at 9:44 AM, Rohini Palaniswamy <
>>>>>>>> rohini.aditya@gmail.com
>>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> I will create a 4.0.1 version in jira for this. Is there
>>>> anything
>>>>>>>>> additional that needs to be done than adding the version in
>>>> Versions
>>>>>>> tab?
>>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>> Rohini
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Wed, Sep 4, 2013 at 11:27 AM, Robert Kanter
>>>>>>> <rk...@cloudera.com>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> That's a good idea; we can replace the unreleased
>>>> 2.2.0-SNAPSHOT
>>>>>>> with
>>>>>>>>>> 2.1.0-beta for the "hadoop-2" profile. Is there anything
>>>> else
>>>>>>> that
>>>>>>>> would
>>>>>>>>>> be good (probably only critical or very minor things) to
>>>> include
>>>>>>> in
>>>>>>>> this
>>>>>>>>>> release?
>>>>>>>>>>
>>>>>>>>>> thanks
>>>>>>>>>> - Robert
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On Wed, Sep 4, 2013 at 4:30 AM, Alejandro Abdelnur <
>>>>>>> tucu@cloudera.com
>>>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>>> I think we should do a new Oozie release using Hadoop
>>>>>>> 2.1.0-beta,
>>>>>>>> this
>>>>>>>>>> will
>>>>>>>>>>> help users and developers to start playing with Hadoop 2 .
>>>>>>>>>>>
>>>>>>>>>>> thx.
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> Alejandro
>>>>
>>>>
>>>> --
>>>> Alejandro
>>
>>
Re: doing a oozie 4.0.1 release using hadoop 2.1.0-beta as the
hadoop-2 version
Posted by Robert Kanter <rk...@cloudera.com>.
Reviving this thread. I guess we all got busy with other things at the end
of the year. To reiterate what Mona said in the last email: we should do a
4.0.1 release ASAP because Oozie 4.0.0 doesn't even compile out-of-the-box.
I'd like to volunteer to drive the 4.0.1 release.
It currently has the following commits on top of 4.0.0:
1cce35c OZIE-1626 pig action pop-up is not working properly in UI (puru via
rohini)
b2858ab OOZIE-1670 Workflow kill command doesn't kill child job for
map-reduce action (puru via rohini)
cfba5e9 OOZIE-1626 pig action pop-up is not working properly in UI (puru
via rohini)
901ca12 OOZIE-1630 <prepare> operations fail when path doesn't have scheme
(ryota)
5050f69 OOZIE-1627 Rerun doesn't resolve workflow app name (puru via rohini)
b1358a5 amending release-log.txt for OOZIE-1626
d12edf9 OOZIE-1626 pig action pop-up is not working properly in UI (ryota)
e4d4d66 [Doc]Update workflow specification for chgrp command (puru via
rohini)
b6376e9 OOZIE-1542 When extjs isn't installed, the web UI is unhelpfully
blank (rkanter)
1f5d524 OOZIE-1565 OOZIE-1481 should only affect v2 of the API, not v1
(rkanter)
d657100 OOZIE-1551 Change hadoop-2 profile to use 2.2.0
(rkanter,rohini,mona via rkanter)
572200a OOZIE-1573 coord:tzOffset() gives incorrect offset for daylight
saving timezones (rohini)
b67c500 OOZIE-1582 Bump up Tomcat version to 6.0.37 (rkanter)
fd7a085 OOZIE-1563 colt jar includes GPL licence (rkanter)
e30d6b9 OOZIE-1284 oozie.service.SchemaService.wf.ext.schemas in oozie-site
is missing some newer xsd files (rkanter)
e6d118a OOZIE-1549 Update hcat documentation to mention
hcatalog-pig-adapter jar (bowenzhangusa via rohini)
I'd also like to add the following on top of that:
14d040d OOZIE-1223 too many extjs cookies can cause the web UI to stop
responding (puru via rkanter)
Any other suggestions? Please keep in mind that this is 4.0.1 and not
4.1.0 so we don't want a lot of big or risky changes.
On Mon, Dec 23, 2013 at 1:30 PM, Mona Chitnis <ch...@yahoo-inc.com> wrote:
> The 4.0.0 release has hadoop version 2.2.0-SNAPSHOT in the pom files.
> Since these artifacts are no longer available on the maven repository, I
> think we should do a 4.0.1 release ASAP since OOZIE-1551 updates the pom
> versions to the released version 2.2.0.
>
> --Mona
>
> On 10/1/13 1:09 PM, "Robert Kanter" <rk...@cloudera.com> wrote:
>
> >They recently put up the 2.1.1-beta jars in Maven, so I created a patch
> >for
> >OOZIE-1551. However, I haven't had a chance to try it yet and there were
> >some test failures (mostly Pig action related). I don't have time to look
> >into the failures now, but I uploaded the patch and listed the failed
> >tests
> >in case anyone else wants to look into it in the meantime.
> >
> >
> >
> >
> >On Mon, Sep 23, 2013 at 11:03 AM, Alejandro Abdelnur
> ><tu...@cloudera.com>wrote:
> >
> >> I suggest we wait till Hadoop 2.1.1-beta is out, unless something nasty
> >> creeps out it should be out quite soon.
> >>
> >>
> >> On Mon, Sep 23, 2013 at 6:20 PM, Mona Chitnis <ch...@yahoo-inc.com>
> >> wrote:
> >>
> >> > I'd suggest OOZIE-1448, 1513 and 1530 bug fixes go into 4.0.1 since
> >>they
> >> > contribute towards stability
> >> >
> >> > On 9/20/13 4:22 PM, "Robert Kanter" <rk...@cloudera.com> wrote:
> >> >
> >> > >Thanks Rohini. I just put OOZIE-1284 into branch-4.0 and trunk.
> >> > >
> >> > >I also created OOZIE-1551
> >> > ><https://issues.apache.org/jira/browse/OOZIE-1551>to change the
> >> > >hadoop-2 profile to use 2.1.0-beta. Is there anything else
> >> > >we want to put in 4.0.1 besides these 3 things?
> >> > >
> >> > >
> >> > >thanks
> >> > >- Robert
> >> > >
> >> > >
> >> > >On Fri, Sep 20, 2013 at 1:21 PM, Rohini Palaniswamy
> >> > ><rohini.aditya@gmail.com
> >> > >> wrote:
> >> > >
> >> > >> Thanks Robert. Created 4.0.1 branch. OOZIE-1549 is checked in as
> >>part
> >> of
> >> > >> 4.0.1 in branch-4.0. Please go ahead and check in OOZIE-1284 in
> >> > >>branch-4.0.
> >> > >>
> >> > >> Regards,
> >> > >> Rohini
> >> > >>
> >> > >>
> >> > >> On Fri, Sep 20, 2013 at 10:05 AM, Robert Kanter
> >><rkanter@cloudera.com
> >> > >> >wrote:
> >> > >>
> >> > >> > I guess we need to update the release-log.txt to have a 4.0.1
> >> section
> >> > >>in
> >> > >> > trunk and branch-4.0, but I don't think we need to do anything
> >>else.
> >> > >> >
> >> > >> > And for 4.0.1, according to
> >> > >> > https://cwiki.apache.org/confluence/display/OOZIE/How+To+Release
> ,
> >> we
> >> > >> just
> >> > >> > keep using branch-4.0 so no need to create a new branch either.
> >> > >> >
> >> > >> > Also, I think we should put
> >> > >> > OOZIE-1284<https://issues.apache.org/jira/browse/OOZIE-1284
> >> > >> > >(oozie.service.SchemaService.wf.ext.schemas
> >> > >> > in oozie-site is missing some
> >> > >> > newer xsd files) in 4.0.1.
> >> > >> >
> >> > >> > thanks
> >> > >> > - Robert
> >> > >> >
> >> > >> >
> >> > >> > On Fri, Sep 20, 2013 at 9:44 AM, Rohini Palaniswamy <
> >> > >> > rohini.aditya@gmail.com
> >> > >> > > wrote:
> >> > >> >
> >> > >> > > I will create a 4.0.1 version in jira for this. Is there
> >>anything
> >> > >> > > additional that needs to be done than adding the version in
> >> Versions
> >> > >> tab?
> >> > >> > >
> >> > >> > > Regards,
> >> > >> > > Rohini
> >> > >> > >
> >> > >> > >
> >> > >> > > On Wed, Sep 4, 2013 at 11:27 AM, Robert Kanter
> >> > >><rk...@cloudera.com>
> >> > >> > > wrote:
> >> > >> > >
> >> > >> > > > That's a good idea; we can replace the unreleased
> >>2.2.0-SNAPSHOT
> >> > >>with
> >> > >> > > > 2.1.0-beta for the "hadoop-2" profile. Is there anything
> >>else
> >> > >>that
> >> > >> > would
> >> > >> > > > be good (probably only critical or very minor things) to
> >>include
> >> > >>in
> >> > >> > this
> >> > >> > > > release?
> >> > >> > > >
> >> > >> > > > thanks
> >> > >> > > > - Robert
> >> > >> > > >
> >> > >> > > >
> >> > >> > > > On Wed, Sep 4, 2013 at 4:30 AM, Alejandro Abdelnur <
> >> > >> tucu@cloudera.com
> >> > >> > > > >wrote:
> >> > >> > > >
> >> > >> > > > > I think we should do a new Oozie release using Hadoop
> >> > >>2.1.0-beta,
> >> > >> > this
> >> > >> > > > will
> >> > >> > > > > help users and developers to start playing with Hadoop 2 .
> >> > >> > > > >
> >> > >> > > > > thx.
> >> > >> > > > >
> >> > >> > > > > --
> >> > >> > > > > Alejandro
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >> >
> >> > >>
> >> >
> >> >
> >>
> >>
> >> --
> >> Alejandro
> >>
>
>