You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ranger.apache.org by Sailaja Polavarapu <sp...@hortonworks.com> on 2018/02/22 23:17:19 UTC
Re: Hadoop 3 support
Rangers:
I am volunteering to be the release manager for ranger 1.0.0 release. Based on the below discussion I will start a new thread on kick of plan for the release soon. Please let me know if any of you have any concerns and/or suggestions.
Thanks,
Sailaja.
On 1/22/18, 9:01 AM, "Colm O hEigeartaigh" <co...@apache.org> wrote:
Sounds good, thanks!
Colm.
On Fri, Jan 19, 2018 at 10:59 PM, Madhan Neethiraj <ma...@apache.org>
wrote:
> Colm,
>
> Atlas team is in the process of releasing 1.0.0-alpha, which should go out
> next week. Once this release is out, Atlas team will get started on 0.8.2
> release; and this release should go out by end of the month.
>
> Thanks,
> Madhan
>
>
>
>
> On 1/19/18, 6:42 AM, "Colm O hEigeartaigh" <co...@apache.org> wrote:
>
> Are the Atlas team still planning on releasing 0.8.2 by the end of the
> month? Are there features we need currently missing on the relevant
> branch
> in Atlas?
>
> Colm.
>
> On Wed, Jan 17, 2018 at 2:59 PM, Velmurugan Periasamy <ve...@apache.org>
> wrote:
>
> > +1
> >
> > Another suggestion. Atlas is in the process
> > <https://lists.apache.org/thread.html/f72ccbc48515ff5ea9a3a8832bd298
> 7d19573069eec90984d9d71277@%3Cdev.atlas.apache.org%3E>
> > of releasing 1.0.0-alpha. Once this is complete, Ranger 1.0.0-alpha
> can be
> > released based on that. Atlas team can be requested to back port any
> > changes in Ranger/Atlas interface to 0.8.2, which can be used for
> Ranger
> > 1.0.0.
> >
> > From: Colm O hEigeartaigh <co...@apache.org>
> > Reply-To: "dev@ranger.apache.org" <de...@ranger.apache.org>, "
> > coheigea@apache.org" <co...@apache.org>
> > Date: Tuesday, January 9, 2018 at 10:40 AM
> > To: Abhay Kulkarni <ak...@hortonworks.com>
> > Cc: "dev@ranger.apache.org" <de...@ranger.apache.org>, Ramesh Mani <
> > rmani@hortonworks.com>
> >
> > Subject: Re: Hadoop 3 support
> >
> > +1 for this suggestion. Will there be any issue with downgrading
> Atlas in
> > Ranger from the current 1.0.0-SNAPSHOT version?
> >
> > Colm.
> >
> > On Mon, Jan 8, 2018 at 11:01 PM, Abhay Kulkarni <
> akulkarni@hortonworks.com
> > >
> > wrote:
> >
> > All,
> >
> > Here is another proposal for Ranger release 1.0.0.
> >
> > Atlas team is planning to make a Atlas-0.8.2 release towards the end
> of
> > this month. Once that is done, Ranger can do release 1.0.0 with
> dependency
> > on Atlas 0.8.2 (without Hadoop 3.0.0).
> >
> > Thanks,
> > -Abhay
> >
> > On 1/8/18, 12:23 PM, "Velmurugan Periasamy" <
> vperiasamy@hortonworks.com on
> > behalf of vel@apache.org> wrote:
> >
> > >+1 for getting the 1.0.0 release out soon.
> > >
> > >From: Colm O hEigeartaigh <co...@apache.org>
> > >Reply-To: "dev@ranger.apache.org" <de...@ranger.apache.org>,
> > >"coheigea@apache.org" <co...@apache.org>
> > >Date: Monday, January 8, 2018 at 12:37 PM
> > >To: Ramesh Mani <rm...@hortonworks.com>
> > >Cc: "dev@ranger.apache.org" <de...@ranger.apache.org>
> > >Subject: Re: Hadoop 3 support
> > >
> > >OK thanks. I will test the patch a bit more thoroughly before
> submitting
> > >for a RR.
> > >
> > >Just in regards as to whether to release 1.0.0 with or without
> Hadoop
> > >3.0.0...currently we have a dependency on Atlas 1.0.0-SNAPSHOT.
> What's the
> > >timeline for releasing this? That would be the only thing blocking
> getting
> > >a 1.0.0 of Ranger out "quickly". If that's not imminent then I
> guess that
> > >gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0 support.
> > >
> > >However, it's been ages since the last release so we should
> probably not
> > >wait too long before getting a release out.
> > >
> > >Colm.
> > >
> > >On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani <rm...@hortonworks.com>
> > wrote:
> > >
> > >> Thanks Colm,
> > >>
> > >> I am fine with Option 1 or 3. Do you want to create a RR for
> this
> > >>patch?
> > >>
> > >> Thanks,
> > >> Ramesh
> > >>
> > >> From: Colm O hEigeartaigh <co...@apache.org>
> > >> Reply-To: "coheigea@apache.org" <co...@apache.org>
> > >> Date: Friday, January 5, 2018 at 4:19 AM
> > >> To: Ramesh Mani <rm...@hortonworks.com>
> > >> Cc: "dev@ranger.apache.org" <de...@ranger.apache.org>
> > >> Subject: Re: Hadoop 3 support
> > >>
> > >> I should have added - a third option is just not to support
> Hadoop
> > >>3.0.0
> > >> at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon and
> then
> > >>update
> > >> to Hadoop 3.0.0 in Ranger 1.1/2.0 etc.
> > >>
> > >> Colm.
> > >>
> > >> On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh
> > >><co...@apache.org>
> > >> wrote:
> > >>
> > >>> Hi Ramesh,
> > >>>
> > >>> Yes, the Ranger core will depend on Hadoop 3.0.0, and the HDFS
> + Yarn
> > >>> plugins will support Hadoop 3.0.0 only. There is no other
> option due
> > >>>to API
> > >>> changes. A user can use the earlier plugins from 0.7.x if
> support for
> > >>> Hadoop 2.7.x is required.
> > >>>
> > >>> I am not really tied to this approach though - I'm also fine
> with just
> > >>> having new plugins to support Hadoop 3.0.0 and Yarn 3.0.0. The
> > >>>approach to
> > >>> update all of Ranger to use Hadoop 3.0.0 was based on the
> comments on
> > >>>this
> > >>> JIRA:
> > >>>
> > >>> https://issues.apache.org/jira/browse/RANGER-1738
> > >>>
> > >>> Colm.
> > >>>
> > >>> On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani <
> rmani@hortonworks.com>
> > >>> wrote:
> > >>>
> > >>>> Colm,
> > >>>>
> > >>>> Is this proposal is to have Ranger 1.0.0 support Hadoop 3.0.0
> only?
> > >>>>
> > >>>> Thanks.
> > >>>> Ramesh
> > >>>>
> > >>>>
> > >>>>
> > >>>> On 1/4/18, 9:32 AM, "Colm O hEigeartaigh" <coheigea@apache.org
> >
> > >>>>wrote:
> > >>>>
> > >>>>> >Hi Ranger devs,
> > >>>>> >
> > >>>>> >I posted an initial patch here to bump Ranger up to use
> Hadoop
> > >>>>>3.0.0:
> > >>>>> >
> > >>>>> >https://issues.apache.org/jira/browse/RANGER-1935
> > >>>>> >
> > >>>>> >I would appreciate some initial feedback before proceeding
> further
> > >>>>>with
> > >>>>> >testing it (just a general "looks ok" or "this would be
> problematic
> > >>>>> >because
> > >>>>> >X").
> > >>>>> >
> > >>>>> >Colm.
> > >>>>> >
> > >>>>> >
> > >>>>> >--
> > >>>>> >Colm O hEigeartaigh
> > >>>>> >
> > >>>>> >Talend Community Coder
> > >>>>> >http://coders.talend.com
> > >>>>
> > >>>>
> > >>>
> > >>>
> > >>> --
> > >>> Colm O hEigeartaigh
> > >>>
> > >>> Talend Community Coder
> > >>> http://coders.talend.com
> > >>>
> > >>
> > >>
> > >>
> > >> --
> > >> Colm O hEigeartaigh
> > >>
> > >> Talend Community Coder
> > >> http://coders.talend.com
> > >>
> > >
> > >
> > >
> > >--
> > >Colm O hEigeartaigh
> > >
> > >Talend Community Coder
> > >http://coders.talend.com
> > >
> > >
> > >
> >
> >
> >
> >
> > --
> > Colm O hEigeartaigh
> >
> > Talend Community Coder
> > http://coders.talend.com
> >
> >
>
>
> --
> Colm O hEigeartaigh
>
> Talend Community Coder
> http://coders.talend.com
>
>
>
>
--
Colm O hEigeartaigh
Talend Community Coder
http://coders.talend.com
Re: Hadoop 3 support
Posted by Ramesh Mani <rm...@hortonworks.com>.
+1 for Ranger 1.0.0 release.
Thanks,
Ramesh
On 2/22/18, 3:17 PM, "Sailaja Polavarapu" <sp...@hortonworks.com>
wrote:
>Rangers:
> I am volunteering to be the release manager for ranger 1.0.0 release.
>Based on the below discussion I will start a new thread on kick of plan
>for the release soon. Please let me know if any of you have any concerns
>and/or suggestions.
>
>Thanks,
>Sailaja.
>
>On 1/22/18, 9:01 AM, "Colm O hEigeartaigh" <co...@apache.org> wrote:
>
> Sounds good, thanks!
>
> Colm.
>
> On Fri, Jan 19, 2018 at 10:59 PM, Madhan Neethiraj <ma...@apache.org>
> wrote:
>
> > Colm,
> >
> > Atlas team is in the process of releasing 1.0.0-alpha, which should
>go out
> > next week. Once this release is out, Atlas team will get started on
>0.8.2
> > release; and this release should go out by end of the month.
> >
> > Thanks,
> > Madhan
> >
> >
> >
> >
> > On 1/19/18, 6:42 AM, "Colm O hEigeartaigh" <co...@apache.org>
>wrote:
> >
> > Are the Atlas team still planning on releasing 0.8.2 by the end
>of the
> > month? Are there features we need currently missing on the
>relevant
> > branch
> > in Atlas?
> >
> > Colm.
> >
> > On Wed, Jan 17, 2018 at 2:59 PM, Velmurugan Periasamy
><ve...@apache.org>
> > wrote:
> >
> > > +1
> > >
> > > Another suggestion. Atlas is in the process
> > >
><https://lists.apache.org/thread.html/f72ccbc48515ff5ea9a3a8832bd298
> > 7d19573069eec90984d9d71277@%3Cdev.atlas.apache.org%3E>
> > > of releasing 1.0.0-alpha. Once this is complete, Ranger
>1.0.0-alpha
> > can be
> > > released based on that. Atlas team can be requested to back
>port any
> > > changes in Ranger/Atlas interface to 0.8.2, which can be used
>for
> > Ranger
> > > 1.0.0.
> > >
> > > From: Colm O hEigeartaigh <co...@apache.org>
> > > Reply-To: "dev@ranger.apache.org" <de...@ranger.apache.org>, "
> > > coheigea@apache.org" <co...@apache.org>
> > > Date: Tuesday, January 9, 2018 at 10:40 AM
> > > To: Abhay Kulkarni <ak...@hortonworks.com>
> > > Cc: "dev@ranger.apache.org" <de...@ranger.apache.org>, Ramesh
>Mani <
> > > rmani@hortonworks.com>
> > >
> > > Subject: Re: Hadoop 3 support
> > >
> > > +1 for this suggestion. Will there be any issue with
>downgrading
> > Atlas in
> > > Ranger from the current 1.0.0-SNAPSHOT version?
> > >
> > > Colm.
> > >
> > > On Mon, Jan 8, 2018 at 11:01 PM, Abhay Kulkarni <
> > akulkarni@hortonworks.com
> > > >
> > > wrote:
> > >
> > > All,
> > >
> > > Here is another proposal for Ranger release 1.0.0.
> > >
> > > Atlas team is planning to make a Atlas-0.8.2 release towards
>the end
> > of
> > > this month. Once that is done, Ranger can do release 1.0.0
>with
> > dependency
> > > on Atlas 0.8.2 (without Hadoop 3.0.0).
> > >
> > > Thanks,
> > > -Abhay
> > >
> > > On 1/8/18, 12:23 PM, "Velmurugan Periasamy" <
> > vperiasamy@hortonworks.com on
> > > behalf of vel@apache.org> wrote:
> > >
> > > >+1 for getting the 1.0.0 release out soon.
> > > >
> > > >From: Colm O hEigeartaigh <co...@apache.org>
> > > >Reply-To: "dev@ranger.apache.org" <de...@ranger.apache.org>,
> > > >"coheigea@apache.org" <co...@apache.org>
> > > >Date: Monday, January 8, 2018 at 12:37 PM
> > > >To: Ramesh Mani <rm...@hortonworks.com>
> > > >Cc: "dev@ranger.apache.org" <de...@ranger.apache.org>
> > > >Subject: Re: Hadoop 3 support
> > > >
> > > >OK thanks. I will test the patch a bit more thoroughly before
> > submitting
> > > >for a RR.
> > > >
> > > >Just in regards as to whether to release 1.0.0 with or
>without
> > Hadoop
> > > >3.0.0...currently we have a dependency on Atlas
>1.0.0-SNAPSHOT.
> > What's the
> > > >timeline for releasing this? That would be the only thing
>blocking
> > getting
> > > >a 1.0.0 of Ranger out "quickly". If that's not imminent then
>I
> > guess that
> > > >gives us the time to get Ranger 1.0.0 out with Hadoop 3.0.0
>support.
> > > >
> > > >However, it's been ages since the last release so we should
> > probably not
> > > >wait too long before getting a release out.
> > > >
> > > >Colm.
> > > >
> > > >On Fri, Jan 5, 2018 at 6:39 PM, Ramesh Mani
><rm...@hortonworks.com>
> > > wrote:
> > > >
> > > >> Thanks Colm,
> > > >>
> > > >> I am fine with Option 1 or 3. Do you want to create a RR
>for
> > this
> > > >>patch?
> > > >>
> > > >> Thanks,
> > > >> Ramesh
> > > >>
> > > >> From: Colm O hEigeartaigh <co...@apache.org>
> > > >> Reply-To: "coheigea@apache.org" <co...@apache.org>
> > > >> Date: Friday, January 5, 2018 at 4:19 AM
> > > >> To: Ramesh Mani <rm...@hortonworks.com>
> > > >> Cc: "dev@ranger.apache.org" <de...@ranger.apache.org>
> > > >> Subject: Re: Hadoop 3 support
> > > >>
> > > >> I should have added - a third option is just not to
>support
> > Hadoop
> > > >>3.0.0
> > > >> at all in Ranger 1.0.0 - but to release Ranger 1.0.0 soon
>and
> > then
> > > >>update
> > > >> to Hadoop 3.0.0 in Ranger 1.1/2.0 etc.
> > > >>
> > > >> Colm.
> > > >>
> > > >> On Fri, Jan 5, 2018 at 12:17 PM, Colm O hEigeartaigh
> > > >><co...@apache.org>
> > > >> wrote:
> > > >>
> > > >>> Hi Ramesh,
> > > >>>
> > > >>> Yes, the Ranger core will depend on Hadoop 3.0.0, and
>the HDFS
> > + Yarn
> > > >>> plugins will support Hadoop 3.0.0 only. There is no other
> > option due
> > > >>>to API
> > > >>> changes. A user can use the earlier plugins from 0.7.x if
> > support for
> > > >>> Hadoop 2.7.x is required.
> > > >>>
> > > >>> I am not really tied to this approach though - I'm also
>fine
> > with just
> > > >>> having new plugins to support Hadoop 3.0.0 and Yarn
>3.0.0. The
> > > >>>approach to
> > > >>> update all of Ranger to use Hadoop 3.0.0 was based on the
> > comments on
> > > >>>this
> > > >>> JIRA:
> > > >>>
> > > >>> https://issues.apache.org/jira/browse/RANGER-1738
> > > >>>
> > > >>> Colm.
> > > >>>
> > > >>> On Fri, Jan 5, 2018 at 12:55 AM, Ramesh Mani <
> > rmani@hortonworks.com>
> > > >>> wrote:
> > > >>>
> > > >>>> Colm,
> > > >>>>
> > > >>>> Is this proposal is to have Ranger 1.0.0 support Hadoop
>3.0.0
> > only?
> > > >>>>
> > > >>>> Thanks.
> > > >>>> Ramesh
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>> On 1/4/18, 9:32 AM, "Colm O hEigeartaigh"
><coheigea@apache.org
> > >
> > > >>>>wrote:
> > > >>>>
> > > >>>>> >Hi Ranger devs,
> > > >>>>> >
> > > >>>>> >I posted an initial patch here to bump Ranger up to
>use
> > Hadoop
> > > >>>>>3.0.0:
> > > >>>>> >
> > > >>>>> >https://issues.apache.org/jira/browse/RANGER-1935
> > > >>>>> >
> > > >>>>> >I would appreciate some initial feedback before
>proceeding
> > further
> > > >>>>>with
> > > >>>>> >testing it (just a general "looks ok" or "this would
>be
> > problematic
> > > >>>>> >because
> > > >>>>> >X").
> > > >>>>> >
> > > >>>>> >Colm.
> > > >>>>> >
> > > >>>>> >
> > > >>>>> >--
> > > >>>>> >Colm O hEigeartaigh
> > > >>>>> >
> > > >>>>> >Talend Community Coder
> > > >>>>> >http://coders.talend.com
> > > >>>>
> > > >>>>
> > > >>>
> > > >>>
> > > >>> --
> > > >>> Colm O hEigeartaigh
> > > >>>
> > > >>> Talend Community Coder
> > > >>> http://coders.talend.com
> > > >>>
> > > >>
> > > >>
> > > >>
> > > >> --
> > > >> Colm O hEigeartaigh
> > > >>
> > > >> Talend Community Coder
> > > >> http://coders.talend.com
> > > >>
> > > >
> > > >
> > > >
> > > >--
> > > >Colm O hEigeartaigh
> > > >
> > > >Talend Community Coder
> > > >http://coders.talend.com
> > > >
> > > >
> > > >
> > >
> > >
> > >
> > >
> > > --
> > > Colm O hEigeartaigh
> > >
> > > Talend Community Coder
> > > http://coders.talend.com
> > >
> > >
> >
> >
> > --
> > Colm O hEigeartaigh
> >
> > Talend Community Coder
> > http://coders.talend.com
> >
> >
> >
> >
>
>
> --
> Colm O hEigeartaigh
>
> Talend Community Coder
> http://coders.talend.com
>
>