You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@phoenix.apache.org by Mahdi Salarkia <ms...@box.com.INVALID> on 2019/02/13 00:16:23 UTC
CDH 6.X road map
Hi
Is there a plan to release a Hbase-2.0-CDH (Cloudera 6.X) compatible
version of Phoenix anytime soon?
I can see Phoenix currently supports older versions of CDH (5.11, ...) but
doesn't seem to be much work being done for the version 6.
P.S : I'll be happy to help given instructions to help build the CDH 6.X
version
Thanks
Mehdi
Re: CDH 6.X road map
Posted by Pedro Boado <pb...@apache.org>.
Hi William, Mahdi.
I've put together a new patch for PHOENIX-4956 and finally opened a branch
for cdh6 support (5.x-cdh6 ). It's currently building and passing IT ( but
a few IT need to be investigated ) . Build scripts are creating parcels
that seem to run correctly in cloudera's quickstart vm cdh6 / hbase 2.
We'll try to release support for CDH 6.1 with Phoenix 5.1 - we are pretty
close right now - .
Thanks for offering your help. Work is currently needed in debugging and
finding out why a few ITs are failing. Please let's continue the
conversation in PHOENIX-4956.
Thanks!
Pedro.
On Fri, 22 Feb 2019 at 02:09, William Shen <wi...@marinsoftware.com>
wrote:
> Thank you Pedro for supporting the CDH branches... Looking forward to your
> patch.
>
> On Thu, Feb 21, 2019 at 5:50 PM Pedro Boado <pb...@apache.org> wrote:
>
> > Sorry for not being on top of this for a long time. I have ongoing work
> in
> > my laptop for this task. Give me a couple of days so I can review non
> > working bits and push it.
> >
> > On Fri, 22 Feb 2019, 00:45 William Shen, <wi...@marinsoftware.com>
> > wrote:
> >
> > > Mahdi,
> > > I did a little bit of mailinglist/JIRA-diving, and found the following
> > > thread, which may be helpful to get you started in addition to the two
> > JIRA
> > > tickets/patches for previous work (
> > > https://issues.apache.org/jira/browse/PHOENIX-4372 and
> > > https://issues.apache.org/jira/browse/PHOENIX-4956):
> > >
> > > ---------- Forwarded message ---------
> > > From: Pedro Boado <pb...@apache.org>
> > > Date: Thu, Sep 13, 2018 at 11:17 PM
> > > Subject: Re: Phoenix 5.0 + Cloudera CDH 6.0 Integration
> > > To: <de...@phoenix.apache.org>
> > >
> > >
> > > Hi Curtis,
> > >
> > > As far as I am aware nobody is working on it.
> > >
> > > The approach I followed is, starting from master:
> > > - Change parent pom to use cloudera dependencies instead of Apache's
> for
> > > compilation
> > > - Make it compile (relatively easy for 4.x)
> > > - Make it pass tests (not that easy)
> > > - Once it passed, wrote the parcel module.
> > >
> > > There aren't a lot of code differences between cdh and base branches so
> > I'd
> > > try to follow the same approach - basing it on changes in the current
> > > differences-.
> > >
> > > I really think this effort is needed to try to bring both branches
> again
> > as
> > > close to each other as possible. Maybe some code differences are no
> > longer
> > > needed because CDH is already closer to the Apache version of Hadoop
> 3.0
> > > and Hbase 2.0 than it was when I did the migration.
> > >
> > > Hope it helps,
> > > Pedro.
> > >
> > > On 14 Sep 2018 04:57, "Curtis Howard" <cu...@gmail.com>
> > > wrote:
> > >
> > > Hi all,
> > >
> > > Is there anyone working towards Phoenix 5.0 / Cloudera (CDH) 6.0
> > > integration at this point? I could not find any related JIRA for this
> > > after a quick search, and wanted to check here first before adding one.
> > >
> > > If I were to attempt this myself, is there a suggested approach? I can
> > see
> > > from previous 4.x-cdh5.* branches supporting these releases that the
> > > changes for PHOENIX-4372 (
> > > https://issues.apache.org/jira/browse/PHOENIX-4372
> > > )
> > > move the builds to CDH dependencies - for example:
> > >
> > >
> >
> https://github.com/apache/phoenix/commit/024f0f22a5929da6f095dc0025b8e899e2f0c47b
> > >
> > > Would following the pattern of that commit (or attempting a
> cherry-pick)
> > > onto the the v5.0.0-HBase-2.0 tagged release (
> > > https://github.com/apache/phoenix/tree/v5.0.0-HBase-2.0) be a
> reasonable
> > > starting point?
> > >
> > > Thanks in advance
> > >
> > > Curtis
> > >
> > > On Wed, Feb 20, 2019 at 1:28 PM William Shen <
> willshen@marinsoftware.com
> > >
> > > wrote:
> > >
> > > > Same here. Would love to help with adding more CDH versions, if
> someone
> > > > can help guide us on how to best go about it based on the current cdh
> > > > branches.
> > > >
> > > > On Tue, Feb 12, 2019 at 5:10 PM Mahdi Salarkia
> > <msalarkia@box.com.invalid
> > > >
> > > > wrote:
> > > >
> > > >> Hi
> > > >> Is there a plan to release a Hbase-2.0-CDH (Cloudera 6.X) compatible
> > > >> version of Phoenix anytime soon?
> > > >> I can see Phoenix currently supports older versions of CDH (5.11,
> ...)
> > > but
> > > >> doesn't seem to be much work being done for the version 6.
> > > >> P.S : I'll be happy to help given instructions to help build the CDH
> > 6.X
> > > >> version
> > > >>
> > > >> Thanks
> > > >> Mehdi
> > > >>
> > > >
> > >
> >
>
Re: CDH 6.X road map
Posted by William Shen <wi...@marinsoftware.com>.
Thank you Pedro for supporting the CDH branches... Looking forward to your
patch.
On Thu, Feb 21, 2019 at 5:50 PM Pedro Boado <pb...@apache.org> wrote:
> Sorry for not being on top of this for a long time. I have ongoing work in
> my laptop for this task. Give me a couple of days so I can review non
> working bits and push it.
>
> On Fri, 22 Feb 2019, 00:45 William Shen, <wi...@marinsoftware.com>
> wrote:
>
> > Mahdi,
> > I did a little bit of mailinglist/JIRA-diving, and found the following
> > thread, which may be helpful to get you started in addition to the two
> JIRA
> > tickets/patches for previous work (
> > https://issues.apache.org/jira/browse/PHOENIX-4372 and
> > https://issues.apache.org/jira/browse/PHOENIX-4956):
> >
> > ---------- Forwarded message ---------
> > From: Pedro Boado <pb...@apache.org>
> > Date: Thu, Sep 13, 2018 at 11:17 PM
> > Subject: Re: Phoenix 5.0 + Cloudera CDH 6.0 Integration
> > To: <de...@phoenix.apache.org>
> >
> >
> > Hi Curtis,
> >
> > As far as I am aware nobody is working on it.
> >
> > The approach I followed is, starting from master:
> > - Change parent pom to use cloudera dependencies instead of Apache's for
> > compilation
> > - Make it compile (relatively easy for 4.x)
> > - Make it pass tests (not that easy)
> > - Once it passed, wrote the parcel module.
> >
> > There aren't a lot of code differences between cdh and base branches so
> I'd
> > try to follow the same approach - basing it on changes in the current
> > differences-.
> >
> > I really think this effort is needed to try to bring both branches again
> as
> > close to each other as possible. Maybe some code differences are no
> longer
> > needed because CDH is already closer to the Apache version of Hadoop 3.0
> > and Hbase 2.0 than it was when I did the migration.
> >
> > Hope it helps,
> > Pedro.
> >
> > On 14 Sep 2018 04:57, "Curtis Howard" <cu...@gmail.com>
> > wrote:
> >
> > Hi all,
> >
> > Is there anyone working towards Phoenix 5.0 / Cloudera (CDH) 6.0
> > integration at this point? I could not find any related JIRA for this
> > after a quick search, and wanted to check here first before adding one.
> >
> > If I were to attempt this myself, is there a suggested approach? I can
> see
> > from previous 4.x-cdh5.* branches supporting these releases that the
> > changes for PHOENIX-4372 (
> > https://issues.apache.org/jira/browse/PHOENIX-4372
> > )
> > move the builds to CDH dependencies - for example:
> >
> >
> https://github.com/apache/phoenix/commit/024f0f22a5929da6f095dc0025b8e899e2f0c47b
> >
> > Would following the pattern of that commit (or attempting a cherry-pick)
> > onto the the v5.0.0-HBase-2.0 tagged release (
> > https://github.com/apache/phoenix/tree/v5.0.0-HBase-2.0) be a reasonable
> > starting point?
> >
> > Thanks in advance
> >
> > Curtis
> >
> > On Wed, Feb 20, 2019 at 1:28 PM William Shen <willshen@marinsoftware.com
> >
> > wrote:
> >
> > > Same here. Would love to help with adding more CDH versions, if someone
> > > can help guide us on how to best go about it based on the current cdh
> > > branches.
> > >
> > > On Tue, Feb 12, 2019 at 5:10 PM Mahdi Salarkia
> <msalarkia@box.com.invalid
> > >
> > > wrote:
> > >
> > >> Hi
> > >> Is there a plan to release a Hbase-2.0-CDH (Cloudera 6.X) compatible
> > >> version of Phoenix anytime soon?
> > >> I can see Phoenix currently supports older versions of CDH (5.11, ...)
> > but
> > >> doesn't seem to be much work being done for the version 6.
> > >> P.S : I'll be happy to help given instructions to help build the CDH
> 6.X
> > >> version
> > >>
> > >> Thanks
> > >> Mehdi
> > >>
> > >
> >
>
Re: CDH 6.X road map
Posted by Pedro Boado <pb...@apache.org>.
Sorry for not being on top of this for a long time. I have ongoing work in
my laptop for this task. Give me a couple of days so I can review non
working bits and push it.
On Fri, 22 Feb 2019, 00:45 William Shen, <wi...@marinsoftware.com> wrote:
> Mahdi,
> I did a little bit of mailinglist/JIRA-diving, and found the following
> thread, which may be helpful to get you started in addition to the two JIRA
> tickets/patches for previous work (
> https://issues.apache.org/jira/browse/PHOENIX-4372 and
> https://issues.apache.org/jira/browse/PHOENIX-4956):
>
> ---------- Forwarded message ---------
> From: Pedro Boado <pb...@apache.org>
> Date: Thu, Sep 13, 2018 at 11:17 PM
> Subject: Re: Phoenix 5.0 + Cloudera CDH 6.0 Integration
> To: <de...@phoenix.apache.org>
>
>
> Hi Curtis,
>
> As far as I am aware nobody is working on it.
>
> The approach I followed is, starting from master:
> - Change parent pom to use cloudera dependencies instead of Apache's for
> compilation
> - Make it compile (relatively easy for 4.x)
> - Make it pass tests (not that easy)
> - Once it passed, wrote the parcel module.
>
> There aren't a lot of code differences between cdh and base branches so I'd
> try to follow the same approach - basing it on changes in the current
> differences-.
>
> I really think this effort is needed to try to bring both branches again as
> close to each other as possible. Maybe some code differences are no longer
> needed because CDH is already closer to the Apache version of Hadoop 3.0
> and Hbase 2.0 than it was when I did the migration.
>
> Hope it helps,
> Pedro.
>
> On 14 Sep 2018 04:57, "Curtis Howard" <cu...@gmail.com>
> wrote:
>
> Hi all,
>
> Is there anyone working towards Phoenix 5.0 / Cloudera (CDH) 6.0
> integration at this point? I could not find any related JIRA for this
> after a quick search, and wanted to check here first before adding one.
>
> If I were to attempt this myself, is there a suggested approach? I can see
> from previous 4.x-cdh5.* branches supporting these releases that the
> changes for PHOENIX-4372 (
> https://issues.apache.org/jira/browse/PHOENIX-4372
> )
> move the builds to CDH dependencies - for example:
>
> https://github.com/apache/phoenix/commit/024f0f22a5929da6f095dc0025b8e899e2f0c47b
>
> Would following the pattern of that commit (or attempting a cherry-pick)
> onto the the v5.0.0-HBase-2.0 tagged release (
> https://github.com/apache/phoenix/tree/v5.0.0-HBase-2.0) be a reasonable
> starting point?
>
> Thanks in advance
>
> Curtis
>
> On Wed, Feb 20, 2019 at 1:28 PM William Shen <wi...@marinsoftware.com>
> wrote:
>
> > Same here. Would love to help with adding more CDH versions, if someone
> > can help guide us on how to best go about it based on the current cdh
> > branches.
> >
> > On Tue, Feb 12, 2019 at 5:10 PM Mahdi Salarkia <msalarkia@box.com.invalid
> >
> > wrote:
> >
> >> Hi
> >> Is there a plan to release a Hbase-2.0-CDH (Cloudera 6.X) compatible
> >> version of Phoenix anytime soon?
> >> I can see Phoenix currently supports older versions of CDH (5.11, ...)
> but
> >> doesn't seem to be much work being done for the version 6.
> >> P.S : I'll be happy to help given instructions to help build the CDH 6.X
> >> version
> >>
> >> Thanks
> >> Mehdi
> >>
> >
>
Re: CDH 6.X road map
Posted by William Shen <wi...@marinsoftware.com>.
Mahdi,
I did a little bit of mailinglist/JIRA-diving, and found the following
thread, which may be helpful to get you started in addition to the two JIRA
tickets/patches for previous work (
https://issues.apache.org/jira/browse/PHOENIX-4372 and
https://issues.apache.org/jira/browse/PHOENIX-4956):
---------- Forwarded message ---------
From: Pedro Boado <pb...@apache.org>
Date: Thu, Sep 13, 2018 at 11:17 PM
Subject: Re: Phoenix 5.0 + Cloudera CDH 6.0 Integration
To: <de...@phoenix.apache.org>
Hi Curtis,
As far as I am aware nobody is working on it.
The approach I followed is, starting from master:
- Change parent pom to use cloudera dependencies instead of Apache's for
compilation
- Make it compile (relatively easy for 4.x)
- Make it pass tests (not that easy)
- Once it passed, wrote the parcel module.
There aren't a lot of code differences between cdh and base branches so I'd
try to follow the same approach - basing it on changes in the current
differences-.
I really think this effort is needed to try to bring both branches again as
close to each other as possible. Maybe some code differences are no longer
needed because CDH is already closer to the Apache version of Hadoop 3.0
and Hbase 2.0 than it was when I did the migration.
Hope it helps,
Pedro.
On 14 Sep 2018 04:57, "Curtis Howard" <cu...@gmail.com> wrote:
Hi all,
Is there anyone working towards Phoenix 5.0 / Cloudera (CDH) 6.0
integration at this point? I could not find any related JIRA for this
after a quick search, and wanted to check here first before adding one.
If I were to attempt this myself, is there a suggested approach? I can see
from previous 4.x-cdh5.* branches supporting these releases that the
changes for PHOENIX-4372 (https://issues.apache.org/jira/browse/PHOENIX-4372
)
move the builds to CDH dependencies - for example:
https://github.com/apache/phoenix/commit/024f0f22a5929da6f095dc0025b8e899e2f0c47b
Would following the pattern of that commit (or attempting a cherry-pick)
onto the the v5.0.0-HBase-2.0 tagged release (
https://github.com/apache/phoenix/tree/v5.0.0-HBase-2.0) be a reasonable
starting point?
Thanks in advance
Curtis
On Wed, Feb 20, 2019 at 1:28 PM William Shen <wi...@marinsoftware.com>
wrote:
> Same here. Would love to help with adding more CDH versions, if someone
> can help guide us on how to best go about it based on the current cdh
> branches.
>
> On Tue, Feb 12, 2019 at 5:10 PM Mahdi Salarkia <ms...@box.com.invalid>
> wrote:
>
>> Hi
>> Is there a plan to release a Hbase-2.0-CDH (Cloudera 6.X) compatible
>> version of Phoenix anytime soon?
>> I can see Phoenix currently supports older versions of CDH (5.11, ...) but
>> doesn't seem to be much work being done for the version 6.
>> P.S : I'll be happy to help given instructions to help build the CDH 6.X
>> version
>>
>> Thanks
>> Mehdi
>>
>
Re: CDH 6.X road map
Posted by William Shen <wi...@marinsoftware.com>.
Same here. Would love to help with adding more CDH versions, if someone can
help guide us on how to best go about it based on the current cdh branches.
On Tue, Feb 12, 2019 at 5:10 PM Mahdi Salarkia <ms...@box.com.invalid>
wrote:
> Hi
> Is there a plan to release a Hbase-2.0-CDH (Cloudera 6.X) compatible
> version of Phoenix anytime soon?
> I can see Phoenix currently supports older versions of CDH (5.11, ...) but
> doesn't seem to be much work being done for the version 6.
> P.S : I'll be happy to help given instructions to help build the CDH 6.X
> version
>
> Thanks
> Mehdi
>