You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@livy.apache.org by Ibrahim Sallam <ib...@genimind.com> on 2021/08/03 04:20:33 UTC
Project status!
Hello Bikas et al.
I saw this thread (below) back in June but I haven't seen any update on the
issue since. The project is important to one of my clients and I'd like to
see it graduating and being supported moving forward.
Best regards,
Ibrahim
8<-------------
From: Bikas Saha <bi...@apache.org>
To: "dev@livy.incubator.apache.org" <de...@livy.incubator.apache.org>, "
user@livy.incubator.apache.org" <us...@livy.incubator.apache.org>
Cc:
Bcc:
Date: Thu, 3 Jun 2021 16:22:43 +0000
Subject: Graduate or retire
Hi all,
Apache Livy is a successful project that has met many of its initial design
goals to provide interactive access to spark jobs. It appears to be widely
used by many organizations and users. However, project development has been
inactive due to lack of demand for new features and relative stability of
the code base.
At this point there are 2 options for the project given its incubating
status
1. Graduate - The project has been following the Apache way in its
release process and community. It can graduate as long as there are 3 pmc
willing to continue to manage the project. Also, volunteers are needed to
complete the graduation checklist and help move the project through the
graduation process.
* https://incubator.apache.org/guides/graduation.html
2. Retire - The project will be retired and no longer be supported by
the ASF development process. Its website will be deleted and generally new
releases would not be available. The biggest drawback of this for the user
community is that security patches like the recent CVE release in Feb 21
will not be made available. That can be a blocker for many organizations.
* https://incubator.apache.org/guides/retirement.html
What does the community think about this situation and how to proceed?
Should we graduate or retire?
When supporting graduation, please indicate willingness to drive the
graduation process and subsequently participate in the project pmc.
Bikas
----------------------->8
--------------------------
Ibrahim Sallam
Principal
GeniMind, Inc.
w: +1.613.216.2620
m: +1 613.415.6681
Re: Project status!
Posted by Bikas Saha <bi...@apache.org>.
+1. I ack'd that on the report.
________________________________
From: Jean-Baptiste Onofr? <jb...@nanthrax.net>
Sent: Monday, August 2, 2021 9:41 PM
To: dev@livy.apache.org <de...@livy.apache.org>
Subject: Re: Project status!
Hi Ibrahim
I discussed with some users, and IMHO, the podling is mature but the
community still needs to be expanded.
So, IMHO, the project should move forward towards graduation (it's what
I proposed on the podling report this month).
Unfortunately, the activity is "low" on the mailing list, so, we should:
1. prepare some communication actions (and a new release)
2. prepare the maturity matrix to identify the gaps to graduation
3. discuss about graduation and next steps
My $0.01
Regards
JB
On 03/08/2021 06:20, Ibrahim Sallam wrote:
> Hello Bikas et al.
>
> I saw this thread (below) back in June but I haven't seen any update on the
> issue since. The project is important to one of my clients and I'd like to
> see it graduating and being supported moving forward.
>
> Best regards,
> Ibrahim
>
> 8<-------------
> From: Bikas Saha <bi...@apache.org>
> To: "dev@livy.incubator.apache.org" <de...@livy.incubator.apache.org>, "
> user@livy.incubator.apache.org" <us...@livy.incubator.apache.org>
> Cc:
> Bcc:
> Date: Thu, 3 Jun 2021 16:22:43 +0000
> Subject: Graduate or retire
> Hi all,
>
> Apache Livy is a successful project that has met many of its initial design
> goals to provide interactive access to spark jobs. It appears to be widely
> used by many organizations and users. However, project development has been
> inactive due to lack of demand for new features and relative stability of
> the code base.
>
> At this point there are 2 options for the project given its incubating
> status
>
> 1. Graduate - The project has been following the Apache way in its
> release process and community. It can graduate as long as there are 3 pmc
> willing to continue to manage the project. Also, volunteers are needed to
> complete the graduation checklist and help move the project through the
> graduation process.
> * https://incubator.apache.org/guides/graduation.html
> 2. Retire - The project will be retired and no longer be supported by
> the ASF development process. Its website will be deleted and generally new
> releases would not be available. The biggest drawback of this for the user
> community is that security patches like the recent CVE release in Feb 21
> will not be made available. That can be a blocker for many organizations.
> * https://incubator.apache.org/guides/retirement.html
>
> What does the community think about this situation and how to proceed?
> Should we graduate or retire?
>
> When supporting graduation, please indicate willingness to drive the
> graduation process and subsequently participate in the project pmc.
>
> Bikas
> ----------------------->8
>
>
>
> --------------------------
> Ibrahim Sallam
> Principal
> GeniMind, Inc.
> w: +1.613.216.2620
> m: +1 613.415.6681
>
Re: Project status!
Posted by Ibrahim Sallam <ib...@genimind.com>.
Sure, please do. I’ll be happy to help during my free time.
Cheers,
Ibrahim
On Wed, Aug 4, 2021 at 8:26 AM Jean-Baptiste Onofré <jb...@nanthrax.net> wrote:
> Hi Ibrahim,
>
> unfortunately, the "original" Livy team is not very active right now.
>
> I'm on #livy on ASF Slack, it's very convenient to speed up
> communication (even if all discussions/decisions should be done on the
> mailing list).
>
> Let me know if I can invite you.
>
> Regards
> JB
>
> On 04/08/2021 14:23, Ibrahim Sallam wrote:
> > Ok, great!
> >
> > No, I’m not on the ASF slack. Is the a better way of communicating with
> the
> > Livy team?
> >
> >
> >
> > On Wed, Aug 4, 2021 at 1:50 AM Jean-Baptiste Onofré <jb...@nanthrax.net>
> wrote:
> >
> >> Hi Ibrahim,
> >>
> >> Yes, I think Livy is almost OK about graduation.
> >>
> >> Let's sync together about release plan and next steps.
> >>
> >> Are you on ASF Slack ?
> >>
> >> Regards
> >> JB
> >>
> >> On 04/08/2021 03:54, Ibrahim Sallam wrote:
> >>> Thank you JB for the maturity matrix example.
> >>> It doesn't look like much work with Livy being out there with multiple
> >>> releases already available and a build process in place.
> >>>
> >>> I'll be happy to volunteer as well, if needed, to have the next release
> >>> moving forward.
> >>> In the next week or so, I do need to have a build that works with Spark
> >>> 3.x, so I guess I'll start looking at the build process and I believe
> >> there
> >>> is a pull request for such support.
> >>>
> >>> Cheers,
> >>> Ibrahim
> >>> --------------------------
> >>> Ibrahim Sallam
> >>> Principal
> >>> GeniMind, Inc.
> >>> w: +1.613.216.2620
> >>> m: +1 613.415.6681
> >>>
> >>>
> >>>
> >>> On Tue, Aug 3, 2021 at 1:40 AM Jean-Baptiste Onofré <jb...@nanthrax.net>
> >> wrote:
> >>>
> >>>> Hi Ibrahim
> >>>>
> >>>> the maturity matrix is a document listing the topics required for
> >>>> graduation.
> >>>>
> >>>> For instance, you can see the one I did for CarbonData:
> >>>>
> >>>>
> >>>>
> >>
> https://cwiki.apache.org/confluence/display/CARBONDATA/Apache+Maturity+Model+Assessment+for+CarbonData
> >>>>
> >>>> I agree with the release, and it's what I already proposed (I'm also
> >>>> volunteer to deal with the release, and review the PR).
> >>>>
> >>>> Regards
> >>>> JB
> >>>>
> >>>> On 03/08/2021 07:38, Ibrahim Sallam wrote:
> >>>>> Thanks JB!
> >>>>>
> >>>>> Totally agree with you, and I'll be happy to help to move this
> project
> >>>>> forward if I can.
> >>>>>
> >>>>> I'm not sure what will be in the maturity matrix to allow a project
> to
> >>>>> graduate, but I do believe that we need the next release (v0.8 ?)
> soon
> >>>> and
> >>>>> it might give the community an idea about the feature set available
> and
> >>>>> what's missing if any. On my side, there are a couple of pull
> requests
> >>>> that
> >>>>> I'm interested in for sure.
> >>>>>
> >>>>> Cheers,
> >>>>> Ibrahim
> >>>>>
> >>>>>
> >>>>>
> >>>>> --------------------------
> >>>>> Ibrahim Sallam
> >>>>> Principal
> >>>>> GeniMind, Inc.
> >>>>> w: +1.613.216.2620
> >>>>> m: +1 613.415.6681
> >>>>>
> >>>>>
> >>>>>
> >>>>> On Tue, Aug 3, 2021 at 12:41 AM Jean-Baptiste Onofré <
> jb@nanthrax.net>
> >>>>> wrote:
> >>>>>
> >>>>>> Hi Ibrahim
> >>>>>>
> >>>>>> I discussed with some users, and IMHO, the podling is mature but the
> >>>>>> community still needs to be expanded.
> >>>>>>
> >>>>>> So, IMHO, the project should move forward towards graduation (it's
> >> what
> >>>>>> I proposed on the podling report this month).
> >>>>>>
> >>>>>> Unfortunately, the activity is "low" on the mailing list, so, we
> >> should:
> >>>>>>
> >>>>>> 1. prepare some communication actions (and a new release)
> >>>>>> 2. prepare the maturity matrix to identify the gaps to graduation
> >>>>>> 3. discuss about graduation and next steps
> >>>>>>
> >>>>>> My $0.01
> >>>>>>
> >>>>>> Regards
> >>>>>> JB
> >>>>>>
> >>>>>> On 03/08/2021 06:20, Ibrahim Sallam wrote:
> >>>>>>> Hello Bikas et al.
> >>>>>>>
> >>>>>>> I saw this thread (below) back in June but I haven't seen any
> update
> >> on
> >>>>>> the
> >>>>>>> issue since. The project is important to one of my clients and I'd
> >> like
> >>>>>> to
> >>>>>>> see it graduating and being supported moving forward.
> >>>>>>>
> >>>>>>> Best regards,
> >>>>>>> Ibrahim
> >>>>>>>
> >>>>>>> 8<-------------
> >>>>>>> From: Bikas Saha <bi...@apache.org>
> >>>>>>> To: "dev@livy.incubator.apache.org" <dev@livy.incubator.apache.org
> >,
> >> "
> >>>>>>> user@livy.incubator.apache.org" <us...@livy.incubator.apache.org>
> >>>>>>> Cc:
> >>>>>>> Bcc:
> >>>>>>> Date: Thu, 3 Jun 2021 16:22:43 +0000
> >>>>>>> Subject: Graduate or retire
> >>>>>>> Hi all,
> >>>>>>>
> >>>>>>> Apache Livy is a successful project that has met many of its
> initial
> >>>>>> design
> >>>>>>> goals to provide interactive access to spark jobs. It appears to be
> >>>>>> widely
> >>>>>>> used by many organizations and users. However, project development
> >> has
> >>>>>> been
> >>>>>>> inactive due to lack of demand for new features and relative
> >> stability
> >>>> of
> >>>>>>> the code base.
> >>>>>>>
> >>>>>>> At this point there are 2 options for the project given its
> >> incubating
> >>>>>>> status
> >>>>>>>
> >>>>>>> 1. Graduate - The project has been following the Apache way
> in
> >> its
> >>>>>>> release process and community. It can graduate as long as there
> are 3
> >>>> pmc
> >>>>>>> willing to continue to manage the project. Also, volunteers are
> >> needed
> >>>> to
> >>>>>>> complete the graduation checklist and help move the project through
> >> the
> >>>>>>> graduation process.
> >>>>>>> * https://incubator.apache.org/guides/graduation.html
> >>>>>>> 2. Retire - The project will be retired and no longer be
> >>>> supported by
> >>>>>>> the ASF development process. Its website will be deleted and
> >> generally
> >>>>>> new
> >>>>>>> releases would not be available. The biggest drawback of this for
> the
> >>>>>> user
> >>>>>>> community is that security patches like the recent CVE release in
> Feb
> >>>> 21
> >>>>>>> will not be made available. That can be a blocker for many
> >>>> organizations.
> >>>>>>> * https://incubator.apache.org/guides/retirement.html
> >>>>>>>
> >>>>>>> What does the community think about this situation and how to
> >> proceed?
> >>>>>>> Should we graduate or retire?
> >>>>>>>
> >>>>>>> When supporting graduation, please indicate willingness to drive
> the
> >>>>>>> graduation process and subsequently participate in the project pmc.
> >>>>>>>
> >>>>>>> Bikas
> >>>>>>> ----------------------->8
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>> --------------------------
> >>>>>>> Ibrahim Sallam
> >>>>>>> Principal
> >>>>>>> GeniMind, Inc.
> >>>>>>> w: +1.613.216.2620
> >>>>>>> m: +1 613.415.6681
> >>>>>>>
> >>>>>>
> >>>>>
> >>>>
> >>>
> >>
>
--
--------------------------
Ibrahim Sallam
Principal
GeniMind, Inc.
w: +1.613.216.2620
m: +1 613.415.6681
Re: Project status!
Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Hi Ibrahim,
unfortunately, the "original" Livy team is not very active right now.
I'm on #livy on ASF Slack, it's very convenient to speed up
communication (even if all discussions/decisions should be done on the
mailing list).
Let me know if I can invite you.
Regards
JB
On 04/08/2021 14:23, Ibrahim Sallam wrote:
> Ok, great!
>
> No, I’m not on the ASF slack. Is the a better way of communicating with the
> Livy team?
>
>
>
> On Wed, Aug 4, 2021 at 1:50 AM Jean-Baptiste Onofré <jb...@nanthrax.net> wrote:
>
>> Hi Ibrahim,
>>
>> Yes, I think Livy is almost OK about graduation.
>>
>> Let's sync together about release plan and next steps.
>>
>> Are you on ASF Slack ?
>>
>> Regards
>> JB
>>
>> On 04/08/2021 03:54, Ibrahim Sallam wrote:
>>> Thank you JB for the maturity matrix example.
>>> It doesn't look like much work with Livy being out there with multiple
>>> releases already available and a build process in place.
>>>
>>> I'll be happy to volunteer as well, if needed, to have the next release
>>> moving forward.
>>> In the next week or so, I do need to have a build that works with Spark
>>> 3.x, so I guess I'll start looking at the build process and I believe
>> there
>>> is a pull request for such support.
>>>
>>> Cheers,
>>> Ibrahim
>>> --------------------------
>>> Ibrahim Sallam
>>> Principal
>>> GeniMind, Inc.
>>> w: +1.613.216.2620
>>> m: +1 613.415.6681
>>>
>>>
>>>
>>> On Tue, Aug 3, 2021 at 1:40 AM Jean-Baptiste Onofré <jb...@nanthrax.net>
>> wrote:
>>>
>>>> Hi Ibrahim
>>>>
>>>> the maturity matrix is a document listing the topics required for
>>>> graduation.
>>>>
>>>> For instance, you can see the one I did for CarbonData:
>>>>
>>>>
>>>>
>> https://cwiki.apache.org/confluence/display/CARBONDATA/Apache+Maturity+Model+Assessment+for+CarbonData
>>>>
>>>> I agree with the release, and it's what I already proposed (I'm also
>>>> volunteer to deal with the release, and review the PR).
>>>>
>>>> Regards
>>>> JB
>>>>
>>>> On 03/08/2021 07:38, Ibrahim Sallam wrote:
>>>>> Thanks JB!
>>>>>
>>>>> Totally agree with you, and I'll be happy to help to move this project
>>>>> forward if I can.
>>>>>
>>>>> I'm not sure what will be in the maturity matrix to allow a project to
>>>>> graduate, but I do believe that we need the next release (v0.8 ?) soon
>>>> and
>>>>> it might give the community an idea about the feature set available and
>>>>> what's missing if any. On my side, there are a couple of pull requests
>>>> that
>>>>> I'm interested in for sure.
>>>>>
>>>>> Cheers,
>>>>> Ibrahim
>>>>>
>>>>>
>>>>>
>>>>> --------------------------
>>>>> Ibrahim Sallam
>>>>> Principal
>>>>> GeniMind, Inc.
>>>>> w: +1.613.216.2620
>>>>> m: +1 613.415.6681
>>>>>
>>>>>
>>>>>
>>>>> On Tue, Aug 3, 2021 at 12:41 AM Jean-Baptiste Onofré <jb...@nanthrax.net>
>>>>> wrote:
>>>>>
>>>>>> Hi Ibrahim
>>>>>>
>>>>>> I discussed with some users, and IMHO, the podling is mature but the
>>>>>> community still needs to be expanded.
>>>>>>
>>>>>> So, IMHO, the project should move forward towards graduation (it's
>> what
>>>>>> I proposed on the podling report this month).
>>>>>>
>>>>>> Unfortunately, the activity is "low" on the mailing list, so, we
>> should:
>>>>>>
>>>>>> 1. prepare some communication actions (and a new release)
>>>>>> 2. prepare the maturity matrix to identify the gaps to graduation
>>>>>> 3. discuss about graduation and next steps
>>>>>>
>>>>>> My $0.01
>>>>>>
>>>>>> Regards
>>>>>> JB
>>>>>>
>>>>>> On 03/08/2021 06:20, Ibrahim Sallam wrote:
>>>>>>> Hello Bikas et al.
>>>>>>>
>>>>>>> I saw this thread (below) back in June but I haven't seen any update
>> on
>>>>>> the
>>>>>>> issue since. The project is important to one of my clients and I'd
>> like
>>>>>> to
>>>>>>> see it graduating and being supported moving forward.
>>>>>>>
>>>>>>> Best regards,
>>>>>>> Ibrahim
>>>>>>>
>>>>>>> 8<-------------
>>>>>>> From: Bikas Saha <bi...@apache.org>
>>>>>>> To: "dev@livy.incubator.apache.org" <de...@livy.incubator.apache.org>,
>> "
>>>>>>> user@livy.incubator.apache.org" <us...@livy.incubator.apache.org>
>>>>>>> Cc:
>>>>>>> Bcc:
>>>>>>> Date: Thu, 3 Jun 2021 16:22:43 +0000
>>>>>>> Subject: Graduate or retire
>>>>>>> Hi all,
>>>>>>>
>>>>>>> Apache Livy is a successful project that has met many of its initial
>>>>>> design
>>>>>>> goals to provide interactive access to spark jobs. It appears to be
>>>>>> widely
>>>>>>> used by many organizations and users. However, project development
>> has
>>>>>> been
>>>>>>> inactive due to lack of demand for new features and relative
>> stability
>>>> of
>>>>>>> the code base.
>>>>>>>
>>>>>>> At this point there are 2 options for the project given its
>> incubating
>>>>>>> status
>>>>>>>
>>>>>>> 1. Graduate - The project has been following the Apache way in
>> its
>>>>>>> release process and community. It can graduate as long as there are 3
>>>> pmc
>>>>>>> willing to continue to manage the project. Also, volunteers are
>> needed
>>>> to
>>>>>>> complete the graduation checklist and help move the project through
>> the
>>>>>>> graduation process.
>>>>>>> * https://incubator.apache.org/guides/graduation.html
>>>>>>> 2. Retire - The project will be retired and no longer be
>>>> supported by
>>>>>>> the ASF development process. Its website will be deleted and
>> generally
>>>>>> new
>>>>>>> releases would not be available. The biggest drawback of this for the
>>>>>> user
>>>>>>> community is that security patches like the recent CVE release in Feb
>>>> 21
>>>>>>> will not be made available. That can be a blocker for many
>>>> organizations.
>>>>>>> * https://incubator.apache.org/guides/retirement.html
>>>>>>>
>>>>>>> What does the community think about this situation and how to
>> proceed?
>>>>>>> Should we graduate or retire?
>>>>>>>
>>>>>>> When supporting graduation, please indicate willingness to drive the
>>>>>>> graduation process and subsequently participate in the project pmc.
>>>>>>>
>>>>>>> Bikas
>>>>>>> ----------------------->8
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --------------------------
>>>>>>> Ibrahim Sallam
>>>>>>> Principal
>>>>>>> GeniMind, Inc.
>>>>>>> w: +1.613.216.2620
>>>>>>> m: +1 613.415.6681
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
Re: Project status!
Posted by Ibrahim Sallam <ib...@genimind.com>.
Ok, great!
No, I’m not on the ASF slack. Is the a better way of communicating with the
Livy team?
On Wed, Aug 4, 2021 at 1:50 AM Jean-Baptiste Onofré <jb...@nanthrax.net> wrote:
> Hi Ibrahim,
>
> Yes, I think Livy is almost OK about graduation.
>
> Let's sync together about release plan and next steps.
>
> Are you on ASF Slack ?
>
> Regards
> JB
>
> On 04/08/2021 03:54, Ibrahim Sallam wrote:
> > Thank you JB for the maturity matrix example.
> > It doesn't look like much work with Livy being out there with multiple
> > releases already available and a build process in place.
> >
> > I'll be happy to volunteer as well, if needed, to have the next release
> > moving forward.
> > In the next week or so, I do need to have a build that works with Spark
> > 3.x, so I guess I'll start looking at the build process and I believe
> there
> > is a pull request for such support.
> >
> > Cheers,
> > Ibrahim
> > --------------------------
> > Ibrahim Sallam
> > Principal
> > GeniMind, Inc.
> > w: +1.613.216.2620
> > m: +1 613.415.6681
> >
> >
> >
> > On Tue, Aug 3, 2021 at 1:40 AM Jean-Baptiste Onofré <jb...@nanthrax.net>
> wrote:
> >
> >> Hi Ibrahim
> >>
> >> the maturity matrix is a document listing the topics required for
> >> graduation.
> >>
> >> For instance, you can see the one I did for CarbonData:
> >>
> >>
> >>
> https://cwiki.apache.org/confluence/display/CARBONDATA/Apache+Maturity+Model+Assessment+for+CarbonData
> >>
> >> I agree with the release, and it's what I already proposed (I'm also
> >> volunteer to deal with the release, and review the PR).
> >>
> >> Regards
> >> JB
> >>
> >> On 03/08/2021 07:38, Ibrahim Sallam wrote:
> >>> Thanks JB!
> >>>
> >>> Totally agree with you, and I'll be happy to help to move this project
> >>> forward if I can.
> >>>
> >>> I'm not sure what will be in the maturity matrix to allow a project to
> >>> graduate, but I do believe that we need the next release (v0.8 ?) soon
> >> and
> >>> it might give the community an idea about the feature set available and
> >>> what's missing if any. On my side, there are a couple of pull requests
> >> that
> >>> I'm interested in for sure.
> >>>
> >>> Cheers,
> >>> Ibrahim
> >>>
> >>>
> >>>
> >>> --------------------------
> >>> Ibrahim Sallam
> >>> Principal
> >>> GeniMind, Inc.
> >>> w: +1.613.216.2620
> >>> m: +1 613.415.6681
> >>>
> >>>
> >>>
> >>> On Tue, Aug 3, 2021 at 12:41 AM Jean-Baptiste Onofré <jb...@nanthrax.net>
> >>> wrote:
> >>>
> >>>> Hi Ibrahim
> >>>>
> >>>> I discussed with some users, and IMHO, the podling is mature but the
> >>>> community still needs to be expanded.
> >>>>
> >>>> So, IMHO, the project should move forward towards graduation (it's
> what
> >>>> I proposed on the podling report this month).
> >>>>
> >>>> Unfortunately, the activity is "low" on the mailing list, so, we
> should:
> >>>>
> >>>> 1. prepare some communication actions (and a new release)
> >>>> 2. prepare the maturity matrix to identify the gaps to graduation
> >>>> 3. discuss about graduation and next steps
> >>>>
> >>>> My $0.01
> >>>>
> >>>> Regards
> >>>> JB
> >>>>
> >>>> On 03/08/2021 06:20, Ibrahim Sallam wrote:
> >>>>> Hello Bikas et al.
> >>>>>
> >>>>> I saw this thread (below) back in June but I haven't seen any update
> on
> >>>> the
> >>>>> issue since. The project is important to one of my clients and I'd
> like
> >>>> to
> >>>>> see it graduating and being supported moving forward.
> >>>>>
> >>>>> Best regards,
> >>>>> Ibrahim
> >>>>>
> >>>>> 8<-------------
> >>>>> From: Bikas Saha <bi...@apache.org>
> >>>>> To: "dev@livy.incubator.apache.org" <de...@livy.incubator.apache.org>,
> "
> >>>>> user@livy.incubator.apache.org" <us...@livy.incubator.apache.org>
> >>>>> Cc:
> >>>>> Bcc:
> >>>>> Date: Thu, 3 Jun 2021 16:22:43 +0000
> >>>>> Subject: Graduate or retire
> >>>>> Hi all,
> >>>>>
> >>>>> Apache Livy is a successful project that has met many of its initial
> >>>> design
> >>>>> goals to provide interactive access to spark jobs. It appears to be
> >>>> widely
> >>>>> used by many organizations and users. However, project development
> has
> >>>> been
> >>>>> inactive due to lack of demand for new features and relative
> stability
> >> of
> >>>>> the code base.
> >>>>>
> >>>>> At this point there are 2 options for the project given its
> incubating
> >>>>> status
> >>>>>
> >>>>> 1. Graduate - The project has been following the Apache way in
> its
> >>>>> release process and community. It can graduate as long as there are 3
> >> pmc
> >>>>> willing to continue to manage the project. Also, volunteers are
> needed
> >> to
> >>>>> complete the graduation checklist and help move the project through
> the
> >>>>> graduation process.
> >>>>> * https://incubator.apache.org/guides/graduation.html
> >>>>> 2. Retire - The project will be retired and no longer be
> >> supported by
> >>>>> the ASF development process. Its website will be deleted and
> generally
> >>>> new
> >>>>> releases would not be available. The biggest drawback of this for the
> >>>> user
> >>>>> community is that security patches like the recent CVE release in Feb
> >> 21
> >>>>> will not be made available. That can be a blocker for many
> >> organizations.
> >>>>> * https://incubator.apache.org/guides/retirement.html
> >>>>>
> >>>>> What does the community think about this situation and how to
> proceed?
> >>>>> Should we graduate or retire?
> >>>>>
> >>>>> When supporting graduation, please indicate willingness to drive the
> >>>>> graduation process and subsequently participate in the project pmc.
> >>>>>
> >>>>> Bikas
> >>>>> ----------------------->8
> >>>>>
> >>>>>
> >>>>>
> >>>>> --------------------------
> >>>>> Ibrahim Sallam
> >>>>> Principal
> >>>>> GeniMind, Inc.
> >>>>> w: +1.613.216.2620
> >>>>> m: +1 613.415.6681
> >>>>>
> >>>>
> >>>
> >>
> >
>
--
--------------------------
Ibrahim Sallam
Principal
GeniMind, Inc.
w: +1.613.216.2620
m: +1 613.415.6681
Re: Project status!
Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Hi Ibrahim,
Yes, I think Livy is almost OK about graduation.
Let's sync together about release plan and next steps.
Are you on ASF Slack ?
Regards
JB
On 04/08/2021 03:54, Ibrahim Sallam wrote:
> Thank you JB for the maturity matrix example.
> It doesn't look like much work with Livy being out there with multiple
> releases already available and a build process in place.
>
> I'll be happy to volunteer as well, if needed, to have the next release
> moving forward.
> In the next week or so, I do need to have a build that works with Spark
> 3.x, so I guess I'll start looking at the build process and I believe there
> is a pull request for such support.
>
> Cheers,
> Ibrahim
> --------------------------
> Ibrahim Sallam
> Principal
> GeniMind, Inc.
> w: +1.613.216.2620
> m: +1 613.415.6681
>
>
>
> On Tue, Aug 3, 2021 at 1:40 AM Jean-Baptiste Onofré <jb...@nanthrax.net> wrote:
>
>> Hi Ibrahim
>>
>> the maturity matrix is a document listing the topics required for
>> graduation.
>>
>> For instance, you can see the one I did for CarbonData:
>>
>>
>> https://cwiki.apache.org/confluence/display/CARBONDATA/Apache+Maturity+Model+Assessment+for+CarbonData
>>
>> I agree with the release, and it's what I already proposed (I'm also
>> volunteer to deal with the release, and review the PR).
>>
>> Regards
>> JB
>>
>> On 03/08/2021 07:38, Ibrahim Sallam wrote:
>>> Thanks JB!
>>>
>>> Totally agree with you, and I'll be happy to help to move this project
>>> forward if I can.
>>>
>>> I'm not sure what will be in the maturity matrix to allow a project to
>>> graduate, but I do believe that we need the next release (v0.8 ?) soon
>> and
>>> it might give the community an idea about the feature set available and
>>> what's missing if any. On my side, there are a couple of pull requests
>> that
>>> I'm interested in for sure.
>>>
>>> Cheers,
>>> Ibrahim
>>>
>>>
>>>
>>> --------------------------
>>> Ibrahim Sallam
>>> Principal
>>> GeniMind, Inc.
>>> w: +1.613.216.2620
>>> m: +1 613.415.6681
>>>
>>>
>>>
>>> On Tue, Aug 3, 2021 at 12:41 AM Jean-Baptiste Onofré <jb...@nanthrax.net>
>>> wrote:
>>>
>>>> Hi Ibrahim
>>>>
>>>> I discussed with some users, and IMHO, the podling is mature but the
>>>> community still needs to be expanded.
>>>>
>>>> So, IMHO, the project should move forward towards graduation (it's what
>>>> I proposed on the podling report this month).
>>>>
>>>> Unfortunately, the activity is "low" on the mailing list, so, we should:
>>>>
>>>> 1. prepare some communication actions (and a new release)
>>>> 2. prepare the maturity matrix to identify the gaps to graduation
>>>> 3. discuss about graduation and next steps
>>>>
>>>> My $0.01
>>>>
>>>> Regards
>>>> JB
>>>>
>>>> On 03/08/2021 06:20, Ibrahim Sallam wrote:
>>>>> Hello Bikas et al.
>>>>>
>>>>> I saw this thread (below) back in June but I haven't seen any update on
>>>> the
>>>>> issue since. The project is important to one of my clients and I'd like
>>>> to
>>>>> see it graduating and being supported moving forward.
>>>>>
>>>>> Best regards,
>>>>> Ibrahim
>>>>>
>>>>> 8<-------------
>>>>> From: Bikas Saha <bi...@apache.org>
>>>>> To: "dev@livy.incubator.apache.org" <de...@livy.incubator.apache.org>, "
>>>>> user@livy.incubator.apache.org" <us...@livy.incubator.apache.org>
>>>>> Cc:
>>>>> Bcc:
>>>>> Date: Thu, 3 Jun 2021 16:22:43 +0000
>>>>> Subject: Graduate or retire
>>>>> Hi all,
>>>>>
>>>>> Apache Livy is a successful project that has met many of its initial
>>>> design
>>>>> goals to provide interactive access to spark jobs. It appears to be
>>>> widely
>>>>> used by many organizations and users. However, project development has
>>>> been
>>>>> inactive due to lack of demand for new features and relative stability
>> of
>>>>> the code base.
>>>>>
>>>>> At this point there are 2 options for the project given its incubating
>>>>> status
>>>>>
>>>>> 1. Graduate - The project has been following the Apache way in its
>>>>> release process and community. It can graduate as long as there are 3
>> pmc
>>>>> willing to continue to manage the project. Also, volunteers are needed
>> to
>>>>> complete the graduation checklist and help move the project through the
>>>>> graduation process.
>>>>> * https://incubator.apache.org/guides/graduation.html
>>>>> 2. Retire - The project will be retired and no longer be
>> supported by
>>>>> the ASF development process. Its website will be deleted and generally
>>>> new
>>>>> releases would not be available. The biggest drawback of this for the
>>>> user
>>>>> community is that security patches like the recent CVE release in Feb
>> 21
>>>>> will not be made available. That can be a blocker for many
>> organizations.
>>>>> * https://incubator.apache.org/guides/retirement.html
>>>>>
>>>>> What does the community think about this situation and how to proceed?
>>>>> Should we graduate or retire?
>>>>>
>>>>> When supporting graduation, please indicate willingness to drive the
>>>>> graduation process and subsequently participate in the project pmc.
>>>>>
>>>>> Bikas
>>>>> ----------------------->8
>>>>>
>>>>>
>>>>>
>>>>> --------------------------
>>>>> Ibrahim Sallam
>>>>> Principal
>>>>> GeniMind, Inc.
>>>>> w: +1.613.216.2620
>>>>> m: +1 613.415.6681
>>>>>
>>>>
>>>
>>
>
Re: Project status!
Posted by Ibrahim Sallam <ib...@genimind.com>.
Thank you JB for the maturity matrix example.
It doesn't look like much work with Livy being out there with multiple
releases already available and a build process in place.
I'll be happy to volunteer as well, if needed, to have the next release
moving forward.
In the next week or so, I do need to have a build that works with Spark
3.x, so I guess I'll start looking at the build process and I believe there
is a pull request for such support.
Cheers,
Ibrahim
--------------------------
Ibrahim Sallam
Principal
GeniMind, Inc.
w: +1.613.216.2620
m: +1 613.415.6681
On Tue, Aug 3, 2021 at 1:40 AM Jean-Baptiste Onofré <jb...@nanthrax.net> wrote:
> Hi Ibrahim
>
> the maturity matrix is a document listing the topics required for
> graduation.
>
> For instance, you can see the one I did for CarbonData:
>
>
> https://cwiki.apache.org/confluence/display/CARBONDATA/Apache+Maturity+Model+Assessment+for+CarbonData
>
> I agree with the release, and it's what I already proposed (I'm also
> volunteer to deal with the release, and review the PR).
>
> Regards
> JB
>
> On 03/08/2021 07:38, Ibrahim Sallam wrote:
> > Thanks JB!
> >
> > Totally agree with you, and I'll be happy to help to move this project
> > forward if I can.
> >
> > I'm not sure what will be in the maturity matrix to allow a project to
> > graduate, but I do believe that we need the next release (v0.8 ?) soon
> and
> > it might give the community an idea about the feature set available and
> > what's missing if any. On my side, there are a couple of pull requests
> that
> > I'm interested in for sure.
> >
> > Cheers,
> > Ibrahim
> >
> >
> >
> > --------------------------
> > Ibrahim Sallam
> > Principal
> > GeniMind, Inc.
> > w: +1.613.216.2620
> > m: +1 613.415.6681
> >
> >
> >
> > On Tue, Aug 3, 2021 at 12:41 AM Jean-Baptiste Onofré <jb...@nanthrax.net>
> > wrote:
> >
> >> Hi Ibrahim
> >>
> >> I discussed with some users, and IMHO, the podling is mature but the
> >> community still needs to be expanded.
> >>
> >> So, IMHO, the project should move forward towards graduation (it's what
> >> I proposed on the podling report this month).
> >>
> >> Unfortunately, the activity is "low" on the mailing list, so, we should:
> >>
> >> 1. prepare some communication actions (and a new release)
> >> 2. prepare the maturity matrix to identify the gaps to graduation
> >> 3. discuss about graduation and next steps
> >>
> >> My $0.01
> >>
> >> Regards
> >> JB
> >>
> >> On 03/08/2021 06:20, Ibrahim Sallam wrote:
> >>> Hello Bikas et al.
> >>>
> >>> I saw this thread (below) back in June but I haven't seen any update on
> >> the
> >>> issue since. The project is important to one of my clients and I'd like
> >> to
> >>> see it graduating and being supported moving forward.
> >>>
> >>> Best regards,
> >>> Ibrahim
> >>>
> >>> 8<-------------
> >>> From: Bikas Saha <bi...@apache.org>
> >>> To: "dev@livy.incubator.apache.org" <de...@livy.incubator.apache.org>, "
> >>> user@livy.incubator.apache.org" <us...@livy.incubator.apache.org>
> >>> Cc:
> >>> Bcc:
> >>> Date: Thu, 3 Jun 2021 16:22:43 +0000
> >>> Subject: Graduate or retire
> >>> Hi all,
> >>>
> >>> Apache Livy is a successful project that has met many of its initial
> >> design
> >>> goals to provide interactive access to spark jobs. It appears to be
> >> widely
> >>> used by many organizations and users. However, project development has
> >> been
> >>> inactive due to lack of demand for new features and relative stability
> of
> >>> the code base.
> >>>
> >>> At this point there are 2 options for the project given its incubating
> >>> status
> >>>
> >>> 1. Graduate - The project has been following the Apache way in its
> >>> release process and community. It can graduate as long as there are 3
> pmc
> >>> willing to continue to manage the project. Also, volunteers are needed
> to
> >>> complete the graduation checklist and help move the project through the
> >>> graduation process.
> >>> * https://incubator.apache.org/guides/graduation.html
> >>> 2. Retire - The project will be retired and no longer be
> supported by
> >>> the ASF development process. Its website will be deleted and generally
> >> new
> >>> releases would not be available. The biggest drawback of this for the
> >> user
> >>> community is that security patches like the recent CVE release in Feb
> 21
> >>> will not be made available. That can be a blocker for many
> organizations.
> >>> * https://incubator.apache.org/guides/retirement.html
> >>>
> >>> What does the community think about this situation and how to proceed?
> >>> Should we graduate or retire?
> >>>
> >>> When supporting graduation, please indicate willingness to drive the
> >>> graduation process and subsequently participate in the project pmc.
> >>>
> >>> Bikas
> >>> ----------------------->8
> >>>
> >>>
> >>>
> >>> --------------------------
> >>> Ibrahim Sallam
> >>> Principal
> >>> GeniMind, Inc.
> >>> w: +1.613.216.2620
> >>> m: +1 613.415.6681
> >>>
> >>
> >
>
Re: Project status!
Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Hi Ibrahim
the maturity matrix is a document listing the topics required for
graduation.
For instance, you can see the one I did for CarbonData:
https://cwiki.apache.org/confluence/display/CARBONDATA/Apache+Maturity+Model+Assessment+for+CarbonData
I agree with the release, and it's what I already proposed (I'm also
volunteer to deal with the release, and review the PR).
Regards
JB
On 03/08/2021 07:38, Ibrahim Sallam wrote:
> Thanks JB!
>
> Totally agree with you, and I'll be happy to help to move this project
> forward if I can.
>
> I'm not sure what will be in the maturity matrix to allow a project to
> graduate, but I do believe that we need the next release (v0.8 ?) soon and
> it might give the community an idea about the feature set available and
> what's missing if any. On my side, there are a couple of pull requests that
> I'm interested in for sure.
>
> Cheers,
> Ibrahim
>
>
>
> --------------------------
> Ibrahim Sallam
> Principal
> GeniMind, Inc.
> w: +1.613.216.2620
> m: +1 613.415.6681
>
>
>
> On Tue, Aug 3, 2021 at 12:41 AM Jean-Baptiste Onofré <jb...@nanthrax.net>
> wrote:
>
>> Hi Ibrahim
>>
>> I discussed with some users, and IMHO, the podling is mature but the
>> community still needs to be expanded.
>>
>> So, IMHO, the project should move forward towards graduation (it's what
>> I proposed on the podling report this month).
>>
>> Unfortunately, the activity is "low" on the mailing list, so, we should:
>>
>> 1. prepare some communication actions (and a new release)
>> 2. prepare the maturity matrix to identify the gaps to graduation
>> 3. discuss about graduation and next steps
>>
>> My $0.01
>>
>> Regards
>> JB
>>
>> On 03/08/2021 06:20, Ibrahim Sallam wrote:
>>> Hello Bikas et al.
>>>
>>> I saw this thread (below) back in June but I haven't seen any update on
>> the
>>> issue since. The project is important to one of my clients and I'd like
>> to
>>> see it graduating and being supported moving forward.
>>>
>>> Best regards,
>>> Ibrahim
>>>
>>> 8<-------------
>>> From: Bikas Saha <bi...@apache.org>
>>> To: "dev@livy.incubator.apache.org" <de...@livy.incubator.apache.org>, "
>>> user@livy.incubator.apache.org" <us...@livy.incubator.apache.org>
>>> Cc:
>>> Bcc:
>>> Date: Thu, 3 Jun 2021 16:22:43 +0000
>>> Subject: Graduate or retire
>>> Hi all,
>>>
>>> Apache Livy is a successful project that has met many of its initial
>> design
>>> goals to provide interactive access to spark jobs. It appears to be
>> widely
>>> used by many organizations and users. However, project development has
>> been
>>> inactive due to lack of demand for new features and relative stability of
>>> the code base.
>>>
>>> At this point there are 2 options for the project given its incubating
>>> status
>>>
>>> 1. Graduate - The project has been following the Apache way in its
>>> release process and community. It can graduate as long as there are 3 pmc
>>> willing to continue to manage the project. Also, volunteers are needed to
>>> complete the graduation checklist and help move the project through the
>>> graduation process.
>>> * https://incubator.apache.org/guides/graduation.html
>>> 2. Retire - The project will be retired and no longer be supported by
>>> the ASF development process. Its website will be deleted and generally
>> new
>>> releases would not be available. The biggest drawback of this for the
>> user
>>> community is that security patches like the recent CVE release in Feb 21
>>> will not be made available. That can be a blocker for many organizations.
>>> * https://incubator.apache.org/guides/retirement.html
>>>
>>> What does the community think about this situation and how to proceed?
>>> Should we graduate or retire?
>>>
>>> When supporting graduation, please indicate willingness to drive the
>>> graduation process and subsequently participate in the project pmc.
>>>
>>> Bikas
>>> ----------------------->8
>>>
>>>
>>>
>>> --------------------------
>>> Ibrahim Sallam
>>> Principal
>>> GeniMind, Inc.
>>> w: +1.613.216.2620
>>> m: +1 613.415.6681
>>>
>>
>
Re: Project status!
Posted by Ibrahim Sallam <ib...@genimind.com>.
Thanks JB!
Totally agree with you, and I'll be happy to help to move this project
forward if I can.
I'm not sure what will be in the maturity matrix to allow a project to
graduate, but I do believe that we need the next release (v0.8 ?) soon and
it might give the community an idea about the feature set available and
what's missing if any. On my side, there are a couple of pull requests that
I'm interested in for sure.
Cheers,
Ibrahim
--------------------------
Ibrahim Sallam
Principal
GeniMind, Inc.
w: +1.613.216.2620
m: +1 613.415.6681
On Tue, Aug 3, 2021 at 12:41 AM Jean-Baptiste Onofré <jb...@nanthrax.net>
wrote:
> Hi Ibrahim
>
> I discussed with some users, and IMHO, the podling is mature but the
> community still needs to be expanded.
>
> So, IMHO, the project should move forward towards graduation (it's what
> I proposed on the podling report this month).
>
> Unfortunately, the activity is "low" on the mailing list, so, we should:
>
> 1. prepare some communication actions (and a new release)
> 2. prepare the maturity matrix to identify the gaps to graduation
> 3. discuss about graduation and next steps
>
> My $0.01
>
> Regards
> JB
>
> On 03/08/2021 06:20, Ibrahim Sallam wrote:
> > Hello Bikas et al.
> >
> > I saw this thread (below) back in June but I haven't seen any update on
> the
> > issue since. The project is important to one of my clients and I'd like
> to
> > see it graduating and being supported moving forward.
> >
> > Best regards,
> > Ibrahim
> >
> > 8<-------------
> > From: Bikas Saha <bi...@apache.org>
> > To: "dev@livy.incubator.apache.org" <de...@livy.incubator.apache.org>, "
> > user@livy.incubator.apache.org" <us...@livy.incubator.apache.org>
> > Cc:
> > Bcc:
> > Date: Thu, 3 Jun 2021 16:22:43 +0000
> > Subject: Graduate or retire
> > Hi all,
> >
> > Apache Livy is a successful project that has met many of its initial
> design
> > goals to provide interactive access to spark jobs. It appears to be
> widely
> > used by many organizations and users. However, project development has
> been
> > inactive due to lack of demand for new features and relative stability of
> > the code base.
> >
> > At this point there are 2 options for the project given its incubating
> > status
> >
> > 1. Graduate - The project has been following the Apache way in its
> > release process and community. It can graduate as long as there are 3 pmc
> > willing to continue to manage the project. Also, volunteers are needed to
> > complete the graduation checklist and help move the project through the
> > graduation process.
> > * https://incubator.apache.org/guides/graduation.html
> > 2. Retire - The project will be retired and no longer be supported by
> > the ASF development process. Its website will be deleted and generally
> new
> > releases would not be available. The biggest drawback of this for the
> user
> > community is that security patches like the recent CVE release in Feb 21
> > will not be made available. That can be a blocker for many organizations.
> > * https://incubator.apache.org/guides/retirement.html
> >
> > What does the community think about this situation and how to proceed?
> > Should we graduate or retire?
> >
> > When supporting graduation, please indicate willingness to drive the
> > graduation process and subsequently participate in the project pmc.
> >
> > Bikas
> > ----------------------->8
> >
> >
> >
> > --------------------------
> > Ibrahim Sallam
> > Principal
> > GeniMind, Inc.
> > w: +1.613.216.2620
> > m: +1 613.415.6681
> >
>
Re: Project status!
Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Hi Ibrahim
I discussed with some users, and IMHO, the podling is mature but the
community still needs to be expanded.
So, IMHO, the project should move forward towards graduation (it's what
I proposed on the podling report this month).
Unfortunately, the activity is "low" on the mailing list, so, we should:
1. prepare some communication actions (and a new release)
2. prepare the maturity matrix to identify the gaps to graduation
3. discuss about graduation and next steps
My $0.01
Regards
JB
On 03/08/2021 06:20, Ibrahim Sallam wrote:
> Hello Bikas et al.
>
> I saw this thread (below) back in June but I haven't seen any update on the
> issue since. The project is important to one of my clients and I'd like to
> see it graduating and being supported moving forward.
>
> Best regards,
> Ibrahim
>
> 8<-------------
> From: Bikas Saha <bi...@apache.org>
> To: "dev@livy.incubator.apache.org" <de...@livy.incubator.apache.org>, "
> user@livy.incubator.apache.org" <us...@livy.incubator.apache.org>
> Cc:
> Bcc:
> Date: Thu, 3 Jun 2021 16:22:43 +0000
> Subject: Graduate or retire
> Hi all,
>
> Apache Livy is a successful project that has met many of its initial design
> goals to provide interactive access to spark jobs. It appears to be widely
> used by many organizations and users. However, project development has been
> inactive due to lack of demand for new features and relative stability of
> the code base.
>
> At this point there are 2 options for the project given its incubating
> status
>
> 1. Graduate - The project has been following the Apache way in its
> release process and community. It can graduate as long as there are 3 pmc
> willing to continue to manage the project. Also, volunteers are needed to
> complete the graduation checklist and help move the project through the
> graduation process.
> * https://incubator.apache.org/guides/graduation.html
> 2. Retire - The project will be retired and no longer be supported by
> the ASF development process. Its website will be deleted and generally new
> releases would not be available. The biggest drawback of this for the user
> community is that security patches like the recent CVE release in Feb 21
> will not be made available. That can be a blocker for many organizations.
> * https://incubator.apache.org/guides/retirement.html
>
> What does the community think about this situation and how to proceed?
> Should we graduate or retire?
>
> When supporting graduation, please indicate willingness to drive the
> graduation process and subsequently participate in the project pmc.
>
> Bikas
> ----------------------->8
>
>
>
> --------------------------
> Ibrahim Sallam
> Principal
> GeniMind, Inc.
> w: +1.613.216.2620
> m: +1 613.415.6681
>