You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@datafu.apache.org by "John D. Ament" <jo...@apache.org> on 2017/07/10 10:28:21 UTC
What's the status of DataFu?
All,
I'd like to know the current status of DataFu. It looks like the list
traffic has died down quite a bit, are you still a viable project?
John
Re: What's the status of DataFu?
Posted by Matthew Hayes <ma...@gmail.com>.
In that discussion 5 months ago it was noted that we needed to do another
release with some LICENSE and NOTICE issues resolved. That release
happened. Then we completed the maturity evaluation and drafted a
graduation resolution. Podling status is up to date as Roman just recently
updated it. PODLINGNAMESEARCH-48 was already done for DataFu so it's not
clear to me what else we need to do. How do we get PODLINGNAMESEARCH-48 on
file with Whimsy?
On Fri, Jul 14, 2017 at 2:58 AM, John D. Ament <jo...@apache.org>
wrote:
> Hi,
>
> I see that 5 months ago you discussed graduation -
> https://lists.apache.org/thread.html/667c3cbba36c4550e682a3946c816f
> f8bb6e8e7789c8c74108809623@%3Cdev.datafu.apache.org%3E - that's a long
> time ago, why the huge gap in time?
>
> I would ensure that your podling status is up to date -
> http://incubator.apache.org/projects/datafu.html
> I would also check that Whimsy's roster and Podling Name Search look
> accurate - https://whimsy.apache.org/roster/ppmc/datafu (it appears you
> have no PNS)
> I would also make sure you've read through the graduation guide. You
> mention having drafted a resolution, but I can't find any discussion of the
> resolution on list. https://incubator.apache.org/guides/graduation.html
>
> John
>
>
> On Thu, Jul 13, 2017 at 11:55 PM Matthew Hayes <
> matthew.terence.hayes@gmail.com> wrote:
>
>> Roman, do you think we should share the graduation resolution with the
>> incubator general mailing list and start a discussion?
>>
>> -Matt
>>
>> On Thu, Jul 13, 2017 at 8:45 PM, Sam Shah <sh...@umich.edu> wrote:
>>
>>> We've had the paperwork for graduation ready for a couple weeks now.
>>> What's
>>> the next step here? Happy to help however I can.
>>>
>>> On Mon, Jul 10, 2017 at 12:40 PM, Roman Shaposhnik <roman@shaposhnik.org
>>> >
>>> wrote:
>>>
>>> > What Matthew said!
>>> >
>>> > Thanks,
>>> > Roman.
>>> >
>>> > On Mon, Jul 10, 2017 at 8:50 PM, Matthew Hayes
>>> > <ma...@gmail.com> wrote:
>>> > > I think DataFu is pretty close to graduating from incubator. We
>>> > completed
>>> > > the maturity evaluation
>>> > > https://cwiki.apache.org/confluence/display/DATAFU/
>>> Maturity+Evaluation
>>> > and
>>> > > I've drafted a graduation resolution
>>> > > https://cwiki.apache.org/confluence/pages/viewpage.
>>> > action?pageId=68716826
>>> > > that needs to be reviewed. I'm not sure what else needs to be done
>>> > besides
>>> > > that. John do you have any suggestion on next steps?
>>> > >
>>> > > Eyal, expanding DataFu to include Spark-related code makes sense to
>>> me.
>>> > I
>>> > > recall Russell had the same suggestion.
>>> > >
>>> > > -Matt
>>> > >
>>> > > On Mon, Jul 10, 2017 at 3:45 AM, Eyal Allweil <
>>> > > eyal_allweil@yahoo.com.invalid> wrote:
>>> > >
>>> > >> Hi John (and everyone else),
>>> > >>
>>> > >> There isn't a lot of traffic, but over the past few months the
>>> community
>>> > >> has been working on preparing for graduation - I think we're almost
>>> > there.
>>> > >> There was one JIRA issue opened this past month by a new
>>> contributor,
>>> > which
>>> > >> I've already reviewed and need to commit. There are other issues
>>> with
>>> > >> patches that need to be decided on or reviewed.
>>> > >>
>>> > >> I think the project is still viable, but part of the lessening of
>>> > interest
>>> > >> in it is because of a general decline in Apache Pig as a platform.
>>> > >> Personally I'd like to expand DataFu to include Spark-related code,
>>> > which I
>>> > >> think will bring new contributions and contributors. Currently there
>>> > isn't
>>> > >> an open-source "home" for auxiliary Spark code, and just as DataFu
>>> has
>>> > been
>>> > >> that home for Pig, it could be for Spark.
>>> > >> Thoughts?
>>> > >> Regards,Eyal
>>> > >>
>>> > >>
>>> > >>
>>> > >>
>>> > >> On Monday, July 10, 2017 1:28 PM, John D. Ament <
>>> > johndament@apache.org>
>>> > >> wrote:
>>> > >>
>>> > >>
>>> > >> All,
>>> > >>
>>> > >> I'd like to know the current status of DataFu. It looks like the
>>> list
>>> > >> traffic has died down quite a bit, are you still a viable project?
>>> > >>
>>> > >> John
>>> > >>
>>> > >>
>>> > >>
>>> > >>
>>> >
>>>
>>
>>
Re: What's the status of DataFu?
Posted by "John D. Ament" <jo...@apache.org>.
Hi,
I see that 5 months ago you discussed graduation -
https://lists.apache.org/thread.html/667c3cbba36c4550e682a3946c816ff8bb6e8e7789c8c74108809623@%3Cdev.datafu.apache.org%3E
-
that's a long time ago, why the huge gap in time?
I would ensure that your podling status is up to date -
http://incubator.apache.org/projects/datafu.html
I would also check that Whimsy's roster and Podling Name Search look
accurate - https://whimsy.apache.org/roster/ppmc/datafu (it appears you
have no PNS)
I would also make sure you've read through the graduation guide. You
mention having drafted a resolution, but I can't find any discussion of the
resolution on list. https://incubator.apache.org/guides/graduation.html
John
On Thu, Jul 13, 2017 at 11:55 PM Matthew Hayes <
matthew.terence.hayes@gmail.com> wrote:
> Roman, do you think we should share the graduation resolution with the
> incubator general mailing list and start a discussion?
>
> -Matt
>
> On Thu, Jul 13, 2017 at 8:45 PM, Sam Shah <sh...@umich.edu> wrote:
>
>> We've had the paperwork for graduation ready for a couple weeks now.
>> What's
>> the next step here? Happy to help however I can.
>>
>> On Mon, Jul 10, 2017 at 12:40 PM, Roman Shaposhnik <ro...@shaposhnik.org>
>> wrote:
>>
>> > What Matthew said!
>> >
>> > Thanks,
>> > Roman.
>> >
>> > On Mon, Jul 10, 2017 at 8:50 PM, Matthew Hayes
>> > <ma...@gmail.com> wrote:
>> > > I think DataFu is pretty close to graduating from incubator. We
>> > completed
>> > > the maturity evaluation
>> > >
>> https://cwiki.apache.org/confluence/display/DATAFU/Maturity+Evaluation
>> > and
>> > > I've drafted a graduation resolution
>> > > https://cwiki.apache.org/confluence/pages/viewpage.
>> > action?pageId=68716826
>> > > that needs to be reviewed. I'm not sure what else needs to be done
>> > besides
>> > > that. John do you have any suggestion on next steps?
>> > >
>> > > Eyal, expanding DataFu to include Spark-related code makes sense to
>> me.
>> > I
>> > > recall Russell had the same suggestion.
>> > >
>> > > -Matt
>> > >
>> > > On Mon, Jul 10, 2017 at 3:45 AM, Eyal Allweil <
>> > > eyal_allweil@yahoo.com.invalid> wrote:
>> > >
>> > >> Hi John (and everyone else),
>> > >>
>> > >> There isn't a lot of traffic, but over the past few months the
>> community
>> > >> has been working on preparing for graduation - I think we're almost
>> > there.
>> > >> There was one JIRA issue opened this past month by a new contributor,
>> > which
>> > >> I've already reviewed and need to commit. There are other issues with
>> > >> patches that need to be decided on or reviewed.
>> > >>
>> > >> I think the project is still viable, but part of the lessening of
>> > interest
>> > >> in it is because of a general decline in Apache Pig as a platform.
>> > >> Personally I'd like to expand DataFu to include Spark-related code,
>> > which I
>> > >> think will bring new contributions and contributors. Currently there
>> > isn't
>> > >> an open-source "home" for auxiliary Spark code, and just as DataFu
>> has
>> > been
>> > >> that home for Pig, it could be for Spark.
>> > >> Thoughts?
>> > >> Regards,Eyal
>> > >>
>> > >>
>> > >>
>> > >>
>> > >> On Monday, July 10, 2017 1:28 PM, John D. Ament <
>> > johndament@apache.org>
>> > >> wrote:
>> > >>
>> > >>
>> > >> All,
>> > >>
>> > >> I'd like to know the current status of DataFu. It looks like the
>> list
>> > >> traffic has died down quite a bit, are you still a viable project?
>> > >>
>> > >> John
>> > >>
>> > >>
>> > >>
>> > >>
>> >
>>
>
>
Re: What's the status of DataFu?
Posted by Matthew Hayes <ma...@gmail.com>.
Roman, do you think we should share the graduation resolution with the
incubator general mailing list and start a discussion?
-Matt
On Thu, Jul 13, 2017 at 8:45 PM, Sam Shah <sh...@umich.edu> wrote:
> We've had the paperwork for graduation ready for a couple weeks now. What's
> the next step here? Happy to help however I can.
>
> On Mon, Jul 10, 2017 at 12:40 PM, Roman Shaposhnik <ro...@shaposhnik.org>
> wrote:
>
> > What Matthew said!
> >
> > Thanks,
> > Roman.
> >
> > On Mon, Jul 10, 2017 at 8:50 PM, Matthew Hayes
> > <ma...@gmail.com> wrote:
> > > I think DataFu is pretty close to graduating from incubator. We
> > completed
> > > the maturity evaluation
> > > https://cwiki.apache.org/confluence/display/DATAFU/Maturity+Evaluation
> > and
> > > I've drafted a graduation resolution
> > > https://cwiki.apache.org/confluence/pages/viewpage.
> > action?pageId=68716826
> > > that needs to be reviewed. I'm not sure what else needs to be done
> > besides
> > > that. John do you have any suggestion on next steps?
> > >
> > > Eyal, expanding DataFu to include Spark-related code makes sense to me.
> > I
> > > recall Russell had the same suggestion.
> > >
> > > -Matt
> > >
> > > On Mon, Jul 10, 2017 at 3:45 AM, Eyal Allweil <
> > > eyal_allweil@yahoo.com.invalid> wrote:
> > >
> > >> Hi John (and everyone else),
> > >>
> > >> There isn't a lot of traffic, but over the past few months the
> community
> > >> has been working on preparing for graduation - I think we're almost
> > there.
> > >> There was one JIRA issue opened this past month by a new contributor,
> > which
> > >> I've already reviewed and need to commit. There are other issues with
> > >> patches that need to be decided on or reviewed.
> > >>
> > >> I think the project is still viable, but part of the lessening of
> > interest
> > >> in it is because of a general decline in Apache Pig as a platform.
> > >> Personally I'd like to expand DataFu to include Spark-related code,
> > which I
> > >> think will bring new contributions and contributors. Currently there
> > isn't
> > >> an open-source "home" for auxiliary Spark code, and just as DataFu has
> > been
> > >> that home for Pig, it could be for Spark.
> > >> Thoughts?
> > >> Regards,Eyal
> > >>
> > >>
> > >>
> > >>
> > >> On Monday, July 10, 2017 1:28 PM, John D. Ament <
> > johndament@apache.org>
> > >> wrote:
> > >>
> > >>
> > >> All,
> > >>
> > >> I'd like to know the current status of DataFu. It looks like the list
> > >> traffic has died down quite a bit, are you still a viable project?
> > >>
> > >> John
> > >>
> > >>
> > >>
> > >>
> >
>
Re: What's the status of DataFu?
Posted by Sam Shah <sh...@umich.edu>.
We've had the paperwork for graduation ready for a couple weeks now. What's
the next step here? Happy to help however I can.
On Mon, Jul 10, 2017 at 12:40 PM, Roman Shaposhnik <ro...@shaposhnik.org>
wrote:
> What Matthew said!
>
> Thanks,
> Roman.
>
> On Mon, Jul 10, 2017 at 8:50 PM, Matthew Hayes
> <ma...@gmail.com> wrote:
> > I think DataFu is pretty close to graduating from incubator. We
> completed
> > the maturity evaluation
> > https://cwiki.apache.org/confluence/display/DATAFU/Maturity+Evaluation
> and
> > I've drafted a graduation resolution
> > https://cwiki.apache.org/confluence/pages/viewpage.
> action?pageId=68716826
> > that needs to be reviewed. I'm not sure what else needs to be done
> besides
> > that. John do you have any suggestion on next steps?
> >
> > Eyal, expanding DataFu to include Spark-related code makes sense to me.
> I
> > recall Russell had the same suggestion.
> >
> > -Matt
> >
> > On Mon, Jul 10, 2017 at 3:45 AM, Eyal Allweil <
> > eyal_allweil@yahoo.com.invalid> wrote:
> >
> >> Hi John (and everyone else),
> >>
> >> There isn't a lot of traffic, but over the past few months the community
> >> has been working on preparing for graduation - I think we're almost
> there.
> >> There was one JIRA issue opened this past month by a new contributor,
> which
> >> I've already reviewed and need to commit. There are other issues with
> >> patches that need to be decided on or reviewed.
> >>
> >> I think the project is still viable, but part of the lessening of
> interest
> >> in it is because of a general decline in Apache Pig as a platform.
> >> Personally I'd like to expand DataFu to include Spark-related code,
> which I
> >> think will bring new contributions and contributors. Currently there
> isn't
> >> an open-source "home" for auxiliary Spark code, and just as DataFu has
> been
> >> that home for Pig, it could be for Spark.
> >> Thoughts?
> >> Regards,Eyal
> >>
> >>
> >>
> >>
> >> On Monday, July 10, 2017 1:28 PM, John D. Ament <
> johndament@apache.org>
> >> wrote:
> >>
> >>
> >> All,
> >>
> >> I'd like to know the current status of DataFu. It looks like the list
> >> traffic has died down quite a bit, are you still a viable project?
> >>
> >> John
> >>
> >>
> >>
> >>
>
Re: What's the status of DataFu?
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
What Matthew said!
Thanks,
Roman.
On Mon, Jul 10, 2017 at 8:50 PM, Matthew Hayes
<ma...@gmail.com> wrote:
> I think DataFu is pretty close to graduating from incubator. We completed
> the maturity evaluation
> https://cwiki.apache.org/confluence/display/DATAFU/Maturity+Evaluation and
> I've drafted a graduation resolution
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=68716826
> that needs to be reviewed. I'm not sure what else needs to be done besides
> that. John do you have any suggestion on next steps?
>
> Eyal, expanding DataFu to include Spark-related code makes sense to me. I
> recall Russell had the same suggestion.
>
> -Matt
>
> On Mon, Jul 10, 2017 at 3:45 AM, Eyal Allweil <
> eyal_allweil@yahoo.com.invalid> wrote:
>
>> Hi John (and everyone else),
>>
>> There isn't a lot of traffic, but over the past few months the community
>> has been working on preparing for graduation - I think we're almost there.
>> There was one JIRA issue opened this past month by a new contributor, which
>> I've already reviewed and need to commit. There are other issues with
>> patches that need to be decided on or reviewed.
>>
>> I think the project is still viable, but part of the lessening of interest
>> in it is because of a general decline in Apache Pig as a platform.
>> Personally I'd like to expand DataFu to include Spark-related code, which I
>> think will bring new contributions and contributors. Currently there isn't
>> an open-source "home" for auxiliary Spark code, and just as DataFu has been
>> that home for Pig, it could be for Spark.
>> Thoughts?
>> Regards,Eyal
>>
>>
>>
>>
>> On Monday, July 10, 2017 1:28 PM, John D. Ament <jo...@apache.org>
>> wrote:
>>
>>
>> All,
>>
>> I'd like to know the current status of DataFu. It looks like the list
>> traffic has died down quite a bit, are you still a viable project?
>>
>> John
>>
>>
>>
>>
Re: What's the status of DataFu?
Posted by Russell Jurney <ru...@gmail.com>.
I want to contribute code for PySpark! Utilities and things to perform
repeatable experiments for machine learning, and joins with RDDs and things
like that.
On Mon, Jul 10, 2017 at 10:59 AM Matthew Hayes <
matthew.terence.hayes@gmail.com> wrote:
> I think DataFu is pretty close to graduating from incubator. We completed
> the maturity evaluation
> https://cwiki.apache.org/confluence/display/DATAFU/Maturity+Evaluation and
> I've drafted a graduation resolution
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=68716826
> that needs to be reviewed. I'm not sure what else needs to be done besides
> that. John do you have any suggestion on next steps?
>
> Eyal, expanding DataFu to include Spark-related code makes sense to me. I
> recall Russell had the same suggestion.
>
> -Matt
>
> On Mon, Jul 10, 2017 at 3:45 AM, Eyal Allweil <
> eyal_allweil@yahoo.com.invalid> wrote:
>
> > Hi John (and everyone else),
> >
> > There isn't a lot of traffic, but over the past few months the community
> > has been working on preparing for graduation - I think we're almost
> there.
> > There was one JIRA issue opened this past month by a new contributor,
> which
> > I've already reviewed and need to commit. There are other issues with
> > patches that need to be decided on or reviewed.
> >
> > I think the project is still viable, but part of the lessening of
> interest
> > in it is because of a general decline in Apache Pig as a platform.
> > Personally I'd like to expand DataFu to include Spark-related code,
> which I
> > think will bring new contributions and contributors. Currently there
> isn't
> > an open-source "home" for auxiliary Spark code, and just as DataFu has
> been
> > that home for Pig, it could be for Spark.
> > Thoughts?
> > Regards,Eyal
> >
> >
> >
> >
> > On Monday, July 10, 2017 1:28 PM, John D. Ament <
> johndament@apache.org>
> > wrote:
> >
> >
> > All,
> >
> > I'd like to know the current status of DataFu. It looks like the list
> > traffic has died down quite a bit, are you still a viable project?
> >
> > John
> >
> >
> >
> >
>
--
Russell Jurney @rjurney <http://twitter.com/rjurney>
russell.jurney@gmail.com LI <http://linkedin.com/in/russelljurney> FB
<http://facebook.com/jurney> datasyndrome.com
Re: What's the status of DataFu?
Posted by Matthew Hayes <ma...@gmail.com>.
I think DataFu is pretty close to graduating from incubator. We completed
the maturity evaluation
https://cwiki.apache.org/confluence/display/DATAFU/Maturity+Evaluation and
I've drafted a graduation resolution
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=68716826
that needs to be reviewed. I'm not sure what else needs to be done besides
that. John do you have any suggestion on next steps?
Eyal, expanding DataFu to include Spark-related code makes sense to me. I
recall Russell had the same suggestion.
-Matt
On Mon, Jul 10, 2017 at 3:45 AM, Eyal Allweil <
eyal_allweil@yahoo.com.invalid> wrote:
> Hi John (and everyone else),
>
> There isn't a lot of traffic, but over the past few months the community
> has been working on preparing for graduation - I think we're almost there.
> There was one JIRA issue opened this past month by a new contributor, which
> I've already reviewed and need to commit. There are other issues with
> patches that need to be decided on or reviewed.
>
> I think the project is still viable, but part of the lessening of interest
> in it is because of a general decline in Apache Pig as a platform.
> Personally I'd like to expand DataFu to include Spark-related code, which I
> think will bring new contributions and contributors. Currently there isn't
> an open-source "home" for auxiliary Spark code, and just as DataFu has been
> that home for Pig, it could be for Spark.
> Thoughts?
> Regards,Eyal
>
>
>
>
> On Monday, July 10, 2017 1:28 PM, John D. Ament <jo...@apache.org>
> wrote:
>
>
> All,
>
> I'd like to know the current status of DataFu. It looks like the list
> traffic has died down quite a bit, are you still a viable project?
>
> John
>
>
>
>
Re: What's the status of DataFu?
Posted by Eyal Allweil <ey...@yahoo.com.INVALID>.
Hi John (and everyone else),
There isn't a lot of traffic, but over the past few months the community has been working on preparing for graduation - I think we're almost there. There was one JIRA issue opened this past month by a new contributor, which I've already reviewed and need to commit. There are other issues with patches that need to be decided on or reviewed.
I think the project is still viable, but part of the lessening of interest in it is because of a general decline in Apache Pig as a platform. Personally I'd like to expand DataFu to include Spark-related code, which I think will bring new contributions and contributors. Currently there isn't an open-source "home" for auxiliary Spark code, and just as DataFu has been that home for Pig, it could be for Spark.
Thoughts?
Regards,Eyal
On Monday, July 10, 2017 1:28 PM, John D. Ament <jo...@apache.org> wrote:
All,
I'd like to know the current status of DataFu. It looks like the list
traffic has died down quite a bit, are you still a viable project?
John