You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@datafu.apache.org by Eyal Allweil <ey...@apache.org> on 2020/12/29 15:15:13 UTC
Deprecating Datafu Pig and Hourglass
Hi Datafu devs,
I have high hopes for DataFu Spark, but we haven't seen any contributions
for Datafu Pig or Hourglass in years. What do you think about deprecating
them? We can leave them in the code for now, mark them as deprecated, and
when we release a major version (2.0.0?) in the future we'll delete them.
If we ever need to make a hotfix or do get a contribution, we can always
fork from the release tags.
I think this will help simplify our code, website, documentation, and make
it easier for Spark contributors to join. It also has the advantage of
allowing us to upgrade our Gradle version, since the Pig build uses an old
Gradle plugin that hasn't been supported for years.
Regards,
Eyal
Re: [E] Re: Deprecating Datafu Pig and Hourglass
Posted by Matthew Hayes <ma...@gmail.com>.
I think it's this one: https://issues.apache.org/jira/browse/DATAFU-156
On Wed, Jan 13, 2021 at 4:26 PM Koji Noguchi
<kn...@verizonmedia.com.invalid> wrote:
> Is there a jira for Pig Gradle issue? We can have someone from Pig side
> take a look at the build/patch.
>
> Koji
>
> On Wed, Jan 13, 2021 at 6:55 PM Matthew Hayes <
> matthew.terence.hayes@gmail.com> wrote:
>
> > I agree with this and I think your proposal for marking them as
> deprecated
> > and then removing them with the next major version makes sense.
> >
> > -Matt
> >
> > On Tue, Dec 29, 2020 at 7:15 AM Eyal Allweil <ey...@apache.org> wrote:
> >
> > > Hi Datafu devs,
> > >
> > > I have high hopes for DataFu Spark, but we haven't seen any
> contributions
> > > for Datafu Pig or Hourglass in years. What do you think about
> deprecating
> > > them? We can leave them in the code for now, mark them as deprecated,
> and
> > > when we release a major version (2.0.0?) in the future we'll delete
> them.
> > > If we ever need to make a hotfix or do get a contribution, we can
> always
> > > fork from the release tags.
> > >
> > > I think this will help simplify our code, website, documentation, and
> > make
> > > it easier for Spark contributors to join. It also has the advantage of
> > > allowing us to upgrade our Gradle version, since the Pig build uses an
> > old
> > > Gradle plugin that hasn't been supported for years.
> > >
> > > Regards,
> > > Eyal
> > >
> >
>
Re: [E] Re: Deprecating Datafu Pig and Hourglass
Posted by Koji Noguchi <kn...@verizonmedia.com.INVALID>.
Is there a jira for Pig Gradle issue? We can have someone from Pig side
take a look at the build/patch.
Koji
On Wed, Jan 13, 2021 at 6:55 PM Matthew Hayes <
matthew.terence.hayes@gmail.com> wrote:
> I agree with this and I think your proposal for marking them as deprecated
> and then removing them with the next major version makes sense.
>
> -Matt
>
> On Tue, Dec 29, 2020 at 7:15 AM Eyal Allweil <ey...@apache.org> wrote:
>
> > Hi Datafu devs,
> >
> > I have high hopes for DataFu Spark, but we haven't seen any contributions
> > for Datafu Pig or Hourglass in years. What do you think about deprecating
> > them? We can leave them in the code for now, mark them as deprecated, and
> > when we release a major version (2.0.0?) in the future we'll delete them.
> > If we ever need to make a hotfix or do get a contribution, we can always
> > fork from the release tags.
> >
> > I think this will help simplify our code, website, documentation, and
> make
> > it easier for Spark contributors to join. It also has the advantage of
> > allowing us to upgrade our Gradle version, since the Pig build uses an
> old
> > Gradle plugin that hasn't been supported for years.
> >
> > Regards,
> > Eyal
> >
>
Re: Deprecating Datafu Pig and Hourglass
Posted by Matthew Hayes <ma...@gmail.com>.
I agree with this and I think your proposal for marking them as deprecated
and then removing them with the next major version makes sense.
-Matt
On Tue, Dec 29, 2020 at 7:15 AM Eyal Allweil <ey...@apache.org> wrote:
> Hi Datafu devs,
>
> I have high hopes for DataFu Spark, but we haven't seen any contributions
> for Datafu Pig or Hourglass in years. What do you think about deprecating
> them? We can leave them in the code for now, mark them as deprecated, and
> when we release a major version (2.0.0?) in the future we'll delete them.
> If we ever need to make a hotfix or do get a contribution, we can always
> fork from the release tags.
>
> I think this will help simplify our code, website, documentation, and make
> it easier for Spark contributors to join. It also has the advantage of
> allowing us to upgrade our Gradle version, since the Pig build uses an old
> Gradle plugin that hasn't been supported for years.
>
> Regards,
> Eyal
>