Hadoop

[Christopher <ct...@fedoraproject.org>]

So, it would seem at some point, without me noticing (certainly my fault,
for not paying attention enough), the Hadoop packages got orphaned and/or
retired? in Fedora.

This is a big problem for me, because the main package I work on is
dependent upon Hadoop.

What's the state of Hadoop in Fedora these days? Are there packaging
problems? Not enough support from upstream Apache community? Missing
dependencies in Fedora? Not enough time to work on it? No interest from
users?

Whatever the issue is... I'd like to help wherever I can... I'd like to
keep this stuff going.

Re: Hadoop

[Christopher <ct...@apache.org>]

Well, I wouldn't be surprised with some issues across a fedup (which is a
way to do an upgrade between Fedora versions), but it should have been
stable with normal/routine yum/dnf upgrades.

Were you using the Fedora-provided packages, or the BigTop ones? Or another
set?

On Thu, Jun 2, 2016 at 5:04 PM Corey Nolet <cj...@gmail.com> wrote:

> This may not be directly related but I've noticed Hadoop packages have been
> not uninstalling/updating well the past year or so. The last couple times
> I've run fedup, I've had to go back in manually and remove/update a bunch
> of the Hadoop packages like Zookeeper and Parquet.
>
> On Thu, Jun 2, 2016 at 4:59 PM, Christopher <ct...@fedoraproject.org>
> wrote:
>
> > That first post was intended for the Fedora developer list. Apologies for
> > sending to the wrong list.
> >
> > If anybody is curious, it seems the Fedora community support around
> Hadoop
> > and Big Data is really dying... the packager for Flume and HTrace has
> > abandoned their efforts to package for Fedora, and now it looks like the
> > Hadoop package maintainer abandoned Hadoop, leaving Accumulo with
> > unsatisfied dependencies. This is actually kind of a sad state of
> affairs,
> > because better packaging downstream could really help users, and expose
> > more ways to improve the upstream products.
> >
> > As it stands, I think there is a disconnect between the upstream
> > communities and the downstream packagers in the Big Data space which
> > includes Accumulo. I would love to see more interest in better packaging
> > for downstream users through these existing downstream packager
> communities
> > (Homebrew, Fedora, Debian, EPEL, Ubuntu, etc.), and I would love to see
> > more volunteers come from these downstream communities to make
> improvements
> > upstream.
> >
> > As an upstream community, I believe the responsibility is for us to reach
> > down first, rather than wait for them to come to us. I've tried to do
> that
> > within Fedora, with the hope that others would follow for the downstream
> > communities they care about. Unfortunately, things haven't turned out how
> > I'd have preferred, but I'm still hopeful. If there is anybody interested
> > in downstream community packaging, let me know if I can help you get
> > started.
> >
> > On Thu, Jun 2, 2016 at 4:28 PM Christopher <ct...@fedoraproject.org>
> > wrote:
> >
> > > Sorry, wrong list.
> > >
> > > On Thu, Jun 2, 2016 at 4:20 PM Christopher <ctubbsii@fedoraproject.org
> >
> > > wrote:
> > >
> > >> So, it would seem at some point, without me noticing (certainly my
> > fault,
> > >> for not paying attention enough), the Hadoop packages got orphaned
> > and/or
> > >> retired? in Fedora.
> > >>
> > >> This is a big problem for me, because the main package I work on is
> > >> dependent upon Hadoop.
> > >>
> > >> What's the state of Hadoop in Fedora these days? Are there packaging
> > >> problems? Not enough support from upstream Apache community? Missing
> > >> dependencies in Fedora? Not enough time to work on it? No interest
> from
> > >> users?
> > >>
> > >> Whatever the issue is... I'd like to help wherever I can... I'd like
> to
> > >> keep this stuff going.
> > >>
> > >
> >
>

Re: Hadoop

[Corey Nolet <cj...@gmail.com>]

This may not be directly related but I've noticed Hadoop packages have been
not uninstalling/updating well the past year or so. The last couple times
I've run fedup, I've had to go back in manually and remove/update a bunch
of the Hadoop packages like Zookeeper and Parquet.

On Thu, Jun 2, 2016 at 4:59 PM, Christopher <ct...@fedoraproject.org>
wrote:

> That first post was intended for the Fedora developer list. Apologies for
> sending to the wrong list.
>
> If anybody is curious, it seems the Fedora community support around Hadoop
> and Big Data is really dying... the packager for Flume and HTrace has
> abandoned their efforts to package for Fedora, and now it looks like the
> Hadoop package maintainer abandoned Hadoop, leaving Accumulo with
> unsatisfied dependencies. This is actually kind of a sad state of affairs,
> because better packaging downstream could really help users, and expose
> more ways to improve the upstream products.
>
> As it stands, I think there is a disconnect between the upstream
> communities and the downstream packagers in the Big Data space which
> includes Accumulo. I would love to see more interest in better packaging
> for downstream users through these existing downstream packager communities
> (Homebrew, Fedora, Debian, EPEL, Ubuntu, etc.), and I would love to see
> more volunteers come from these downstream communities to make improvements
> upstream.
>
> As an upstream community, I believe the responsibility is for us to reach
> down first, rather than wait for them to come to us. I've tried to do that
> within Fedora, with the hope that others would follow for the downstream
> communities they care about. Unfortunately, things haven't turned out how
> I'd have preferred, but I'm still hopeful. If there is anybody interested
> in downstream community packaging, let me know if I can help you get
> started.
>
> On Thu, Jun 2, 2016 at 4:28 PM Christopher <ct...@fedoraproject.org>
> wrote:
>
> > Sorry, wrong list.
> >
> > On Thu, Jun 2, 2016 at 4:20 PM Christopher <ct...@fedoraproject.org>
> > wrote:
> >
> >> So, it would seem at some point, without me noticing (certainly my
> fault,
> >> for not paying attention enough), the Hadoop packages got orphaned
> and/or
> >> retired? in Fedora.
> >>
> >> This is a big problem for me, because the main package I work on is
> >> dependent upon Hadoop.
> >>
> >> What's the state of Hadoop in Fedora these days? Are there packaging
> >> problems? Not enough support from upstream Apache community? Missing
> >> dependencies in Fedora? Not enough time to work on it? No interest from
> >> users?
> >>
> >> Whatever the issue is... I'd like to help wherever I can... I'd like to
> >> keep this stuff going.
> >>
> >
>

Re: Hadoop

[Christopher <ct...@fedoraproject.org>]

That first post was intended for the Fedora developer list. Apologies for
sending to the wrong list.

If anybody is curious, it seems the Fedora community support around Hadoop
and Big Data is really dying... the packager for Flume and HTrace has
abandoned their efforts to package for Fedora, and now it looks like the
Hadoop package maintainer abandoned Hadoop, leaving Accumulo with
unsatisfied dependencies. This is actually kind of a sad state of affairs,
because better packaging downstream could really help users, and expose
more ways to improve the upstream products.

As it stands, I think there is a disconnect between the upstream
communities and the downstream packagers in the Big Data space which
includes Accumulo. I would love to see more interest in better packaging
for downstream users through these existing downstream packager communities
(Homebrew, Fedora, Debian, EPEL, Ubuntu, etc.), and I would love to see
more volunteers come from these downstream communities to make improvements
upstream.

As an upstream community, I believe the responsibility is for us to reach
down first, rather than wait for them to come to us. I've tried to do that
within Fedora, with the hope that others would follow for the downstream
communities they care about. Unfortunately, things haven't turned out how
I'd have preferred, but I'm still hopeful. If there is anybody interested
in downstream community packaging, let me know if I can help you get
started.

On Thu, Jun 2, 2016 at 4:28 PM Christopher <ct...@fedoraproject.org>
wrote:

> Sorry, wrong list.
>
> On Thu, Jun 2, 2016 at 4:20 PM Christopher <ct...@fedoraproject.org>
> wrote:
>
>> So, it would seem at some point, without me noticing (certainly my fault,
>> for not paying attention enough), the Hadoop packages got orphaned and/or
>> retired? in Fedora.
>>
>> This is a big problem for me, because the main package I work on is
>> dependent upon Hadoop.
>>
>> What's the state of Hadoop in Fedora these days? Are there packaging
>> problems? Not enough support from upstream Apache community? Missing
>> dependencies in Fedora? Not enough time to work on it? No interest from
>> users?
>>
>> Whatever the issue is... I'd like to help wherever I can... I'd like to
>> keep this stuff going.
>>
>

Re: Hadoop

[Christopher <ct...@fedoraproject.org>]

Sorry, wrong list.

On Thu, Jun 2, 2016 at 4:20 PM Christopher <ct...@fedoraproject.org>
wrote:

> So, it would seem at some point, without me noticing (certainly my fault,
> for not paying attention enough), the Hadoop packages got orphaned and/or
> retired? in Fedora.
>
> This is a big problem for me, because the main package I work on is
> dependent upon Hadoop.
>
> What's the state of Hadoop in Fedora these days? Are there packaging
> problems? Not enough support from upstream Apache community? Missing
> dependencies in Fedora? Not enough time to work on it? No interest from
> users?
>
> Whatever the issue is... I'd like to help wherever I can... I'd like to
> keep this stuff going.
>