You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by Jay Sen <ja...@apache.org> on 2020/03/24 19:28:19 UTC

Hadoop 3 support

Hi Dev Team,

What do you guys think about support for Hadoop 3 to run the Gobblin on ?

Thanks
Jay

Re: Hadoop 3 support

Posted by Jayesh Senjaliya <ja...@gmail.com>.
created https://issues.apache.org/jira/browse/GOBBLIN-1161, will add more
details later.


On Tue, May 26, 2020 at 9:56 AM Shirshanka Das <sh...@apache.org>
wrote:

> Yes, it looks like some annoying compile issues like dependencies on
> GlobPattern etc will have to be fixed first.
> We should make a plan and do it.
>
> Shirshanka
>
>
>
>
> On Thu, May 21, 2020 at 1:29 AM Jay Sen <ja...@apache.org> wrote:
>
> > Hi Tamas,
> >
> > I meant to add support for Hadoop version 3.x (
> > https://hadoop.apache.org/docs/r3.2.1/)
> >
> > Yes, I tried and its already looking like there are some breaking
> changes.
> > As organizations moves to Hadoop 3.x, it would be a good to add this
> > support.
> >
> > Let me know your thoughts and we can start collaborating on this.
> >
> > Thanks
> > Jay
> >
> >
> >
> >
> > On Thu, Apr 9, 2020 at 2:08 PM Tamás Németh <tr...@apache.org> wrote:
> >
> > > Hey Jay,
> > >
> > > I don't know much about Hadoop 3 but I'm curious, what is the Hadoop 3
> > > support means?
> > > Will Gobblin MR/yarn work on Hadoop 3 as it is or there are breaking
> > > changes?
> > >
> > > Thanks,
> > > Tamas
> > >
> > > On Tue, 24 Mar 2020 at 20:28, Jay Sen <ja...@apache.org> wrote:
> > >
> > > > Hi Dev Team,
> > > >
> > > > What do you guys think about support for Hadoop 3 to run the Gobblin
> > on ?
> > > >
> > > > Thanks
> > > > Jay
> > > >
> > >
> >
>

Re: Hadoop 3 support

Posted by Shirshanka Das <sh...@apache.org>.
Yes, it looks like some annoying compile issues like dependencies on
GlobPattern etc will have to be fixed first.
We should make a plan and do it.

Shirshanka




On Thu, May 21, 2020 at 1:29 AM Jay Sen <ja...@apache.org> wrote:

> Hi Tamas,
>
> I meant to add support for Hadoop version 3.x (
> https://hadoop.apache.org/docs/r3.2.1/)
>
> Yes, I tried and its already looking like there are some breaking changes.
> As organizations moves to Hadoop 3.x, it would be a good to add this
> support.
>
> Let me know your thoughts and we can start collaborating on this.
>
> Thanks
> Jay
>
>
>
>
> On Thu, Apr 9, 2020 at 2:08 PM Tamás Németh <tr...@apache.org> wrote:
>
> > Hey Jay,
> >
> > I don't know much about Hadoop 3 but I'm curious, what is the Hadoop 3
> > support means?
> > Will Gobblin MR/yarn work on Hadoop 3 as it is or there are breaking
> > changes?
> >
> > Thanks,
> > Tamas
> >
> > On Tue, 24 Mar 2020 at 20:28, Jay Sen <ja...@apache.org> wrote:
> >
> > > Hi Dev Team,
> > >
> > > What do you guys think about support for Hadoop 3 to run the Gobblin
> on ?
> > >
> > > Thanks
> > > Jay
> > >
> >
>

Re: Hadoop 3 support

Posted by Jay Sen <ja...@apache.org>.
Hi Tamas,

I meant to add support for Hadoop version 3.x (
https://hadoop.apache.org/docs/r3.2.1/)

Yes, I tried and its already looking like there are some breaking changes.
As organizations moves to Hadoop 3.x, it would be a good to add this
support.

Let me know your thoughts and we can start collaborating on this.

Thanks
Jay




On Thu, Apr 9, 2020 at 2:08 PM Tamás Németh <tr...@apache.org> wrote:

> Hey Jay,
>
> I don't know much about Hadoop 3 but I'm curious, what is the Hadoop 3
> support means?
> Will Gobblin MR/yarn work on Hadoop 3 as it is or there are breaking
> changes?
>
> Thanks,
> Tamas
>
> On Tue, 24 Mar 2020 at 20:28, Jay Sen <ja...@apache.org> wrote:
>
> > Hi Dev Team,
> >
> > What do you guys think about support for Hadoop 3 to run the Gobblin on ?
> >
> > Thanks
> > Jay
> >
>

Re: Hadoop 3 support

Posted by Tamás Németh <tr...@apache.org>.
Hey Jay,

I don't know much about Hadoop 3 but I'm curious, what is the Hadoop 3
support means?
Will Gobblin MR/yarn work on Hadoop 3 as it is or there are breaking
changes?

Thanks,
Tamas

On Tue, 24 Mar 2020 at 20:28, Jay Sen <ja...@apache.org> wrote:

> Hi Dev Team,
>
> What do you guys think about support for Hadoop 3 to run the Gobblin on ?
>
> Thanks
> Jay
>