You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "MrAsanjar ." <af...@gmail.com> on 2016/11/28 15:06:46 UTC
Hadoop 2.7.3 upgrade brook Giraph build ..
As part of Bigtop release 1.2 road-map, I upgraded hadoop to version 2.7.3
last week. Unfortunately it appears the recent changes (HADOOP-11252) in
Hadoop 2.7.3 has broken source-level compatibility resulting in Apache
Graph build-break. This issue has been reported by
https://issues.apache.org/jira/browse/GIRAPH-1112.
The good news is, it looks like the failure has been resolved by
https://issues.apache.org/jira/browse/HADOOP-13579 that is targeted for
Hadoop 2.7.4.
The question is, should we target hadoop 2.7.4 or maintain Hadoop 2.7.2 for
bigtop v1.2.0 ?
Re: Hadoop 2.7.3 upgrade brook Giraph build ..
Posted by Olaf Flebbe <of...@oflebbe.de>.
Sorry I was refering to GIRAPH-1110. A patch to Giraph not Hadoop.
Olaf
> Am 28.11.2016 um 23:38 schrieb Roman Shaposhnik <ro...@shaposhnik.org>:
>
> On Mon, Nov 28, 2016 at 11:10 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
>> Hi,
>>
>> I vote for patching Giraph according to GIRAPH-1112, since it will be a future-proof (i.e. Hadoop-2.8.x) work around. Additionally, the list of issues resolved by hadoop-2.7.3 is rather long.
>
> I'm confused. Since GIRAPH-1112 doesn't have a patch attached to it, I
> presume you
> suggest that we patch Hadoop 2.7.3 by the patch provided on HADOOP-13579 ?
>
> When it comes to custom patching in Bigtop -- I'm a little bit nervous
> when we have
> to do it with Hadoop itself (other components I'm less concerned about).
>
> I think 2.7.4 should be out soon enough. I can also check with ODPi
> members around the
> migration plans of various vendors. IOW, if it all checks out -- is
> there any reason not
> to go with 2.7.4?
>
> Thanks,
> Roman.
>
> P.S. This all reminds me that we should probably have an experimental
> branch for Hadoop 3.
> Now that I'm back from my travels -- this is something I'd be more
> that willing to look at.
Re: Hadoop 2.7.3 upgrade brook Giraph build ..
Posted by "MrAsanjar ." <af...@gmail.com>.
I rather move to Hadoop 2.7.4, if the release day is near.
On Tue, Dec 6, 2016 at 7:33 PM, Roman Shaposhnik <ro...@shaposhnik.org>
wrote:
> Soo.... what's the consensus here?
>
> Thanks,
> Roman.
>
> On Wed, Nov 30, 2016 at 11:15 AM, Akira Ajisaka
> <aj...@oss.nttdata.com> wrote:
> > Hi,
> >
> > I've created a patch for Apache Giraph to compile with Hadoop 2.7.3.
> > https://issues.apache.org/jira/browse/GIRAPH-1110
> >
> > Is it work for you?
> >
> > Regards,
> > Akira
> >
> >
> > On 2016/11/29 7:38, Roman Shaposhnik wrote:
> >>
> >> On Mon, Nov 28, 2016 at 11:10 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
> >>>
> >>> Hi,
> >>>
> >>> I vote for patching Giraph according to GIRAPH-1112, since it will be a
> >>> future-proof (i.e. Hadoop-2.8.x) work around. Additionally, the list of
> >>> issues resolved by hadoop-2.7.3 is rather long.
> >>
> >>
> >> I'm confused. Since GIRAPH-1112 doesn't have a patch attached to it, I
> >> presume you
> >> suggest that we patch Hadoop 2.7.3 by the patch provided on
> HADOOP-13579 ?
> >>
> >> When it comes to custom patching in Bigtop -- I'm a little bit nervous
> >> when we have
> >> to do it with Hadoop itself (other components I'm less concerned about).
> >>
> >> I think 2.7.4 should be out soon enough. I can also check with ODPi
> >> members around the
> >> migration plans of various vendors. IOW, if it all checks out -- is
> >> there any reason not
> >> to go with 2.7.4?
> >>
> >> Thanks,
> >> Roman.
> >>
> >> P.S. This all reminds me that we should probably have an experimental
> >> branch for Hadoop 3.
> >> Now that I'm back from my travels -- this is something I'd be more
> >> that willing to look at.
> >>
> >
>
Re: Hadoop 2.7.3 upgrade brook Giraph build ..
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
Soo.... what's the consensus here?
Thanks,
Roman.
On Wed, Nov 30, 2016 at 11:15 AM, Akira Ajisaka
<aj...@oss.nttdata.com> wrote:
> Hi,
>
> I've created a patch for Apache Giraph to compile with Hadoop 2.7.3.
> https://issues.apache.org/jira/browse/GIRAPH-1110
>
> Is it work for you?
>
> Regards,
> Akira
>
>
> On 2016/11/29 7:38, Roman Shaposhnik wrote:
>>
>> On Mon, Nov 28, 2016 at 11:10 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
>>>
>>> Hi,
>>>
>>> I vote for patching Giraph according to GIRAPH-1112, since it will be a
>>> future-proof (i.e. Hadoop-2.8.x) work around. Additionally, the list of
>>> issues resolved by hadoop-2.7.3 is rather long.
>>
>>
>> I'm confused. Since GIRAPH-1112 doesn't have a patch attached to it, I
>> presume you
>> suggest that we patch Hadoop 2.7.3 by the patch provided on HADOOP-13579 ?
>>
>> When it comes to custom patching in Bigtop -- I'm a little bit nervous
>> when we have
>> to do it with Hadoop itself (other components I'm less concerned about).
>>
>> I think 2.7.4 should be out soon enough. I can also check with ODPi
>> members around the
>> migration plans of various vendors. IOW, if it all checks out -- is
>> there any reason not
>> to go with 2.7.4?
>>
>> Thanks,
>> Roman.
>>
>> P.S. This all reminds me that we should probably have an experimental
>> branch for Hadoop 3.
>> Now that I'm back from my travels -- this is something I'd be more
>> that willing to look at.
>>
>
Re: Hadoop 2.7.3 upgrade brook Giraph build ..
Posted by Akira Ajisaka <aj...@oss.nttdata.com>.
Hi,
I've created a patch for Apache Giraph to compile with Hadoop 2.7.3.
https://issues.apache.org/jira/browse/GIRAPH-1110
Is it work for you?
Regards,
Akira
On 2016/11/29 7:38, Roman Shaposhnik wrote:
> On Mon, Nov 28, 2016 at 11:10 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
>> Hi,
>>
>> I vote for patching Giraph according to GIRAPH-1112, since it will be a future-proof (i.e. Hadoop-2.8.x) work around. Additionally, the list of issues resolved by hadoop-2.7.3 is rather long.
>
> I'm confused. Since GIRAPH-1112 doesn't have a patch attached to it, I
> presume you
> suggest that we patch Hadoop 2.7.3 by the patch provided on HADOOP-13579 ?
>
> When it comes to custom patching in Bigtop -- I'm a little bit nervous
> when we have
> to do it with Hadoop itself (other components I'm less concerned about).
>
> I think 2.7.4 should be out soon enough. I can also check with ODPi
> members around the
> migration plans of various vendors. IOW, if it all checks out -- is
> there any reason not
> to go with 2.7.4?
>
> Thanks,
> Roman.
>
> P.S. This all reminds me that we should probably have an experimental
> branch for Hadoop 3.
> Now that I'm back from my travels -- this is something I'd be more
> that willing to look at.
>
Re: Hadoop 2.7.3 upgrade brook Giraph build ..
Posted by "MrAsanjar ." <af...@gmail.com>.
+1 on hadoop 3 development build..
On Mon, Nov 28, 2016 at 4:38 PM, Roman Shaposhnik <ro...@shaposhnik.org>
wrote:
> On Mon, Nov 28, 2016 at 11:10 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
> > Hi,
> >
> > I vote for patching Giraph according to GIRAPH-1112, since it will be a
> future-proof (i.e. Hadoop-2.8.x) work around. Additionally, the list of
> issues resolved by hadoop-2.7.3 is rather long.
>
> I'm confused. Since GIRAPH-1112 doesn't have a patch attached to it, I
> presume you
> suggest that we patch Hadoop 2.7.3 by the patch provided on HADOOP-13579 ?
>
> When it comes to custom patching in Bigtop -- I'm a little bit nervous
> when we have
> to do it with Hadoop itself (other components I'm less concerned about).
>
> I think 2.7.4 should be out soon enough. I can also check with ODPi
> members around the
> migration plans of various vendors. IOW, if it all checks out -- is
> there any reason not
> to go with 2.7.4?
>
> Thanks,
> Roman.
>
> P.S. This all reminds me that we should probably have an experimental
> branch for Hadoop 3.
> Now that I'm back from my travels -- this is something I'd be more
> that willing to look at.
>
Re: Hadoop 2.7.3 upgrade brook Giraph build ..
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
On Mon, Nov 28, 2016 at 11:10 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
> Hi,
>
> I vote for patching Giraph according to GIRAPH-1112, since it will be a future-proof (i.e. Hadoop-2.8.x) work around. Additionally, the list of issues resolved by hadoop-2.7.3 is rather long.
I'm confused. Since GIRAPH-1112 doesn't have a patch attached to it, I
presume you
suggest that we patch Hadoop 2.7.3 by the patch provided on HADOOP-13579 ?
When it comes to custom patching in Bigtop -- I'm a little bit nervous
when we have
to do it with Hadoop itself (other components I'm less concerned about).
I think 2.7.4 should be out soon enough. I can also check with ODPi
members around the
migration plans of various vendors. IOW, if it all checks out -- is
there any reason not
to go with 2.7.4?
Thanks,
Roman.
P.S. This all reminds me that we should probably have an experimental
branch for Hadoop 3.
Now that I'm back from my travels -- this is something I'd be more
that willing to look at.
Re: Hadoop 2.7.3 upgrade brook Giraph build ..
Posted by Olaf Flebbe <of...@oflebbe.de>.
Hi,
I vote for patching Giraph according to GIRAPH-1112, since it will be a future-proof (i.e. Hadoop-2.8.x) work around. Additionally, the list of issues resolved by hadoop-2.7.3 is rather long.
Olaf
> Am 28.11.2016 um 16:06 schrieb MrAsanjar . <af...@gmail.com>:
>
> As part of Bigtop release 1.2 road-map, I upgraded hadoop to version 2.7.3
> last week. Unfortunately it appears the recent changes (HADOOP-11252) in
> Hadoop 2.7.3 has broken source-level compatibility resulting in Apache
> Graph build-break. This issue has been reported by
> https://issues.apache.org/jira/browse/GIRAPH-1112.
> The good news is, it looks like the failure has been resolved by
> https://issues.apache.org/jira/browse/HADOOP-13579 that is targeted for
> Hadoop 2.7.4.
>
> The question is, should we target hadoop 2.7.4 or maintain Hadoop 2.7.2 for
> bigtop v1.2.0 ?