You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by Ayush Saxena <ay...@gmail.com> on 2023/02/01 09:44:24 UTC
Re: [DISCUSS] IPV6 Support for Hadoop
Thanx Uma for driving this. Catching up a bit late and I see the only
problem with this is lack of IPv6 Infra for testing. I quickly had a word
with Gavin McDonald <gm...@apache.org> and he said it is possible to
migrate our existing ones to Ipv6, maybe we can dedicate one of our nodes
and map to the IPv6 branch, that should be all?
-Ayush
On Tue, 31 Jan 2023 at 03:49, Uma Maheswara Rao Gangumalla <
umagangumalla@gmail.com> wrote:
> Sounds great. Thanks Brahma for the reply. Also thanks for details of the
> pending work on this and offering help on this.
> It would be great if we have IPV6 based infra. Not sure Apache Infra can
> help us here to provide any IPV6 based instance for CI.
>
> >What is the complexity or difficulty of making Hadoop support IPv6?
> IIUC, Looks like they don't have infra available to test it with the
> developers who worked on it at this stage. It would be great to see if
> community help on this. I will shoot a mail to infra team if there is any
> chance to get IPV6 base machines to use for CI.
>
> Regards,
> Uma
>
> On Fri, Jan 27, 2023 at 10:03 AM Battula, Brahma Reddy <bb...@visa.com>
> wrote:
>
> > Hi Sangjin Lee, Uma,
> >
> > Nice to see topic on IPV6. Yes, We worked on the HADOOP-11890 and tested
> > internally.
> > We found following four jira's which needs to merged.
> >
> > https://issues.apache.org/jira/browse/HADOOP-17843
> > https://issues.apache.org/jira/browse/YARN-8604
> > https://issues.apache.org/jira/browse/HADOOP-18312
> > https://issues.apache.org/jira/browse/HADOOP-18209
> >
> > We need to merge these Jira's and test against latest trunk. Currently we
> > don't have IPV6 machines to test.
> > If anybody can help on test, we can try to help on fixing any further
> > issues.
> >
> >
> > Regards,
> > Brahma
> >
> > On 25/01/23, 11:19 PM, "Sangjin Lee" <sjlee@apache.org <mailto:
> > sjlee@apache.org>> wrote:
> >
> >
> > +1 in understanding where this effort is and what it would take to get
> this
> > done. I haven't been intimately involved in Hadoop lately, so I can't
> speak
> > to the level of effort. But I can comment on the importance of Hadoop
> > supporting IPv6 from the customer perspective.
> >
> >
> > What is the complexity or difficulty of making Hadoop support IPv6?
> >
> >
> > On Tue, Jan 24, 2023 at 8:25 PM Uma Maheswara Rao Gangumalla <
> > umagangumalla@gmail.com <ma...@gmail.com>> wrote:
> >
> >
> > > Hey Hadoop Devs,
> > >
> > > I would like to bring up the topic of IPV6 support. I saw some work
> based
> > > on 2.7 and later cloned the JIRAs
> > > <
> >
> https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FHADOOP-11890&data=05%7C01%7Cbbattula%40visa.com%7C22315ffd0f73433de87708dafefc805a%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C638102657689199570%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=BbmMJ7TR8bs3Rm%2Bt5uWdahBFX9MK%2BxfhImxT4DYVtPs%3D&reserved=0
> >
> > <
> >
> https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FHADOOP-11890&data=05%7C01%7Cbbattula%40visa.com%7C22315ffd0f73433de87708dafefc805a%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C638102657689199570%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=BbmMJ7TR8bs3Rm%2Bt5uWdahBFX9MK%2BxfhImxT4DYVtPs%3D&reserved=0>
> ;>
> > to get into the
> > > trunk.
> > > Has anyone looked into the current state of the feature branch? Also is
> > > there any community interest in taking this work forward?
> > > Just cc-ing some of the folks who were involved in JIRA discussions or
> > > active in the community.
> > >
> > > CC: @Ayush Saxena <ayushsaxena@apache.org <mailto:
> ayushsaxena@apache.org>>
> > @Wei-Chiu Chuang
> > > <weichiu@apache.org <ma...@apache.org>> @Battula, Brahma
> Reddy
> > <bbattula@visa.com <ma...@visa.com>> @Hemant
> > > @Akira
> > > Ajisaka <aajisaka@apache.org <ma...@apache.org>>
> > >
> > > Looking at JIRA comments, there is interest in using Hadoop with IPV6
> > envs
> > > ( based on people checking for status for it.)
> > >
> > > Regards,
> > > Uma
> > >
> >
> >
> >
> >
>
Re: [DISCUSS] IPV6 Support for Hadoop
Posted by Uma Maheswara Rao Gangumalla <um...@gmail.com>.
Good idea @Ayush Saxena <ay...@apache.org>. I am not closely
monitoring our CI machines, so @Wei-Chiu Chuang <we...@apache.org> / @Akira
Ajisaka <aa...@apache.org> or you can figure it out, which machine can
be dedicated to IPV6?
If we can dedicate one, that would be awesome. I am +1 from my side to do
that.
Regards,
Uma
On Wed, Feb 1, 2023 at 1:44 AM Ayush Saxena <ay...@gmail.com> wrote:
> Thanx Uma for driving this. Catching up a bit late and I see the only
> problem with this is lack of IPv6 Infra for testing. I quickly had a word
> with Gavin McDonald <gm...@apache.org> and he said it is possible to
> migrate our existing ones to Ipv6, maybe we can dedicate one of our nodes
> and map to the IPv6 branch, that should be all?
>
> -Ayush
>
> On Tue, 31 Jan 2023 at 03:49, Uma Maheswara Rao Gangumalla <
> umagangumalla@gmail.com> wrote:
>
>> Sounds great. Thanks Brahma for the reply. Also thanks for details of the
>> pending work on this and offering help on this.
>> It would be great if we have IPV6 based infra. Not sure Apache Infra can
>> help us here to provide any IPV6 based instance for CI.
>>
>> >What is the complexity or difficulty of making Hadoop support IPv6?
>> IIUC, Looks like they don't have infra available to test it with the
>> developers who worked on it at this stage. It would be great to see if
>> community help on this. I will shoot a mail to infra team if there is any
>> chance to get IPV6 base machines to use for CI.
>>
>> Regards,
>> Uma
>>
>> On Fri, Jan 27, 2023 at 10:03 AM Battula, Brahma Reddy <bbattula@visa.com
>> >
>> wrote:
>>
>> > Hi Sangjin Lee, Uma,
>> >
>> > Nice to see topic on IPV6. Yes, We worked on the HADOOP-11890 and tested
>> > internally.
>> > We found following four jira's which needs to merged.
>> >
>> > https://issues.apache.org/jira/browse/HADOOP-17843
>> > https://issues.apache.org/jira/browse/YARN-8604
>> > https://issues.apache.org/jira/browse/HADOOP-18312
>> > https://issues.apache.org/jira/browse/HADOOP-18209
>> >
>> > We need to merge these Jira's and test against latest trunk. Currently
>> we
>> > don't have IPV6 machines to test.
>> > If anybody can help on test, we can try to help on fixing any further
>> > issues.
>> >
>> >
>> > Regards,
>> > Brahma
>> >
>> > On 25/01/23, 11:19 PM, "Sangjin Lee" <sjlee@apache.org <mailto:
>> > sjlee@apache.org>> wrote:
>> >
>> >
>> > +1 in understanding where this effort is and what it would take to get
>> this
>> > done. I haven't been intimately involved in Hadoop lately, so I can't
>> speak
>> > to the level of effort. But I can comment on the importance of Hadoop
>> > supporting IPv6 from the customer perspective.
>> >
>> >
>> > What is the complexity or difficulty of making Hadoop support IPv6?
>> >
>> >
>> > On Tue, Jan 24, 2023 at 8:25 PM Uma Maheswara Rao Gangumalla <
>> > umagangumalla@gmail.com <ma...@gmail.com>> wrote:
>> >
>> >
>> > > Hey Hadoop Devs,
>> > >
>> > > I would like to bring up the topic of IPV6 support. I saw some work
>> based
>> > > on 2.7 and later cloned the JIRAs
>> > > <
>> >
>> https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FHADOOP-11890&data=05%7C01%7Cbbattula%40visa.com%7C22315ffd0f73433de87708dafefc805a%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C638102657689199570%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=BbmMJ7TR8bs3Rm%2Bt5uWdahBFX9MK%2BxfhImxT4DYVtPs%3D&reserved=0
>> >
>> > <
>> >
>> https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FHADOOP-11890&data=05%7C01%7Cbbattula%40visa.com%7C22315ffd0f73433de87708dafefc805a%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C638102657689199570%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=BbmMJ7TR8bs3Rm%2Bt5uWdahBFX9MK%2BxfhImxT4DYVtPs%3D&reserved=0>
>> ;>
>> > to get into the
>> > > trunk.
>> > > Has anyone looked into the current state of the feature branch? Also
>> is
>> > > there any community interest in taking this work forward?
>> > > Just cc-ing some of the folks who were involved in JIRA discussions or
>> > > active in the community.
>> > >
>> > > CC: @Ayush Saxena <ayushsaxena@apache.org <mailto:
>> ayushsaxena@apache.org>>
>> > @Wei-Chiu Chuang
>> > > <weichiu@apache.org <ma...@apache.org>> @Battula, Brahma
>> Reddy
>> > <bbattula@visa.com <ma...@visa.com>> @Hemant
>> > > @Akira
>> > > Ajisaka <aajisaka@apache.org <ma...@apache.org>>
>> > >
>> > > Looking at JIRA comments, there is interest in using Hadoop with IPV6
>> > envs
>> > > ( based on people checking for status for it.)
>> > >
>> > > Regards,
>> > > Uma
>> > >
>> >
>> >
>> >
>> >
>>
>