You are viewing a plain text version of this content. The canonical link for it is here.
Posted to general@hadoop.apache.org by Yehuda Korotkin <ye...@korotkin.co.il> on 2014/09/23 11:56:43 UTC
Hadoop protocol question
Hello,
Why hadoop transfer files via TCP instead UDP ?
May-be UDP is better or i missing something ?
--
Regards,
Yehuda Korotkin
<http://www.korotkin.co.il/>
web www.korotkin.co.il
mobile +972 (50) 414-6444
email yehuda@korotkin.co.il
Re: Hadoop protocol question
Posted by Yehuda Korotkin <ye...@korotkin.co.il>.
You right,
The question is it good for us?
Basically we can create "Validation packet" on UDP for a bigger chunk of
data,
Instead using small chunk of TCP that send each packet of data lot of
packets of hand-shake etc and i didn't start to talk about TCP Packet has
bigger header.
via UDP we can "Stream " more information and faster to hadoop.
send once bigger chunks of data.
and each 10M (for example) send validation packet instead sending
validation packets each packet that sent
On Tue, Sep 23, 2014 at 1:09 PM, Abhinav Mathur <ab...@abhinavmathur.net>
wrote:
> as far as I know UDP is not reliable, in the sense it does not guarantee
> that files will be transferred and so TCP is generally the preferred
> protocol when we need reliability.
>
> On Tue, Sep 23, 2014 at 3:26 PM, Yehuda Korotkin <ye...@korotkin.co.il>
> wrote:
>
> > Hello,
> >
> > Why hadoop transfer files via TCP instead UDP ?
> > May-be UDP is better or i missing something ?
> >
> >
> > --
> >
> > Regards,
> > Yehuda Korotkin
> >
> > <http://www.korotkin.co.il/>
> >
> > web www.korotkin.co.il
> >
> > mobile +972 (50) 414-6444
> >
> > email yehuda@korotkin.co.il
> >
>
--
Regards,
Yehuda Korotkin
<http://www.korotkin.co.il/>
web www.korotkin.co.il
mobile +972 (50) 414-6444
email yehuda@korotkin.co.il
Re: Hadoop protocol question
Posted by Yehuda Korotkin <ye...@korotkin.co.il>.
You right,
The question is it good for us?
Basically we can create "Validation packet" on UDP for a bigger chunk of
data,
Instead using small chunk of TCP that send each packet of data lot of
packets of hand-shake etc and i didn't start to talk about TCP Packet has
bigger header.
via UDP we can "Stream " more information and faster to hadoop.
send once bigger chunks of data.
and each 10M (for example) send validation packet instead sending
validation packets each packet that sent
On Tue, Sep 23, 2014 at 1:09 PM, Abhinav Mathur <ab...@abhinavmathur.net>
wrote:
> as far as I know UDP is not reliable, in the sense it does not guarantee
> that files will be transferred and so TCP is generally the preferred
> protocol when we need reliability.
>
> On Tue, Sep 23, 2014 at 3:26 PM, Yehuda Korotkin <ye...@korotkin.co.il>
> wrote:
>
> > Hello,
> >
> > Why hadoop transfer files via TCP instead UDP ?
> > May-be UDP is better or i missing something ?
> >
> >
> > --
> >
> > Regards,
> > Yehuda Korotkin
> >
> > <http://www.korotkin.co.il/>
> >
> > web www.korotkin.co.il
> >
> > mobile +972 (50) 414-6444
> >
> > email yehuda@korotkin.co.il
> >
>
--
Regards,
Yehuda Korotkin
<http://www.korotkin.co.il/>
web www.korotkin.co.il
mobile +972 (50) 414-6444
email yehuda@korotkin.co.il
Re: Hadoop protocol question
Posted by Abhinav Mathur <ab...@abhinavmathur.net>.
as far as I know UDP is not reliable, in the sense it does not guarantee
that files will be transferred and so TCP is generally the preferred
protocol when we need reliability.
On Tue, Sep 23, 2014 at 3:26 PM, Yehuda Korotkin <ye...@korotkin.co.il>
wrote:
> Hello,
>
> Why hadoop transfer files via TCP instead UDP ?
> May-be UDP is better or i missing something ?
>
>
> --
>
> Regards,
> Yehuda Korotkin
>
> <http://www.korotkin.co.il/>
>
> web www.korotkin.co.il
>
> mobile +972 (50) 414-6444
>
> email yehuda@korotkin.co.il
>
Re: Hadoop protocol question
Posted by Abhinav Mathur <ab...@abhinavmathur.net>.
as far as I know UDP is not reliable, in the sense it does not guarantee
that files will be transferred and so TCP is generally the preferred
protocol when we need reliability.
On Tue, Sep 23, 2014 at 3:26 PM, Yehuda Korotkin <ye...@korotkin.co.il>
wrote:
> Hello,
>
> Why hadoop transfer files via TCP instead UDP ?
> May-be UDP is better or i missing something ?
>
>
> --
>
> Regards,
> Yehuda Korotkin
>
> <http://www.korotkin.co.il/>
>
> web www.korotkin.co.il
>
> mobile +972 (50) 414-6444
>
> email yehuda@korotkin.co.il
>