You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by rab ra <ra...@gmail.com> on 2013/11/11 05:51:55 UTC
Why SSH
Hello
I have a question. To transfer the files to datanodes what protocol hadoop
uses? SSH or http or https
Re: Why SSH
Posted by rab ra <ra...@gmail.com>.
Thanks for d response. It helps. :-)
On 11 Nov 2013 14:04, "unmesha sreeveni" <un...@gmail.com> wrote:
> I guess it is TCP .
>
> The server is DataXceiverServer<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f> and
> the client is DFSClient<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/DFSClient.java#DFSClient>.
> Basiclly, they use the Java Socket API.
>
> DataXceiverServer<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f>
> :
> http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f
>
>
>
> On Mon, Nov 11, 2013 at 12:11 PM, Harsh J <ha...@cloudera.com> wrote:
>
>> Neither of those. We stream data directly over a TCP network socket.
>>
>> Please read http://wiki.apache.org/hadoop/FAQ#Does_Hadoop_require_SSH.3F
>> regarding your SSH confusion.
>>
>> On Mon, Nov 11, 2013 at 10:21 AM, rab ra <ra...@gmail.com> wrote:
>> > Hello
>> >
>> > I have a question. To transfer the files to datanodes what protocol
>> hadoop
>> > uses? SSH or http or https
>>
>>
>>
>> --
>> Harsh J
>>
>
>
>
> --
> *Thanks & Regards*
>
> Unmesha Sreeveni U.B
>
> *Junior Developer*
>
> *Amrita Center For Cyber Security *
>
>
> * Amritapuri.www.amrita.edu/cyber/ <http://www.amrita.edu/cyber/>*
>
Re: Why SSH
Posted by rab ra <ra...@gmail.com>.
Thanks for d response. It helps. :-)
On 11 Nov 2013 14:04, "unmesha sreeveni" <un...@gmail.com> wrote:
> I guess it is TCP .
>
> The server is DataXceiverServer<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f> and
> the client is DFSClient<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/DFSClient.java#DFSClient>.
> Basiclly, they use the Java Socket API.
>
> DataXceiverServer<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f>
> :
> http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f
>
>
>
> On Mon, Nov 11, 2013 at 12:11 PM, Harsh J <ha...@cloudera.com> wrote:
>
>> Neither of those. We stream data directly over a TCP network socket.
>>
>> Please read http://wiki.apache.org/hadoop/FAQ#Does_Hadoop_require_SSH.3F
>> regarding your SSH confusion.
>>
>> On Mon, Nov 11, 2013 at 10:21 AM, rab ra <ra...@gmail.com> wrote:
>> > Hello
>> >
>> > I have a question. To transfer the files to datanodes what protocol
>> hadoop
>> > uses? SSH or http or https
>>
>>
>>
>> --
>> Harsh J
>>
>
>
>
> --
> *Thanks & Regards*
>
> Unmesha Sreeveni U.B
>
> *Junior Developer*
>
> *Amrita Center For Cyber Security *
>
>
> * Amritapuri.www.amrita.edu/cyber/ <http://www.amrita.edu/cyber/>*
>
Re: Why SSH
Posted by rab ra <ra...@gmail.com>.
Thanks for d response. It helps. :-)
On 11 Nov 2013 14:04, "unmesha sreeveni" <un...@gmail.com> wrote:
> I guess it is TCP .
>
> The server is DataXceiverServer<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f> and
> the client is DFSClient<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/DFSClient.java#DFSClient>.
> Basiclly, they use the Java Socket API.
>
> DataXceiverServer<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f>
> :
> http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f
>
>
>
> On Mon, Nov 11, 2013 at 12:11 PM, Harsh J <ha...@cloudera.com> wrote:
>
>> Neither of those. We stream data directly over a TCP network socket.
>>
>> Please read http://wiki.apache.org/hadoop/FAQ#Does_Hadoop_require_SSH.3F
>> regarding your SSH confusion.
>>
>> On Mon, Nov 11, 2013 at 10:21 AM, rab ra <ra...@gmail.com> wrote:
>> > Hello
>> >
>> > I have a question. To transfer the files to datanodes what protocol
>> hadoop
>> > uses? SSH or http or https
>>
>>
>>
>> --
>> Harsh J
>>
>
>
>
> --
> *Thanks & Regards*
>
> Unmesha Sreeveni U.B
>
> *Junior Developer*
>
> *Amrita Center For Cyber Security *
>
>
> * Amritapuri.www.amrita.edu/cyber/ <http://www.amrita.edu/cyber/>*
>
Re: Why SSH
Posted by rab ra <ra...@gmail.com>.
Thanks for d response. It helps. :-)
On 11 Nov 2013 14:04, "unmesha sreeveni" <un...@gmail.com> wrote:
> I guess it is TCP .
>
> The server is DataXceiverServer<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f> and
> the client is DFSClient<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/DFSClient.java#DFSClient>.
> Basiclly, they use the Java Socket API.
>
> DataXceiverServer<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f>
> :
> http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f
>
>
>
> On Mon, Nov 11, 2013 at 12:11 PM, Harsh J <ha...@cloudera.com> wrote:
>
>> Neither of those. We stream data directly over a TCP network socket.
>>
>> Please read http://wiki.apache.org/hadoop/FAQ#Does_Hadoop_require_SSH.3F
>> regarding your SSH confusion.
>>
>> On Mon, Nov 11, 2013 at 10:21 AM, rab ra <ra...@gmail.com> wrote:
>> > Hello
>> >
>> > I have a question. To transfer the files to datanodes what protocol
>> hadoop
>> > uses? SSH or http or https
>>
>>
>>
>> --
>> Harsh J
>>
>
>
>
> --
> *Thanks & Regards*
>
> Unmesha Sreeveni U.B
>
> *Junior Developer*
>
> *Amrita Center For Cyber Security *
>
>
> * Amritapuri.www.amrita.edu/cyber/ <http://www.amrita.edu/cyber/>*
>
Re: Why SSH
Posted by unmesha sreeveni <un...@gmail.com>.
I guess it is TCP .
The server is DataXceiverServer<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f>
and
the client is DFSClient<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/DFSClient.java#DFSClient>.
Basiclly, they use the Java Socket API.
DataXceiverServer<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f>
:
http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f
On Mon, Nov 11, 2013 at 12:11 PM, Harsh J <ha...@cloudera.com> wrote:
> Neither of those. We stream data directly over a TCP network socket.
>
> Please read http://wiki.apache.org/hadoop/FAQ#Does_Hadoop_require_SSH.3F
> regarding your SSH confusion.
>
> On Mon, Nov 11, 2013 at 10:21 AM, rab ra <ra...@gmail.com> wrote:
> > Hello
> >
> > I have a question. To transfer the files to datanodes what protocol
> hadoop
> > uses? SSH or http or https
>
>
>
> --
> Harsh J
>
--
*Thanks & Regards*
Unmesha Sreeveni U.B
*Junior Developer*
*Amrita Center For Cyber Security*
* Amritapuri.www.amrita.edu/cyber/ <http://www.amrita.edu/cyber/>*
Re: Why SSH
Posted by unmesha sreeveni <un...@gmail.com>.
I guess it is TCP .
The server is DataXceiverServer<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f>
and
the client is DFSClient<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/DFSClient.java#DFSClient>.
Basiclly, they use the Java Socket API.
DataXceiverServer<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f>
:
http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f
On Mon, Nov 11, 2013 at 12:11 PM, Harsh J <ha...@cloudera.com> wrote:
> Neither of those. We stream data directly over a TCP network socket.
>
> Please read http://wiki.apache.org/hadoop/FAQ#Does_Hadoop_require_SSH.3F
> regarding your SSH confusion.
>
> On Mon, Nov 11, 2013 at 10:21 AM, rab ra <ra...@gmail.com> wrote:
> > Hello
> >
> > I have a question. To transfer the files to datanodes what protocol
> hadoop
> > uses? SSH or http or https
>
>
>
> --
> Harsh J
>
--
*Thanks & Regards*
Unmesha Sreeveni U.B
*Junior Developer*
*Amrita Center For Cyber Security*
* Amritapuri.www.amrita.edu/cyber/ <http://www.amrita.edu/cyber/>*
Re: Why SSH
Posted by unmesha sreeveni <un...@gmail.com>.
I guess it is TCP .
The server is DataXceiverServer<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f>
and
the client is DFSClient<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/DFSClient.java#DFSClient>.
Basiclly, they use the Java Socket API.
DataXceiverServer<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f>
:
http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f
On Mon, Nov 11, 2013 at 12:11 PM, Harsh J <ha...@cloudera.com> wrote:
> Neither of those. We stream data directly over a TCP network socket.
>
> Please read http://wiki.apache.org/hadoop/FAQ#Does_Hadoop_require_SSH.3F
> regarding your SSH confusion.
>
> On Mon, Nov 11, 2013 at 10:21 AM, rab ra <ra...@gmail.com> wrote:
> > Hello
> >
> > I have a question. To transfer the files to datanodes what protocol
> hadoop
> > uses? SSH or http or https
>
>
>
> --
> Harsh J
>
--
*Thanks & Regards*
Unmesha Sreeveni U.B
*Junior Developer*
*Amrita Center For Cyber Security*
* Amritapuri.www.amrita.edu/cyber/ <http://www.amrita.edu/cyber/>*
Re: Why SSH
Posted by unmesha sreeveni <un...@gmail.com>.
I guess it is TCP .
The server is DataXceiverServer<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f>
and
the client is DFSClient<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/DFSClient.java#DFSClient>.
Basiclly, they use the Java Socket API.
DataXceiverServer<http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f>
:
http://www.grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.hadoop/hadoop-hdfs/2.0.0-cdh4.3.0/org/apache/hadoop/hdfs/server/datanode/DataXceiverServer.java?av=f
On Mon, Nov 11, 2013 at 12:11 PM, Harsh J <ha...@cloudera.com> wrote:
> Neither of those. We stream data directly over a TCP network socket.
>
> Please read http://wiki.apache.org/hadoop/FAQ#Does_Hadoop_require_SSH.3F
> regarding your SSH confusion.
>
> On Mon, Nov 11, 2013 at 10:21 AM, rab ra <ra...@gmail.com> wrote:
> > Hello
> >
> > I have a question. To transfer the files to datanodes what protocol
> hadoop
> > uses? SSH or http or https
>
>
>
> --
> Harsh J
>
--
*Thanks & Regards*
Unmesha Sreeveni U.B
*Junior Developer*
*Amrita Center For Cyber Security*
* Amritapuri.www.amrita.edu/cyber/ <http://www.amrita.edu/cyber/>*
Re: Why SSH
Posted by Harsh J <ha...@cloudera.com>.
Neither of those. We stream data directly over a TCP network socket.
Please read http://wiki.apache.org/hadoop/FAQ#Does_Hadoop_require_SSH.3F
regarding your SSH confusion.
On Mon, Nov 11, 2013 at 10:21 AM, rab ra <ra...@gmail.com> wrote:
> Hello
>
> I have a question. To transfer the files to datanodes what protocol hadoop
> uses? SSH or http or https
--
Harsh J
Re: Why SSH
Posted by Harsh J <ha...@cloudera.com>.
Neither of those. We stream data directly over a TCP network socket.
Please read http://wiki.apache.org/hadoop/FAQ#Does_Hadoop_require_SSH.3F
regarding your SSH confusion.
On Mon, Nov 11, 2013 at 10:21 AM, rab ra <ra...@gmail.com> wrote:
> Hello
>
> I have a question. To transfer the files to datanodes what protocol hadoop
> uses? SSH or http or https
--
Harsh J
Re: Why SSH
Posted by Harsh J <ha...@cloudera.com>.
Neither of those. We stream data directly over a TCP network socket.
Please read http://wiki.apache.org/hadoop/FAQ#Does_Hadoop_require_SSH.3F
regarding your SSH confusion.
On Mon, Nov 11, 2013 at 10:21 AM, rab ra <ra...@gmail.com> wrote:
> Hello
>
> I have a question. To transfer the files to datanodes what protocol hadoop
> uses? SSH or http or https
--
Harsh J
Re: Why SSH
Posted by Harsh J <ha...@cloudera.com>.
Neither of those. We stream data directly over a TCP network socket.
Please read http://wiki.apache.org/hadoop/FAQ#Does_Hadoop_require_SSH.3F
regarding your SSH confusion.
On Mon, Nov 11, 2013 at 10:21 AM, rab ra <ra...@gmail.com> wrote:
> Hello
>
> I have a question. To transfer the files to datanodes what protocol hadoop
> uses? SSH or http or https
--
Harsh J