You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by ha...@visolve.com on 2015/02/21 19:53:01 UTC

Hadoop - HTTPS communication between nodes - How to Confirm ?

Hello Everyone,

 

We are trying to measure performance between HTTP and HTTPS version on
Hadoop DFS, Mapreduce and other related modules.

 

As of now, we have tested using several metrics on Hadoop HTTP Mode.
Similiarly we are trying to test the same metrics on HTTPS Platform.
Basically our test suite cluster consists of one Master Node and two Slave
Nodes. 

We have configured HTTPS connection and now we need to verify whether Nodes
are communicating directly through HTTPS. Tried checking logs, clusters
webhdfs ui, health check information, dfs admin report but of no help. Since
there is only limited documentation available in HTTPS, we are unable to
verify whether Nodes are communicating through HTTPS. 

 

Hence any experts around here can shed some light on how to confirm HTTPS
communication status between nodes (might be with mapreduce/DFS).

 

Note: If I have missed any information, feel free to check with me for the
same. 

 

Thanks,

S.RagavendraGanesh

ViSolve Hadoop Support Team
ViSolve Inc. | San Jose, California
Website: www.visolve.com <http://www.visolve.com>  

email: services@visolve.com <ma...@visolve.com>  | Phone:
408-850-2243

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 



RE: Hadoop - HTTPS communication between nodes - How to Confirm ?

Posted by ha...@visolve.com.
Thanks for the help Ulul/Daemeon,

 

Problem has sorted using lsof –p <datanode pid> command. 

 

Thanks,

S.RagavendraGanesh

ViSolve Hadoop Support Team
ViSolve Inc. | San Jose, California
Website: www.visolve.com <http://www.visolve.com>  

Email: services@visolve.com <ma...@visolve.com>  | Phone:
408-850-2243

 

From: Ulul [mailto:hadoop@ulul.org] 
Sent: Sunday, February 22, 2015 5:23 AM
To: user@hadoop.apache.org
Subject: Re: Hadoop - HTTPS communication between nodes - How to Confirm ?

 

Hi

Be careful, HTTPS is to secure WebHDFS. If you want to protect all network
streams you need more than that :
 
<https://s3.amazonaws.com/dev.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.2/bk
_reference/content/reference_chap-wire-encryption.html>
https://s3.amazonaws.com/dev.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.2/bk_
reference/content/reference_chap-wire-encryption.html

If you're just interested in HTTPS an lsof -p <datanode pid> | grep TCP will
show you that DN listening on 50075 for HTTP, 50475 for HTTPS. For namenode
that would be 50070 and 50470

Ulul
 

Le 21/02/2015 19:53, hadoop.support@visolve.com
<ma...@visolve.com>  a écrit :

Hello Everyone,

 

We are trying to measure performance between HTTP and HTTPS version on
Hadoop DFS, Mapreduce and other related modules.

 

As of now, we have tested using several metrics on Hadoop HTTP Mode.
Similiarly we are trying to test the same metrics on HTTPS Platform.
Basically our test suite cluster consists of one Master Node and two Slave
Nodes. 

We have configured HTTPS connection and now we need to verify whether Nodes
are communicating directly through HTTPS. Tried checking logs, clusters
webhdfs ui, health check information, dfs admin report but of no help. Since
there is only limited documentation available in HTTPS, we are unable to
verify whether Nodes are communicating through HTTPS. 

 

Hence any experts around here can shed some light on how to confirm HTTPS
communication status between nodes (might be with mapreduce/DFS).

 

Note: If I have missed any information, feel free to check with me for the
same. 

 

Thanks,

S.RagavendraGanesh

ViSolve Hadoop Support Team
ViSolve Inc. | San Jose, California
Website: www.visolve.com <http://www.visolve.com>  

email: services@visolve.com <ma...@visolve.com>  | Phone:
408-850-2243

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 


 


RE: Hadoop - HTTPS communication between nodes - How to Confirm ?

Posted by ha...@visolve.com.
Thanks for the help Ulul/Daemeon,

 

Problem has sorted using lsof –p <datanode pid> command. 

 

Thanks,

S.RagavendraGanesh

ViSolve Hadoop Support Team
ViSolve Inc. | San Jose, California
Website: www.visolve.com <http://www.visolve.com>  

Email: services@visolve.com <ma...@visolve.com>  | Phone:
408-850-2243

 

From: Ulul [mailto:hadoop@ulul.org] 
Sent: Sunday, February 22, 2015 5:23 AM
To: user@hadoop.apache.org
Subject: Re: Hadoop - HTTPS communication between nodes - How to Confirm ?

 

Hi

Be careful, HTTPS is to secure WebHDFS. If you want to protect all network
streams you need more than that :
 
<https://s3.amazonaws.com/dev.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.2/bk
_reference/content/reference_chap-wire-encryption.html>
https://s3.amazonaws.com/dev.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.2/bk_
reference/content/reference_chap-wire-encryption.html

If you're just interested in HTTPS an lsof -p <datanode pid> | grep TCP will
show you that DN listening on 50075 for HTTP, 50475 for HTTPS. For namenode
that would be 50070 and 50470

Ulul
 

Le 21/02/2015 19:53, hadoop.support@visolve.com
<ma...@visolve.com>  a écrit :

Hello Everyone,

 

We are trying to measure performance between HTTP and HTTPS version on
Hadoop DFS, Mapreduce and other related modules.

 

As of now, we have tested using several metrics on Hadoop HTTP Mode.
Similiarly we are trying to test the same metrics on HTTPS Platform.
Basically our test suite cluster consists of one Master Node and two Slave
Nodes. 

We have configured HTTPS connection and now we need to verify whether Nodes
are communicating directly through HTTPS. Tried checking logs, clusters
webhdfs ui, health check information, dfs admin report but of no help. Since
there is only limited documentation available in HTTPS, we are unable to
verify whether Nodes are communicating through HTTPS. 

 

Hence any experts around here can shed some light on how to confirm HTTPS
communication status between nodes (might be with mapreduce/DFS).

 

Note: If I have missed any information, feel free to check with me for the
same. 

 

Thanks,

S.RagavendraGanesh

ViSolve Hadoop Support Team
ViSolve Inc. | San Jose, California
Website: www.visolve.com <http://www.visolve.com>  

email: services@visolve.com <ma...@visolve.com>  | Phone:
408-850-2243

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 


 


RE: Hadoop - HTTPS communication between nodes - How to Confirm ?

Posted by ha...@visolve.com.
Thanks for the help Ulul/Daemeon,

 

Problem has sorted using lsof –p <datanode pid> command. 

 

Thanks,

S.RagavendraGanesh

ViSolve Hadoop Support Team
ViSolve Inc. | San Jose, California
Website: www.visolve.com <http://www.visolve.com>  

Email: services@visolve.com <ma...@visolve.com>  | Phone:
408-850-2243

 

From: Ulul [mailto:hadoop@ulul.org] 
Sent: Sunday, February 22, 2015 5:23 AM
To: user@hadoop.apache.org
Subject: Re: Hadoop - HTTPS communication between nodes - How to Confirm ?

 

Hi

Be careful, HTTPS is to secure WebHDFS. If you want to protect all network
streams you need more than that :
 
<https://s3.amazonaws.com/dev.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.2/bk
_reference/content/reference_chap-wire-encryption.html>
https://s3.amazonaws.com/dev.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.2/bk_
reference/content/reference_chap-wire-encryption.html

If you're just interested in HTTPS an lsof -p <datanode pid> | grep TCP will
show you that DN listening on 50075 for HTTP, 50475 for HTTPS. For namenode
that would be 50070 and 50470

Ulul
 

Le 21/02/2015 19:53, hadoop.support@visolve.com
<ma...@visolve.com>  a écrit :

Hello Everyone,

 

We are trying to measure performance between HTTP and HTTPS version on
Hadoop DFS, Mapreduce and other related modules.

 

As of now, we have tested using several metrics on Hadoop HTTP Mode.
Similiarly we are trying to test the same metrics on HTTPS Platform.
Basically our test suite cluster consists of one Master Node and two Slave
Nodes. 

We have configured HTTPS connection and now we need to verify whether Nodes
are communicating directly through HTTPS. Tried checking logs, clusters
webhdfs ui, health check information, dfs admin report but of no help. Since
there is only limited documentation available in HTTPS, we are unable to
verify whether Nodes are communicating through HTTPS. 

 

Hence any experts around here can shed some light on how to confirm HTTPS
communication status between nodes (might be with mapreduce/DFS).

 

Note: If I have missed any information, feel free to check with me for the
same. 

 

Thanks,

S.RagavendraGanesh

ViSolve Hadoop Support Team
ViSolve Inc. | San Jose, California
Website: www.visolve.com <http://www.visolve.com>  

email: services@visolve.com <ma...@visolve.com>  | Phone:
408-850-2243

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 


 


RE: Hadoop - HTTPS communication between nodes - How to Confirm ?

Posted by ha...@visolve.com.
Thanks for the help Ulul/Daemeon,

 

Problem has sorted using lsof –p <datanode pid> command. 

 

Thanks,

S.RagavendraGanesh

ViSolve Hadoop Support Team
ViSolve Inc. | San Jose, California
Website: www.visolve.com <http://www.visolve.com>  

Email: services@visolve.com <ma...@visolve.com>  | Phone:
408-850-2243

 

From: Ulul [mailto:hadoop@ulul.org] 
Sent: Sunday, February 22, 2015 5:23 AM
To: user@hadoop.apache.org
Subject: Re: Hadoop - HTTPS communication between nodes - How to Confirm ?

 

Hi

Be careful, HTTPS is to secure WebHDFS. If you want to protect all network
streams you need more than that :
 
<https://s3.amazonaws.com/dev.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.2/bk
_reference/content/reference_chap-wire-encryption.html>
https://s3.amazonaws.com/dev.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.2/bk_
reference/content/reference_chap-wire-encryption.html

If you're just interested in HTTPS an lsof -p <datanode pid> | grep TCP will
show you that DN listening on 50075 for HTTP, 50475 for HTTPS. For namenode
that would be 50070 and 50470

Ulul
 

Le 21/02/2015 19:53, hadoop.support@visolve.com
<ma...@visolve.com>  a écrit :

Hello Everyone,

 

We are trying to measure performance between HTTP and HTTPS version on
Hadoop DFS, Mapreduce and other related modules.

 

As of now, we have tested using several metrics on Hadoop HTTP Mode.
Similiarly we are trying to test the same metrics on HTTPS Platform.
Basically our test suite cluster consists of one Master Node and two Slave
Nodes. 

We have configured HTTPS connection and now we need to verify whether Nodes
are communicating directly through HTTPS. Tried checking logs, clusters
webhdfs ui, health check information, dfs admin report but of no help. Since
there is only limited documentation available in HTTPS, we are unable to
verify whether Nodes are communicating through HTTPS. 

 

Hence any experts around here can shed some light on how to confirm HTTPS
communication status between nodes (might be with mapreduce/DFS).

 

Note: If I have missed any information, feel free to check with me for the
same. 

 

Thanks,

S.RagavendraGanesh

ViSolve Hadoop Support Team
ViSolve Inc. | San Jose, California
Website: www.visolve.com <http://www.visolve.com>  

email: services@visolve.com <ma...@visolve.com>  | Phone:
408-850-2243

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 


 


Re: Hadoop - HTTPS communication between nodes - How to Confirm ?

Posted by Ulul <ha...@ulul.org>.
Hi

Be careful, HTTPS is to secure WebHDFS. If you want to protect all 
network streams you need more than that :
https://s3.amazonaws.com/dev.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.2/bk_reference/content/reference_chap-wire-encryption.html

If you're just interested in HTTPS an lsof -p <datanode pid> | grep TCP 
will show you that DN listening on 50075 for HTTP, 50475 for HTTPS. For 
namenode that would be 50070 and 50470

Ulul

Le 21/02/2015 19:53, hadoop.support@visolve.com a écrit :
>
> Hello Everyone,
>
> We are trying to measure performance between HTTP and HTTPS version on 
> Hadoop DFS, Mapreduce and other related modules.
>
> As of now, we have tested using several metrics on Hadoop HTTP Mode. 
> Similiarly we are trying to test the same metrics on HTTPS Platform. 
> Basically our test suite cluster consists of one Master Node and two 
> Slave Nodes.
>
> We have configured HTTPS connection and now we need to verify whether 
> Nodes are communicating directly through HTTPS. Tried checking logs, 
> clusters webhdfs ui, health check information, dfs admin report but of 
> no help. Since there is only limited documentation available in HTTPS, 
> we are unable to verify whether Nodes are communicating through HTTPS.
>
> Hence any experts around here can shed some light on how to confirm 
> HTTPS communication status between nodes (might be with mapreduce/DFS).
>
> Note: If I have missed any information, feel free to check with me for 
> the same.
>
> /Thanks,/
>
> /S.RagavendraGanesh///
>
> ViSolve Hadoop Support Team
> ViSolve Inc. | San Jose, California
> Website: www.visolve.com <http://www.visolve.com>
>
> email: services@visolve.com <ma...@visolve.com> | Phone: 
> 408-850-2243
>


Re: Hadoop - HTTPS communication between nodes - How to Confirm ?

Posted by Ulul <ha...@ulul.org>.
Hi

Be careful, HTTPS is to secure WebHDFS. If you want to protect all 
network streams you need more than that :
https://s3.amazonaws.com/dev.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.2/bk_reference/content/reference_chap-wire-encryption.html

If you're just interested in HTTPS an lsof -p <datanode pid> | grep TCP 
will show you that DN listening on 50075 for HTTP, 50475 for HTTPS. For 
namenode that would be 50070 and 50470

Ulul

Le 21/02/2015 19:53, hadoop.support@visolve.com a écrit :
>
> Hello Everyone,
>
> We are trying to measure performance between HTTP and HTTPS version on 
> Hadoop DFS, Mapreduce and other related modules.
>
> As of now, we have tested using several metrics on Hadoop HTTP Mode. 
> Similiarly we are trying to test the same metrics on HTTPS Platform. 
> Basically our test suite cluster consists of one Master Node and two 
> Slave Nodes.
>
> We have configured HTTPS connection and now we need to verify whether 
> Nodes are communicating directly through HTTPS. Tried checking logs, 
> clusters webhdfs ui, health check information, dfs admin report but of 
> no help. Since there is only limited documentation available in HTTPS, 
> we are unable to verify whether Nodes are communicating through HTTPS.
>
> Hence any experts around here can shed some light on how to confirm 
> HTTPS communication status between nodes (might be with mapreduce/DFS).
>
> Note: If I have missed any information, feel free to check with me for 
> the same.
>
> /Thanks,/
>
> /S.RagavendraGanesh///
>
> ViSolve Hadoop Support Team
> ViSolve Inc. | San Jose, California
> Website: www.visolve.com <http://www.visolve.com>
>
> email: services@visolve.com <ma...@visolve.com> | Phone: 
> 408-850-2243
>


Re: Hadoop - HTTPS communication between nodes - How to Confirm ?

Posted by daemeon reiydelle <da...@gmail.com>.
Tcpdump or Wireshark will conform the encrypted traffic. I do not recall
that ssa setup messages are in the logs unless debug levels are high.

sent from my mobile
Daemeon C.M. Reiydelle
USA 415.501.0198
London +44.0.20.8144.9872
On Feb 21, 2015 10:54 AM, <ha...@visolve.com> wrote:

> Hello Everyone,
>
>
>
> We are trying to measure performance between HTTP and HTTPS version on
> Hadoop DFS, Mapreduce and other related modules.
>
>
>
> As of now, we have tested using several metrics on Hadoop HTTP Mode.
> Similiarly we are trying to test the same metrics on HTTPS Platform.
> Basically our test suite cluster consists of one Master Node and two Slave
> Nodes.
>
> We have configured HTTPS connection and now we need to verify whether
> Nodes are communicating directly through HTTPS. Tried checking logs,
> clusters webhdfs ui, health check information, dfs admin report but of no
> help. Since there is only limited documentation available in HTTPS, we are
> unable to verify whether Nodes are communicating through HTTPS.
>
>
>
> Hence any experts around here can shed some light on how to confirm HTTPS
> communication status between nodes (might be with mapreduce/DFS).
>
>
>
> Note: If I have missed any information, feel free to check with me for the
> same.
>
>
>
> *Thanks,*
>
> *S.RagavendraGanesh*
>
> ViSolve Hadoop Support Team
> ViSolve Inc. | San Jose, California
> Website: www.visolve.com
>
> email: services@visolve.com | Phone: 408-850-2243
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>

Re: Hadoop - HTTPS communication between nodes - How to Confirm ?

Posted by Ulul <ha...@ulul.org>.
Hi

Be careful, HTTPS is to secure WebHDFS. If you want to protect all 
network streams you need more than that :
https://s3.amazonaws.com/dev.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.2/bk_reference/content/reference_chap-wire-encryption.html

If you're just interested in HTTPS an lsof -p <datanode pid> | grep TCP 
will show you that DN listening on 50075 for HTTP, 50475 for HTTPS. For 
namenode that would be 50070 and 50470

Ulul

Le 21/02/2015 19:53, hadoop.support@visolve.com a écrit :
>
> Hello Everyone,
>
> We are trying to measure performance between HTTP and HTTPS version on 
> Hadoop DFS, Mapreduce and other related modules.
>
> As of now, we have tested using several metrics on Hadoop HTTP Mode. 
> Similiarly we are trying to test the same metrics on HTTPS Platform. 
> Basically our test suite cluster consists of one Master Node and two 
> Slave Nodes.
>
> We have configured HTTPS connection and now we need to verify whether 
> Nodes are communicating directly through HTTPS. Tried checking logs, 
> clusters webhdfs ui, health check information, dfs admin report but of 
> no help. Since there is only limited documentation available in HTTPS, 
> we are unable to verify whether Nodes are communicating through HTTPS.
>
> Hence any experts around here can shed some light on how to confirm 
> HTTPS communication status between nodes (might be with mapreduce/DFS).
>
> Note: If I have missed any information, feel free to check with me for 
> the same.
>
> /Thanks,/
>
> /S.RagavendraGanesh///
>
> ViSolve Hadoop Support Team
> ViSolve Inc. | San Jose, California
> Website: www.visolve.com <http://www.visolve.com>
>
> email: services@visolve.com <ma...@visolve.com> | Phone: 
> 408-850-2243
>


Re: Hadoop - HTTPS communication between nodes - How to Confirm ?

Posted by daemeon reiydelle <da...@gmail.com>.
Tcpdump or Wireshark will conform the encrypted traffic. I do not recall
that ssa setup messages are in the logs unless debug levels are high.

sent from my mobile
Daemeon C.M. Reiydelle
USA 415.501.0198
London +44.0.20.8144.9872
On Feb 21, 2015 10:54 AM, <ha...@visolve.com> wrote:

> Hello Everyone,
>
>
>
> We are trying to measure performance between HTTP and HTTPS version on
> Hadoop DFS, Mapreduce and other related modules.
>
>
>
> As of now, we have tested using several metrics on Hadoop HTTP Mode.
> Similiarly we are trying to test the same metrics on HTTPS Platform.
> Basically our test suite cluster consists of one Master Node and two Slave
> Nodes.
>
> We have configured HTTPS connection and now we need to verify whether
> Nodes are communicating directly through HTTPS. Tried checking logs,
> clusters webhdfs ui, health check information, dfs admin report but of no
> help. Since there is only limited documentation available in HTTPS, we are
> unable to verify whether Nodes are communicating through HTTPS.
>
>
>
> Hence any experts around here can shed some light on how to confirm HTTPS
> communication status between nodes (might be with mapreduce/DFS).
>
>
>
> Note: If I have missed any information, feel free to check with me for the
> same.
>
>
>
> *Thanks,*
>
> *S.RagavendraGanesh*
>
> ViSolve Hadoop Support Team
> ViSolve Inc. | San Jose, California
> Website: www.visolve.com
>
> email: services@visolve.com | Phone: 408-850-2243
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>

Re: Hadoop - HTTPS communication between nodes - How to Confirm ?

Posted by Ulul <ha...@ulul.org>.
Hi

Be careful, HTTPS is to secure WebHDFS. If you want to protect all 
network streams you need more than that :
https://s3.amazonaws.com/dev.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.2/bk_reference/content/reference_chap-wire-encryption.html

If you're just interested in HTTPS an lsof -p <datanode pid> | grep TCP 
will show you that DN listening on 50075 for HTTP, 50475 for HTTPS. For 
namenode that would be 50070 and 50470

Ulul

Le 21/02/2015 19:53, hadoop.support@visolve.com a écrit :
>
> Hello Everyone,
>
> We are trying to measure performance between HTTP and HTTPS version on 
> Hadoop DFS, Mapreduce and other related modules.
>
> As of now, we have tested using several metrics on Hadoop HTTP Mode. 
> Similiarly we are trying to test the same metrics on HTTPS Platform. 
> Basically our test suite cluster consists of one Master Node and two 
> Slave Nodes.
>
> We have configured HTTPS connection and now we need to verify whether 
> Nodes are communicating directly through HTTPS. Tried checking logs, 
> clusters webhdfs ui, health check information, dfs admin report but of 
> no help. Since there is only limited documentation available in HTTPS, 
> we are unable to verify whether Nodes are communicating through HTTPS.
>
> Hence any experts around here can shed some light on how to confirm 
> HTTPS communication status between nodes (might be with mapreduce/DFS).
>
> Note: If I have missed any information, feel free to check with me for 
> the same.
>
> /Thanks,/
>
> /S.RagavendraGanesh///
>
> ViSolve Hadoop Support Team
> ViSolve Inc. | San Jose, California
> Website: www.visolve.com <http://www.visolve.com>
>
> email: services@visolve.com <ma...@visolve.com> | Phone: 
> 408-850-2243
>


Re: Hadoop - HTTPS communication between nodes - How to Confirm ?

Posted by daemeon reiydelle <da...@gmail.com>.
Tcpdump or Wireshark will conform the encrypted traffic. I do not recall
that ssa setup messages are in the logs unless debug levels are high.

sent from my mobile
Daemeon C.M. Reiydelle
USA 415.501.0198
London +44.0.20.8144.9872
On Feb 21, 2015 10:54 AM, <ha...@visolve.com> wrote:

> Hello Everyone,
>
>
>
> We are trying to measure performance between HTTP and HTTPS version on
> Hadoop DFS, Mapreduce and other related modules.
>
>
>
> As of now, we have tested using several metrics on Hadoop HTTP Mode.
> Similiarly we are trying to test the same metrics on HTTPS Platform.
> Basically our test suite cluster consists of one Master Node and two Slave
> Nodes.
>
> We have configured HTTPS connection and now we need to verify whether
> Nodes are communicating directly through HTTPS. Tried checking logs,
> clusters webhdfs ui, health check information, dfs admin report but of no
> help. Since there is only limited documentation available in HTTPS, we are
> unable to verify whether Nodes are communicating through HTTPS.
>
>
>
> Hence any experts around here can shed some light on how to confirm HTTPS
> communication status between nodes (might be with mapreduce/DFS).
>
>
>
> Note: If I have missed any information, feel free to check with me for the
> same.
>
>
>
> *Thanks,*
>
> *S.RagavendraGanesh*
>
> ViSolve Hadoop Support Team
> ViSolve Inc. | San Jose, California
> Website: www.visolve.com
>
> email: services@visolve.com | Phone: 408-850-2243
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>

Re: Hadoop - HTTPS communication between nodes - How to Confirm ?

Posted by daemeon reiydelle <da...@gmail.com>.
Tcpdump or Wireshark will conform the encrypted traffic. I do not recall
that ssa setup messages are in the logs unless debug levels are high.

sent from my mobile
Daemeon C.M. Reiydelle
USA 415.501.0198
London +44.0.20.8144.9872
On Feb 21, 2015 10:54 AM, <ha...@visolve.com> wrote:

> Hello Everyone,
>
>
>
> We are trying to measure performance between HTTP and HTTPS version on
> Hadoop DFS, Mapreduce and other related modules.
>
>
>
> As of now, we have tested using several metrics on Hadoop HTTP Mode.
> Similiarly we are trying to test the same metrics on HTTPS Platform.
> Basically our test suite cluster consists of one Master Node and two Slave
> Nodes.
>
> We have configured HTTPS connection and now we need to verify whether
> Nodes are communicating directly through HTTPS. Tried checking logs,
> clusters webhdfs ui, health check information, dfs admin report but of no
> help. Since there is only limited documentation available in HTTPS, we are
> unable to verify whether Nodes are communicating through HTTPS.
>
>
>
> Hence any experts around here can shed some light on how to confirm HTTPS
> communication status between nodes (might be with mapreduce/DFS).
>
>
>
> Note: If I have missed any information, feel free to check with me for the
> same.
>
>
>
> *Thanks,*
>
> *S.RagavendraGanesh*
>
> ViSolve Hadoop Support Team
> ViSolve Inc. | San Jose, California
> Website: www.visolve.com
>
> email: services@visolve.com | Phone: 408-850-2243
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>