HBase cluster replication firewall rules

[Levy Meny <Me...@comverse.com>]

Hi,

We are using HBase replication (over Apache 0.94.2) between two sites and we need to define firewall rules between the two sites.

Can anyone provide some information regarding the ports that are used between the sites?



Our understand is:

Replication is from site1  to site2.



*         Region Server (site1) to Region Server (site2), port 60020



*         Region Server (site1) to ZooKeeper (site2), port 2181



*         ZooKeeper (site1) to ZooKeeper (site2) Which of the following ports do we need: 2181, 2888, 3888?



Also, what protocol is used (is IPC simple generic TCP?)



Thanks,



Meny Levy

R&D

IP & Messaging

Comverse - Making Your Network Smarter



T   +972-3-7663350

M +972-52-8543350

Meny.Levy@comverse.com<ma...@comverse.com> <ma...@comverse.com>

www.comverse.com<http://www.comverse.com/<http://www.comverse.com%3chttp:/www.comverse.com/>>

P Please think of the environment before printing this email


________________________________
"This e-mail message may contain confidential, commercial or privileged information that constitutes proprietary information of Comverse Technology or its subsidiaries. If you are not the intended recipient of this message, you are hereby notified that any review, use or distribution of this information is absolutely prohibited and we request that you delete all copies and contact us by e-mailing to: security@comverse.com. Thank You."

Re: HBase cluster replication firewall rules

[Jonathan Hsieh <jo...@cloudera.com>]

On Tue, Apr 30, 2013 at 11:20 PM, Levy Meny <Me...@comverse.com> wrote:

> Hi,
>
> We are using HBase replication (over Apache 0.94.2) between two sites and
> we need to define firewall rules between the two sites.
>
> Can anyone provide some information regarding the ports that are used
> between the sites?
>
> sure. replications is push oriented from site 1 to site 2 I believe so
outbound and inbound ports need to be done correctly.

>
>
> Our understand is:
>
> Replication is from site1  to site2.
>
>
>
> *         Region Server (site1) to Region Server (site2), port 60020
>
> Site 1 pushes data to site 2 here, so site 1 needs to open outbound to and
site 2 needs to open it inbound.

>
>
> *         Region Server (site1) to ZooKeeper (site2), port 2181
>
> yes, 2181 is the default zk client port, and site1's rs's need to be able
to contact this to get to the rs's in site 2 it should ship to.

>
>
> *         ZooKeeper (site1) to ZooKeeper (site2) Which of the following
> ports do we need: 2181, 2888, 3888?
>
> ZK in site 1 and ZK in site 2 are separate quorums and do not directly
talk so the peering ports (2888 and 3888) do not need to be opened.

>
>
> Also, what protocol is used (is IPC simple generic TCP?)
>
> TCP

-- 
// Jonathan Hsieh (shay)
// Software Engineer, Cloudera
// jon@cloudera.com