You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by CPC <ac...@gmail.com> on 2017/07/07 17:28:41 UTC
private interface for interdc messaging
Hi,
We are building 2 datacenters with each machine have one public(for native
client connections) and one for private(internode communication). What we
noticed that nodes in one datacenters trying to communicate with other
nodes in other dc over their public interfaces.
I mean:
DC1 Node1 public interface -> DC2 Node1 private interface
But what we perefer is:
DC1 Node1 private interface -> DC2 Node1 private interface
Is there any configuration so a node make interdc connection over its
private network?
Thank you...
Re: private interface for interdc messaging
Posted by Nitan Kainth <ni...@bamlabs.com>.
Did your network team setup route?
Can you run traceroute and see?
Sent from my iPhone
> On Jul 10, 2017, at 2:12 AM, CPC <ac...@gmail.com> wrote:
>
> Hi,
>
> setting broadcast adress does not resolve problem. We still saw interdc traffic like below:
> dc1 public => dc2 private
>
> traffic. We we want is:
>
> dc1 private => dc2 private
>
> Any idea? Also could it be related to https://issues.apache.org/jira/browse/CASSANDRA-12673. Any idea?
>
>> On 7 July 2017 at 21:51, CPC <ac...@gmail.com> wrote:
>> Thank you Nitan.
>>
>>
>> On Jul 7, 2017 8:59 PM, "Nitan Kainth" <ni...@bamlabs.com> wrote:
>> Yes. Because that's the ip used for internode communication
>>
>> Sent from my iPhone
>>
>>> On Jul 7, 2017, at 10:52 AM, CPC <ac...@gmail.com> wrote:
>>>
>>> Hi Nitan,
>>>
>>> Do you mean setting broadcast_address to private network would suffice?
>>>
>>>> On 7 July 2017 at 20:45, Nitan Kainth <ni...@bamlabs.com> wrote:
>>>> You can setup broadcast address for the IP on which Nodes will communicate with each other. You network team can setup routing table from source to target.
>>>> We had similar setup done in one of my previous project where we segregated network between application and C* nodes communication.
>>>>
>>>> > On Jul 7, 2017, at 10:28 AM, CPC <ac...@gmail.com> wrote:
>>>> >
>>>> > Hi,
>>>> >
>>>> > We are building 2 datacenters with each machine have one public(for native client connections) and one for private(internode communication). What we noticed that nodes in one datacenters trying to communicate with other nodes in other dc over their public interfaces.
>>>> > I mean:
>>>> > DC1 Node1 public interface -> DC2 Node1 private interface
>>>> > But what we perefer is:
>>>> > DC1 Node1 private interface -> DC2 Node1 private interface
>>>> >
>>>> > Is there any configuration so a node make interdc connection over its private network?
>>>> >
>>>> > Thank you...
>>>>
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: user-unsubscribe@cassandra.apache.org
>>>> For additional commands, e-mail: user-help@cassandra.apache.org
>>>>
>>>
>>
>
Re: private interface for interdc messaging
Posted by CPC <ac...@gmail.com>.
Hi,
setting broadcast adress does not resolve problem. We still saw interdc
traffic like below:
dc1 public => dc2 private
traffic. We we want is:
dc1 private => dc2 private
Any idea? Also could it be related to
https://issues.apache.org/jira/browse/CASSANDRA-12673. Any idea?
On 7 July 2017 at 21:51, CPC <ac...@gmail.com> wrote:
> Thank you Nitan.
>
>
> On Jul 7, 2017 8:59 PM, "Nitan Kainth" <ni...@bamlabs.com> wrote:
>
> Yes. Because that's the ip used for internode communication
>
> Sent from my iPhone
>
> On Jul 7, 2017, at 10:52 AM, CPC <ac...@gmail.com> wrote:
>
> Hi Nitan,
>
> Do you mean setting broadcast_address to private network would suffice?
>
> On 7 July 2017 at 20:45, Nitan Kainth <ni...@bamlabs.com> wrote:
>
>> You can setup broadcast address for the IP on which Nodes will
>> communicate with each other. You network team can setup routing table from
>> source to target.
>> We had similar setup done in one of my previous project where we
>> segregated network between application and C* nodes communication.
>>
>> > On Jul 7, 2017, at 10:28 AM, CPC <ac...@gmail.com> wrote:
>> >
>> > Hi,
>> >
>> > We are building 2 datacenters with each machine have one public(for
>> native client connections) and one for private(internode communication).
>> What we noticed that nodes in one datacenters trying to communicate with
>> other nodes in other dc over their public interfaces.
>> > I mean:
>> > DC1 Node1 public interface -> DC2 Node1 private interface
>> > But what we perefer is:
>> > DC1 Node1 private interface -> DC2 Node1 private interface
>> >
>> > Is there any configuration so a node make interdc connection over its
>> private network?
>> >
>> > Thank you...
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@cassandra.apache.org
>> For additional commands, e-mail: user-help@cassandra.apache.org
>>
>>
>
>
Re: private interface for interdc messaging
Posted by CPC <ac...@gmail.com>.
Thank you Nitan.
On Jul 7, 2017 8:59 PM, "Nitan Kainth" <ni...@bamlabs.com> wrote:
Yes. Because that's the ip used for internode communication
Sent from my iPhone
On Jul 7, 2017, at 10:52 AM, CPC <ac...@gmail.com> wrote:
Hi Nitan,
Do you mean setting broadcast_address to private network would suffice?
On 7 July 2017 at 20:45, Nitan Kainth <ni...@bamlabs.com> wrote:
> You can setup broadcast address for the IP on which Nodes will communicate
> with each other. You network team can setup routing table from source to
> target.
> We had similar setup done in one of my previous project where we
> segregated network between application and C* nodes communication.
>
> > On Jul 7, 2017, at 10:28 AM, CPC <ac...@gmail.com> wrote:
> >
> > Hi,
> >
> > We are building 2 datacenters with each machine have one public(for
> native client connections) and one for private(internode communication).
> What we noticed that nodes in one datacenters trying to communicate with
> other nodes in other dc over their public interfaces.
> > I mean:
> > DC1 Node1 public interface -> DC2 Node1 private interface
> > But what we perefer is:
> > DC1 Node1 private interface -> DC2 Node1 private interface
> >
> > Is there any configuration so a node make interdc connection over its
> private network?
> >
> > Thank you...
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@cassandra.apache.org
> For additional commands, e-mail: user-help@cassandra.apache.org
>
>
Re: private interface for interdc messaging
Posted by Nitan Kainth <ni...@bamlabs.com>.
Yes. Because that's the ip used for internode communication
Sent from my iPhone
> On Jul 7, 2017, at 10:52 AM, CPC <ac...@gmail.com> wrote:
>
> Hi Nitan,
>
> Do you mean setting broadcast_address to private network would suffice?
>
>> On 7 July 2017 at 20:45, Nitan Kainth <ni...@bamlabs.com> wrote:
>> You can setup broadcast address for the IP on which Nodes will communicate with each other. You network team can setup routing table from source to target.
>> We had similar setup done in one of my previous project where we segregated network between application and C* nodes communication.
>>
>> > On Jul 7, 2017, at 10:28 AM, CPC <ac...@gmail.com> wrote:
>> >
>> > Hi,
>> >
>> > We are building 2 datacenters with each machine have one public(for native client connections) and one for private(internode communication). What we noticed that nodes in one datacenters trying to communicate with other nodes in other dc over their public interfaces.
>> > I mean:
>> > DC1 Node1 public interface -> DC2 Node1 private interface
>> > But what we perefer is:
>> > DC1 Node1 private interface -> DC2 Node1 private interface
>> >
>> > Is there any configuration so a node make interdc connection over its private network?
>> >
>> > Thank you...
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@cassandra.apache.org
>> For additional commands, e-mail: user-help@cassandra.apache.org
>>
>
Re: private interface for interdc messaging
Posted by CPC <ac...@gmail.com>.
Hi Nitan,
Do you mean setting broadcast_address to private network would suffice?
On 7 July 2017 at 20:45, Nitan Kainth <ni...@bamlabs.com> wrote:
> You can setup broadcast address for the IP on which Nodes will communicate
> with each other. You network team can setup routing table from source to
> target.
> We had similar setup done in one of my previous project where we
> segregated network between application and C* nodes communication.
>
> > On Jul 7, 2017, at 10:28 AM, CPC <ac...@gmail.com> wrote:
> >
> > Hi,
> >
> > We are building 2 datacenters with each machine have one public(for
> native client connections) and one for private(internode communication).
> What we noticed that nodes in one datacenters trying to communicate with
> other nodes in other dc over their public interfaces.
> > I mean:
> > DC1 Node1 public interface -> DC2 Node1 private interface
> > But what we perefer is:
> > DC1 Node1 private interface -> DC2 Node1 private interface
> >
> > Is there any configuration so a node make interdc connection over its
> private network?
> >
> > Thank you...
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@cassandra.apache.org
> For additional commands, e-mail: user-help@cassandra.apache.org
>
>
Re: private interface for interdc messaging
Posted by Nitan Kainth <ni...@bamlabs.com>.
You can setup broadcast address for the IP on which Nodes will communicate with each other. You network team can setup routing table from source to target.
We had similar setup done in one of my previous project where we segregated network between application and C* nodes communication.
> On Jul 7, 2017, at 10:28 AM, CPC <ac...@gmail.com> wrote:
>
> Hi,
>
> We are building 2 datacenters with each machine have one public(for native client connections) and one for private(internode communication). What we noticed that nodes in one datacenters trying to communicate with other nodes in other dc over their public interfaces.
> I mean:
> DC1 Node1 public interface -> DC2 Node1 private interface
> But what we perefer is:
> DC1 Node1 private interface -> DC2 Node1 private interface
>
> Is there any configuration so a node make interdc connection over its private network?
>
> Thank you...
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@cassandra.apache.org
For additional commands, e-mail: user-help@cassandra.apache.org
Re: private interface for interdc messaging
Posted by Anuj Wadehra <an...@yahoo.co.in.INVALID>.
Hi,
I am not sure why you would want to connect clients on public interface. Are you making db calls from clients outside the DC?
Also, not sure why you expect two DCs to communicate on private networks unless they are two logical DCs within same physical DC.
Generally, you configure multi dc setup in yaml as follows:
-use GossipingPropertyFileSnitch and set prefer_local to true in cassandra-rackdc.properties. This would ensure that local node to node communication within a dc happens on private.
-set Rpc_address to private ip so that clients connect to private interface.
-set listen_address to private IP. Cassandra would communicate to nodes in local dc using this address.
-set broadcast_address to public ip.Cassandra would communicate to nodes in other dc using this address.
-set listen_on_broadcast_address to true
ThanksAnuj
On Fri, 7 Jul 2017 at 22:58, CPC<ac...@gmail.com> wrote: Hi,
We are building 2 datacenters with each machine have one public(for native client connections) and one for private(internode communication). What we noticed that nodes in one datacenters trying to communicate with other nodes in other dc over their public interfaces. I mean:DC1 Node1 public interface -> DC2 Node1 private interfaceBut what we perefer is:DC1 Node1 private interface -> DC2 Node1 private interface
Is there any configuration so a node make interdc connection over its private network?
Thank you...