You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Tom van den Berge <to...@drillster.com> on 2013/12/03 12:25:58 UTC
How to measure data transfer between data centers?
Is there a way to know how much data is transferred between two nodes, or
more specifically, between two data centers?
I'm especially interested in how much data is being replicated from one
data center to another, to know how much of the available bandwidth is used.
Thanks,
Tom
Re: How to measure data transfer between data centers?
Posted by Hobin Yoon <ho...@gmail.com>.
I had the same requirement and modified iptraf to log traffic every second.
https://github.com/hobinyoon/iptraf-3.0.0.git
Hobin
On Thu, Dec 5, 2013 at 2:17 AM, Jason Wee <pe...@gmail.com> wrote:
> Hi,
>
> Will it be simpler to just measure the network interface of the node
> instead?
>
> /Jason
>
>
> On Thu, Dec 5, 2013 at 10:57 AM, Jacob Rhoden <ja...@me.com> wrote:
>
>>
>>
>> http://unix.stackexchange.com/questions/41765/traffic-stats-per-network-port
>>
>> ______________________________
>> Sent from iPhone
>>
>> On 5 Dec 2013, at 5:44 am, Tom van den Berge <to...@drillster.com> wrote:
>>
>> Hi Chris,
>>
>> I think streaming is used for repair tasks, bulk loading and that kind of
>> things, but not for regular replication traffic.
>>
>> I think you're right that I should look into network tools. I don't
>> think cassandra can supply this information.
>>
>> Thanks,
>> Tom
>>
>>
>> On Wed, Dec 4, 2013 at 6:08 PM, Chris Burroughs <
>> chris.burroughs@gmail.com> wrote:
>>
>>> https://wiki.apache.org/cassandra/Metrics has per node Streaming
>>> metrics that include total bytes/in out. That is only a small bit of what
>>> you want though.
>>>
>>> For total DC bandwidth it might be more straightforward to measure this
>>> at the router/switch/fancy-network-gear level.
>>>
>>>
>>> On 12/03/2013 06:25 AM, Tom van den Berge wrote:
>>>
>>>> Is there a way to know how much data is transferred between two nodes,
>>>> or
>>>> more specifically, between two data centers?
>>>>
>>>> I'm especially interested in how much data is being replicated from one
>>>> data center to another, to know how much of the available bandwidth is
>>>> used.
>>>>
>>>>
>>>> Thanks,
>>>> Tom
>>>>
>>>>
>>>
>>
>>
>> --
>>
>> Drillster BV
>> Middenburcht 136
>> 3452MT Vleuten
>> Netherlands
>>
>> +31 30 755 5330
>>
>> Open your free account at www.drillster.com
>>
>>
>
Re: How to measure data transfer between data centers?
Posted by Jason Wee <pe...@gmail.com>.
Hi,
Will it be simpler to just measure the network interface of the node
instead?
/Jason
On Thu, Dec 5, 2013 at 10:57 AM, Jacob Rhoden <ja...@me.com> wrote:
>
>
> http://unix.stackexchange.com/questions/41765/traffic-stats-per-network-port
>
> ______________________________
> Sent from iPhone
>
> On 5 Dec 2013, at 5:44 am, Tom van den Berge <to...@drillster.com> wrote:
>
> Hi Chris,
>
> I think streaming is used for repair tasks, bulk loading and that kind of
> things, but not for regular replication traffic.
>
> I think you're right that I should look into network tools. I don't think
> cassandra can supply this information.
>
> Thanks,
> Tom
>
>
> On Wed, Dec 4, 2013 at 6:08 PM, Chris Burroughs <chris.burroughs@gmail.com
> > wrote:
>
>> https://wiki.apache.org/cassandra/Metrics has per node Streaming metrics
>> that include total bytes/in out. That is only a small bit of what you want
>> though.
>>
>> For total DC bandwidth it might be more straightforward to measure this
>> at the router/switch/fancy-network-gear level.
>>
>>
>> On 12/03/2013 06:25 AM, Tom van den Berge wrote:
>>
>>> Is there a way to know how much data is transferred between two nodes, or
>>> more specifically, between two data centers?
>>>
>>> I'm especially interested in how much data is being replicated from one
>>> data center to another, to know how much of the available bandwidth is
>>> used.
>>>
>>>
>>> Thanks,
>>> Tom
>>>
>>>
>>
>
>
> --
>
> Drillster BV
> Middenburcht 136
> 3452MT Vleuten
> Netherlands
>
> +31 30 755 5330
>
> Open your free account at www.drillster.com
>
>
Re: How to measure data transfer between data centers?
Posted by Jacob Rhoden <ja...@me.com>.
http://unix.stackexchange.com/questions/41765/traffic-stats-per-network-port
______________________________
Sent from iPhone
> On 5 Dec 2013, at 5:44 am, Tom van den Berge <to...@drillster.com> wrote:
>
> Hi Chris,
>
> I think streaming is used for repair tasks, bulk loading and that kind of things, but not for regular replication traffic.
>
> I think you're right that I should look into network tools. I don't think cassandra can supply this information.
>
> Thanks,
> Tom
>
>
>> On Wed, Dec 4, 2013 at 6:08 PM, Chris Burroughs <ch...@gmail.com> wrote:
>> https://wiki.apache.org/cassandra/Metrics has per node Streaming metrics that include total bytes/in out. That is only a small bit of what you want though.
>>
>> For total DC bandwidth it might be more straightforward to measure this at the router/switch/fancy-network-gear level.
>>
>>
>>> On 12/03/2013 06:25 AM, Tom van den Berge wrote:
>>> Is there a way to know how much data is transferred between two nodes, or
>>> more specifically, between two data centers?
>>>
>>> I'm especially interested in how much data is being replicated from one
>>> data center to another, to know how much of the available bandwidth is used.
>>>
>>>
>>> Thanks,
>>> Tom
>
>
>
> --
>
> Drillster BV
> Middenburcht 136
> 3452MT Vleuten
> Netherlands
>
> +31 30 755 5330
>
> Open your free account at www.drillster.com
Re: How to measure data transfer between data centers?
Posted by Tom van den Berge <to...@drillster.com>.
Hi Chris,
I think streaming is used for repair tasks, bulk loading and that kind of
things, but not for regular replication traffic.
I think you're right that I should look into network tools. I don't think
cassandra can supply this information.
Thanks,
Tom
On Wed, Dec 4, 2013 at 6:08 PM, Chris Burroughs
<ch...@gmail.com>wrote:
> https://wiki.apache.org/cassandra/Metrics has per node Streaming metrics
> that include total bytes/in out. That is only a small bit of what you want
> though.
>
> For total DC bandwidth it might be more straightforward to measure this at
> the router/switch/fancy-network-gear level.
>
>
> On 12/03/2013 06:25 AM, Tom van den Berge wrote:
>
>> Is there a way to know how much data is transferred between two nodes, or
>> more specifically, between two data centers?
>>
>> I'm especially interested in how much data is being replicated from one
>> data center to another, to know how much of the available bandwidth is
>> used.
>>
>>
>> Thanks,
>> Tom
>>
>>
>
--
Drillster BV
Middenburcht 136
3452MT Vleuten
Netherlands
+31 30 755 5330
Open your free account at www.drillster.com
Re: How to measure data transfer between data centers?
Posted by Chris Burroughs <ch...@gmail.com>.
https://wiki.apache.org/cassandra/Metrics has per node Streaming metrics
that include total bytes/in out. That is only a small bit of what you
want though.
For total DC bandwidth it might be more straightforward to measure this
at the router/switch/fancy-network-gear level.
On 12/03/2013 06:25 AM, Tom van den Berge wrote:
> Is there a way to know how much data is transferred between two nodes, or
> more specifically, between two data centers?
>
> I'm especially interested in how much data is being replicated from one
> data center to another, to know how much of the available bandwidth is used.
>
>
> Thanks,
> Tom
>