You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Jonathan Ellis <jb...@gmail.com> on 2012/01/24 04:46:54 UTC

Re: Cassandra performance question

Can you elaborate on to what exactly you were testing on the Cassandra
side?  It sounds like what this post refers to as "node" encryption
corresponds to enabling "internode_encryption: all", but I couldn't
guess what your client encryption is since Cassandra doesn't support
that out of the box yet.  (Which is highly relevant since that's where
most of the slowdown you observed comes from.)

On Fri, Dec 30, 2011 at 2:11 PM, Chris Marino <ch...@vcider.com> wrote:
> We did some benchmarking as well.
>
> http://blog.vcider.com/2011/09/virtual-networks-can-run-cassandra-up-to-60-faster/
>
> Although we were primarily interested in the networking issues....
>
> CM
>
>
> On Fri, Dec 30, 2011 at 12:08 PM, Jeremy Hanna <je...@gmail.com>
> wrote:
>>
>> This might be helpful:
>> http://techblog.netflix.com/2011/11/benchmarking-cassandra-scalability-on.html
>>
>> On Dec 30, 2011, at 1:59 PM, Dom Wong wrote:
>>
>> > Hi, could anyone tell me whether this is possible with Cassandra using
>> > an appropriately sized EC2 cluster.
>> >
>> > 100,000 clients writing 50k each to their own specific row at 5 second
>> > intervals?
>>
>



-- 
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of DataStax, the source for professional Cassandra support
http://www.datastax.com

Re: Cassandra performance question

Posted by Jonathan Ellis <jb...@gmail.com>.
No argument there.  Thanks for explaining what you were doing to
encrypt client traffic!

On Mon, Jan 23, 2012 at 10:11 PM, Chris Marino <ch...@vcider.com> wrote:
> Hi Jonathan, yes, when I say 'node encryption' I mean inter-Cassandra node
> encryption. When I say 'client encryption' I mean encrypted traffic from the
> Cassandra nodes to the clients. For these benchmarks we used the stress test
> client load generator.
>
> We ran test with no encryption, then with 'node only' and then again with
> both node and client encryption.
>
> Looking at the post again right now I realize that I never mention the
> client encryption technique.  My mistake.  We just used OpenVPN. We set it
> up on the client stress test machine and set up individual VPNs to each
> Cassandra node in the cluster.
>
> I tired to make it clear in my post where the performance gains
> were coming from. Didn't mean to confuse anyone. That said, if you're
> running in a public cloud and you want to encrypt, you've got to tackle the
> client traffic encryption problem as well so it seemed like performance
> gains that most could expect.
>
> CM
>
>
> On Mon, Jan 23, 2012 at 7:46 PM, Jonathan Ellis <jb...@gmail.com> wrote:
>>
>> Can you elaborate on to what exactly you were testing on the Cassandra
>> side?  It sounds like what this post refers to as "node" encryption
>> corresponds to enabling "internode_encryption: all", but I couldn't
>> guess what your client encryption is since Cassandra doesn't support
>> that out of the box yet.  (Which is highly relevant since that's where
>> most of the slowdown you observed comes from.)
>>
>> On Fri, Dec 30, 2011 at 2:11 PM, Chris Marino <ch...@vcider.com> wrote:
>> > We did some benchmarking as well.
>> >
>> >
>> > http://blog.vcider.com/2011/09/virtual-networks-can-run-cassandra-up-to-60-faster/
>> >
>> > Although we were primarily interested in the networking issues....
>> >
>> > CM
>> >
>> >
>> > On Fri, Dec 30, 2011 at 12:08 PM, Jeremy Hanna
>> > <je...@gmail.com>
>> > wrote:
>> >>
>> >> This might be helpful:
>> >>
>> >> http://techblog.netflix.com/2011/11/benchmarking-cassandra-scalability-on.html
>> >>
>> >> On Dec 30, 2011, at 1:59 PM, Dom Wong wrote:
>> >>
>> >> > Hi, could anyone tell me whether this is possible with Cassandra
>> >> > using
>> >> > an appropriately sized EC2 cluster.
>> >> >
>> >> > 100,000 clients writing 50k each to their own specific row at 5
>> >> > second
>> >> > intervals?
>> >>
>> >
>>
>>
>>
>> --
>> Jonathan Ellis
>> Project Chair, Apache Cassandra
>> co-founder of DataStax, the source for professional Cassandra support
>> http://www.datastax.com
>
>



-- 
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of DataStax, the source for professional Cassandra support
http://www.datastax.com

Re: Cassandra performance question

Posted by Chris Marino <ch...@vcider.com>.
Hi Jonathan, yes, when I say 'node encryption' I mean inter-Cassandra node
encryption. When I say 'client encryption' I mean encrypted traffic from
the Cassandra nodes to the clients. For these benchmarks we used the stress
test client load generator.

We ran test with no encryption, then with 'node only' and then again with
both node and client encryption.

Looking at the post again right now I realize that I never mention the
client encryption technique.  My mistake.  We just used OpenVPN. We set it
up on the client stress test machine and set up individual VPNs to each
Cassandra node in the cluster.

I tired to make it clear in my post where the performance gains
were coming from. Didn't mean to confuse anyone. That said, if you're
running in a public cloud and you want to encrypt, you've got to tackle the
client traffic encryption problem as well so it seemed like performance
gains that most could expect.

CM

On Mon, Jan 23, 2012 at 7:46 PM, Jonathan Ellis <jb...@gmail.com> wrote:

> Can you elaborate on to what exactly you were testing on the Cassandra
> side?  It sounds like what this post refers to as "node" encryption
> corresponds to enabling "internode_encryption: all", but I couldn't
> guess what your client encryption is since Cassandra doesn't support
> that out of the box yet.  (Which is highly relevant since that's where
> most of the slowdown you observed comes from.)
>
> On Fri, Dec 30, 2011 at 2:11 PM, Chris Marino <ch...@vcider.com> wrote:
> > We did some benchmarking as well.
> >
> >
> http://blog.vcider.com/2011/09/virtual-networks-can-run-cassandra-up-to-60-faster/
> >
> > Although we were primarily interested in the networking issues....
> >
> > CM
> >
> >
> > On Fri, Dec 30, 2011 at 12:08 PM, Jeremy Hanna <
> jeremy.hanna1234@gmail.com>
> > wrote:
> >>
> >> This might be helpful:
> >>
> http://techblog.netflix.com/2011/11/benchmarking-cassandra-scalability-on.html
> >>
> >> On Dec 30, 2011, at 1:59 PM, Dom Wong wrote:
> >>
> >> > Hi, could anyone tell me whether this is possible with Cassandra using
> >> > an appropriately sized EC2 cluster.
> >> >
> >> > 100,000 clients writing 50k each to their own specific row at 5 second
> >> > intervals?
> >>
> >
>
>
>
> --
> Jonathan Ellis
> Project Chair, Apache Cassandra
> co-founder of DataStax, the source for professional Cassandra support
> http://www.datastax.com
>