You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Sasha Dolgy <sd...@gmail.com> on 2011/03/22 09:21:24 UTC
SSL & Streaming
Hi,
Is there documentation available anywhere that describes how one can
use org.apache.cassandra.security.streaming.* ? After the EC2 posts
yesterday, one question I was asked was about the security of data
being shifted between nodes. Is it done in clear text, or
encrypted..? I haven't seen anything to suggest that it's encrypted,
but see in the source that security.streaming does leverage SSL ...
Thanks in advance for some pointers to documentation.
Also, for anyone who is using SSL .. how much of a performance impact
have you noticed? Is it minimal or significant?
--
Sasha Dolgy
sasha.dolgy@gmail.com
Re: Cassandra Statistics and Metrics
Posted by Marcos Ortiz <ml...@uci.cu>.
We are thinking a Web 2.0 application, so Munin was not built with these
thougths in mind.
I will be reviewing the datadoghq site.
Regards
El 6/14/2011 10:23 AM, Dan Kuebrich escribió:
> Here's what people usually monitor from munin (and how they get at
> it): https://github.com/jbellis/cassandra-munin-plugins .
>
> Sounds a lot like what these guys are doing (even the stack?):
> http://datadoghq.com/
>
> On Tue, Jun 14, 2011 at 10:13 AM, Viktor Jevdokimov
> <vjevdokimov@gmail.com <ma...@gmail.com>>
>
> We're using open source monitoring solution Zabbix from
> http://www.zabbix.com/ using zapcat - not only for Cassandra but
> for the whole system.
>
> As MX4J tools plugin is supported by Cassandra, support of zapcat
> in Cassandra by default is welcome - we have to use a wrapper to
> start zapcat agent.
>
>
> 2011/6/14 Marcos Ortiz <mlortiz@uci.cu <ma...@uci.cu>>
>
> Regards to all.
> My team and me here on the University are working on a generic
> solution for Monitoring and Capacity Planning for Open Sources
> Databases, and one of the NoSQL db that we choosed to give it
> support is Cassandra.
> Where I can find all the metrics and statistics of Cassandra?
> I'm thinking for example:
> - Available space
> - Number of CF
> and all kind of metrics
>
> We are using for this development: Python + Django + Twisted +
> Orbited + jQuery. The idea behind is to build a Comet-based
> web application on top of these technologies.
> Any advice is welcome
>
> --
> Marcos Luís Ortíz Valmaseda
> Software Engineer (UCI)
> http://marcosluis2186.posterous.com
> http://twitter.com/marcosluis2186
>
>
>
--
Marcos Luís Ortíz Valmaseda
Software Engineer (UCI)
http://marcosluis2186.posterous.com
http://twitter.com/marcosluis2186
Re: Cassandra Statistics and Metrics
Posted by Dan Kuebrich <da...@gmail.com>.
Here's what people usually monitor from munin (and how they get at it):
https://github.com/jbellis/cassandra-munin-plugins .
Sounds a lot like what these guys are doing (even the stack?):
http://datadoghq.com/
On Tue, Jun 14, 2011 at 10:13 AM, Viktor Jevdokimov
<vj...@gmail.com>wrote:
> We're using open source monitoring solution Zabbix from
> http://www.zabbix.com/ using zapcat - not only for Cassandra but for the
> whole system.
>
> As MX4J tools plugin is supported by Cassandra, support of zapcat in
> Cassandra by default is welcome - we have to use a wrapper to start zapcat
> agent.
>
>
> 2011/6/14 Marcos Ortiz <ml...@uci.cu>
>
>> Regards to all.
>> My team and me here on the University are working on a generic solution
>> for Monitoring and Capacity Planning for Open Sources Databases, and one of
>> the NoSQL db that we choosed to give it support is Cassandra.
>> Where I can find all the metrics and statistics of Cassandra? I'm thinking
>> for example:
>> - Available space
>> - Number of CF
>> and all kind of metrics
>>
>> We are using for this development: Python + Django + Twisted + Orbited +
>> jQuery. The idea behind is to build a Comet-based web application on top of
>> these technologies.
>> Any advice is welcome
>>
>> --
>> Marcos Luís Ortíz Valmaseda
>> Software Engineer (UCI)
>> http://marcosluis2186.posterous.com
>> http://twitter.com/marcosluis2186
>>
>>
>
>
Re: Cassandra Statistics and Metrics
Posted by Héctor Izquierdo Seliva <iz...@strands.com>.
This is what I use:
http://code.google.com/p/simple-cassandra-monitoring/
Disclaimer: I did it myself, don't expect too much :P
El jue, 16-06-2011 a las 19:35 +0300, Viktor Jevdokimov escribió:
> There's possibility to use command line JMX client with standard
> Zabbix agent to request JMX counters without incorporating zapcat into
> Cassandra or another Java app.
> I'm investigating this feature right now, will post results when
> finish.
>
> 2011/6/15 Viktor Jevdokimov <vj...@gmail.com>
> http://www.kjkoster.org/zapcat/Zapcat_JMX_Zabbix_Bridge.html
>
>
>
> 2011/6/14 Marcos Ortiz <ml...@uci.cu>
> Where I can find the source code?
>
> El 6/14/2011 10:13 AM, Viktor Jevdokimov escribió:
>
> > We're using open source monitoring solution Zabbix
> > from http://www.zabbix.com/ using zapcat - not only
> > for Cassandra but for the whole system.
> >
> >
> > As MX4J tools plugin is supported by Cassandra,
> > support of zapcat in Cassandra by default is welcome
> > - we have to use a wrapper to start zapcat agent.
> >
> > 2011/6/14 Marcos Ortiz <ml...@uci.cu>
> > Regards to all.
> > My team and me here on the University are
> > working on a generic solution for Monitoring
> > and Capacity Planning for Open Sources
> > Databases, and one of the NoSQL db that we
> > choosed to give it support is Cassandra.
> > Where I can find all the metrics and
> > statistics of Cassandra? I'm thinking for
> > example:
> > - Available space
> > - Number of CF
> > and all kind of metrics
> >
> > We are using for this development: Python +
> > Django + Twisted + Orbited + jQuery. The
> > idea behind is to build a Comet-based web
> > application on top of these technologies.
> > Any advice is welcome
> >
> > --
> > Marcos Luís Ortíz Valmaseda
> > Software Engineer (UCI)
> > http://marcosluis2186.posterous.com
> > http://twitter.com/marcosluis2186
> >
> >
> >
>
> --
> Marcos Luís Ortíz Valmaseda
> Software Engineer (UCI)
> http://marcosluis2186.posterous.com
> http://twitter.com/marcosluis2186
>
>
>
>
>
Re: Cassandra Statistics and Metrics
Posted by Viktor Jevdokimov <vj...@gmail.com>.
There's possibility to use command line JMX client with standard Zabbix
agent to request JMX counters without incorporating zapcat into Cassandra or
another Java app.
I'm investigating this feature right now, will post results when finish.
2011/6/15 Viktor Jevdokimov <vj...@gmail.com>
> http://www.kjkoster.org/zapcat/Zapcat_JMX_Zabbix_Bridge.html
>
> 2011/6/14 Marcos Ortiz <ml...@uci.cu>
>
>> Where I can find the source code?
>>
>> El 6/14/2011 10:13 AM, Viktor Jevdokimov escribió:
>>
>> We're using open source monitoring solution Zabbix from
>> http://www.zabbix.com/ using zapcat - not only for Cassandra but for the
>> whole system.
>>
>> As MX4J tools plugin is supported by Cassandra, support of zapcat in
>> Cassandra by default is welcome - we have to use a wrapper to start zapcat
>> agent.
>>
>> 2011/6/14 Marcos Ortiz <ml...@uci.cu>
>>
>>> Regards to all.
>>> My team and me here on the University are working on a generic solution
>>> for Monitoring and Capacity Planning for Open Sources Databases, and one of
>>> the NoSQL db that we choosed to give it support is Cassandra.
>>> Where I can find all the metrics and statistics of Cassandra? I'm
>>> thinking for example:
>>> - Available space
>>> - Number of CF
>>> and all kind of metrics
>>>
>>> We are using for this development: Python + Django + Twisted + Orbited +
>>> jQuery. The idea behind is to build a Comet-based web application on top of
>>> these technologies.
>>> Any advice is welcome
>>>
>>> --
>>> Marcos Luís Ortíz Valmaseda
>>> Software Engineer (UCI)
>>> http://marcosluis2186.posterous.com
>>> http://twitter.com/marcosluis2186
>>>
>>>
>>
>>
>> --
>> Marcos Luís Ortíz Valmaseda
>> Software Engineer (UCI)
>> http://marcosluis2186.posterous.com
>> http://twitter.com/marcosluis2186
>>
>>
>
Re: Cassandra Statistics and Metrics
Posted by Viktor Jevdokimov <vj...@gmail.com>.
http://www.kjkoster.org/zapcat/Zapcat_JMX_Zabbix_Bridge.html
2011/6/14 Marcos Ortiz <ml...@uci.cu>
> Where I can find the source code?
>
> El 6/14/2011 10:13 AM, Viktor Jevdokimov escribió:
>
> We're using open source monitoring solution Zabbix from
> http://www.zabbix.com/ using zapcat - not only for Cassandra but for the
> whole system.
>
> As MX4J tools plugin is supported by Cassandra, support of zapcat in
> Cassandra by default is welcome - we have to use a wrapper to start zapcat
> agent.
>
> 2011/6/14 Marcos Ortiz <ml...@uci.cu>
>
>> Regards to all.
>> My team and me here on the University are working on a generic solution
>> for Monitoring and Capacity Planning for Open Sources Databases, and one of
>> the NoSQL db that we choosed to give it support is Cassandra.
>> Where I can find all the metrics and statistics of Cassandra? I'm thinking
>> for example:
>> - Available space
>> - Number of CF
>> and all kind of metrics
>>
>> We are using for this development: Python + Django + Twisted + Orbited +
>> jQuery. The idea behind is to build a Comet-based web application on top of
>> these technologies.
>> Any advice is welcome
>>
>> --
>> Marcos Luís Ortíz Valmaseda
>> Software Engineer (UCI)
>> http://marcosluis2186.posterous.com
>> http://twitter.com/marcosluis2186
>>
>>
>
>
> --
> Marcos Luís Ortíz Valmaseda
> Software Engineer (UCI)
> http://marcosluis2186.posterous.com
> http://twitter.com/marcosluis2186
>
>
Re: Cassandra Statistics and Metrics
Posted by Marcos Ortiz <ml...@uci.cu>.
Where I can find the source code?
El 6/14/2011 10:13 AM, Viktor Jevdokimov escribió:
> We're using open source monitoring solution Zabbix from
> http://www.zabbix.com/ using zapcat - not only for Cassandra but for
> the whole system.
>
> As MX4J tools plugin is supported by Cassandra, support of zapcat in
> Cassandra by default is welcome - we have to use a wrapper to start
> zapcat agent.
>
> 2011/6/14 Marcos Ortiz <mlortiz@uci.cu <ma...@uci.cu>>
>
> Regards to all.
> My team and me here on the University are working on a generic
> solution for Monitoring and Capacity Planning for Open Sources
> Databases, and one of the NoSQL db that we choosed to give it
> support is Cassandra.
> Where I can find all the metrics and statistics of Cassandra? I'm
> thinking for example:
> - Available space
> - Number of CF
> and all kind of metrics
>
> We are using for this development: Python + Django + Twisted +
> Orbited + jQuery. The idea behind is to build a Comet-based web
> application on top of these technologies.
> Any advice is welcome
>
> --
> Marcos Luís Ortíz Valmaseda
> Software Engineer (UCI)
> http://marcosluis2186.posterous.com
> http://twitter.com/marcosluis2186
>
>
--
Marcos Luís Ortíz Valmaseda
Software Engineer (UCI)
http://marcosluis2186.posterous.com
http://twitter.com/marcosluis2186
Re: Cassandra Statistics and Metrics
Posted by Viktor Jevdokimov <vj...@gmail.com>.
We're using open source monitoring solution Zabbix from
http://www.zabbix.com/ using zapcat - not only for Cassandra but for the
whole system.
As MX4J tools plugin is supported by Cassandra, support of zapcat in
Cassandra by default is welcome - we have to use a wrapper to start zapcat
agent.
2011/6/14 Marcos Ortiz <ml...@uci.cu>
> Regards to all.
> My team and me here on the University are working on a generic solution for
> Monitoring and Capacity Planning for Open Sources Databases, and one of the
> NoSQL db that we choosed to give it support is Cassandra.
> Where I can find all the metrics and statistics of Cassandra? I'm thinking
> for example:
> - Available space
> - Number of CF
> and all kind of metrics
>
> We are using for this development: Python + Django + Twisted + Orbited +
> jQuery. The idea behind is to build a Comet-based web application on top of
> these technologies.
> Any advice is welcome
>
> --
> Marcos Luís Ortíz Valmaseda
> Software Engineer (UCI)
> http://marcosluis2186.posterous.com
> http://twitter.com/marcosluis2186
>
>
Cassandra Statistics and Metrics
Posted by Marcos Ortiz <ml...@uci.cu>.
Regards to all.
My team and me here on the University are working on a generic solution
for Monitoring and Capacity Planning for Open Sources Databases, and one
of the NoSQL db that we choosed to give it support is Cassandra.
Where I can find all the metrics and statistics of Cassandra? I'm
thinking for example:
- Available space
- Number of CF
and all kind of metrics
We are using for this development: Python + Django + Twisted + Orbited +
jQuery. The idea behind is to build a Comet-based web application on top
of these technologies.
Any advice is welcome
--
Marcos Luís Ortíz Valmaseda
Software Engineer (UCI)
http://marcosluis2186.posterous.com
http://twitter.com/marcosluis2186
Re: SSL & Streaming
Posted by Sasha Dolgy <sd...@gmail.com>.
AJ was responding to an email I sent in March....although i do appreciate
the quick reaponse from the community ;) i moved on to our implementation of
vpn...
On Jun 14, 2011 1:35 AM, "aaron morton" <aa...@thelastpickle.com> wrote:
> Sasha does
https://github.com/apache/cassandra/blob/cassandra-0.8.0/conf/cassandra.yaml#L362help
?
>
> A
>
>
> -----------------
> Aaron Morton
> Freelance Cassandra Developer
> @aaronmorton
> http://www.thelastpickle.com
>
> On 13 Jun 2011, at 23:26, AJ wrote:
>
>> Performance-wise, I think it would be better to just let the client
encrypt sensitive data before storing it, versus encrypting all traffic all
the time. If individual values are encrypted, then they don't have to be
encrypted/decrypted during transit between nodes during the initial updates
as well as during the commissioning of a new node or other times.
>>
>> A drawback, however, is now you have to manage one or more keys for the
lifetime of the data. It will also complicate your data view interfaces.
However, if Cassandra had data encryption built-in somehow, that would solve
this problem... just thinking out loud.
>>
>> Can anyone think of other pro/cons of both strategies?
>>
>> On 3/22/2011 2:21 AM, Sasha Dolgy wrote:
>>> Hi,
>>>
>>> Is there documentation available anywhere that describes how one can
>>> use org.apache.cassandra.security.streaming.* ? After the EC2 posts
>>> yesterday, one question I was asked was about the security of data
>>> being shifted between nodes. Is it done in clear text, or
>>> encrypted..? I haven't seen anything to suggest that it's encrypted,
>>> but see in the source that security.streaming does leverage SSL ...
>>>
>>> Thanks in advance for some pointers to documentation.
>>>
>>> Also, for anyone who is using SSL .. how much of a performance impact
>>> have you noticed? Is it minimal or significant?
>>>
>>
>
Re: SSL & Streaming
Posted by aaron morton <aa...@thelastpickle.com>.
Sasha does https://github.com/apache/cassandra/blob/cassandra-0.8.0/conf/cassandra.yaml#L362 help ?
A
-----------------
Aaron Morton
Freelance Cassandra Developer
@aaronmorton
http://www.thelastpickle.com
On 13 Jun 2011, at 23:26, AJ wrote:
> Performance-wise, I think it would be better to just let the client encrypt sensitive data before storing it, versus encrypting all traffic all the time. If individual values are encrypted, then they don't have to be encrypted/decrypted during transit between nodes during the initial updates as well as during the commissioning of a new node or other times.
>
> A drawback, however, is now you have to manage one or more keys for the lifetime of the data. It will also complicate your data view interfaces. However, if Cassandra had data encryption built-in somehow, that would solve this problem... just thinking out loud.
>
> Can anyone think of other pro/cons of both strategies?
>
> On 3/22/2011 2:21 AM, Sasha Dolgy wrote:
>> Hi,
>>
>> Is there documentation available anywhere that describes how one can
>> use org.apache.cassandra.security.streaming.* ? After the EC2 posts
>> yesterday, one question I was asked was about the security of data
>> being shifted between nodes. Is it done in clear text, or
>> encrypted..? I haven't seen anything to suggest that it's encrypted,
>> but see in the source that security.streaming does leverage SSL ...
>>
>> Thanks in advance for some pointers to documentation.
>>
>> Also, for anyone who is using SSL .. how much of a performance impact
>> have you noticed? Is it minimal or significant?
>>
>
Re: SSL & Streaming
Posted by AJ <aj...@dude.podzone.net>.
Performance-wise, I think it would be better to just let the client
encrypt sensitive data before storing it, versus encrypting all traffic
all the time. If individual values are encrypted, then they don't have
to be encrypted/decrypted during transit between nodes during the
initial updates as well as during the commissioning of a new node or
other times.
A drawback, however, is now you have to manage one or more keys for the
lifetime of the data. It will also complicate your data view
interfaces. However, if Cassandra had data encryption built-in somehow,
that would solve this problem... just thinking out loud.
Can anyone think of other pro/cons of both strategies?
On 3/22/2011 2:21 AM, Sasha Dolgy wrote:
> Hi,
>
> Is there documentation available anywhere that describes how one can
> use org.apache.cassandra.security.streaming.* ? After the EC2 posts
> yesterday, one question I was asked was about the security of data
> being shifted between nodes. Is it done in clear text, or
> encrypted..? I haven't seen anything to suggest that it's encrypted,
> but see in the source that security.streaming does leverage SSL ...
>
> Thanks in advance for some pointers to documentation.
>
> Also, for anyone who is using SSL .. how much of a performance impact
> have you noticed? Is it minimal or significant?
>