You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by yangyangyyy <te...@gmail.com> on 2011/05/21 01:35:18 UTC
Re: RTG/MRTG/Cricket replacement using Cassandra?
hi Ryan:
Thanks for the link.
I read the slides, could you please provide some more details on how the
temporal aggregation is implemented?
do you use time+granularity as the key ? or as column names ?
Thanks
Yang
In reply to this post by Aaron Turner
We have a solution for time series data on cassandra at Twitter that
we'd like to open source, but it requires 0.8/trunk so we're not going
to release it until that's stable.
See
http://www.slideshare.net/kevinweil/rainbird-realtime-analytics-at-twitter-strata-2011
-ryan
On Thu, Mar 31, 2011 at 3:56 PM, Aaron Turner <[hidden email]> wrote:
> I've been looking at replacing our PostgreSQL backend for RTG (a SNMP
> based polling and graphing solution for network traffic/ports) with
> something using Cassandra in order to solve our scalability and
> redundancy requirements. Based on a lot of what I've read, Cassandra
> is an ideal data store for this time series data. In fact, Eric
> Evans in his presentation on the Cassandra home page suggests that
> this kind of use case is perfect for Cassandra.
>
> So this got me wondering if someone had already come up with a CF
> model for this kind of data, including daily/weekly/monthly/yearly
> rollups. Perhaps there's even an open source project or two
> implementing this sorta thing? I've found flewton
> (https://github.com/flewton/flewton), which is possibly relevant, but
> my Java skills are pretty non-existent so I'm having a hard time
> figuring it out.
>
> Thanks,
> Aaron
>
> --
> Aaron Turner
> http://synfin.net/ http://synfin.net/ Twitter: @synfinatic
> http://tcpreplay.synfin.net/ - Pcap editing and replay tools for Unix &
> Windows
> Those who would give up essential Liberty, to purchase a little temporary
> Safety, deserve neither Liberty nor Safety.
> -- Benjamin Franklin
> "carpe diem quam minimum credula postero"
>
... [show rest of quote]
--
View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/RTG-MRTG-Cricket-replacement-using-Cassandra-tp6229322p6388192.html
Sent from the cassandra-user@incubator.apache.org mailing list archive at Nabble.com.
Re: RTG/MRTG/Cricket replacement using Cassandra?
Posted by David Hawthorne <dh...@3crowd.com>.
Have you looked at graphite? It would be very cool to see graphite using cassandra as a backend, and then to have cacti feeding data into cassandra.
On May 20, 2011, at 4:48 PM, Edward Capriolo wrote:
> The first love of my open life was cacti. I am going to discuss with
> them porting some of the system to cassandra.
>
> On Friday, May 20, 2011, yangyangyyy <te...@gmail.com> wrote:
>> hi Ryan:
>>
>>
>> Thanks for the link.
>> I read the slides, could you please provide some more details on how the
>> temporal aggregation is implemented?
>> do you use time+granularity as the key ? or as column names ?
>>
>> Thanks
>> Yang
>>
>> In reply to this post by Aaron Turner
>> We have a solution for time series data on cassandra at Twitter that
>> we'd like to open source, but it requires 0.8/trunk so we're not going
>> to release it until that's stable.
>>
>> See
>> http://www.slideshare.net/kevinweil/rainbird-realtime-analytics-at-twitter-strata-2011
>>
>> -ryan
>>
>> On Thu, Mar 31, 2011 at 3:56 PM, Aaron Turner <[hidden email]> wrote:
>>
>>> I've been looking at replacing our PostgreSQL backend for RTG (a SNMP
>>> based polling and graphing solution for network traffic/ports) with
>>> something using Cassandra in order to solve our scalability and
>>> redundancy requirements. Based on a lot of what I've read, Cassandra
>>> is an ideal data store for this time series data. In fact, Eric
>>> Evans in his presentation on the Cassandra home page suggests that
>>> this kind of use case is perfect for Cassandra.
>>>
>>> So this got me wondering if someone had already come up with a CF
>>> model for this kind of data, including daily/weekly/monthly/yearly
>>> rollups. Perhaps there's even an open source project or two
>>> implementing this sorta thing? I've found flewton
>>> (https://github.com/flewton/flewton), which is possibly relevant, but
>>> my Java skills are pretty non-existent so I'm having a hard time
>>> figuring it out.
>>>
>>> Thanks,
>>> Aaron
>>>
>>> --
>>> Aaron Turner
>>> http://synfin.net/ http://synfin.net/ Twitter: @synfinatic
>>> http://tcpreplay.synfin.net/ - Pcap editing and replay tools for Unix &
>>> Windows
>>> Those who would give up essential Liberty, to purchase a little temporary
>>> Safety, deserve neither Liberty nor Safety.
>>> -- Benjamin Franklin
>>> "carpe diem quam minimum credula postero"
>>>
>> ... [show rest of quote]
>>
>> --
>> View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/RTG-MRTG-Cricket-replacement-using-Cassandra-tp6229322p6388192.html
>> Sent from the cassandra-user@incubator.apache.org mailing list archive at Nabble.com.
>>
Re: RTG/MRTG/Cricket replacement using Cassandra?
Posted by Edward Capriolo <ed...@gmail.com>.
The first love of my open life was cacti. I am going to discuss with
them porting some of the system to cassandra.
On Friday, May 20, 2011, yangyangyyy <te...@gmail.com> wrote:
> hi Ryan:
>
>
> Thanks for the link.
> I read the slides, could you please provide some more details on how the
> temporal aggregation is implemented?
> do you use time+granularity as the key ? or as column names ?
>
> Thanks
> Yang
>
> In reply to this post by Aaron Turner
> We have a solution for time series data on cassandra at Twitter that
> we'd like to open source, but it requires 0.8/trunk so we're not going
> to release it until that's stable.
>
> See
> http://www.slideshare.net/kevinweil/rainbird-realtime-analytics-at-twitter-strata-2011
>
> -ryan
>
> On Thu, Mar 31, 2011 at 3:56 PM, Aaron Turner <[hidden email]> wrote:
>
>> I've been looking at replacing our PostgreSQL backend for RTG (a SNMP
>> based polling and graphing solution for network traffic/ports) with
>> something using Cassandra in order to solve our scalability and
>> redundancy requirements. Based on a lot of what I've read, Cassandra
>> is an ideal data store for this time series data. In fact, Eric
>> Evans in his presentation on the Cassandra home page suggests that
>> this kind of use case is perfect for Cassandra.
>>
>> So this got me wondering if someone had already come up with a CF
>> model for this kind of data, including daily/weekly/monthly/yearly
>> rollups. Perhaps there's even an open source project or two
>> implementing this sorta thing? I've found flewton
>> (https://github.com/flewton/flewton), which is possibly relevant, but
>> my Java skills are pretty non-existent so I'm having a hard time
>> figuring it out.
>>
>> Thanks,
>> Aaron
>>
>> --
>> Aaron Turner
>> http://synfin.net/ http://synfin.net/ Twitter: @synfinatic
>> http://tcpreplay.synfin.net/ - Pcap editing and replay tools for Unix &
>> Windows
>> Those who would give up essential Liberty, to purchase a little temporary
>> Safety, deserve neither Liberty nor Safety.
>> -- Benjamin Franklin
>> "carpe diem quam minimum credula postero"
>>
> ... [show rest of quote]
>
> --
> View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/RTG-MRTG-Cricket-replacement-using-Cassandra-tp6229322p6388192.html
> Sent from the cassandra-user@incubator.apache.org mailing list archive at Nabble.com.
>
Re: RTG/MRTG/Cricket replacement using Cassandra?
Posted by Edward Capriolo <ed...@gmail.com>.
I have tried to re-open the distributed polling and data collection topic
pitching Cassandra as an alternative.
http://forums.cacti.net/viewtopic.php?f=7&t=24869&p=212010#p212010
On Fri, May 20, 2011 at 7:35 PM, yangyangyyy <te...@gmail.com> wrote:
> hi Ryan:
>
>
> Thanks for the link.
> I read the slides, could you please provide some more details on how the
> temporal aggregation is implemented?
> do you use time+granularity as the key ? or as column names ?
>
> Thanks
> Yang
>
> In reply to this post by Aaron Turner
> We have a solution for time series data on cassandra at Twitter that
> we'd like to open source, but it requires 0.8/trunk so we're not going
> to release it until that's stable.
>
> See
>
> http://www.slideshare.net/kevinweil/rainbird-realtime-analytics-at-twitter-strata-2011
>
> -ryan
>
> On Thu, Mar 31, 2011 at 3:56 PM, Aaron Turner <[hidden email]> wrote:
>
> > I've been looking at replacing our PostgreSQL backend for RTG (a SNMP
> > based polling and graphing solution for network traffic/ports) with
> > something using Cassandra in order to solve our scalability and
> > redundancy requirements. Based on a lot of what I've read, Cassandra
> > is an ideal data store for this time series data. In fact, Eric
> > Evans in his presentation on the Cassandra home page suggests that
> > this kind of use case is perfect for Cassandra.
> >
> > So this got me wondering if someone had already come up with a CF
> > model for this kind of data, including daily/weekly/monthly/yearly
> > rollups. Perhaps there's even an open source project or two
> > implementing this sorta thing? I've found flewton
> > (https://github.com/flewton/flewton), which is possibly relevant, but
> > my Java skills are pretty non-existent so I'm having a hard time
> > figuring it out.
> >
> > Thanks,
> > Aaron
> >
> > --
> > Aaron Turner
> > http://synfin.net/ http://synfin.net/ Twitter: @synfinatic
> > http://tcpreplay.synfin.net/ - Pcap editing and replay tools for Unix &
> > Windows
> > Those who would give up essential Liberty, to purchase a little temporary
> > Safety, deserve neither Liberty nor Safety.
> > -- Benjamin Franklin
> > "carpe diem quam minimum credula postero"
> >
> ... [show rest of quote]
>
> --
> View this message in context:
> http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/RTG-MRTG-Cricket-replacement-using-Cassandra-tp6229322p6388192.html
> Sent from the cassandra-user@incubator.apache.org mailing list archive at
> Nabble.com.
>