You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Deno Vichas <de...@syncopated.net> on 2012/06/28 21:02:52 UTC
Re: hector timeouts
On 6/28/2012 9:37 AM, David Leimbach wrote:
>
> That coupled with Hector timeout issues became a real problem for us.
could you share some details on this? we're using hector and we see
random timeout warns in the logs and not sure how to address them.
thanks,
deno
Re: hector timeouts
Posted by Joe Stein <cr...@gmail.com>.
lots of folks use Apache Kafka, check out
https://cwiki.apache.org/confluence/display/KAFKA/Powered+By just to name a
few
you can read about the performance for yourself
http://incubator.apache.org/kafka/performance.html
@ http://www.medialets.com we use Kafka upstream of Cassandra acting like a
queue so our workers can do their business logic prior to storing their
results in Cassandra, Hadoop & MySQL
this decouples our backend analytics from our forwarding facing system
keeping our forward facing system (ad serving to mobile devices) as fast as
possible and our backend results near realtime (seconds from data coming in)
here are some papers and presentations
https://cwiki.apache.org/confluence/display/KAFKA/Kafka+papers+and+presentations
On Mon, Jul 2, 2012 at 10:09 PM, Deno Vichas <de...@syncopated.net> wrote:
> is anybody using kafka? what other options is there? currently i need
> to do around 50,000 (is that a lot?) a minute.
>
>
> On 7/1/2012 11:39 AM, aaron morton wrote:
>
> Using Cassandra as a queue is generally thought of as a bas idea, owing to
> the high delete workload. Levelled compaction handles it better but it is
> still no the best approach.
>
> Depending on your needs consider running
> http://incubator.apache.org/kafka/
>
> could you share some details on this? we're using hector and we see
> random timeout warns in the logs and not sure how to address them.
>
> First determine if they are server side or client side timeouts. Then
> determine what the query was.
>
> Cheers
>
> -----------------
> Aaron Morton
> Freelance Developer
> @aaronmorton
> http://www.thelastpickle.com
>
> On 29/06/2012, at 7:02 AM, Deno Vichas wrote:
>
> On 6/28/2012 9:37 AM, David Leimbach wrote:
>
>
> That coupled with Hector timeout issues became a real problem for us.
>
>
> could you share some details on this? we're using hector and we see
> random timeout warns in the logs and not sure how to address them.
>
>
> thanks,
> deno
>
>
>
>
>
--
/*
Joe Stein
http://www.linkedin.com/in/charmalloc
Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
*/
Re: hector timeouts
Posted by Deno Vichas <de...@syncopated.net>.
is anybody using kafka? what other options is there? currently i need
to do around 50,000 (is that a lot?) a minute.
On 7/1/2012 11:39 AM, aaron morton wrote:
> Using Cassandra as a queue is generally thought of as a bas idea,
> owing to the high delete workload. Levelled compaction handles it
> better but it is still no the best approach.
>
> Depending on your needs consider running
> http://incubator.apache.org/kafka/
>
>> could you share some details on this? we're using hector and we see
>> random timeout warns in the logs and not sure how to address them.
> First determine if they are server side or client side timeouts. Then
> determine what the query was.
>
> Cheers
>
> -----------------
> Aaron Morton
> Freelance Developer
> @aaronmorton
> http://www.thelastpickle.com
>
> On 29/06/2012, at 7:02 AM, Deno Vichas wrote:
>
>> On 6/28/2012 9:37 AM, David Leimbach wrote:
>>>
>>> That coupled with Hector timeout issues became a real problem for us.
>>
>> could you share some details on this? we're using hector and we see
>> random timeout warns in the logs and not sure how to address them.
>>
>>
>> thanks,
>> deno
>
Re: hector timeouts
Posted by aaron morton <aa...@thelastpickle.com>.
Using Cassandra as a queue is generally thought of as a bas idea, owing to the high delete workload. Levelled compaction handles it better but it is still no the best approach.
Depending on your needs consider running http://incubator.apache.org/kafka/
> could you share some details on this? we're using hector and we see random timeout warns in the logs and not sure how to address them.
First determine if they are server side or client side timeouts. Then determine what the query was.
Cheers
-----------------
Aaron Morton
Freelance Developer
@aaronmorton
http://www.thelastpickle.com
On 29/06/2012, at 7:02 AM, Deno Vichas wrote:
> On 6/28/2012 9:37 AM, David Leimbach wrote:
>>
>> That coupled with Hector timeout issues became a real problem for us.
>
> could you share some details on this? we're using hector and we see random timeout warns in the logs and not sure how to address them.
>
>
> thanks,
> deno