Insertion batch stoping for some reason at 100 records

[Alberto Velandia <be...@gmail.com>]

Hi i'm using Cassandra 0.6.8 and Fauna, I'm running a batch to populate my db and for some reason every time it gets to a 100 records it stops no error report or anything apparently it keeps storing but every time I count the number of records it stays in a hundred, it is updating two Column Families and one is updating fine.

any ideas?? this is driving me crazy!!! 

Re: Insertion batch stoping for some reason at 100 records

[Peter Schuller <pe...@infidyne.com>]

>> Makes perfect sense thanks, how can I set the Count limit for an specific Column Family?
>
> Looks like you can pass a :count option to get() (I just did a quick
> check, I haven't used the client myself). See cassandra.rb's
> documentation at the top.

... and that seems to apply to count_columns() too.

(Sorry for flooding the list so much today instead of being more
careful in posting to begin with.)

-- 
/ Peter Schuller

Re: Insertion batch stoping for some reason at 100 records

[Peter Schuller <pe...@infidyne.com>]

(Btw I said "row count" in my response; that was a poor choice of
words given that "row" has a specific meaning in Cassandra. I meant
column count.)

> Makes perfect sense thanks, how can I set the Count limit for an specific Column Family?

Looks like you can pass a :count option to get() (I just did a quick
check, I haven't used the client myself). See cassandra.rb's
documentation at the top.

-- 
/ Peter Schuller

Re: Insertion batch stoping for some reason at 100 records

[Alberto Velandia <be...@gmail.com>]

Makes perfect sense thanks, how can I set the Count limit for an specific Column Family? 

On Dec 14, 2010, at 3:47 PM, Peter Schuller wrote:

>> Hi i'm using Cassandra 0.6.8 and Fauna, I'm running a batch to populate my db and for some reason every time it gets to a 100 records it stops no error report or anything apparently it keeps storing but every time I count the number of records it stays in a hundred, it is updating two Column Families and one is updating fine.
>> 
>> any ideas?? this is driving me crazy!!!
> 
> It sounds like you're counting columns with a maximum row count of 100
> when you're testing how many have been inserted. The cost of counting
> rows is similar to the cost of retrieving them, so counts are subject
> to the same limits as regular retrievals. You cannot efficiently
> perform a count, but if you're willing to take the cost you can submit
> a count with a very high count limit in order to get the actual full
> count.
> 
> -- 
> / Peter Schuller

Re: Insertion batch stoping for some reason at 100 records

[Peter Schuller <pe...@infidyne.com>]

> Hi i'm using Cassandra 0.6.8 and Fauna, I'm running a batch to populate my db and for some reason every time it gets to a 100 records it stops no error report or anything apparently it keeps storing but every time I count the number of records it stays in a hundred, it is updating two Column Families and one is updating fine.
>
> any ideas?? this is driving me crazy!!!

It sounds like you're counting columns with a maximum row count of 100
when you're testing how many have been inserted. The cost of counting
rows is similar to the cost of retrieving them, so counts are subject
to the same limits as regular retrievals. You cannot efficiently
perform a count, but if you're willing to take the cost you can submit
a count with a very high count limit in order to get the actual full
count.

-- 
/ Peter Schuller