You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by JKnight JKnight <be...@gmail.com> on 2011/06/09 17:13:06 UTC

Best way to import data from Cassandra 0.6 to 0.8

Dear all,

Could you tell me the best way to import data from Cassandra 0.6 to 0.8?
Thank you very much.

-- 
Best regards,
JKnight

Re: about the virtual memory

Posted by Jonathan Ellis <jb...@gmail.com>.
You should always disable swap on server machines.

On Fri, Jun 10, 2011 at 2:28 AM, Donna Li <do...@utstar.com> wrote:
>
>
> Hello all:
>
> Does cassandra use swap size? why the physical memory is 1200932k free , but
> swap size is 31472k used. My cassandra server is 32 bit and DiskAccessMode
> is standard.
>
>
>
> top - 09:58:58 up 17 days, 17:54, 10 users,  load average: 0.05, 0.08, 0.08
>
> Tasks:  76 total,   2 running,  74 sleeping,   0 stopped,   0 zombie
>
> Cpu(s):  0.3% us,  0.0% sy,  0.0% ni, 95.3% id,  0.0% wa,  4.3% hi,  0.0% si
>
> Mem:   2074776k total,   873844k used,  1200932k free,   231872k buffers
>
> Swap:  3911736k total,    31472k used,  3880264k free,   386028k cached
>
>   PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+
> COMMAND
>
> 27097 root      22   0  705m 146m 6368 S  0.3  7.2   0:18.48
> java
>
> 11984 root      16   0  382m  43m 2668 S  0.0  2.2   0:00.11
> psi
>
>  2430 root      19   0  408m  28m 3184 S  0.0  1.4   0:08.04
> java
>
> Best Regards
>
> Donna li



-- 
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of DataStax, the source for professional Cassandra support
http://www.datastax.com

about the virtual memory

Posted by Donna Li <do...@utstar.com>.
 

Hello all:

Does cassandra use swap size? why the physical memory is 1200932k free ,
but swap size is 31472k used. My cassandra server is 32 bit and
DiskAccessMode is standard.

 

top - 09:58:58 up 17 days, 17:54, 10 users,  load average: 0.05, 0.08,
0.08

Tasks:  76 total,   2 running,  74 sleeping,   0 stopped,   0 zombie

Cpu(s):  0.3% us,  0.0% sy,  0.0% ni, 95.3% id,  0.0% wa,  4.3% hi,
0.0% si

Mem:   2074776k total,   873844k used,  1200932k free,   231872k buffers

Swap:  3911736k total,    31472k used,  3880264k free,   386028k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND


27097 root      22   0  705m 146m 6368 S  0.3  7.2   0:18.48 java


11984 root      16   0  382m  43m 2668 S  0.0  2.2   0:00.11 psi


 2430 root      19   0  408m  28m 3184 S  0.0  1.4   0:08.04 java


Best Regards

Donna li


Re: toke range

Posted by Jonathan Ellis <jb...@gmail.com>.
That would be correct for SimpleStrategy.

On Fri, Jun 10, 2011 at 3:09 AM, Donna Li <do...@utstar.com> wrote:
>
>
> Hello all:
>
>          Cassandra use MD5 hash and we can get the token range such as:
>
> Address       Status     Load
> Range                                      Ring
>
>
> 142717619497548302610133488236729667990
>
> 10.63.59.71   Up         140.93 KB
> 38183556207930269037140083379529366016     |<--|
>
> 10.63.59.72   Up         133.91 KB
> 93623288409632417443453979080454166465     |   |
>
> 10.63.59.74   Up         178.93 KB
> 133908707295005027172461791030411347948    |   |
>
> 10.63.59.73   Up         100.74 KB
> 142717619497548302610133488236729667990    |-->|
>
>          If I insert a key donna, and MD5(donna) =
> 32FF0880C7C75D751D0F9EF3A816EAE2(hex) = 6.6373303140336465e+37(dec),
> 38183556207930269037140083379529366016     < 6.6373303140336465e+37 <
> 93623288409632417443453979080454166465,  so the key save in 10.63.59.72. If
> the replication is 3, the key is also saved in 10.63.59.74 and 10.63.59.73.
>  Am I right?
>
>
>
> Best Regards
>
> Donna li



-- 
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of DataStax, the source for professional Cassandra support
http://www.datastax.com

toke range

Posted by Donna Li <do...@utstar.com>.
 

Hello all:

         Cassandra use MD5 hash and we can get the token range such as:

Address       Status     Load          Range
Ring

 
142717619497548302610133488236729667990    

10.63.59.71   Up         140.93 KB
38183556207930269037140083379529366016     |<--|

10.63.59.72   Up         133.91 KB
93623288409632417443453979080454166465     |   |

10.63.59.74   Up         178.93 KB
133908707295005027172461791030411347948    |   |

10.63.59.73   Up         100.74 KB
142717619497548302610133488236729667990    |-->|

         If I insert a key donna, and MD5(donna) =
32FF0880C7C75D751D0F9EF3A816EAE2(hex) = 6.6373303140336465e+37(dec),
38183556207930269037140083379529366016     < 6.6373303140336465e+37 <
93623288409632417443453979080454166465,  so the key save in 10.63.59.72.
If the replication is 3, the key is also saved in 10.63.59.74 and
10.63.59.73.  Am I right?

 

Best Regards

Donna li


Re: Best way to import data from Cassandra 0.6 to 0.8

Posted by aaron morton <aa...@thelastpickle.com>.
If you are talking about an upgrade AFAIK 0.8 can read 0.6 SSTables, you will need to migrate the schema as described in the 0.7 upgrade info here 
https://github.com/apache/cassandra/blob/cassandra-0.7.6-2/NEWS.txt#L134

If you want to do a bulk dump / load take a look at sstable2json. 

Hope that helps. 
 
-----------------
Aaron Morton
Freelance Cassandra Developer
@aaronmorton
http://www.thelastpickle.com

On 10 Jun 2011, at 03:13, JKnight JKnight wrote:

> Dear all, 
> 
> Could you tell me the best way to import data from Cassandra 0.6 to 0.8? 
> Thank you very much.
> 
> -- 
> Best regards,
> JKnight