You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by "akshatbakliwal@gmail.com" <ak...@gmail.com> on 2011/01/20 14:02:48 UTC
Compression in Cassandra
Hi all,
I am experiencing a unique situation. I loaded some data onto Cassandra.
my data was about 40 GB but when loaded to Cassandra the data directory size
is almost 170GB.
This means the **data got inflated**.
Is it the case just with me or some else is also facing the inflation or its
the general behavior of Cassandra.
I am using Cassandra 0.6.8. on Ubuntu 10.10
--
Akshat Bakliwal
Search Information and Extraction Lab
IIIT-Hyderabad
09963885762
WebPage
<http://web.iiit.ac.in/%7Eakshat_b>
Re: Compression in Cassandra
Posted by Terje Marthinussen <tm...@gmail.com>.
Perfectly normal with 3-7x increase in data size depending on you data schema.
Regards,
Terje
On 20 Jan 2011, at 23:17, "akshatbakliwal@gmail.com" <ak...@gmail.com> wrote:
> I just did a du -h DataDump which showed 40G
> and du -h CassandraDataDump which showed 170G
>
> am i doing something wrong.
> have you observed some compression in it.
>
> On Thu, Jan 20, 2011 at 6:57 PM, Javier Canillas <ja...@gmail.com> wrote:
> How do you calculate your 40g data? When you insert it into Cassandra, you need to convert the data into a Byte[], maybe your problem is there.
>
>
> On Thu, Jan 20, 2011 at 10:02 AM, akshatbakliwal@gmail.com <ak...@gmail.com> wrote:
> Hi all,
>
> I am experiencing a unique situation. I loaded some data onto Cassandra.
> my data was about 40 GB but when loaded to Cassandra the data directory size is almost 170GB.
>
> This means the **data got inflated**.
>
> Is it the case just with me or some else is also facing the inflation or its the general behavior of Cassandra.
>
> I am using Cassandra 0.6.8. on Ubuntu 10.10
>
> --
> Akshat Bakliwal
> Search Information and Extraction Lab
> IIIT-Hyderabad
> 09963885762
> WebPage
>
>
>
>
>
> --
> Akshat Bakliwal
> Search Information and Extraction Lab
> IIIT-Hyderabad
> 09963885762
> WebPage
>
Re: Compression in Cassandra
Posted by "akshatbakliwal@gmail.com" <ak...@gmail.com>.
I just did a du -h DataDump which showed 40G
and du -h CassandraDataDump which showed 170G
am i doing something wrong.
have you observed some compression in it.
On Thu, Jan 20, 2011 at 6:57 PM, Javier Canillas
<ja...@gmail.com>wrote:
> How do you calculate your 40g data? When you insert it into Cassandra, you
> need to convert the data into a Byte[], maybe your problem is there.
>
>
> On Thu, Jan 20, 2011 at 10:02 AM, akshatbakliwal@gmail.com <
> akshatbakliwal@gmail.com> wrote:
>
>> Hi all,
>>
>> I am experiencing a unique situation. I loaded some data onto Cassandra.
>> my data was about 40 GB but when loaded to Cassandra the data directory
>> size is almost 170GB.
>>
>> This means the **data got inflated**.
>>
>> Is it the case just with me or some else is also facing the inflation or
>> its the general behavior of Cassandra.
>>
>> I am using Cassandra 0.6.8. on Ubuntu 10.10
>>
>> --
>> Akshat Bakliwal
>> Search Information and Extraction Lab
>> IIIT-Hyderabad
>> 09963885762
>> WebPage
>> <http://web.iiit.ac.in/%7Eakshat_b>
>>
>
>
--
Akshat Bakliwal
Search Information and Extraction Lab
IIIT-Hyderabad
09963885762
WebPage
<http://web.iiit.ac.in/%7Eakshat_b>
Re: Compression in Cassandra
Posted by Javier Canillas <ja...@gmail.com>.
How do you calculate your 40g data? When you insert it into Cassandra, you
need to convert the data into a Byte[], maybe your problem is there.
On Thu, Jan 20, 2011 at 10:02 AM, akshatbakliwal@gmail.com <
akshatbakliwal@gmail.com> wrote:
> Hi all,
>
> I am experiencing a unique situation. I loaded some data onto Cassandra.
> my data was about 40 GB but when loaded to Cassandra the data directory
> size is almost 170GB.
>
> This means the **data got inflated**.
>
> Is it the case just with me or some else is also facing the inflation or
> its the general behavior of Cassandra.
>
> I am using Cassandra 0.6.8. on Ubuntu 10.10
>
> --
> Akshat Bakliwal
> Search Information and Extraction Lab
> IIIT-Hyderabad
> 09963885762
> WebPage
> <http://web.iiit.ac.in/%7Eakshat_b>
>