You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Simon Majou <si...@majou.org> on 2013/06/20 10:43:40 UTC

Get fragments of big files (videos)

Hello,

If I store a video into a column, how can I get a fragment of it
without having to download it entirely ? Is there a way to give an
offset on a column ?

Do I have to fragment it over a lot of small fixed sizes columns ? Is
there any disadvantage to do so ? For example fragment a 10GB file
into 1 000 columns of 10 MB ?

Simon

Re: Get fragments of big files (videos)

Posted by aaron morton <aa...@thelastpickle.com>.
You should split the large blobs into multiple rows, and I would use 10MB per row as a good rule of thumb. 

See http://www.datastax.com/dev/blog/cassandra-file-system-design for a description of blob store in cassandra

Cheers

-----------------
Aaron Morton
Freelance Cassandra Consultant
New Zealand

@aaronmorton
http://www.thelastpickle.com

On 20/06/2013, at 8:54 PM, Simon Majou <si...@majou.org> wrote:

> Thanks Serge
> 
> Simon
> 
> 
> On Thu, Jun 20, 2013 at 10:48 AM, Serge Fonville
> <se...@gmail.com> wrote:
>> Also, after a quick Google.
>> 
>> http://wiki.apache.org/cassandra/CassandraLimitations states values cannot
>> exceed 2GB, it also answers you offset question
>> 
>> HTH
>> Kind regards/met vriendelijke groet,
>> 
>> Serge Fonville
>> 
>> http://www.sergefonville.nl
>> 
>> Convince Microsoft!
>> They need to add TRUNCATE PARTITION in SQL Server
>> https://connect.microsoft.com/SQLServer/feedback/details/417926/truncate-partition-of-partitioned-table
>> 
>> 
>> 2013/6/20 Sachin Sinha <si...@gmail.com>
>>> 
>>> Fragment them in rows, that will help.
>>> 
>>> 
>>> On 20 June 2013 09:43, Simon Majou <si...@majou.org> wrote:
>>>> 
>>>> Hello,
>>>> 
>>>> If I store a video into a column, how can I get a fragment of it
>>>> without having to download it entirely ? Is there a way to give an
>>>> offset on a column ?
>>>> 
>>>> Do I have to fragment it over a lot of small fixed sizes columns ? Is
>>>> there any disadvantage to do so ? For example fragment a 10GB file
>>>> into 1 000 columns of 10 MB ?
>>>> 
>>>> Simon
>>> 
>>> 
>> 


Re: Get fragments of big files (videos)

Posted by Simon Majou <si...@majou.org>.
Thanks Serge

Simon


On Thu, Jun 20, 2013 at 10:48 AM, Serge Fonville
<se...@gmail.com> wrote:
> Also, after a quick Google.
>
> http://wiki.apache.org/cassandra/CassandraLimitations states values cannot
> exceed 2GB, it also answers you offset question
>
> HTH
> Kind regards/met vriendelijke groet,
>
> Serge Fonville
>
> http://www.sergefonville.nl
>
> Convince Microsoft!
> They need to add TRUNCATE PARTITION in SQL Server
> https://connect.microsoft.com/SQLServer/feedback/details/417926/truncate-partition-of-partitioned-table
>
>
> 2013/6/20 Sachin Sinha <si...@gmail.com>
>>
>> Fragment them in rows, that will help.
>>
>>
>> On 20 June 2013 09:43, Simon Majou <si...@majou.org> wrote:
>>>
>>> Hello,
>>>
>>> If I store a video into a column, how can I get a fragment of it
>>> without having to download it entirely ? Is there a way to give an
>>> offset on a column ?
>>>
>>> Do I have to fragment it over a lot of small fixed sizes columns ? Is
>>> there any disadvantage to do so ? For example fragment a 10GB file
>>> into 1 000 columns of 10 MB ?
>>>
>>> Simon
>>
>>
>

Re: Get fragments of big files (videos)

Posted by Serge Fonville <se...@gmail.com>.
Also, after a quick Google.

http://wiki.apache.org/cassandra/CassandraLimitations states values cannot
exceed 2GB, it also answers you offset question

HTH
Kind regards/met vriendelijke groet,

Serge Fonville

http://www.sergefonville.nl

Convince Microsoft!
They need to add TRUNCATE PARTITION in SQL Server
https://connect.microsoft.com/SQLServer/feedback/details/417926/truncate-partition-of-partitioned-table


2013/6/20 Sachin Sinha <si...@gmail.com>

> Fragment them in rows, that will help.
>
>
> On 20 June 2013 09:43, Simon Majou <si...@majou.org> wrote:
>
>> Hello,
>>
>> If I store a video into a column, how can I get a fragment of it
>> without having to download it entirely ? Is there a way to give an
>> offset on a column ?
>>
>> Do I have to fragment it over a lot of small fixed sizes columns ? Is
>> there any disadvantage to do so ? For example fragment a 10GB file
>> into 1 000 columns of 10 MB ?
>>
>> Simon
>>
>
>

Re: Get fragments of big files (videos)

Posted by Sachin Sinha <si...@gmail.com>.
Fragment them in rows, that will help.


On 20 June 2013 09:43, Simon Majou <si...@majou.org> wrote:

> Hello,
>
> If I store a video into a column, how can I get a fragment of it
> without having to download it entirely ? Is there a way to give an
> offset on a column ?
>
> Do I have to fragment it over a lot of small fixed sizes columns ? Is
> there any disadvantage to do so ? For example fragment a 10GB file
> into 1 000 columns of 10 MB ?
>
> Simon
>