Storing videos in cassandra

[raghavendra vutti <ra...@gmail.com>]

Hi,

 Just wanted to know How does hulu or netflix store videos in cassandra.

Do they just use references to the video files in the form of URL's and
store in the DB??

could someone please me on this.


Thanks,
Raghavendra.

Re: Storing videos in cassandra

[Johan Edstrom <se...@gmail.com>]

URI comes in pretty handy ; 

video://videoprovider:codecSomething:myConverter:videoId <video://videoprovider:codecSomething:myConverter:videoId>

Or XRI but what Michael said.

> On Nov 14, 2016, at 11:59 AM, Michael Shuler <mi...@pbandjelly.org> wrote:
> 
> Forward thinking, I would also suggest not storing the full URL, just
> the video ID of some sort. The application code can create the URL as
> needed, using the ID. If the full URL is stored in Cassandra and some
> day in the future, the video file storage system needs to be changed,
> this would require updating all the records. One could also use multiple
> storage systems, based on if the ID has some characteristic..
> 
> -- 
> Michael
> 
> On 11/14/2016 12:00 PM, Oskar Kjellin wrote:
>> The actual video is not stored in Cassandra. You need to use a proper origin like s3. 
>> 
>> Although you can probably store it in Cassandra, it's not a good idea. 
>> 
>> 
>>> On 14 nov. 2016, at 18:02, raghavendra vutti <ra...@gmail.com> wrote:
>>> 
>>> Hi,
>>> 
>>> Just wanted to know How does hulu or netflix store videos in cassandra.
>>> 
>>> Do they just use references to the video files in the form of URL's and store in the DB??
>>> 
>>> could someone please me on this.
>>> 
>>> 
>>> Thanks,
>>> Raghavendra.
> 

Re: Storing videos in cassandra

[Michael Shuler <mi...@pbandjelly.org>]

Forward thinking, I would also suggest not storing the full URL, just
the video ID of some sort. The application code can create the URL as
needed, using the ID. If the full URL is stored in Cassandra and some
day in the future, the video file storage system needs to be changed,
this would require updating all the records. One could also use multiple
storage systems, based on if the ID has some characteristic..

-- 
Michael

On 11/14/2016 12:00 PM, Oskar Kjellin wrote:
> The actual video is not stored in Cassandra. You need to use a proper origin like s3. 
> 
> Although you can probably store it in Cassandra, it's not a good idea. 
> 
> 
>> On 14 nov. 2016, at 18:02, raghavendra vutti <ra...@gmail.com> wrote:
>>
>> Hi,
>>
>>  Just wanted to know How does hulu or netflix store videos in cassandra.
>>
>> Do they just use references to the video files in the form of URL's and store in the DB??
>>
>> could someone please me on this.
>>
>>
>> Thanks,
>> Raghavendra.

Re: Storing videos in cassandra

[Ali Akhtar <al...@gmail.com>]

I am truly sorry, Raghavendra. It didn't occur to me that you could be a
beginner.

On Mon, Nov 14, 2016 at 11:46 PM, Jon Haddad <jo...@gmail.com>
wrote:

> Think about it like this.  You just started using Cassandra for the first
> time.  You have a question, you find there’s a mailing list, and you ask.
> You have zero experience with the DB and are an outsider to a community.
> You ask anyways, because it’s where the Apache website says to go.  You get
> back 2 sarcastic responses which aren’t helpful at all.  You, Ali, are the
> first contact with the community and it's a negative one.  Your joke,
> however funny it is, excludes someone who isn’t on the inside.  They don’t
> get the elbow to the ribs, haha, we’re just having fun, they get the “wow,
> all I did was ask a question and I got made fun of” feeling.
>
> Everyone is a beginner, and an outsider, at some point.  Please keep that
> in mind no-one has any understanding to the intent on your jokes when all
> they have is a 2 sentence response that is obviously not meant to be
> helpful.
>
> Jon
>
> On Nov 14, 2016, at 10:25 AM, Ali Akhtar <al...@gmail.com> wrote:
>
> Excuse me? I did not make fun of anyone. I gave valid suggestions that are
> all theoretically possible.
>
> If it came off in a condescending way, i am genuinely sorry.
>
> On 14 Nov 2016 11:22 pm, "Jon Haddad" <jo...@gmail.com> wrote:
>
>> You’ve asked a lot of questions on this mailing list, and you’ve gotten
>> help on a ton of beginner issues.  Making fun of someone for asking similar
>> beginner questions is not cool at all.  Cut it out.
>>
>>
>>
>> On Nov 14, 2016, at 10:13 AM, Ali Akhtar <al...@gmail.com> wrote:
>>
>> Another solution could be to print the raw bytes to paper, and write the
>> page numbers to cassandra. Playback will be challenging with this method
>> however, unless interns are available to transcribe the papers back to a
>> digital format.
>>
>> On Mon, Nov 14, 2016 at 11:06 PM, Ali Akhtar <al...@gmail.com>
>> wrote:
>>
>>> The video can be written to floppy diskettes, and the serial numbers of
>>> the diskettes can be written to cassandra.
>>>
>>> On Mon, Nov 14, 2016 at 11:00 PM, Oskar Kjellin <oskar.kjellin@gmail.com
>>> > wrote:
>>>
>>>> The actual video is not stored in Cassandra. You need to use a proper
>>>> origin like s3.
>>>>
>>>> Although you can probably store it in Cassandra, it's not a good idea.
>>>>
>>>> Sent from my iPhone
>>>>
>>>> > On 14 nov. 2016, at 18:02, raghavendra vutti <
>>>> raghu9raghavendra@gmail.com> wrote:
>>>> >
>>>> > Hi,
>>>> >
>>>> >  Just wanted to know How does hulu or netflix store videos in
>>>> cassandra.
>>>> >
>>>> > Do they just use references to the video files in the form of URL's
>>>> and store in the DB??
>>>> >
>>>> > could someone please me on this.
>>>> >
>>>> >
>>>> > Thanks,
>>>> > Raghavendra.
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>>
>>>
>>>
>>
>>
>

Re: Storing videos in cassandra

[Jon Haddad <jo...@gmail.com>]

Think about it like this.  You just started using Cassandra for the first time.  You have a question, you find there’s a mailing list, and you ask.  You have zero experience with the DB and are an outsider to a community.  You ask anyways, because it’s where the Apache website says to go.  You get back 2 sarcastic responses which aren’t helpful at all.  You, Ali, are the first contact with the community and it's a negative one.  Your joke, however funny it is, excludes someone who isn’t on the inside.  They don’t get the elbow to the ribs, haha, we’re just having fun, they get the “wow, all I did was ask a question and I got made fun of” feeling.

Everyone is a beginner, and an outsider, at some point.  Please keep that in mind no-one has any understanding to the intent on your jokes when all they have is a 2 sentence response that is obviously not meant to be helpful.

Jon

> On Nov 14, 2016, at 10:25 AM, Ali Akhtar <al...@gmail.com> wrote:
> 
> Excuse me? I did not make fun of anyone. I gave valid suggestions that are all theoretically possible.
> 
> If it came off in a condescending way, i am genuinely sorry.
> 
> 
> On 14 Nov 2016 11:22 pm, "Jon Haddad" <jonathan.haddad@gmail.com <ma...@gmail.com>> wrote:
> You’ve asked a lot of questions on this mailing list, and you’ve gotten help on a ton of beginner issues.  Making fun of someone for asking similar beginner questions is not cool at all.  Cut it out.
> 
> 
> 
>> On Nov 14, 2016, at 10:13 AM, Ali Akhtar <ali.rac200@gmail.com <ma...@gmail.com>> wrote:
>> 
>> Another solution could be to print the raw bytes to paper, and write the page numbers to cassandra. Playback will be challenging with this method however, unless interns are available to transcribe the papers back to a digital format.
>> 
>> On Mon, Nov 14, 2016 at 11:06 PM, Ali Akhtar <ali.rac200@gmail.com <ma...@gmail.com>> wrote:
>> The video can be written to floppy diskettes, and the serial numbers of the diskettes can be written to cassandra.
>> 
>> On Mon, Nov 14, 2016 at 11:00 PM, Oskar Kjellin <oskar.kjellin@gmail.com <ma...@gmail.com>> wrote:
>> The actual video is not stored in Cassandra. You need to use a proper origin like s3.
>> 
>> Although you can probably store it in Cassandra, it's not a good idea.
>> 
>> Sent from my iPhone
>> 
>> > On 14 nov. 2016, at 18:02, raghavendra vutti <raghu9raghavendra@gmail.com <ma...@gmail.com>> wrote:
>> >
>> > Hi,
>> >
>> >  Just wanted to know How does hulu or netflix store videos in cassandra.
>> >
>> > Do they just use references to the video files in the form of URL's and store in the DB??
>> >
>> > could someone please me on this.
>> >
>> >
>> > Thanks,
>> > Raghavendra.
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> 
>> 
> 

Re: Storing videos in cassandra

[Ali Akhtar <al...@gmail.com>]

Excuse me? I did not make fun of anyone. I gave valid suggestions that are
all theoretically possible.

If it came off in a condescending way, i am genuinely sorry.

On 14 Nov 2016 11:22 pm, "Jon Haddad" <jo...@gmail.com> wrote:

> You’ve asked a lot of questions on this mailing list, and you’ve gotten
> help on a ton of beginner issues.  Making fun of someone for asking similar
> beginner questions is not cool at all.  Cut it out.
>
>
>
> On Nov 14, 2016, at 10:13 AM, Ali Akhtar <al...@gmail.com> wrote:
>
> Another solution could be to print the raw bytes to paper, and write the
> page numbers to cassandra. Playback will be challenging with this method
> however, unless interns are available to transcribe the papers back to a
> digital format.
>
> On Mon, Nov 14, 2016 at 11:06 PM, Ali Akhtar <al...@gmail.com> wrote:
>
>> The video can be written to floppy diskettes, and the serial numbers of
>> the diskettes can be written to cassandra.
>>
>> On Mon, Nov 14, 2016 at 11:00 PM, Oskar Kjellin <os...@gmail.com>
>> wrote:
>>
>>> The actual video is not stored in Cassandra. You need to use a proper
>>> origin like s3.
>>>
>>> Although you can probably store it in Cassandra, it's not a good idea.
>>>
>>> Sent from my iPhone
>>>
>>> > On 14 nov. 2016, at 18:02, raghavendra vutti <
>>> raghu9raghavendra@gmail.com> wrote:
>>> >
>>> > Hi,
>>> >
>>> >  Just wanted to know How does hulu or netflix store videos in
>>> cassandra.
>>> >
>>> > Do they just use references to the video files in the form of URL's
>>> and store in the DB??
>>> >
>>> > could someone please me on this.
>>> >
>>> >
>>> > Thanks,
>>> > Raghavendra.
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>>
>>
>>
>
>

Re: Storing videos in cassandra

["list@airstreamcomm.net" <li...@airstreamcomm.net>]

Seconded.  It is completely unhelpful to spam this list.  Please stop.

> On Nov 14, 2016, at 12:21 PM, Jon Haddad <jo...@gmail.com> wrote:
> 
> You’ve asked a lot of questions on this mailing list, and you’ve gotten help on a ton of beginner issues.  Making fun of someone for asking similar beginner questions is not cool at all.  Cut it out.
> 
> 
> 
>> On Nov 14, 2016, at 10:13 AM, Ali Akhtar <al...@gmail.com> wrote:
>> 
>> Another solution could be to print the raw bytes to paper, and write the page numbers to cassandra. Playback will be challenging with this method however, unless interns are available to transcribe the papers back to a digital format.
>> 
>> On Mon, Nov 14, 2016 at 11:06 PM, Ali Akhtar <al...@gmail.com> wrote:
>>> The video can be written to floppy diskettes, and the serial numbers of the diskettes can be written to cassandra.
>>> 
>>>> On Mon, Nov 14, 2016 at 11:00 PM, Oskar Kjellin <os...@gmail.com> wrote:
>>>> The actual video is not stored in Cassandra. You need to use a proper origin like s3.
>>>> 
>>>> Although you can probably store it in Cassandra, it's not a good idea.
>>>> 
>>>> Sent from my iPhone
>>>> 
>>>> > On 14 nov. 2016, at 18:02, raghavendra vutti <ra...@gmail.com> wrote:
>>>> >
>>>> > Hi,
>>>> >
>>>> >  Just wanted to know How does hulu or netflix store videos in cassandra.
>>>> >
>>>> > Do they just use references to the video files in the form of URL's and store in the DB??
>>>> >
>>>> > could someone please me on this.
>>>> >
>>>> >
>>>> > Thanks,
>>>> > Raghavendra.
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>> 
>> 
> 

Re: Storing videos in cassandra

[Jon Haddad <jo...@gmail.com>]

You’ve asked a lot of questions on this mailing list, and you’ve gotten help on a ton of beginner issues.  Making fun of someone for asking similar beginner questions is not cool at all.  Cut it out.



> On Nov 14, 2016, at 10:13 AM, Ali Akhtar <al...@gmail.com> wrote:
> 
> Another solution could be to print the raw bytes to paper, and write the page numbers to cassandra. Playback will be challenging with this method however, unless interns are available to transcribe the papers back to a digital format.
> 
> On Mon, Nov 14, 2016 at 11:06 PM, Ali Akhtar <ali.rac200@gmail.com <ma...@gmail.com>> wrote:
> The video can be written to floppy diskettes, and the serial numbers of the diskettes can be written to cassandra.
> 
> On Mon, Nov 14, 2016 at 11:00 PM, Oskar Kjellin <oskar.kjellin@gmail.com <ma...@gmail.com>> wrote:
> The actual video is not stored in Cassandra. You need to use a proper origin like s3.
> 
> Although you can probably store it in Cassandra, it's not a good idea.
> 
> Sent from my iPhone
> 
> > On 14 nov. 2016, at 18:02, raghavendra vutti <raghu9raghavendra@gmail.com <ma...@gmail.com>> wrote:
> >
> > Hi,
> >
> >  Just wanted to know How does hulu or netflix store videos in cassandra.
> >
> > Do they just use references to the video files in the form of URL's and store in the DB??
> >
> > could someone please me on this.
> >
> >
> > Thanks,
> > Raghavendra.
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> 
> 

Re: Storing videos in cassandra

[Ali Akhtar <al...@gmail.com>]

Another solution could be to print the raw bytes to paper, and write the
page numbers to cassandra. Playback will be challenging with this method
however, unless interns are available to transcribe the papers back to a
digital format.

On Mon, Nov 14, 2016 at 11:06 PM, Ali Akhtar <al...@gmail.com> wrote:

> The video can be written to floppy diskettes, and the serial numbers of
> the diskettes can be written to cassandra.
>
> On Mon, Nov 14, 2016 at 11:00 PM, Oskar Kjellin <os...@gmail.com>
> wrote:
>
>> The actual video is not stored in Cassandra. You need to use a proper
>> origin like s3.
>>
>> Although you can probably store it in Cassandra, it's not a good idea.
>>
>> Sent from my iPhone
>>
>> > On 14 nov. 2016, at 18:02, raghavendra vutti <
>> raghu9raghavendra@gmail.com> wrote:
>> >
>> > Hi,
>> >
>> >  Just wanted to know How does hulu or netflix store videos in cassandra.
>> >
>> > Do they just use references to the video files in the form of URL's and
>> store in the DB??
>> >
>> > could someone please me on this.
>> >
>> >
>> > Thanks,
>> > Raghavendra.
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>>
>
>

Re: Storing videos in cassandra

[Ali Akhtar <al...@gmail.com>]

The video can be written to floppy diskettes, and the serial numbers of the
diskettes can be written to cassandra.

On Mon, Nov 14, 2016 at 11:00 PM, Oskar Kjellin <os...@gmail.com>
wrote:

> The actual video is not stored in Cassandra. You need to use a proper
> origin like s3.
>
> Although you can probably store it in Cassandra, it's not a good idea.
>
> Sent from my iPhone
>
> > On 14 nov. 2016, at 18:02, raghavendra vutti <
> raghu9raghavendra@gmail.com> wrote:
> >
> > Hi,
> >
> >  Just wanted to know How does hulu or netflix store videos in cassandra.
> >
> > Do they just use references to the video files in the form of URL's and
> store in the DB??
> >
> > could someone please me on this.
> >
> >
> > Thanks,
> > Raghavendra.
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
>

Re: Storing videos in cassandra

[Oskar Kjellin <os...@gmail.com>]

The actual video is not stored in Cassandra. You need to use a proper origin like s3. 

Although you can probably store it in Cassandra, it's not a good idea. 

Sent from my iPhone

> On 14 nov. 2016, at 18:02, raghavendra vutti <ra...@gmail.com> wrote:
> 
> Hi,
> 
>  Just wanted to know How does hulu or netflix store videos in cassandra.
> 
> Do they just use references to the video files in the form of URL's and store in the DB??
> 
> could someone please me on this.
> 
> 
> Thanks,
> Raghavendra.
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 

Re: Storing videos in cassandra

[Benjamin Roth <be...@jaumo.com>]

I haven't had the chance to test Pithos but from an architectural view it
MUST be slower than a haystack-like architecture (
https://code.facebook.com/posts/685565858139515/needle-in-a-haystack-efficient-storage-of-billions-of-photos/).
This is why we decided to move to SeaweedFS (
https://github.com/chrislusf/seaweedfs). It still has a central component
(master server) but it is so slim and well designed that you really need to
hit a Facebook-like scale to push it to the limits. Haystack is purely
designed for simplicity + speed.
If you need more functionality, like authentication, permission management,
multi-tenancy, whatever, it probably will not be the architecture of your
choice. Actually there are really a lot of solutions for a Blob-Store. Some
use Cassandra, many of them have different approaches, every one with its
own pros and cons for certain use cases.

2016-11-20 10:53 GMT+01:00 DuyHai Doan <do...@gmail.com>:

> No idea, just contact them
>
> On Sun, Nov 20, 2016 at 5:45 AM, vvshvv <vv...@gmail.com> wrote:
>
>> Hi Doan,
>>
>> Is there any performance test of Pithos?
>>
>>
>>
>> Sent from my Mi phone
>> On DuyHai Doan <do...@gmail.com>, Nov 19, 2016 6:46 PM wrote:
>>
>> There is a project Pithos that stores blob in Cassandra and exposes them
>> via S3 compatible API:
>>
>> https://www.exoscale.ch/syslog/2016/08/15/object-storage-
>> cassandra-pithos/
>>
>> On Sat, Nov 19, 2016 at 1:36 PM, Kai Wang <de...@gmail.com> wrote:
>>
>>> IIRC, I watched a presentation where they said Netflix store almost
>>> everything in C* *except* video content and payment stuff.
>>>
>>> That was 1-2 years ago. Not sure if it's still the case.
>>>
>>> On Nov 14, 2016 12:03 PM, "raghavendra vutti" <
>>> raghu9raghavendra@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>>  Just wanted to know How does hulu or netflix store videos in cassandra.
>>>>
>>>> Do they just use references to the video files in the form of URL's and
>>>> store in the DB??
>>>>
>>>> could someone please me on this.
>>>>
>>>>
>>>> Thanks,
>>>> Raghavendra.
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>
>


-- 
Benjamin Roth
Prokurist

Jaumo GmbH · www.jaumo.com
Wehrstraße 46 · 73035 Göppingen · Germany
Phone +49 7161 304880-6 · Fax +49 7161 304880-1
AG Ulm · HRB 731058 · Managing Director: Jens Kammerer

Re: Storing videos in cassandra

[DuyHai Doan <do...@gmail.com>]

No idea, just contact them

On Sun, Nov 20, 2016 at 5:45 AM, vvshvv <vv...@gmail.com> wrote:

> Hi Doan,
>
> Is there any performance test of Pithos?
>
>
>
> Sent from my Mi phone
> On DuyHai Doan <do...@gmail.com>, Nov 19, 2016 6:46 PM wrote:
>
> There is a project Pithos that stores blob in Cassandra and exposes them
> via S3 compatible API:
>
> https://www.exoscale.ch/syslog/2016/08/15/object-storage-cassandra-pithos/
>
> On Sat, Nov 19, 2016 at 1:36 PM, Kai Wang <de...@gmail.com> wrote:
>
>> IIRC, I watched a presentation where they said Netflix store almost
>> everything in C* *except* video content and payment stuff.
>>
>> That was 1-2 years ago. Not sure if it's still the case.
>>
>> On Nov 14, 2016 12:03 PM, "raghavendra vutti" <
>> raghu9raghavendra@gmail.com> wrote:
>>
>>> Hi,
>>>
>>>  Just wanted to know How does hulu or netflix store videos in cassandra.
>>>
>>> Do they just use references to the video files in the form of URL's and
>>> store in the DB??
>>>
>>> could someone please me on this.
>>>
>>>
>>> Thanks,
>>> Raghavendra.
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>

Re: Storing videos in cassandra

[DuyHai Doan <do...@gmail.com>]

There is a project Pithos that stores blob in Cassandra and exposes them
via S3 compatible API:

https://www.exoscale.ch/syslog/2016/08/15/object-storage-cassandra-pithos/

On Sat, Nov 19, 2016 at 1:36 PM, Kai Wang <de...@gmail.com> wrote:

> IIRC, I watched a presentation where they said Netflix store almost
> everything in C* *except* video content and payment stuff.
>
> That was 1-2 years ago. Not sure if it's still the case.
>
> On Nov 14, 2016 12:03 PM, "raghavendra vutti" <ra...@gmail.com>
> wrote:
>
>> Hi,
>>
>>  Just wanted to know How does hulu or netflix store videos in cassandra.
>>
>> Do they just use references to the video files in the form of URL's and
>> store in the DB??
>>
>> could someone please me on this.
>>
>>
>> Thanks,
>> Raghavendra.
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>

Re: Storing videos in cassandra

[Kai Wang <de...@gmail.com>]

IIRC, I watched a presentation where they said Netflix store almost
everything in C* *except* video content and payment stuff.

That was 1-2 years ago. Not sure if it's still the case.

On Nov 14, 2016 12:03 PM, "raghavendra vutti" <ra...@gmail.com>
wrote:

> Hi,
>
>  Just wanted to know How does hulu or netflix store videos in cassandra.
>
> Do they just use references to the video files in the form of URL's and
> store in the DB??
>
> could someone please me on this.
>
>
> Thanks,
> Raghavendra.
>
>
>
>
>
>
>
>
>
>
>

Re: Storing videos in cassandra

[Paulo Motta <pa...@gmail.com>]

For the record, there is an interesting use case of globo.com using
Cassandra to store video payload and stream live video at scale (in
particular, the FIFA World Cup + Olympics), but it's a pretty
non-conventional/advanced use case:
-
https://leandromoreira.com.br/2015/04/26/fifa-2014-world-cup-live-stream-architecture/
-
https://www.javacodegeeks.com/2016/06/cassandra-heart-globos-live-streaming-platform.html

2016-11-14 16:56 GMT-02:00 Benjamin Roth <be...@jaumo.com>:

> Some time ago, I stumbled across this: https://github.com/
> chrislusf/seaweedfs
> It is an open source implementation of Facebooks Haystack design. Have no
> experience yet but we will evaluate it as a blob-store to replace our
> Mogile-FS installation which stores over one billion images. From my point
> of view it looks very promising and probably much more resource-friendly
> for this use case.
>
> Maybe that helps ...
>
> 2016-11-14 19:52 GMT+01:00 Jon Haddad <jo...@gmail.com>:
>
>> While Cassandra *can* be used this way, I don’t recommend it.  It’s going
>> to be far cheaper and easier to maintain to store data in an Object store
>> like S3, like Oskar recommended.
>>
>> > On Nov 14, 2016, at 10:16 AM, list@airstreamcomm.net wrote:
>> >
>> > We store videos and files in Cassandra by chunking them into small
>> portions and saving them as blobs.  As for video you could track the file
>> byte offset of each chunk and request the relevant pieces when scrubbing to
>> a particular portion of the video.
>> >
>> >> On Nov 14, 2016, at 11:02 AM, raghavendra vutti <
>> raghu9raghavendra@gmail.com> wrote:
>> >>
>> >> Hi,
>> >>
>> >> Just wanted to know How does hulu or netflix store videos in cassandra.
>> >>
>> >> Do they just use references to the video files in the form of URL's
>> and store in the DB??
>> >>
>> >> could someone please me on this.
>> >>
>> >>
>> >> Thanks,
>> >> Raghavendra.
>> >>
>> >>
>> >>
>> >>
>> >>
>> >>
>> >>
>> >>
>> >>
>> >>
>> >
>> >
>>
>>
>
>
> --
> Benjamin Roth
> Prokurist
>
> Jaumo GmbH · www.jaumo.com
> Wehrstraße 46 · 73035 Göppingen · Germany
> Phone +49 7161 304880-6 · Fax +49 7161 304880-1
> AG Ulm · HRB 731058 · Managing Director: Jens Kammerer
>

Re: Storing videos in cassandra

[Benjamin Roth <be...@jaumo.com>]

Some time ago, I stumbled across this:
https://github.com/chrislusf/seaweedfs
It is an open source implementation of Facebooks Haystack design. Have no
experience yet but we will evaluate it as a blob-store to replace our
Mogile-FS installation which stores over one billion images. From my point
of view it looks very promising and probably much more resource-friendly
for this use case.

Maybe that helps ...

2016-11-14 19:52 GMT+01:00 Jon Haddad <jo...@gmail.com>:

> While Cassandra *can* be used this way, I don’t recommend it.  It’s going
> to be far cheaper and easier to maintain to store data in an Object store
> like S3, like Oskar recommended.
>
> > On Nov 14, 2016, at 10:16 AM, list@airstreamcomm.net wrote:
> >
> > We store videos and files in Cassandra by chunking them into small
> portions and saving them as blobs.  As for video you could track the file
> byte offset of each chunk and request the relevant pieces when scrubbing to
> a particular portion of the video.
> >
> >> On Nov 14, 2016, at 11:02 AM, raghavendra vutti <
> raghu9raghavendra@gmail.com> wrote:
> >>
> >> Hi,
> >>
> >> Just wanted to know How does hulu or netflix store videos in cassandra.
> >>
> >> Do they just use references to the video files in the form of URL's and
> store in the DB??
> >>
> >> could someone please me on this.
> >>
> >>
> >> Thanks,
> >> Raghavendra.
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >
> >
>
>


-- 
Benjamin Roth
Prokurist

Jaumo GmbH · www.jaumo.com
Wehrstraße 46 · 73035 Göppingen · Germany
Phone +49 7161 304880-6 · Fax +49 7161 304880-1
AG Ulm · HRB 731058 · Managing Director: Jens Kammerer

Re: Storing videos in cassandra

[Jon Haddad <jo...@gmail.com>]

While Cassandra *can* be used this way, I don’t recommend it.  It’s going to be far cheaper and easier to maintain to store data in an Object store like S3, like Oskar recommended.

> On Nov 14, 2016, at 10:16 AM, list@airstreamcomm.net wrote:
> 
> We store videos and files in Cassandra by chunking them into small portions and saving them as blobs.  As for video you could track the file byte offset of each chunk and request the relevant pieces when scrubbing to a particular portion of the video.  
> 
>> On Nov 14, 2016, at 11:02 AM, raghavendra vutti <ra...@gmail.com> wrote:
>> 
>> Hi,
>> 
>> Just wanted to know How does hulu or netflix store videos in cassandra.
>> 
>> Do they just use references to the video files in the form of URL's and store in the DB??
>> 
>> could someone please me on this.
>> 
>> 
>> Thanks,
>> Raghavendra.
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
> 
> 

Re: Storing videos in cassandra

["list@airstreamcomm.net" <li...@airstreamcomm.net>]

We store videos and files in Cassandra by chunking them into small portions and saving them as blobs.  As for video you could track the file byte offset of each chunk and request the relevant pieces when scrubbing to a particular portion of the video.  

> On Nov 14, 2016, at 11:02 AM, raghavendra vutti <ra...@gmail.com> wrote:
> 
> Hi,
> 
>  Just wanted to know How does hulu or netflix store videos in cassandra.
> 
> Do they just use references to the video files in the form of URL's and store in the DB??
> 
> could someone please me on this.
> 
> 
> Thanks,
> Raghavendra.
> 
> 
> 
> 
> 
> 
> 
> 
> 
>