You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@trafodion.apache.org by "Yang, Yang (Felix)" <ya...@esgyn.cn> on 2016/07/14 09:55:52 UTC

Best practice to store video and audio files

Hi there,

What's the most recommended way to manage small video and audio files?
Is our BLOB good to store something like a 30-sec low-sample-rate audio, like 1MB in size?
Or, should we store the path in Trafodion and leave the A/V file in HDFS?

Best,
Felix

RE: Best practice to store video and audio files

Posted by "Yang, Yang (Felix)" <ya...@esgyn.cn>.
Dear Sandhya and Anoop,
Thanks for the response. I’ve been asked about this in different occasions, from generic social media messages like Wechat, to more specialized captures by vehicle and traffic cameras.
Besides the need to analyze and retract these unstructured data for surveillance purposes, there are players trying to create IoT service platforms, and sell value-added insights by advanced analytics.

Let’s leave it hear and people may follow with more specific SLA requirements.

Best,
Felix

From: Sandhya Sundaresan [mailto:sandhya.sundaresan@esgyn.com]
Sent: Thursday, July 14, 2016 11:54 PM
To: user@trafodion.incubator.apache.org
Subject: RE: Best practice to store video and audio files

Hi,
    For the audio/video files themselves, we have 2 options when we nsert them into a blob column.

1.     They could be stored in our internally maintained hdfs location  (/lobs) which is Trafodion’s  managed storage.

2.     If the user wants the audio/video files left as is in the location where they want,  we have support for external lobs where we can take the full path to the location of the file and store the handle and some metadata information of the external lob withink our Trafodion table. We won’t import that audio/video file in our /lobs storage in this case.
So we have functions to perform  inserts and extracts of botht he above types.
Sandhya

From: Anoop Sharma [mailto:anoop.sharma@esgyn.com<ma...@esgyn.com>]
Sent: Thursday, July 14, 2016 7:09 AM
To: user@trafodion.incubator.apache.org<ma...@trafodion.incubator.apache.org>
Subject: RE: Best practice to store video and audio files

hi
  storing it in trafodion ‘blob’ column will be the best way to do this.
Traf will internally store a ‘handle’ as part of the stored row. Actual data
will be stored in HDFS. ‘handle’ contains information on how to access that
data (path, offset, etc).

  blob/clob support is in tech preview right now and not fully externalized.

anoop

From: Yang, Yang (Felix) [mailto:yang.yang@esgyn.cn]
Sent: Thursday, July 14, 2016 2:56 AM
To: user@trafodion.apache.org<ma...@trafodion.apache.org>
Subject: Best practice to store video and audio files

Hi there,

What’s the most recommended way to manage small video and audio files?
Is our BLOB good to store something like a 30-sec low-sample-rate audio, like 1MB in size?
Or, should we store the path in Trafodion and leave the A/V file in HDFS?

Best,
Felix

RE: Best practice to store video and audio files

Posted by Sandhya Sundaresan <sa...@esgyn.com>.
Hi,

    For the audio/video files themselves, we have 2 options when we nsert
them into a blob column.

1.       They could be stored in our internally maintained hdfs location
(/lobs) which is Trafodion’s  managed storage.

2.       If the user wants the audio/video files left as is in the location
where they want,  we have support for external lobs where we can take the
full path to the location of the file and store the handle and some
metadata information of the external lob withink our Trafodion table. We
won’t import that audio/video file in our /lobs storage in this case.

So we have functions to perform  inserts and extracts of botht he above
types.

Sandhya



*From:* Anoop Sharma [mailto:anoop.sharma@esgyn.com]
*Sent:* Thursday, July 14, 2016 7:09 AM
*To:* user@trafodion.incubator.apache.org
*Subject:* RE: Best practice to store video and audio files



hi

  storing it in trafodion ‘blob’ column will be the best way to do this.

Traf will internally store a ‘handle’ as part of the stored row. Actual data

will be stored in HDFS. ‘handle’ contains information on how to access that

data (path, offset, etc).



  blob/clob support is in tech preview right now and not fully externalized.



anoop



*From:* Yang, Yang (Felix) [mailto:yang.yang@esgyn.cn <ya...@esgyn.cn>]
*Sent:* Thursday, July 14, 2016 2:56 AM
*To:* user@trafodion.apache.org
*Subject:* Best practice to store video and audio files



Hi there,



What’s the most recommended way to manage small video and audio files?

Is our BLOB good to store something like a 30-sec low-sample-rate audio,
like 1MB in size?

Or, should we store the path in Trafodion and leave the A/V file in HDFS?



Best,
Felix

RE: Best practice to store video and audio files

Posted by Anoop Sharma <an...@esgyn.com>.
hi

  storing it in trafodion 'blob' column will be the best way to do this.

Traf will internally store a 'handle' as part of the stored row. Actual data

will be stored in HDFS. 'handle' contains information on how to access that

data (path, offset, etc).

 

  blob/clob support is in tech preview right now and not fully externalized.

 

anoop

 

From: Yang, Yang (Felix) [mailto:yang.yang@esgyn.cn] 
Sent: Thursday, July 14, 2016 2:56 AM
To: user@trafodion.apache.org
Subject: Best practice to store video and audio files

 

Hi there, 

 

What's the most recommended way to manage small video and audio files?

Is our BLOB good to store something like a 30-sec low-sample-rate audio,
like 1MB in size?

Or, should we store the path in Trafodion and leave the A/V file in HDFS?

 

Best, 
Felix