You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Jaonary Rabarisoa <ja...@gmail.com> on 2014/07/09 08:47:22 UTC
Need advice to create an objectfile of set of images from Spark
Hi all,
I need to run a spark job that need a set of images as input. I need
something that load these images as RDD but I just don't know how to do
that. Do some of you have any idea ?
Cheers,
Jao
Re: Need advice to create an objectfile of set of images from Spark
Posted by Jaonary Rabarisoa <ja...@gmail.com>.
The idea is to run a job that use images as input so that each work will
process a subset of the images
On Wed, Jul 9, 2014 at 2:30 PM, Mayur Rustagi <ma...@gmail.com>
wrote:
> RDD can only keep objects. How do you plan to encode these images so that
> they can be loaded. Keeping the whole image as a single object in 1 rdd
> would perhaps not be super optimized.
> Regards
> Mayur
>
> Mayur Rustagi
> Ph: +1 (760) 203 3257
> http://www.sigmoidanalytics.com
> @mayur_rustagi <https://twitter.com/mayur_rustagi>
>
>
>
> On Wed, Jul 9, 2014 at 12:17 PM, Jaonary Rabarisoa <ja...@gmail.com>
> wrote:
>
>> Hi all,
>>
>> I need to run a spark job that need a set of images as input. I need
>> something that load these images as RDD but I just don't know how to do
>> that. Do some of you have any idea ?
>>
>> Cheers,
>>
>>
>> Jao
>>
>
>
Re: Need advice to create an objectfile of set of images from Spark
Posted by Mayur Rustagi <ma...@gmail.com>.
RDD can only keep objects. How do you plan to encode these images so that
they can be loaded. Keeping the whole image as a single object in 1 rdd
would perhaps not be super optimized.
Regards
Mayur
Mayur Rustagi
Ph: +1 (760) 203 3257
http://www.sigmoidanalytics.com
@mayur_rustagi <https://twitter.com/mayur_rustagi>
On Wed, Jul 9, 2014 at 12:17 PM, Jaonary Rabarisoa <ja...@gmail.com>
wrote:
> Hi all,
>
> I need to run a spark job that need a set of images as input. I need
> something that load these images as RDD but I just don't know how to do
> that. Do some of you have any idea ?
>
> Cheers,
>
>
> Jao
>