Hadoop and Matlab

[Dmitry Pushkarev <um...@stanford.edu>]

Hi.

 

Can anyone share experience of successfully parallelizing matlab tasks using
hadoop?

 

We have implemented this thing with python (in form of simple module that
takes serialized function and data array and runs this function on the
cluster)m but we really have no clue how to that in Matlab.

 

Ideally we want to use Matlab in the same way -  write .m file that takes
set of parameters and returns some value, specify list of input parameters
(like lists of variable to try for Gaussian kernels) and run it on the
cluster, in somewhat failproof manner - that's the ideal situation.

 

Has anyone tried that? 

 

---

Dmitry

Re: Hadoop and Matlab

["Edward J. Yoon" <ed...@apache.org>]

Just FYI, See hama (http://incubator.apache.org/hama/)

We are working on parallel math (from scalapack/matlab people we got a
positive answer) project using hadoop.

On Sat, Dec 13, 2008 at 12:39 PM, Dmitry Pushkarev <um...@stanford.edu> wrote:
> Hi.
>
>
>
> Can anyone share experience of successfully parallelizing matlab tasks using
> hadoop?
>
>
>
> We have implemented this thing with python (in form of simple module that
> takes serialized function and data array and runs this function on the
> cluster)m but we really have no clue how to that in Matlab.
>
>
>
> Ideally we want to use Matlab in the same way -  write .m file that takes
> set of parameters and returns some value, specify list of input parameters
> (like lists of variable to try for Gaussian kernels) and run it on the
> cluster, in somewhat failproof manner - that's the ideal situation.
>
>
>
> Has anyone tried that?
>
>
>
> ---
>
> Dmitry
>
>



-- 
Best Regards, Edward J. Yoon @ NHN, corp.
edwardyoon@apache.org
http://blog.udanax.org