You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by "Edward J. Yoon" <ed...@apache.org> on 2009/05/20 15:53:58 UTC
Re: Hama Problem
Hi,
> I am not sure this code easily can be parallel computed,or how to change
> this code to add the parallel compuation.any advice will be
> appreciated.thanks in advance.
OK, I'm sure it could be run on Hama/Hadoop.
According to my understanding of your code, It's a PCA. If you have an
M images as represented N^2 * 1 vectors, vector will be nomalized by
step-2. In step-3, the covariance matrix will be constructed using
matrix A by deviation of images and A^T. Finally you'll get the
eigenfaces using eigen values/vectors.
There are two large computing component in the step-3 and step-4, such
as N^2 by N^2 matrix transpose, multiplication and eigen
values/vectors of M by M matrix.
Currently in Hama, multiplication and transpose were implemented. If
eigenvalue decomposition is implement, you can easily migrate code.
> hama has it's own mailing list and this question is probably better
> asked there. see http://incubator.apache.org/hama/mailing_lists.html
Yes, we have own mailing list. Please contact us.
Thanks,
Edward
On Wed, May 20, 2009 at 4:51 PM, Robert Burrell Donkin
<ro...@gmail.com> wrote:
> On Wed, May 20, 2009 at 8:08 AM, ykj <yk...@163.com> wrote:
>>
>> Hello,everyone
>
> hi
>
>> I am new to hama. in our project ,my team leader let me upload old
>> code, run it on hadoop with parallel matrix computation.
>
> hama has it's own mailing list and this question is probably better
> asked there. see http://incubator.apache.org/hama/mailing_lists.html
>
> thanks
>
> - robert
>
--
Best Regards, Edward J. Yoon @ NHN, corp.
edwardyoon@apache.org
http://blog.udanax.org
Re: Hama Problem
Posted by "Edward J. Yoon" <ed...@apache.org>.
I think... If we construct the small matrix, we maybe don't need to
use the hbase before the store it.
On Wed, May 20, 2009 at 11:16 PM, Edward J. Yoon <ed...@apache.org> wrote:
> //make matrix of stacked flattened images
> Matrix matrix = new Matrix(dpix);
>
> Hmm, Should we add this constructor for Image? IMO, it can be added to
> DenseMatrix, but it could be really small.
>
> AFAIK, In commons.math2, linear algebra will be added. It would be
> nice if we use it as a local version.
>
> Any comments are welcome.
>
> On Wed, May 20, 2009 at 10:53 PM, Edward J. Yoon <ed...@apache.org> wrote:
>> Hi,
>>
>>> I am not sure this code easily can be parallel computed,or how to change
>>> this code to add the parallel compuation.any advice will be
>>> appreciated.thanks in advance.
>>
>> OK, I'm sure it could be run on Hama/Hadoop.
>>
>> According to my understanding of your code, It's a PCA. If you have an
>> M images as represented N^2 * 1 vectors, vector will be nomalized by
>> step-2. In step-3, the covariance matrix will be constructed using
>> matrix A by deviation of images and A^T. Finally you'll get the
>> eigenfaces using eigen values/vectors.
>>
>> There are two large computing component in the step-3 and step-4, such
>> as N^2 by N^2 matrix transpose, multiplication and eigen
>> values/vectors of M by M matrix.
>>
>> Currently in Hama, multiplication and transpose were implemented. If
>> eigenvalue decomposition is implement, you can easily migrate code.
>>
>>> hama has it's own mailing list and this question is probably better
>>> asked there. see http://incubator.apache.org/hama/mailing_lists.html
>>
>> Yes, we have own mailing list. Please contact us.
>>
>> Thanks,
>> Edward
>>
>> On Wed, May 20, 2009 at 4:51 PM, Robert Burrell Donkin
>> <ro...@gmail.com> wrote:
>>> On Wed, May 20, 2009 at 8:08 AM, ykj <yk...@163.com> wrote:
>>>>
>>>> Hello,everyone
>>>
>>> hi
>>>
>>>> I am new to hama. in our project ,my team leader let me upload old
>>>> code, run it on hadoop with parallel matrix computation.
>>>
>>> hama has it's own mailing list and this question is probably better
>>> asked there. see http://incubator.apache.org/hama/mailing_lists.html
>>>
>>> thanks
>>>
>>> - robert
>>>
>>
>>
>>
>> --
>> Best Regards, Edward J. Yoon @ NHN, corp.
>> edwardyoon@apache.org
>> http://blog.udanax.org
>>
>
>
>
> --
> Best Regards, Edward J. Yoon @ NHN, corp.
> edwardyoon@apache.org
> http://blog.udanax.org
>
--
Best Regards, Edward J. Yoon @ NHN, corp.
edwardyoon@apache.org
http://blog.udanax.org
MO,
Re: Hama Problem
Posted by "Edward J. Yoon" <ed...@apache.org>.
//make matrix of stacked flattened images
Matrix matrix = new Matrix(dpix);
Hmm, Should we add this constructor for Image? IMO, it can be added to
DenseMatrix, but it could be really small.
AFAIK, In commons.math2, linear algebra will be added. It would be
nice if we use it as a local version.
Any comments are welcome.
On Wed, May 20, 2009 at 10:53 PM, Edward J. Yoon <ed...@apache.org> wrote:
> Hi,
>
>> I am not sure this code easily can be parallel computed,or how to change
>> this code to add the parallel compuation.any advice will be
>> appreciated.thanks in advance.
>
> OK, I'm sure it could be run on Hama/Hadoop.
>
> According to my understanding of your code, It's a PCA. If you have an
> M images as represented N^2 * 1 vectors, vector will be nomalized by
> step-2. In step-3, the covariance matrix will be constructed using
> matrix A by deviation of images and A^T. Finally you'll get the
> eigenfaces using eigen values/vectors.
>
> There are two large computing component in the step-3 and step-4, such
> as N^2 by N^2 matrix transpose, multiplication and eigen
> values/vectors of M by M matrix.
>
> Currently in Hama, multiplication and transpose were implemented. If
> eigenvalue decomposition is implement, you can easily migrate code.
>
>> hama has it's own mailing list and this question is probably better
>> asked there. see http://incubator.apache.org/hama/mailing_lists.html
>
> Yes, we have own mailing list. Please contact us.
>
> Thanks,
> Edward
>
> On Wed, May 20, 2009 at 4:51 PM, Robert Burrell Donkin
> <ro...@gmail.com> wrote:
>> On Wed, May 20, 2009 at 8:08 AM, ykj <yk...@163.com> wrote:
>>>
>>> Hello,everyone
>>
>> hi
>>
>>> I am new to hama. in our project ,my team leader let me upload old
>>> code, run it on hadoop with parallel matrix computation.
>>
>> hama has it's own mailing list and this question is probably better
>> asked there. see http://incubator.apache.org/hama/mailing_lists.html
>>
>> thanks
>>
>> - robert
>>
>
>
>
> --
> Best Regards, Edward J. Yoon @ NHN, corp.
> edwardyoon@apache.org
> http://blog.udanax.org
>
--
Best Regards, Edward J. Yoon @ NHN, corp.
edwardyoon@apache.org
http://blog.udanax.org