You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Dmitriy Lyubimov (JIRA)" <ji...@apache.org> on 2011/02/15 01:16:57 UTC
[jira] Updated: (MAHOUT-593) Backport of Stochastic SVD patch
(Mahout-376) to hadoop 0.20 to ensure compatibility with current Mahout
dependencies.
[ https://issues.apache.org/jira/browse/MAHOUT-593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dmitriy Lyubimov updated MAHOUT-593:
------------------------------------
Attachment: SSVD-givens-CLI.pdf
command line help document. Hope that helps with understanding the usage.
> Backport of Stochastic SVD patch (Mahout-376) to hadoop 0.20 to ensure compatibility with current Mahout dependencies.
> ----------------------------------------------------------------------------------------------------------------------
>
> Key: MAHOUT-593
> URL: https://issues.apache.org/jira/browse/MAHOUT-593
> Project: Mahout
> Issue Type: New Feature
> Components: Math
> Affects Versions: 0.4
> Reporter: Dmitriy Lyubimov
> Fix For: 0.5
>
> Attachments: MAHOUT-593.patch.gz, SSVD-givens-CLI.pdf
>
>
> Current Mahout-376 patch requries 'new' hadoop API. Certain elements of that API (namely, multiple outputs) are not available in standard hadoop 0.20.2 release. As such, that may work only with either CDH or 0.21 distributions.
> In order to bring it into sync with current Mahout dependencies, a backport of the patch to 'old' API is needed.
> Also, some work is needed to resolve math dependencies. Existing patch relies on apache commons-math 2.1 for eigen decomposition of small matrices. This dependency is not currently set up in the mahout core. So, certain snippets of code are either required to go to mahout-math or use Colt eigen decompositon (last time i tried, my results were mixed with that one. It seems to produce results inconsistent with those from mahout-math eigensolver, at the very least, it doesn't produce singular values in sorted order).
> So this patch is mainly moing some Mahout-376 code around.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [jira] Updated: (MAHOUT-593) Backport of Stochastic SVD patch
(Mahout-376) to hadoop 0.20 to ensure compatibility with current Mahout dependencies.
Posted by Ted Dunning <te...@gmail.com>.
Common
On Mon, Feb 14, 2011 at 5:09 PM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
> Question --
> there seems to exist 2 versions of MahoutTestCase --
> o.a.m.common.MahoutTestCase and o.a.m.math.MahoutTestCase.
>
> Which one is to use ?
>
> Thanks.
> -Dmitriy
>
> On Mon, Feb 14, 2011 at 4:16 PM, Dmitriy Lyubimov (JIRA)
> <ji...@apache.org> wrote:
> >
> > [
> https://issues.apache.org/jira/browse/MAHOUT-593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel]
> >
> > Dmitriy Lyubimov updated MAHOUT-593:
> > ------------------------------------
> >
> > Attachment: SSVD-givens-CLI.pdf
> >
> > command line help document. Hope that helps with understanding the usage.
> >
> >> Backport of Stochastic SVD patch (Mahout-376) to hadoop 0.20 to ensure
> compatibility with current Mahout dependencies.
> >>
> ----------------------------------------------------------------------------------------------------------------------
> >>
> >> Key: MAHOUT-593
> >> URL: https://issues.apache.org/jira/browse/MAHOUT-593
> >> Project: Mahout
> >> Issue Type: New Feature
> >> Components: Math
> >> Affects Versions: 0.4
> >> Reporter: Dmitriy Lyubimov
> >> Fix For: 0.5
> >>
> >> Attachments: MAHOUT-593.patch.gz, SSVD-givens-CLI.pdf
> >>
> >>
> >> Current Mahout-376 patch requries 'new' hadoop API. Certain elements of
> that API (namely, multiple outputs) are not available in standard hadoop
> 0.20.2 release. As such, that may work only with either CDH or 0.21
> distributions.
> >> In order to bring it into sync with current Mahout dependencies, a
> backport of the patch to 'old' API is needed.
> >> Also, some work is needed to resolve math dependencies. Existing patch
> relies on apache commons-math 2.1 for eigen decomposition of small matrices.
> This dependency is not currently set up in the mahout core. So, certain
> snippets of code are either required to go to mahout-math or use Colt eigen
> decompositon (last time i tried, my results were mixed with that one. It
> seems to produce results inconsistent with those from mahout-math
> eigensolver, at the very least, it doesn't produce singular values in sorted
> order).
> >> So this patch is mainly moing some Mahout-376 code around.
> >
> > --
> > This message is automatically generated by JIRA.
> > -
> > For more information on JIRA, see:
> http://www.atlassian.com/software/jira
> >
> >
> >
>
Re: [jira] Updated: (MAHOUT-593) Backport of Stochastic SVD patch
(Mahout-376) to hadoop 0.20 to ensure compatibility with current Mahout dependencies.
Posted by Dmitriy Lyubimov <dl...@gmail.com>.
Question --
there seems to exist 2 versions of MahoutTestCase --
o.a.m.common.MahoutTestCase and o.a.m.math.MahoutTestCase.
Which one is to use ?
Thanks.
-Dmitriy
On Mon, Feb 14, 2011 at 4:16 PM, Dmitriy Lyubimov (JIRA)
<ji...@apache.org> wrote:
>
> [ https://issues.apache.org/jira/browse/MAHOUT-593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
>
> Dmitriy Lyubimov updated MAHOUT-593:
> ------------------------------------
>
> Attachment: SSVD-givens-CLI.pdf
>
> command line help document. Hope that helps with understanding the usage.
>
>> Backport of Stochastic SVD patch (Mahout-376) to hadoop 0.20 to ensure compatibility with current Mahout dependencies.
>> ----------------------------------------------------------------------------------------------------------------------
>>
>> Key: MAHOUT-593
>> URL: https://issues.apache.org/jira/browse/MAHOUT-593
>> Project: Mahout
>> Issue Type: New Feature
>> Components: Math
>> Affects Versions: 0.4
>> Reporter: Dmitriy Lyubimov
>> Fix For: 0.5
>>
>> Attachments: MAHOUT-593.patch.gz, SSVD-givens-CLI.pdf
>>
>>
>> Current Mahout-376 patch requries 'new' hadoop API. Certain elements of that API (namely, multiple outputs) are not available in standard hadoop 0.20.2 release. As such, that may work only with either CDH or 0.21 distributions.
>> In order to bring it into sync with current Mahout dependencies, a backport of the patch to 'old' API is needed.
>> Also, some work is needed to resolve math dependencies. Existing patch relies on apache commons-math 2.1 for eigen decomposition of small matrices. This dependency is not currently set up in the mahout core. So, certain snippets of code are either required to go to mahout-math or use Colt eigen decompositon (last time i tried, my results were mixed with that one. It seems to produce results inconsistent with those from mahout-math eigensolver, at the very least, it doesn't produce singular values in sorted order).
>> So this patch is mainly moing some Mahout-376 code around.
>
> --
> This message is automatically generated by JIRA.
> -
> For more information on JIRA, see: http://www.atlassian.com/software/jira
>
>
>