You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Smita Wadhwa (JIRA)" <ji...@apache.org> on 2012/10/11 12:53:03 UTC
[jira] [Created] (MAHOUT-1097) SSVd does not writing uSigma after
uSigma true
Smita Wadhwa created MAHOUT-1097:
------------------------------------
Summary: SSVd does not writing uSigma after uSigma true
Key: MAHOUT-1097
URL: https://issues.apache.org/jira/browse/MAHOUT-1097
Project: Mahout
Issue Type: Bug
Components: Math
Affects Versions: 0.8
Reporter: Smita Wadhwa
Fix For: 0.8
SSVd does not writing uSigma file after uSigma variable true
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [jira] [Commented] (MAHOUT-1097) SSVd does not writing uSigma
after uSigma true
Posted by Dmitriy Lyubimov <dl...@gmail.com>.
ok, let me check. But the patch is still not the way to do it.
On Thu, Oct 11, 2012 at 9:29 AM, Smita Wadhwa (JIRA) <ji...@apache.org> wrote:
>
> [ https://issues.apache.org/jira/browse/MAHOUT-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13474288#comment-13474288 ]
>
> Smita Wadhwa commented on MAHOUT-1097:
> --------------------------------------
>
> I could see U, V and sigma(diagonal matrix) written in the output directory, whereas all the stuff is written in temp directory . May be I am missing something, but when I set param uSigma to true , then it was not written in output directory , where as if I set computeU and computeV to true -> it writes in output directory as out/U/ and out/V/ and out/sigma but not out/Usigma . May be I am missing something.
>
>> SSVd does not writing uSigma after uSigma true
>> ----------------------------------------------
>>
>> Key: MAHOUT-1097
>> URL: https://issues.apache.org/jira/browse/MAHOUT-1097
>> Project: Mahout
>> Issue Type: Bug
>> Components: Math
>> Affects Versions: 0.8
>> Reporter: Smita Wadhwa
>> Fix For: 0.8
>>
>> Attachments: ssvd_cusigma.diff
>>
>>
>> SSVd does not writing uSigma file after uSigma variable true
>
> --
> This message is automatically generated by JIRA.
> If you think it was sent incorrectly, please contact your JIRA administrators
> For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-1097) SSVd does not writing uSigma after
uSigma true
Posted by "Dmitriy Lyubimov (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13474343#comment-13474343 ]
Dmitriy Lyubimov commented on MAHOUT-1097:
------------------------------------------
Are you sure? Are you using latest trunk?
Still don't see the problem.
This is the way U paths are set up :
{code}
Path svPath = new Path(outputPath, "Sigma");
Path uPath = new Path(outputPath, "U");
Path uSigmaPath = new Path(outputPath, "USigma");
Path uHalfSigmaPath = new Path(outputPath, "UHalfSigma");
Path vPath = new Path(outputPath, "V");
Path vHalfSigmaPath = new Path(outputPath, "VHalfSigma");
Path vSigmaPath = new Path(outputPath, "VSigma");
{code}
And one person who was using U*Sigma output actually confirmed it worked fine for him... all outputs are saved in output folder but form hierarchy
so basically outputs should be as
output/Sigma -- singular values
output/U -- U
output/V -- V
output/USigma -- U*Sigma
...
and so on per above.
Keep in mind that U and V are enabled by default and USigma is disabled. I guess you need to use something like
mahout ssvd -k 80 --pca -U false -V false --us true
to get the desired outcome.
> SSVd does not writing uSigma after uSigma true
> ----------------------------------------------
>
> Key: MAHOUT-1097
> URL: https://issues.apache.org/jira/browse/MAHOUT-1097
> Project: Mahout
> Issue Type: Bug
> Components: Math
> Affects Versions: 0.8
> Reporter: Smita Wadhwa
> Fix For: 0.8
>
> Attachments: ssvd_cusigma.diff
>
>
> SSVd does not writing uSigma file after uSigma variable true
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAHOUT-1097) SSVd does not writing uSigma after
uSigma true
Posted by "Dmitriy Lyubimov (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dmitriy Lyubimov updated MAHOUT-1097:
-------------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
> SSVd does not writing uSigma after uSigma true
> ----------------------------------------------
>
> Key: MAHOUT-1097
> URL: https://issues.apache.org/jira/browse/MAHOUT-1097
> Project: Mahout
> Issue Type: Bug
> Components: Math
> Affects Versions: 0.8
> Reporter: Smita Wadhwa
> Assignee: Dmitriy Lyubimov
> Priority: Trivial
> Fix For: 0.8
>
> Attachments: ssvd_cusigma.diff
>
>
> SSVd does not writing uSigma file after uSigma variable true
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-1097) SSVd does not writing uSigma after
uSigma true
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13474509#comment-13474509 ]
Hudson commented on MAHOUT-1097:
--------------------------------
Integrated in Mahout-Quality #1699 (See [https://builds.apache.org/job/Mahout-Quality/1699/])
MAHOUT-1097: 1) some results are not moved to output folder. 2) -ow flag was not working as intended, fixed. (Revision 1397251)
Result = SUCCESS
dlyubimov : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1397251
Files :
* /mahout/trunk/core/src/main/java/org/apache/mahout/math/hadoop/stochasticsvd/SSVDCli.java
> SSVd does not writing uSigma after uSigma true
> ----------------------------------------------
>
> Key: MAHOUT-1097
> URL: https://issues.apache.org/jira/browse/MAHOUT-1097
> Project: Mahout
> Issue Type: Bug
> Components: Math
> Affects Versions: 0.8
> Reporter: Smita Wadhwa
> Assignee: Dmitriy Lyubimov
> Priority: Trivial
> Fix For: 0.8
>
> Attachments: ssvd_cusigma.diff
>
>
> SSVd does not writing uSigma file after uSigma variable true
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-1097) SSVd does not writing uSigma after
uSigma true
Posted by "Smita Wadhwa (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13474288#comment-13474288 ]
Smita Wadhwa commented on MAHOUT-1097:
--------------------------------------
I could see U, V and sigma(diagonal matrix) written in the output directory, whereas all the stuff is written in temp directory . May be I am missing something, but when I set param uSigma to true , then it was not written in output directory , where as if I set computeU and computeV to true -> it writes in output directory as out/U/ and out/V/ and out/sigma but not out/Usigma . May be I am missing something.
> SSVd does not writing uSigma after uSigma true
> ----------------------------------------------
>
> Key: MAHOUT-1097
> URL: https://issues.apache.org/jira/browse/MAHOUT-1097
> Project: Mahout
> Issue Type: Bug
> Components: Math
> Affects Versions: 0.8
> Reporter: Smita Wadhwa
> Fix For: 0.8
>
> Attachments: ssvd_cusigma.diff
>
>
> SSVd does not writing uSigma file after uSigma variable true
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAHOUT-1097) SSVd does not writing uSigma after
uSigma true
Posted by "Dmitriy Lyubimov (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dmitriy Lyubimov updated MAHOUT-1097:
-------------------------------------
Priority: Trivial (was: Major)
> SSVd does not writing uSigma after uSigma true
> ----------------------------------------------
>
> Key: MAHOUT-1097
> URL: https://issues.apache.org/jira/browse/MAHOUT-1097
> Project: Mahout
> Issue Type: Bug
> Components: Math
> Affects Versions: 0.8
> Reporter: Smita Wadhwa
> Assignee: Dmitriy Lyubimov
> Priority: Trivial
> Fix For: 0.8
>
> Attachments: ssvd_cusigma.diff
>
>
> SSVd does not writing uSigma file after uSigma variable true
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAHOUT-1097) SSVd does not writing uSigma after
uSigma true
Posted by "Smita Wadhwa (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Smita Wadhwa updated MAHOUT-1097:
---------------------------------
Attachment: ssvd_cusigma.diff
Patch contains the write stuff for cUsigma , if enabled.
> SSVd does not writing uSigma after uSigma true
> ----------------------------------------------
>
> Key: MAHOUT-1097
> URL: https://issues.apache.org/jira/browse/MAHOUT-1097
> Project: Mahout
> Issue Type: Bug
> Components: Math
> Affects Versions: 0.8
> Reporter: Smita Wadhwa
> Fix For: 0.8
>
> Attachments: ssvd_cusigma.diff
>
>
> SSVd does not writing uSigma file after uSigma variable true
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-1097) SSVd does not writing uSigma after
uSigma true
Posted by "Dmitriy Lyubimov (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13474246#comment-13474246 ]
Dmitriy Lyubimov commented on MAHOUT-1097:
------------------------------------------
I dont think either issue or patch is valid. Ssvd writes multiple outputs, and doesnt cram all the files to same output directory.
> SSVd does not writing uSigma after uSigma true
> ----------------------------------------------
>
> Key: MAHOUT-1097
> URL: https://issues.apache.org/jira/browse/MAHOUT-1097
> Project: Mahout
> Issue Type: Bug
> Components: Math
> Affects Versions: 0.8
> Reporter: Smita Wadhwa
> Fix For: 0.8
>
> Attachments: ssvd_cusigma.diff
>
>
> SSVd does not writing uSigma file after uSigma variable true
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-1097) SSVd does not writing uSigma after
uSigma true
Posted by "Dmitriy Lyubimov (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13474411#comment-13474411 ]
Dmitriy Lyubimov commented on MAHOUT-1097:
------------------------------------------
i could reproduce. It's not clear to me yet why it lands where it lands though so far.
> SSVd does not writing uSigma after uSigma true
> ----------------------------------------------
>
> Key: MAHOUT-1097
> URL: https://issues.apache.org/jira/browse/MAHOUT-1097
> Project: Mahout
> Issue Type: Bug
> Components: Math
> Affects Versions: 0.8
> Reporter: Smita Wadhwa
> Fix For: 0.8
>
> Attachments: ssvd_cusigma.diff
>
>
> SSVd does not writing uSigma file after uSigma variable true
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAHOUT-1097) SSVd does not writing uSigma after
uSigma true
Posted by "Dmitriy Lyubimov (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dmitriy Lyubimov reassigned MAHOUT-1097:
----------------------------------------
Assignee: Dmitriy Lyubimov
> SSVd does not writing uSigma after uSigma true
> ----------------------------------------------
>
> Key: MAHOUT-1097
> URL: https://issues.apache.org/jira/browse/MAHOUT-1097
> Project: Mahout
> Issue Type: Bug
> Components: Math
> Affects Versions: 0.8
> Reporter: Smita Wadhwa
> Assignee: Dmitriy Lyubimov
> Fix For: 0.8
>
> Attachments: ssvd_cusigma.diff
>
>
> SSVd does not writing uSigma file after uSigma variable true
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAHOUT-1097) SSVd does not writing uSigma after
uSigma true
Posted by "Dmitriy Lyubimov (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dmitriy Lyubimov updated MAHOUT-1097:
-------------------------------------
Status: Patch Available (was: Open)
committed to trunk, removing and fixing some unnecessarily slow dipping mechanisms in the command line houskeeping
> SSVd does not writing uSigma after uSigma true
> ----------------------------------------------
>
> Key: MAHOUT-1097
> URL: https://issues.apache.org/jira/browse/MAHOUT-1097
> Project: Mahout
> Issue Type: Bug
> Components: Math
> Affects Versions: 0.8
> Reporter: Smita Wadhwa
> Assignee: Dmitriy Lyubimov
> Fix For: 0.8
>
> Attachments: ssvd_cusigma.diff
>
>
> SSVd does not writing uSigma file after uSigma variable true
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-1097) SSVd does not writing uSigma after
uSigma true
Posted by "Smita Wadhwa (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13474032#comment-13474032 ]
Smita Wadhwa commented on MAHOUT-1097:
--------------------------------------
PFA the patch for writing USigma file for ssvd
> SSVd does not writing uSigma after uSigma true
> ----------------------------------------------
>
> Key: MAHOUT-1097
> URL: https://issues.apache.org/jira/browse/MAHOUT-1097
> Project: Mahout
> Issue Type: Bug
> Components: Math
> Affects Versions: 0.8
> Reporter: Smita Wadhwa
> Fix For: 0.8
>
> Attachments: ssvd_cusigma.diff
>
>
> SSVd does not writing uSigma file after uSigma variable true
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-1097) SSVd does not writing uSigma after
uSigma true
Posted by "Dmitriy Lyubimov (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13474451#comment-13474451 ]
Dmitriy Lyubimov commented on MAHOUT-1097:
------------------------------------------
Ok,
there are more issues with moving the result to output folder.
on top of it -ow flag was not working as it should.
Try now from the turnk, it is working for me.
the command line i used was
{code}
bin/mahout ssvd -i /DRM-sparse -o /SSVD-out -ow -k 80 -V false -U false -us true -t 2
{code}
> SSVd does not writing uSigma after uSigma true
> ----------------------------------------------
>
> Key: MAHOUT-1097
> URL: https://issues.apache.org/jira/browse/MAHOUT-1097
> Project: Mahout
> Issue Type: Bug
> Components: Math
> Affects Versions: 0.8
> Reporter: Smita Wadhwa
> Assignee: Dmitriy Lyubimov
> Fix For: 0.8
>
> Attachments: ssvd_cusigma.diff
>
>
> SSVd does not writing uSigma file after uSigma variable true
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-1097) SSVd does not writing uSigma after
uSigma true
Posted by "Smita Wadhwa (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13474914#comment-13474914 ]
Smita Wadhwa commented on MAHOUT-1097:
--------------------------------------
Thanks Dmitriy for considering this a *valid* issue.
> SSVd does not writing uSigma after uSigma true
> ----------------------------------------------
>
> Key: MAHOUT-1097
> URL: https://issues.apache.org/jira/browse/MAHOUT-1097
> Project: Mahout
> Issue Type: Bug
> Components: Math
> Affects Versions: 0.8
> Reporter: Smita Wadhwa
> Assignee: Dmitriy Lyubimov
> Priority: Trivial
> Fix For: 0.8
>
> Attachments: ssvd_cusigma.diff
>
>
> SSVd does not writing uSigma file after uSigma variable true
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira