You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Tom White (Created) (JIRA)" <ji...@apache.org> on 2012/01/18 19:00:41 UTC
[jira] [Created] (MAHOUT-950) Change BtJob to use new
MultipleOutputs API
Change BtJob to use new MultipleOutputs API
-------------------------------------------
Key: MAHOUT-950
URL: https://issues.apache.org/jira/browse/MAHOUT-950
Project: Mahout
Issue Type: Improvement
Components: Math
Reporter: Tom White
BtJob uses a mixture of the old and new MapReduce API to allow it to use MultipleOutputs (which isn't available in Hadoop 0.20/1.0). This fails when run against 0.23 (see MAHOUT-822), so we should change BtJob to use the new MultipleOutputs API. (Hopefully the new MultipleOutputs API will be made available in a 1.x release - see MAPREDUCE-3607.)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAHOUT-950) Change BtJob to use new
MultipleOutputs API
Posted by "Tom White (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated MAHOUT-950:
-----------------------------
Attachment: MAHOUT-950.patch
Here's a patch which works against 0.23.1-SNAPSHOT (run with "mvn clean test -Dhadoop.version=0.23.1-SNAPSHOT -Dtest=LocalSSVDSolverDenseTest", requires patch from MAHOUT-822 to be applied first). Both LocalSSVDSolverDenseTest and LocalSSVDSolverSparseSequentialTest are passing. This is not to be committed since it doesn't work against Hadoop 0.20/1.0.
> Change BtJob to use new MultipleOutputs API
> -------------------------------------------
>
> Key: MAHOUT-950
> URL: https://issues.apache.org/jira/browse/MAHOUT-950
> Project: Mahout
> Issue Type: Improvement
> Components: Math
> Reporter: Tom White
> Attachments: MAHOUT-950.patch
>
>
> BtJob uses a mixture of the old and new MapReduce API to allow it to use MultipleOutputs (which isn't available in Hadoop 0.20/1.0). This fails when run against 0.23 (see MAHOUT-822), so we should change BtJob to use the new MultipleOutputs API. (Hopefully the new MultipleOutputs API will be made available in a 1.x release - see MAPREDUCE-3607.)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-950) Change BtJob to use new
MultipleOutputs API
Posted by "Tom White (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13189476#comment-13189476 ]
Tom White commented on MAHOUT-950:
----------------------------------
As a sanity check for 0.20/1.x, I built Hadoop locally with the patch from MAPREDUCE-3607 applied and changed the version of hadoop-core in the POM to 1.1.0-SNAPSHOT. Both LocalSSVDSolverDenseTest and LocalSSVDSolverSparseSequentialTest passed.
> Change BtJob to use new MultipleOutputs API
> -------------------------------------------
>
> Key: MAHOUT-950
> URL: https://issues.apache.org/jira/browse/MAHOUT-950
> Project: Mahout
> Issue Type: Improvement
> Components: Math
> Reporter: Tom White
> Attachments: MAHOUT-950.patch
>
>
> BtJob uses a mixture of the old and new MapReduce API to allow it to use MultipleOutputs (which isn't available in Hadoop 0.20/1.0). This fails when run against 0.23 (see MAHOUT-822), so we should change BtJob to use the new MultipleOutputs API. (Hopefully the new MultipleOutputs API will be made available in a 1.x release - see MAPREDUCE-3607.)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira