You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Jonathan Traupman (JIRA)" <ji...@apache.org> on 2011/03/29 20:42:06 UTC
[jira] [Updated] (MAHOUT-641) DistributedRowMatrix hadoop jobs
ignore Configuration set via setConf()
[ https://issues.apache.org/jira/browse/MAHOUT-641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Traupman updated MAHOUT-641:
-------------------------------------
Fix Version/s: 0.5
Status: Patch Available (was: Open)
Patch fixes configuration problem in our environment. I changed the existing static JobConf creation routines to take an initial Configuration that will be passed in by DistributedRowMatrix if specified. I also included backward-compatible static routines that maintain the existing signature and behavior.
All unit tests pass. Added 3 new unit test cases to verify this bugfix.
> DistributedRowMatrix hadoop jobs ignore Configuration set via setConf()
> -----------------------------------------------------------------------
>
> Key: MAHOUT-641
> URL: https://issues.apache.org/jira/browse/MAHOUT-641
> Project: Mahout
> Issue Type: Bug
> Components: Math
> Affects Versions: 0.4, 0.5
> Environment: Mahout 0.4 and 0.5-SNAPSHOT run with Hadoop 0.20.2 on Mac OS 10.6 and Linux x86_64 2.6.18
> Reporter: Jonathan Traupman
> Labels: configuration, hadoop
> Fix For: 0.5
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> I am using the Distributed Lanczos solver which uses the DistributedRowMatrix class for it's internal calculation. In our environment, I need to set some Configuration properties (specifically hadoop.job.ugi & hadoop.queue.name), which are when set via the setConf() method on DistributedLanczosSolver. These are correctly passed to DistributedRowMatrix via its setConf() method, but are not passed into the Hadoop JobConfs created by the various static routines in MatrixMultiplicationJob, TimesSquaredJob, and TransposeJob.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira