You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "chungongyu (Commented) (JIRA)" <ji...@apache.org> on 2012/01/20 05:37:39 UTC

[jira] [Commented] (MAHOUT-712) DisplaySpectralKMeans Example Surfaces FileNotFoundException in DistributedRowMatrix.times() Usage/Implementation

    [ https://issues.apache.org/jira/browse/MAHOUT-712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13189619#comment-13189619 ] 

chungongyu commented on MAHOUT-712:
-----------------------------------

hi, all
A simple way to solve this is to do as follows:

org.apache.mahout.clustering.spectral.common.VectorMatrixMultiplicationJob(line 84);


    return new DistributedRowMatrix(outputPath, new Path(outputPath, "tmp"), 

    return new DistributedRowMatrix(outputPath, new Path(outputPath, "_tmp"), 

                
> DisplaySpectralKMeans Example Surfaces FileNotFoundException in DistributedRowMatrix.times() Usage/Implementation
> -----------------------------------------------------------------------------------------------------------------
>
>                 Key: MAHOUT-712
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-712
>             Project: Mahout
>          Issue Type: Sub-task
>          Components: Clustering
>    Affects Versions: 0.5
>            Reporter: Jeff Eastman
>            Assignee: Shannon Quinn
>
> Not clear if this is due to SpectralKMeansDriver usage or an implementation issue deeper inside. The error is repeatable:
> Exception in thread "main" java.lang.IllegalStateException: java.io.FileNotFoundException: File file:/home/dev/workspace/mahout/output/calculations/laplacian-3/tmp/data does not exist.
>         at org.apache.mahout.math.hadoop.DistributedRowMatrix.times(DistributedRowMatrix.java:217)
>         at org.apache.mahout.math.decomposer.lanczos.LanczosSolver.solve(LanczosSolver.java:104)
>         at org.apache.mahout.math.hadoop.decomposer.DistributedLanczosSolver.runJob(DistributedLanczosSolver.java:70)
>         at org.apache.mahout.clustering.spectral.kmeans.SpectralKMeansDriver.run(SpectralKMeansDriver.java:155)
>         at org.apache.mahout.clustering.display.DisplaySpectralKMeans.main(DisplaySpectralKMeans.java:71)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
>         at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
>         at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:187)
> Caused by: java.io.FileNotFoundException: File file:/home/dev/workspace/mahout/output/calculations/laplacian-3/tmp/data does not exist.
>         at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361)
>         at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
>         at org.apache.hadoop.mapred.SequenceFileInputFormat.listStatus(SequenceFileInputFormat.java:51)
>         at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:201)
>         at org.apache.hadoop.mapred.JobClient.writeOldSplits(JobClient.java:810)
>         at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:781)
>         at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:730)
>         at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1249)
>         at org.apache.mahout.math.hadoop.DistributedRowMatrix.times(DistributedRowMatrix.java:209)
>  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira