[jira] [Created] (MAHOUT-1627) Problem with ALS Factorizer MapReduce version when working with oozie because of files in distributed cache. Error: Unable to read sequence file from cache.

["Srinivasarao Daruna (JIRA)" <ji...@apache.org>]

Srinivasarao Daruna created MAHOUT-1627:
-------------------------------------------

             Summary: Problem with ALS Factorizer MapReduce version when working with oozie because of files in distributed cache. Error: Unable to read sequence file from cache.
                 Key: MAHOUT-1627
                 URL: https://issues.apache.org/jira/browse/MAHOUT-1627
             Project: Mahout
          Issue Type: Bug
          Components: Collaborative Filtering
    Affects Versions: 1.0
         Environment: Hadoop
            Reporter: Srinivasarao Daruna


There is a problem with ALS Factorizer when working with distributed environment and oozie.

Steps:

1) Built mahout 1.0 jars and picked mahout-mrlegacy jar.

2) I have created a Java class in which i have called ParallelALSFactorizationJob with respective inputs.

3) Submitted the job and there are list of Map Reduce jobs which got submitted to perform the factorization.

4) Job failed at MultithreadedSharingMapper with the error Unable to read Sequnce file "<ourprogram>.jar" pointing the code at org.apache.mahout.cf.taste.hadoop.als.ALS and readMatrixByRowsFromDistributedCache method.

Cause: The ALS class picks up input files which are sequential files from the distributed cache using readMatrixByRowsFromDistributedCache method. However, when we are working in oozie environment, the program jar as well being copied to distributed cache with input files. As the ALS class trying to read all the files in distributed cache, it is failing when it encounters jar. 

The remedy would be setting a condition to pick files those are other than jars. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)