You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@mahout.apache.org by Sameer Tilak <ss...@live.com> on 2013/12/27 20:11:03 UTC

Mahout itemsimilarity error

Hi All,I am running the following command to process a quite large dataset. I want to mention upfront that my input file does contain few blank lines. Any thought on why this might be happening?
./mahout itemsimilarity -i /scratch/SimilartyInput -o /scratch/SimilartyOutput -s SIMILARITY_COOCCURRENCE maxSimilaritiesPerItem 10
13/12/27 11:06:35 INFO common.AbstractJob: Command line arguments: {--booleanData=[false], --endPhase=[2147483647], --input=[/scratch/SimilartyInput], --maxPrefs=[500], --maxSimilaritiesPerItem=[10], --minPrefsPerUser=[1], --output=[/scratch/SimilartyOutput], --similarityClassname=[SIMILARITY_COOCCURRENCE], --startPhase=[0], --tempDir=[temp]}13/12/27 11:06:35 INFO common.AbstractJob: Command line arguments: {--booleanData=[false], --endPhase=[2147483647], --input=[/scratch/SimilartyInput], --minPrefsPerUser=[1], --output=[temp/prepareRatingMatrix], --ratingShift=[0.0], --startPhase=[0], --tempDir=[temp]}13/12/27 11:06:36 INFO input.FileInputFormat: Total input paths to process : 4013/12/27 11:06:36 INFO util.NativeCodeLoader: Loaded the native-hadoop library13/12/27 11:06:36 WARN snappy.LoadSnappy: Snappy native library not loaded13/12/27 11:06:36 INFO mapred.JobClient: Running job: job_201311111627_042313/12/27 11:06:37 INFO mapred.JobClient:  map 0% reduce 0%13/12/27 11:06:52 INFO mapred.JobClient: Task Id : attempt_201311111627_0423_m_000000_0, Status : FAILEDjava.lang.ArrayIndexOutOfBoundsException: 1	at org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapper.java:50)	at org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapper.java:31)	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)	at org.apache.hadoop.mapred.Child$4.run(Child.java:255)	at java.security.AccessController.doPrivileged(Native Method)	at javax.security.auth.Subject.doAs(Subject.java:415)	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)	at org.apache.hadoop.mapred.Child.main(Child.java:249)
13/12/27 11:06:52 INFO mapred.JobClient: Task Id : attempt_201311111627_0423_m_000001_0, Status : FAILEDjava.lang.ArrayIndexOutOfBoundsException: 1	at org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapper.java:50)	at org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapper.java:31)	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)	at org.apache.hadoop.mapred.Child$4.run(Child.java:255)	at java.security.AccessController.doPrivileged(Native Method)	at javax.security.auth.Subject.doAs(Subject.java:415)	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)	at org.apache.hadoop.mapred.Child.main(Child.java:249)
13/12/27 11:06:53 INFO mapred.JobClient: Task Id : attempt_201311111627_0423_m_000002_0, Status : FAILEDjava.lang.ArrayIndexOutOfBoundsException: 1	at org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapper.java:50)	at org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapper.java:31)	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)	at org.apache.hadoop.mapred.Child$4.run(Child.java:255)	at java.security.AccessController.doPrivileged(Native Method)	at javax.security.auth.Subject.doAs(Subject.java:415)	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)	at org.apache.hadoop.mapred.Child.main(Child.java:249)