You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@mahout.apache.org by "Phan, Truong Q" <Tr...@team.telstra.com> on 2014/04/02 00:41:39 UTC
RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
Hi Sean,
Thanks for reviewing my issue.
Actually, the directory (/usr/lib/hadoop-0.20-mapreduce) contain Cloudera v5b1 which I believe it has been upgraded to Hadoop 2.2.
I also have another Hadoop home directory (/usr/lib/hadoop-mapreduce/) which is also belong to Cloudera v5b1.
Please see below for the content of these directories.
For the sake of this testing I have pointed my CLASSPATH to (/usr/lib/hadoop-mapreduce/) and re-run the test again but I receive a different error.
Please see below for the error.
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
$ env | grep HAD
HADOOP_CMD=/usr/bin/hadoop
HADOOP_HOME=/usr/lib/hadoop
HADOOP_STREAMING=/usr/lib/hadoop-mapreduce/hadoop-streaming-2.2.0-cdh5.0.0-beta-1.jar
$ echo $CLASSPATH
:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9-job.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9-sources.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9-tests.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/math/target/mahout-math-0.9.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/math/target/mahout-math-0.9-sources.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/math/target/mahout-math-0.9-tests.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/integration/target/mahout-integration-0.9.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/integration/target/mahout-integration-0.9-sources.jar
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
$ mahout recommenditembased --input mydata.dat --usersFile user.dat --numRecommendations 2 --output output/ --similarityClassname SIMILARITY_PEARSON_CORRELATION
Running on hadoop, using /usr/lib/hadoop/bin/hadoop and HADOOP_CONF_DIR=
MAHOUT-JOB: /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/examples/target/mahout-examples-0.9-job.jar
14/04/01 17:17:06 INFO common.AbstractJob: Command line arguments: {--booleanData=[false], --endPhase=[2147483647], --input=[mydata.dat], --maxPrefsInItemSimilarity=[500], --maxPrefsPerUser=[10], --maxSimilaritiesPerItem=[100], --minPrefsPerUser=[1], --numRecommendations=[2], --output=[output/], --similarityClassname=[SIMILARITY_PEARSON_CORRELATION], --startPhase=[0], --tempDir=[temp], --usersFile=[user.dat]}
14/04/01 17:17:06 INFO common.AbstractJob: Command line arguments: {--booleanData=[false], --endPhase=[2147483647], --input=[mydata.dat], --minPrefsPerUser=[1], --output=[temp/preparePreferenceMatrix], --ratingShift=[0.0], --startPhase=[0], --tempDir=[temp]}
14/04/01 17:17:07 INFO Configuration.deprecation: mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
14/04/01 17:17:07 INFO Configuration.deprecation: mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
14/04/01 17:17:07 INFO Configuration.deprecation: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
Exception in thread "main" java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected
at org.apache.mahout.common.HadoopUtil.getCustomJobName(HadoopUtil.java:174)
at org.apache.mahout.common.AbstractJob.prepareJob(AbstractJob.java:614)
at org.apache.mahout.cf.taste.hadoop.preparation.PreparePreferenceMatrixJob.run(PreparePreferenceMatrixJob.java:73)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:164)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:322)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
$ ls -al /usr/lib/hadoop-0.20-mapreduce
total 3860
drwxr-xr-x 10 root root 4096 Feb 5 07:08 .
drwxr-xr-x 52 root root 12288 Feb 10 16:56 ..
drwxr-xr-x 2 root root 4096 Feb 12 04:02 bin
-rw-r--r-- 1 root root 348776 Oct 28 11:30 CHANGES.txt
drwxr-xr-x 2 root root 4096 Feb 5 07:08 cloudera
lrwxrwxrwx 1 root root 16 Feb 5 07:08 conf -> /etc/hadoop/conf
drwxr-xr-x 6 root root 4096 Feb 5 07:08 contrib
drwxr-xr-x 4 root root 4096 Feb 5 07:08 example-confs
-rw-r--r-- 1 root root 6833 Oct 28 11:30 hadoop-ant-2.2.0-mr1-cdh5.0.0-beta-1.jar
lrwxrwxrwx 1 root root 40 Feb 5 07:08 hadoop-ant.jar -> hadoop-ant-2.2.0-mr1-cdh5.0.0-beta-1.jar
-rw-r--r-- 1 root root 1757210 Oct 28 11:30 hadoop-core-2.2.0-mr1-cdh5.0.0-beta-1.jar
lrwxrwxrwx 1 root root 41 Feb 5 07:08 hadoop-core.jar -> hadoop-core-2.2.0-mr1-cdh5.0.0-beta-1.jar
-rw-r--r-- 1 root root 142842 Oct 28 11:30 hadoop-examples-2.2.0-mr1-cdh5.0.0-beta-1.jar
lrwxrwxrwx 1 root root 45 Feb 5 07:08 hadoop-examples.jar -> hadoop-examples-2.2.0-mr1-cdh5.0.0-beta-1.jar
-rw-r--r-- 1 root root 1413120 Oct 28 11:30 hadoop-test-2.2.0-mr1-cdh5.0.0-beta-1.jar
lrwxrwxrwx 1 root root 41 Feb 5 07:08 hadoop-test.jar -> hadoop-test-2.2.0-mr1-cdh5.0.0-beta-1.jar
-rw-r--r-- 1 root root 175182 Oct 28 11:30 hadoop-tools-2.2.0-mr1-cdh5.0.0-beta-1.jar
lrwxrwxrwx 1 root root 42 Feb 5 07:08 hadoop-tools.jar -> hadoop-tools-2.2.0-mr1-cdh5.0.0-beta-1.jar
drwxr-xr-x 3 root root 4096 Feb 5 07:08 include
drwxr-xr-x 5 root root 4096 Feb 5 07:08 lib
-rw-r--r-- 1 root root 13366 Oct 28 11:30 LICENSE.txt
-rw-r--r-- 1 root root 101 Oct 28 11:30 NOTICE.txt
-rw-r--r-- 1 root root 1366 Oct 28 11:30 README.txt
drwxr-xr-x 3 root root 4096 Feb 5 07:08 sbin
drwxr-xr-x 5 root root 4096 Feb 5 07:08 webapps
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
$ ls -al /usr/lib/hadoop-mapreduce/
total 5244
drwxr-xr-x 6 root root 4096 Feb 5 07:05 .
drwxr-xr-x 52 root root 12288 Feb 10 16:56 ..
drwxr-xr-x 2 root root 4096 Feb 12 04:02 bin
drwxr-xr-x 2 root root 4096 Feb 5 07:05 cloudera
-rw-r--r-- 1 root root 21515 Oct 28 11:30 hadoop-archives-2.2.0-cdh5.0.0-beta-1.jar
lrwxrwxrwx 1 root root 41 Feb 5 07:05 hadoop-archives.jar -> hadoop-archives-2.2.0-cdh5.0.0-beta-1.jar
-rw-r--r-- 1 root root 14574 Oct 28 11:30 hadoop-datajoin-2.2.0-cdh5.0.0-beta-1.jar
lrwxrwxrwx 1 root root 41 Feb 5 07:05 hadoop-datajoin.jar -> hadoop-datajoin-2.2.0-cdh5.0.0-beta-1.jar
-rw-r--r-- 1 root root 80406 Oct 28 11:30 hadoop-distcp-2.2.0-cdh5.0.0-beta-1.jar
lrwxrwxrwx 1 root root 39 Feb 5 07:05 hadoop-distcp.jar -> hadoop-distcp-2.2.0-cdh5.0.0-beta-1.jar
-rw-r--r-- 1 root root 62071 Oct 28 11:30 hadoop-extras-2.2.0-cdh5.0.0-beta-1.jar
lrwxrwxrwx 1 root root 39 Feb 5 07:05 hadoop-extras.jar -> hadoop-extras-2.2.0-cdh5.0.0-beta-1.jar
-rw-r--r-- 1 root root 215375 Oct 28 11:30 hadoop-gridmix-2.2.0-cdh5.0.0-beta-1.jar
lrwxrwxrwx 1 root root 40 Feb 5 07:05 hadoop-gridmix.jar -> hadoop-gridmix-2.2.0-cdh5.0.0-beta-1.jar
-rw-r--r-- 1 root root 482199 Oct 28 11:30 hadoop-mapreduce-client-app-2.2.0-cdh5.0.0-beta-1.jar
lrwxrwxrwx 1 root root 53 Feb 5 07:05 hadoop-mapreduce-client-app.jar -> hadoop-mapreduce-client-app-2.2.0-cdh5.0.0-beta-1.jar
-rw-r--r-- 1 root root 656300 Oct 28 11:30 hadoop-mapreduce-client-common-2.2.0-cdh5.0.0-beta-1.jar
lrwxrwxrwx 1 root root 56 Feb 5 07:05 hadoop-mapreduce-client-common.jar -> hadoop-mapreduce-client-common-2.2.0-cdh5.0.0-beta-1.jar
-rw-r--r-- 1 root root 1455612 Oct 28 11:30 hadoop-mapreduce-client-core-2.2.0-cdh5.0.0-beta-1.jar
lrwxrwxrwx 1 root root 54 Feb 5 07:05 hadoop-mapreduce-client-core.jar -> hadoop-mapreduce-client-core-2.2.0-cdh5.0.0-beta-1.jar
-rw-r--r-- 1 root root 117249 Oct 28 11:30 hadoop-mapreduce-client-hs-2.2.0-cdh5.0.0-beta-1.jar
lrwxrwxrwx 1 root root 52 Feb 5 07:05 hadoop-mapreduce-client-hs.jar -> hadoop-mapreduce-client-hs-2.2.0-cdh5.0.0-beta-1.jar
-rw-r--r-- 1 root root 4086 Oct 28 11:30 hadoop-mapreduce-client-hs-plugins-2.2.0-cdh5.0.0-beta-1.jar
lrwxrwxrwx 1 root root 60 Feb 5 07:05 hadoop-mapreduce-client-hs-plugins.jar -> hadoop-mapreduce-client-hs-plugins-2.2.0-cdh5.0.0-beta-1.jar
-rw-r--r-- 1 root root 35237 Oct 28 11:30 hadoop-mapreduce-client-jobclient-2.2.0-cdh5.0.0-beta-1.jar
-rw-r--r-- 1 root root 1434812 Oct 28 11:30 hadoop-mapreduce-client-jobclient-2.2.0-cdh5.0.0-beta-1-tests.jar
lrwxrwxrwx 1 root root 59 Feb 5 07:05 hadoop-mapreduce-client-jobclient.jar -> hadoop-mapreduce-client-jobclient-2.2.0-cdh5.0.0-beta-1.jar
-rw-r--r-- 1 root root 21566 Oct 28 11:30 hadoop-mapreduce-client-shuffle-2.2.0-cdh5.0.0-beta-1.jar
lrwxrwxrwx 1 root root 57 Feb 5 07:05 hadoop-mapreduce-client-shuffle.jar -> hadoop-mapreduce-client-shuffle-2.2.0-cdh5.0.0-beta-1.jar
-rw-r--r-- 1 root root 270285 Oct 28 11:30 hadoop-mapreduce-examples-2.2.0-cdh5.0.0-beta-1.jar
lrwxrwxrwx 1 root root 51 Feb 5 07:05 hadoop-mapreduce-examples.jar -> hadoop-mapreduce-examples-2.2.0-cdh5.0.0-beta-1.jar
-rw-r--r-- 1 root root 277597 Oct 28 11:30 hadoop-rumen-2.2.0-cdh5.0.0-beta-1.jar
lrwxrwxrwx 1 root root 38 Feb 5 07:05 hadoop-rumen.jar -> hadoop-rumen-2.2.0-cdh5.0.0-beta-1.jar
-rw-r--r-- 1 root root 102813 Oct 28 11:30 hadoop-streaming-2.2.0-cdh5.0.0-beta-1.jar
lrwxrwxrwx 1 root root 42 Feb 5 07:05 hadoop-streaming.jar -> hadoop-streaming-2.2.0-cdh5.0.0-beta-1.jar
drwxr-xr-x 2 root root 4096 Feb 5 07:05 lib
drwxr-xr-x 2 root root 4096 Feb 5 07:05 sbin
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Thanks and Regards,
Truong Phan
P + 61 2 8576 5771
M + 61 4 1463 7424
E troung.phan@team.telstra.com
W www.telstra.com
-----Original Message-----
From: Sean Owen [mailto:srowen@gmail.com]
Sent: Monday, 31 March 2014 7:05 PM
To: Mahout User List
Subject: RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
But you have a bunch of Hadoop 0.20 jars on your classpath! Definitely a problem. Those should not be there.
On Mar 31, 2014 7:09 AM, "Phan, Truong Q" <Tr...@team.telstra.com>
wrote:
> Yes, I did rebuild it.
>
> oracle@bpdevdmsdbs01: ----
> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib
> ution-0.9
> -----
> $ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1
> -DskipTests=true
> [INFO] Scanning for projects...
> ....
> [INFO]
> ----------------------------------------------------------------------
> --
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Mahout Build Tools ................................ SUCCESS [
> 8.215 s]
> [INFO] Apache Mahout ..................................... SUCCESS [
> 1.158 s]
> [INFO] Mahout Math ....................................... SUCCESS
> [16:21 min] [INFO] Mahout Core .......................................
> SUCCESS [26:21 min] [INFO] Mahout Integration
> ................................ SUCCESS [03:55 min] [INFO] Mahout
> Examples ................................... SUCCESS [02:54 min]
> [INFO] Mahout Release Package ............................ SUCCESS [
> 0.084 s]
> [INFO] Mahout Math/Scala wrappers ........................ SUCCESS
> [01:16 min] [INFO]
> ----------------------------------------------------------------------
> --
> [INFO] BUILD SUCCESS
> [INFO]
> ----------------------------------------------------------------------
> --
> [INFO] Total time: 50:59 min
> [INFO] Finished at: 2014-03-31T14:25:27+10:00 [INFO] Final Memory:
> 47M/250M [INFO]
> ----------------------------------------------------------------------
> --
>
>
> Thanks and Regards,
> Truong Phan
>
>
> P + 61 2 8576 5771
> M + 61 4 1463 7424
> E troung.phan@team.telstra.com
> W www.telstra.com
>
>
> -----Original Message-----
> From: Andrew Musselman [mailto:andrew.musselman@gmail.com]
> Sent: Monday, 31 March 2014 2:44 PM
> To: user@mahout.apache.org
> Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
>
> Have you rebuilt Mahout for your version? We're not supporting Hadoop
> version two yet.
>
> See here for some direction:
> http://mail-archives.us.apache.org/mod_mbox/mahout-user/201403.mbox/%3
> CCANg8BGD8Cm_=ESecQQ5mDL+6ybbNrR1Ce7i=PkuiMXMcktWgMg@mail.gmail.com%3E
>
> > On Mar 30, 2014, at 7:28 PM, "Phan, Truong Q" <
> Troung.Phan@team.telstra.com> wrote:
> >
> > Hi
> >
> > Does Mahout v0.9 supports Cloudera Hadoop v5 (2.2.0-cdh5.0.0-beta-1)?
> > I have managed to installed and run all test cases under the Mahout
> > v0.9
> without any issue.
> > Please see below for the evident of the test cases.
> > However I have no success to run the example from
> http://girlincomputerscience.blogspot.com.au/2010/11/apache-mahout.htmland got the following errors.
> > Note: I have set the CLASSPATH to point to all of Mahout’s jar files.
> >
> > <snip>
> > $ env | grep CLASS
> > CLASSPATH=:/usr/lib/hadoop-0.20-mapreduce/lib:/usr/lib/hadoop-0.20-m
> > ap
> > reduce/lib:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/m
> > ah
> > out-distribution-0.9/core/target/mahout-core-0.9.jar:/ora/db002/stg0
> > 01
> > /BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/
> > ta
> > rget/mahout-core-0.9-job.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dm
> > s/
> > devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9-s
> > ou
> > rces.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mah
> > ou
> > t-distribution-0.9/core/target/mahout-core-0.9-tests.jar:/ora/db002/
> > st
> > g001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/m
> > at
> > h/target/mahout-math-0.9.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dm
> > s/
> > devices/mahout/mahout-distribution-0.9/math/target/mahout-math-0.9-s
> > ou
> > rces.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mah
> > ou
> > t-distribution-0.9/math/target/mahout-math-0.9-tests.jar:/ora/db002/
> > st
> > g001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/i
> > nt
> > egration/target/mahout-integration-0.9.jar:/ora/db002/stg001/BDMSL1D
> > /h
> > adoop/nem-dms/devices/mahout/mahout-distribution-0.9/integration/tar
> > ge t/mahout-integration-0.9-sources.jar
> >
> > $ export
> > MAHOUT_HOME=/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/
> > ma
> > hout-distribution-0.9
> > $ export PATH=$MAHOUT_HOME/bin:$PATH
> >
> > oracle@bpdevdmsdbs01:BDMSSI1D1 ----
> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distr
> > ib ution-0.9/nem-dms ----- $ mahout recommenditembased --input
> > mydata.dat --usersFile user.dat --numRecommendations 2 --output
> > output/ --similarityClassname SIMILARITY_PEARSON_CORRELATION Running
> > on hadoop, using /usr/lib/hadoop-0.20-mapreduce/bin/hadoop and
> > HADOOP_CONF_DIR=
> > MAHOUT-JOB:
> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distr
> > ib ution-0.9/examples/target/mahout-examples-0.9-job.jar
> > Exception in thread "main" java.lang.NoClassDefFoundError:
> > org/apache/hadoop/util/PlatformName
> > Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.util.PlatformName
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> > Could not find the main class: org.apache.hadoop.util.PlatformName.
> Program will exit.
> > Exception in thread "main" java.lang.NoClassDefFoundError:
> > org/apache/hadoop/util/RunJar Caused by:
> java.lang.ClassNotFoundException: org.apache.hadoop.util.RunJar
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> > Could not find the main class: org.apache.hadoop.util.RunJar.
> > Program
> will exit.
> > </snip>
> >
> > <snip>
> > [INFO] --- maven-install-plugin:2.5.1:install (default-install) @
> > mahout-math-scala --- [INFO] Installing
> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distr
> > ib ution-0.9/math-scala/target/mahout-math-scala-0.9.jar to
> > /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/
> > ma hout-math-scala-0.9.jar [INFO] Installing
> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distr
> > ib
> > ution-0.9/math-scala/pom.xml to
> > /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/
> > ma hout-math-scala-0.9.pom [INFO] Installing
> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distr
> > ib ution-0.9/math-scala/target/mahout-math-scala-0.9-tests.jar to
> > /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/
> > ma hout-math-scala-0.9-tests.jar [INFO] Installing
> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distr
> > ib ution-0.9/math-scala/target/mahout-math-scala-0.9-sources.jar to
> > /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/
> > ma hout-math-scala-0.9-sources.jar [INFO]
> > --------------------------------------------------------------------
> > --
> > --
> > [INFO] Reactor Summary:
> > [INFO]
> > [INFO] Mahout Build Tools ................................ SUCCESS
> > [01:21 min] [INFO] Apache Mahout .....................................
> > SUCCESS [ 6.898 s] [INFO] Mahout Math
> > ....................................... SUCCESS [17:39 min] [INFO]
> > Mahout Core ....................................... SUCCESS [ 01:01
> > h] [INFO] Mahout Integration ................................
> > SUCCESS
> > [06:59 min] [INFO] Mahout Examples ...................................
> > SUCCESS [03:15 min] [INFO] Mahout Release Package
> > ............................ SUCCESS [ 0.026 s] [INFO] Mahout
> > Math/Scala wrappers ........................ SUCCESS [03:39 min]
> > [INFO]
> > --------------------------------------------------------------------
> > --
> > --
> > [INFO] BUILD SUCCESS
> > [INFO]
> > --------------------------------------------------------------------
> > --
> > --
> > [INFO] Total time: 01:34 h
> > [INFO] Finished at: 2014-03-28T13:10:48+10:00 [INFO] Final Memory:
> > 49M/276M [INFO]
> > --------------------------------------------------------------------
> > --
> > --
> > </snip>
> >
> > Thanks and Regards,
> > Truong Phan
> > Senior Technology Specialist
> > Database Engineering
> > Transport & Routing Engineering | Networks | Telstra Operations
> >
> > P + 61 2 8576 5771
> > M + 61 4 1463 7424
> > E troung.phan@team.telstra.com
> > W www.telstra.com
> > Love the movies? Telstra takes you there with $10 movie tickets,
> > just to say thanks. Available now at telstra.com/movies This
> > communication
> may contain confidential or copyright information of Telstra
> Corporation Limited (ABN 33 051 775 556). If you are not an intended
> recipient, you must not keep, forward, copy, use, save or rely on this
> communication, and any such action is unauthorised and prohibited. If
> you have received this communication in error, please reply to this
> email to notify the sender of its incorrect delivery, and then delete both it and your reply.
> >
> >
>
RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
Posted by fx MA XIAOJUN <xi...@fujixerox.co.jp>.
Hello, every one.
In fact, I installed mahout 0.9 on pseudo mode of cdh5.0.0-beta-2.
Note that mahout 0.9 may be not able to function on YARN.
So I chose MRv1 when installing cdh5.
Installation of mahout 0.9 was easy.
What I had done is to unzip mahout0.9 distribution and add path to /etc/profile.
With mahout 0.9+cdh5 beta2, I tried mahout kmeans. It seems function normally.
Sylvia
-----Original Message-----
From: Phan, Truong Q [mailto:Troung.Phan@team.telstra.com]
Sent: Monday, April 07, 2014 2:14 PM
To: Gokhan Capan; user@mahout.apache.org
Subject: RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
Hi Gokhan,
I still could not build the Mahout out from the trunk.
Please see below for the error.
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
svn co http://svn.apache.org/repos/asf/mahout/trunk/ mahout-trunk cd mahout-trunk mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0 -DskipTests=true
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.mahout:mahout-spark:jar:1.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.version' for org.scala-tools:maven-scala-plugin is missing. @ line 108, column 15
[WARNING] The expression ${pom.version} is deprecated. Please use ${project.version} instead.
[WARNING] The expression ${pom.version} is deprecated. Please use ${project.version} instead.
[WARNING] The expression ${pom.version} is deprecated. Please use ${project.version} instead.
[WARNING] The expression ${pom.version} is deprecated. Please use ${project.version} instead.
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO]
[INFO] Mahout Build Tools
[INFO] Apache Mahout
[INFO] Mahout Math
[INFO] Mahout Core
[INFO] Mahout Integration
[INFO] Mahout Examples
[INFO] Mahout Release Package
[INFO] Mahout Math/Scala wrappers
[INFO] Mahout Spark bindings
..... CUT OFF LINES
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Mahout Build Tools ................................ SUCCESS [ 7.381 s]
[INFO] Apache Mahout ..................................... SUCCESS [ 0.896 s]
[INFO] Mahout Math ....................................... SUCCESS [15:38 min]
[INFO] Mahout Core ....................................... FAILURE [ 2.135 s]
[INFO] Mahout Integration ................................ SKIPPED
[INFO] Mahout Examples ................................... SKIPPED
[INFO] Mahout Release Package ............................ SKIPPED
[INFO] Mahout Math/Scala wrappers ........................ SKIPPED
[INFO] Mahout Spark bindings ............................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 15:50 min
[INFO] Finished at: 2014-04-07T13:35:29+10:00
[INFO] Final Memory: 29M/241M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project mahout-core: Could not resolve dependencies for project org.apache.mahout:mahout-core:jar:1.0-SNAPSHOT: The following artifacts could not be resolved: org.apache.hadoop:hadoop-common:jar:2.2.0-cdh5.0.0, org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.2.0-cdh5.0.0, org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.2.0-cdh5.0.0: Could not find artifact org.apache.hadoop:hadoop-common:jar:2.2.0-cdh5.0.0 in central (http://repo.maven.apache.org/maven2) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :mahout-core
Thanks and Regards,
Truong Phan
P + 61 2 8576 5771
M + 61 4 1463 7424
E troung.phan@team.telstra.com
W www.telstra.com
-----Original Message-----
From: Gokhan Capan [mailto:gkhncpn@gmail.com]
Sent: Saturday, 5 April 2014 1:14 AM
To: user@mahout.apache.org
Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
Hi,
Could you try that:
$ svn co http://svn.apache.org/repos/asf/mahout/trunk/ mahout-trunk $ cd mahout-trunk $ mvn package -DskipTests=true -Dhadoop2.version=<YOUR_VERSION>
Best
Gokhan
On Fri, Apr 4, 2014 at 6:20 AM, Phan, Truong Q <Troung.Phan@team.telstra.com
> wrote:
> Hi
>
> I have managed to pull down the latest trunk from (
> https://github.com/apache/mahout) but I now having another problem
> with the build from this latest branch ("trunk").
> Please see below for my steps and errors.
>
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> $ sudo git clone https://github.com/apache/mahout mahout-latest
> Cloning into 'mahout-latest'...
> remote: Reusing existing pack: 76730, done.
> remote: Total 76730 (delta 0), reused 0 (delta 0) Receiving objects:
> 100% (76730/76730), 49.16 MiB | 193 KiB/s, done.
> Resolving deltas: 100% (34682/34682), done.
> warning: remote HEAD refers to nonexistent ref, unable to checkout.
>
> $ cd mahout-latest/
>
> $ sudo git branch -a
> remotes/origin/mahout-0.1
> remotes/origin/mahout-0.2
> remotes/origin/mahout-0.8
> remotes/origin/trunk
>
> $ sudo rm -rf mahout-latest
>
> $ sudo git clone -b trunk https://github.com/apache/mahout
> mahout-latest Cloning into 'mahout-latest'...
> remote: Reusing existing pack: 76730, done.
> remote: Total 76730 (delta 0), reused 0 (delta 0) Receiving objects:
> 100% (76730/76730), 49.16 MiB | 194 KiB/s, done.
> Resolving deltas: 100% (34682/34682), done.
> Checking out files: 100% (1475/1475), done.
>
> mvn -X install
>
> Apache Maven 3.2.1 (ea8b2b07643dbb1b84b6d16e1f08391b666bc1e9;
> 2014-02-15T04:37:52+10:00)
> Maven home: /usr/local/apache-maven/apache-maven-3.2.1
> Java version: 1.6.0_32, vendor: Sun Microsystems Inc.
> Java home: /usr/java/jdk1.6.0_32/jre
> Default locale: en_US, platform encoding: UTF-8 OS name: "linux",
> version: "2.6.18-274.el5", arch: "amd64", family: "unix"
> [INFO] Error stacktraces are turned on.
> [DEBUG] Reading global settings from
> /usr/local/apache-maven/apache-maven-3.2.1/conf/settings.xml
> [DEBUG] Reading user settings from /home/oracle/.m2/settings.xml
> [DEBUG] Using local repository at /home/oracle/.m2/repository [DEBUG]
> Using manager EnhancedLocalRepositoryManager with priority 10.0 for
> /home/oracle/.m2/repository [INFO] Scanning for projects...
> [DEBUG] Extension realms for project
> org.apache.mahout:mahout:pom:1.0-SNAPSHOT: (none) [DEBUG] Looking up
> lifecyle mappings for packaging pom from ClassRealm[plexus.core,
> parent: null] [DEBUG] Extension realms for project
> org.apache.mahout:mahout-buildtools:jar:1.0-SNAPSHOT: (none) [DEBUG]
> Looking up lifecyle mappings for packaging jar from
> ClassRealm[plexus.core, parent: null] [DEBUG] Extension realms for
> project
> org.apache.mahout:mahout-math:jar:1.0-SNAPSHOT: (none) [DEBUG] Looking
> up lifecyle mappings for packaging jar from ClassRealm[plexus.core,
> parent: null] [DEBUG] Extension realms for project
> org.apache.mahout:mahout-core:jar:1.0-SNAPSHOT: (none) [DEBUG] Looking
> up lifecyle mappings for packaging jar from ClassRealm[plexus.core,
> parent: null] [DEBUG] Extension realms for project
> org.apache.mahout:mahout-integration:jar:1.0-SNAPSHOT: (none) [DEBUG]
> Looking up lifecyle mappings for packaging jar from
> ClassRealm[plexus.core, parent: null] [DEBUG] Extension realms for
> project
> org.apache.mahout:mahout-examples:jar:1.0-SNAPSHOT: (none) [DEBUG]
> Looking up lifecyle mappings for packaging jar from
> ClassRealm[plexus.core, parent: null] [DEBUG] Extension realms for
> project
> org.apache.mahout:mahout-distribution:pom:1.0-SNAPSHOT: (none) [DEBUG]
> Looking up lifecyle mappings for packaging pom from
> ClassRealm[plexus.core, parent: null] [DEBUG] Extension realms for
> project
> org.apache.mahout:mahout-math-scala:jar:1.0-SNAPSHOT: (none) [DEBUG]
> Looking up lifecyle mappings for packaging jar from
> ClassRealm[plexus.core, parent: null] [DEBUG] Extension realms for
> project
> org.apache.mahout:mahout-spark:jar:1.0-SNAPSHOT: (none) [DEBUG]
> Looking up lifecyle mappings for packaging jar from
> ClassRealm[plexus.core, parent: null] [WARNING] [WARNING] Some
> problems were encountered while building the effective model for
> org.apache.mahout:mahout-spark:jar:1.0-SNAPSHOT
> [WARNING] 'build.plugins.plugin.version' for
> org.scala-tools:maven-scala-plugin is missing. @ line 108, column 15
> [WARNING] The expression ${pom.version} is deprecated. Please use
> ${project.version} instead.
> [WARNING] The expression ${pom.version} is deprecated. Please use
> ${project.version} instead.
> [WARNING] The expression ${pom.version} is deprecated. Please use
> ${project.version} instead.
> [WARNING] The expression ${pom.version} is deprecated. Please use
> ${project.version} instead.
> [WARNING]
> [WARNING] It is highly recommended to fix these problems because they
> threaten the stability of your build.
> [WARNING]
> [WARNING] For this reason, future Maven versions might no longer
> support building such malformed projects.
> [WARNING]
>
> ................ CUT OFF LINES ....
>
> [INFO]
> ----------------------------------------------------------------------
> --
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Mahout Build Tools ................................ FAILURE [
> 0.991 s]
> [INFO] Apache Mahout ..................................... SKIPPED
> [INFO] Mahout Math ....................................... SKIPPED
> [INFO] Mahout Core ....................................... SKIPPED
> [INFO] Mahout Integration ................................ SKIPPED
> [INFO] Mahout Examples ................................... SKIPPED
> [INFO] Mahout Release Package ............................ SKIPPED
> [INFO] Mahout Math/Scala wrappers ........................ SKIPPED
> [INFO] Mahout Spark bindings ............................. SKIPPED
> [INFO]
> ----------------------------------------------------------------------
> --
> [INFO] BUILD FAILURE
> [INFO]
> ----------------------------------------------------------------------
> --
> [INFO] Total time: 2.495 s
> [INFO] Finished at: 2014-04-04T14:04:56+10:00 [INFO] Final Memory:
> 9M/245M [INFO]
> ----------------------------------------------------------------------
> --
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-remote-resources-plugin:1.1:process
> (default) on project mahout-buildtools: Error finding remote resources
> manifests:
> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-latest/
> buildtools/target/maven-shared-archive-resources/META-INF/NOTICE
> (No such file or directory) -> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to
> execute goal
> org.apache.maven.plugins:maven-remote-resources-plugin:1.1:process
> (default) on project mahout-buildtools: Error finding remote resources
> manifests
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
> at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:3
> 56) Caused by: org.apache.maven.plugin.MojoExecutionException: Error
> finding remote resources manifests
> at
> org.apache.maven.plugin.resources.remote.ProcessRemoteResourcesMojo.processResourceBundles(ProcessRemoteResourcesMojo.java:1185)
> at
> org.apache.maven.plugin.resources.remote.ProcessRemoteResourcesMojo.execute(ProcessRemoteResourcesMojo.java:500)
> at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> ... 19 more
> Caused by: java.io.FileNotFoundException:
> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-latest/
> buildtools/target/maven-shared-archive-resources/META-INF/NOTICE
> (No such file or directory)
> at java.io.FileOutputStream.open(Native Method)
> at java.io.FileOutputStream.<init>(FileOutputStream.java:194)
> at java.io.FileOutputStream.<init>(FileOutputStream.java:145)
> at java.io.FileWriter.<init>(FileWriter.java:73)
> at
> org.apache.maven.plugin.resources.remote.ProcessRemoteResourcesMojo.processResourceBundles(ProcessRemoteResourcesMojo.java:1093)
> ... 22 more
> [ERROR]
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionExceptio
> n
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
> Thanks and Regards,
> Truong Phan
>
>
> P + 61 2 8576 5771
> M + 61 4 1463 7424
> E troung.phan@team.telstra.com
> W www.telstra.com
>
>
>
> -----Original Message-----
> From: Phan, Truong Q [mailto:Troung.Phan@team.telstra.com]
> Sent: Friday, 4 April 2014 11:03 AM
> To: user@mahout.apache.org
> Subject: RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
>
> Hi Gokhan,
>
> I having difficult to checkout the latest trunk using MVN.
> Here is my checkout issue.
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> $ sudo git config --global http.proxy http://58.162.7.28:3128 $ sudo
> git config --global http.sslVerify false $ sudo git clone
> https://github.com/apache/mahout Cloning into 'mahout'...
> remote: Reusing existing pack: 76730, done.
> remote: Total 76730 (delta 0), reused 0 (delta 0) Receiving objects:
> 100% (76730/76730), 49.16 MiB | 191 KiB/s, done.
> Resolving deltas: 100% (34682/34682), done.
> warning: remote HEAD refers to nonexistent ref, unable to checkout.
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Thanks and Regards,
> Truong Phan
>
>
> P + 61 2 8576 5771
> M + 61 4 1463 7424
> E troung.phan@team.telstra.com
> W www.telstra.com
>
>
>
> -----Original Message-----
> From: Gokhan Capan [mailto:gkhncpn@gmail.com]
> Sent: Friday, 4 April 2014 5:50 AM
> To: user@mahout.apache.org
> Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
>
> Could you checkout the latest trunk and build the project again?
>
> Sent from my iPhone
>
> > On Apr 2, 2014, at 9:50, Sean Owen <sr...@gmail.com> wrote:
> >
> > Not sure what's going on there. Your build is somehow internally
> > inconsistent at runtime since it fails on the client side due to
> > mismatching Hadoop versions. I can start making up increasingly
> > unlikely causes, like you are building against local copies of the
> > artifacts that are old? Running clean and install should help if so.
> >
> > You might debug the script to print exactly what it is running.
> > On Apr 2, 2014 7:59 AM, "Phan, Truong Q"
> > <Tr...@team.telstra.com>
> > wrote:
> >
> >> The build was successful with those "warning".
> >>
> >> I could not run a test case from this website:
> >> http://girlincomputerscience.blogspot.com.au/2010/11/apache-mahout.
> >> ht
> >> ml
> >>
> >> Here are my run with the error:
> >>
> >>
> >>
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> $ pwd
> >>
> >> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-dist
> >> ri
> >> bution-0.9
> >>
> >> $ echo $CLASSPATH
> >>
> >> $ echo $PATH
> >>
> >> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-dist
> >> ri
> >> bution-0.9/bin:/usr/local/apache-maven/apache-maven-3.2.1/bin:/usr/
> >> lo
> >> cal/bin:/bin:/usr/bin:/home/oracle/bin:.:/usr/java/jdk1.6.0_32/bin
> >>
> >> $ echo $JAVA_HOME
> >> /usr/java/jdk1.6.0_32
> >>
> >> $ env | grep HAD
> >> HADOOP_CMD=/usr/bin/hadoop
> >> HADOOP_HOME=/usr/lib/hadoop
> >>
> >> HADOOP_STREAMING=/usr/lib/hadoop-mapreduce/hadoop-streaming-2.2.0-c
> >> dh
> >> 5.0.0-beta-1.jar
> >>
> >> $ mahout recommenditembased --input mydata.dat --usersFile user.dat
> >> --numRecommendations 2 --output output/ --similarityClassname
> >> SIMILARITY_PEARSON_CORRELATION Running on hadoop, using
> >> /usr/lib/hadoop/bin/hadoop and HADOOP_CONF_DIR=
> >> MAHOUT-JOB:
> >> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-dist
> >> ri bution-0.9/examples/target/mahout-examples-0.9-job.jar
> >> 14/04/02 16:52:48 INFO common.AbstractJob: Command line arguments:
> >> {--booleanData=[false], --endPhase=[2147483647],
> >> --input=[mydata.dat], --maxPrefsInItemSimilarity=[500],
> >> --maxPrefsPerUser=[10], --maxSimilaritiesPerItem=[100],
> >> --minPrefsPerUser=[1], --numRecommendations=[2],
> >> --output=[output/],
> >> --similarityClassname=[SIMILARITY_PEARSON_CORRELATION],
> >> --startPhase=[0], --tempDir=[temp], --usersFile=[user.dat]}
> >> 14/04/02 16:52:48 INFO common.AbstractJob: Command line arguments:
> >> {--booleanData=[false], --endPhase=[2147483647],
> >> --input=[mydata.dat], --minPrefsPerUser=[1],
> >> --output=[temp/preparePreferenceMatrix],
> >> --ratingShift=[0.0], --startPhase=[0], --tempDir=[temp]}
> >> 14/04/02 16:52:49 INFO Configuration.deprecation: mapred.input.dir
> >> is deprecated. Instead, use
> >> mapreduce.input.fileinputformat.inputdir
> >> 14/04/02 16:52:49 INFO Configuration.deprecation:
> >> mapred.compress.map.output is deprecated. Instead, use
> >> mapreduce.map.output.compress
> >> 14/04/02 16:52:49 INFO Configuration.deprecation: mapred.output.dir
> >> is deprecated. Instead, use
> >> mapreduce.output.fileoutputformat.outputdir
> >> Exception in thread "main" java.lang.IncompatibleClassChangeError:
> >> Found interface org.apache.hadoop.mapreduce.JobContext, but class
> >> was
> expected
> >> at
> >>
> org.apache.mahout.common.HadoopUtil.getCustomJobName(HadoopUtil.java:1
> 74)
> >> at
> >> org.apache.mahout.common.AbstractJob.prepareJob(AbstractJob.java:614)
> >> at
> >>
> org.apache.mahout.cf.taste.hadoop.preparation.PreparePreferenceMatrixJ
> ob.run(PreparePreferenceMatrixJob.java:73)
> >> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> >> at
> >>
> org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJ
> ob.java:164)
> >> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> >> at
> >>
> org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(Recommender
> Job.java:322)
> >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >> at
> >>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:39)
> >> at
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccess
> orImpl.java:25)
> >> at java.lang.reflect.Method.invoke(Method.java:597)
> >> at
> >>
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(Program
> Driver.java:72)
> >> at
> org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
> >> at
> >> org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
> >> at
> >> org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
> >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >> at
> >>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:39)
> >> at
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccess
> orImpl.java:25)
> >> at java.lang.reflect.Method.invoke(Method.java:597)
> >> at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
> >> oracle@bpdevdmsdbs01: ----
> >> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-dist
> >> ri
> >> bution-0.9
> >> -----
> >>
> >>
> >> Thanks and Regards,
> >> Truong Phan
> >>
> >>
> >> P + 61 2 8576 5771
> >> M + 61 4 1463 7424
> >> E troung.phan@team.telstra.com
> >> W www.telstra.com
> >>
> >>
> >>
> >> -----Original Message-----
> >> From: Sean Owen [mailto:srowen@gmail.com]
> >> Sent: Wednesday, 2 April 2014 4:05 PM
> >> To: Mahout User List
> >> Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
> >>
> >> Hm, OK something sounds wrong with your directory structure, given
> >> the warnings. I assumed this was changed. It could be that the
> >> .tar.gz distribution isn't quite correctly set up for building from
> source.
> >>
> >> The compilation here is nothing to do with Hadoop. You show a
> >> successful build; what's the part that fails?
> >>
> >> On Wed, Apr 2, 2014 at 6:59 AM, Phan, Truong Q <
> >> Troung.Phan@team.telstra.com> wrote:
> >>> Where did I modifying the build?
> >>> Here are my steps of the build.
> >>> I got the source from one of the official mirror website and build it.
> >>> The only one exception here is that I am using the Cloudera CDH 5.0.
> >>> This latest CDHv5.0 might not work with Mahout v0.9.
> >>>
> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >>> Install Mahout
> >>>
> >>> $ javac -version
> >>> javac 1.6.0_32
> >>>
> >>> $ cd /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout
> >>>
> >>> $ wget
> >>> http://mirror.mel.bkb.net.au/pub/apache/mahout/0.9/mahout-distribu
> >>> ti
> >>> on
> >>> -0.9-src.tar.gz
> >>>
> >>> $ mv mahout-distribution-0.9 mahout-distribution-0.9.old
> >>>
> >>> $ tar xvf mahout-distribution-0.9-src.tar.gz
> >>>
> >>> $ cd mahout-distribution-0.9
> >>>
> >>> $ ls
> >>> bin buildtools core distribution examples integration
> >>> LICENSE.txt math math-scala NOTICE.txt pom.xml README.txt src
> >>>
> >>> $ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1
> >> -DskipTests=true [INFO] Scanning for projects...
> >>> ............
> >>>
> >>> [INFO]
> >>> ------------------------------------------------------------------
> >>> --
> >>> --
> >>> --
> >>> [INFO] Reactor Summary:
> >>> [INFO]
> >>> [INFO] Mahout Build Tools ................................ SUCCESS
> >>> [
> >>> 7.235 s] [INFO] Apache Mahout .....................................
> >>> SUCCESS [ 1.017 s] [INFO] Mahout Math
> >>> ....................................... SUCCESS [15:46 min] [INFO]
> >>> Mahout Core ....................................... SUCCESS [24:29
> >>> min] [INFO] Mahout Integration ................................
> >>> SUCCESS [03:38 min] [INFO] Mahout Examples
> >>> ................................... SUCCESS [02:40 min] [INFO]
> >>> Mahout Release Package ............................ SUCCESS [
> >>> 0.075 s] [INFO] Mahout Math/Scala wrappers ........................
> >>> SUCCESS
> >>> [01:12 min] [INFO]
> >>> ------------------------------------------------------------------
> >>> --
> >>> --
> >>> --
> >>> [INFO] BUILD SUCCESS
> >>> [INFO]
> >>> ------------------------------------------------------------------
> >>> --
> >>> --
> >>> --
> >>> [INFO] Total time: 47:57 min
> >>> [INFO] Finished at: 2014-04-02T15:07:50+10:00 [INFO] Final Memory:
> >>> 49M/288M [INFO]
> >>> ------------------------------------------------------------------
> >>> --
> >>> --
> >>> --
> >>>
> >>>
> >>> Thanks and Regards,
> >>> Truong Phan
> >>>
> >>>
> >>> P + 61 2 8576 5771
> >>> M + 61 4 1463 7424
> >>> E troung.phan@team.telstra.com
> >>> W www.telstra.com
> >>>
> >>>
> >>>
> >>> -----Original Message-----
> >>> From: Sean Owen [mailto:srowen@gmail.com]
> >>> Sent: Wednesday, 2 April 2014 3:33 PM
> >>> To: Mahout User List
> >>> Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
> >>>
> >>> This may be getting to you're-on-your-own-territory since you're
> >> modifying the build. This error means your directory structure
> >> doesn't match up with declarations. You said somewhere that the
> >> parent of module X was Y, but the location given points to the pom
> >> of a
> module that isn't Y.
> >>>
> >>> On Wed, Apr 2, 2014 at 5:28 AM, Phan, Truong Q <
> >> Troung.Phan@team.telstra.com> wrote:
> >>>> Hi Sean,
> >>>>
> >>>> I am trying to build the Mahout again and got some WARNINGs so far.
> >>>> Can you give me some hints what I have done wrong here?
> >>>>
> >>>> Thanks for your help so far.
> >>
>
RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
Posted by "Phan, Truong Q" <Tr...@team.telstra.com>.
Hi Gokhan,
I still could not build the Mahout out from the trunk.
Please see below for the error.
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
svn co http://svn.apache.org/repos/asf/mahout/trunk/ mahout-trunk
cd mahout-trunk
mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0 -DskipTests=true
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.mahout:mahout-spark:jar:1.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.version' for org.scala-tools:maven-scala-plugin is missing. @ line 108, column 15
[WARNING] The expression ${pom.version} is deprecated. Please use ${project.version} instead.
[WARNING] The expression ${pom.version} is deprecated. Please use ${project.version} instead.
[WARNING] The expression ${pom.version} is deprecated. Please use ${project.version} instead.
[WARNING] The expression ${pom.version} is deprecated. Please use ${project.version} instead.
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO]
[INFO] Mahout Build Tools
[INFO] Apache Mahout
[INFO] Mahout Math
[INFO] Mahout Core
[INFO] Mahout Integration
[INFO] Mahout Examples
[INFO] Mahout Release Package
[INFO] Mahout Math/Scala wrappers
[INFO] Mahout Spark bindings
..... CUT OFF LINES
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Mahout Build Tools ................................ SUCCESS [ 7.381 s]
[INFO] Apache Mahout ..................................... SUCCESS [ 0.896 s]
[INFO] Mahout Math ....................................... SUCCESS [15:38 min]
[INFO] Mahout Core ....................................... FAILURE [ 2.135 s]
[INFO] Mahout Integration ................................ SKIPPED
[INFO] Mahout Examples ................................... SKIPPED
[INFO] Mahout Release Package ............................ SKIPPED
[INFO] Mahout Math/Scala wrappers ........................ SKIPPED
[INFO] Mahout Spark bindings ............................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 15:50 min
[INFO] Finished at: 2014-04-07T13:35:29+10:00
[INFO] Final Memory: 29M/241M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project mahout-core: Could not resolve dependencies for project org.apache.mahout:mahout-core:jar:1.0-SNAPSHOT: The following artifacts could not be resolved: org.apache.hadoop:hadoop-common:jar:2.2.0-cdh5.0.0, org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.2.0-cdh5.0.0, org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.2.0-cdh5.0.0: Could not find artifact org.apache.hadoop:hadoop-common:jar:2.2.0-cdh5.0.0 in central (http://repo.maven.apache.org/maven2) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :mahout-core
Thanks and Regards,
Truong Phan
P + 61 2 8576 5771
M + 61 4 1463 7424
E troung.phan@team.telstra.com
W www.telstra.com
-----Original Message-----
From: Gokhan Capan [mailto:gkhncpn@gmail.com]
Sent: Saturday, 5 April 2014 1:14 AM
To: user@mahout.apache.org
Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
Hi,
Could you try that:
$ svn co http://svn.apache.org/repos/asf/mahout/trunk/ mahout-trunk $ cd mahout-trunk $ mvn package -DskipTests=true -Dhadoop2.version=<YOUR_VERSION>
Best
Gokhan
On Fri, Apr 4, 2014 at 6:20 AM, Phan, Truong Q <Troung.Phan@team.telstra.com
> wrote:
> Hi
>
> I have managed to pull down the latest trunk from (
> https://github.com/apache/mahout) but I now having another problem
> with the build from this latest branch ("trunk").
> Please see below for my steps and errors.
>
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> $ sudo git clone https://github.com/apache/mahout mahout-latest
> Cloning into 'mahout-latest'...
> remote: Reusing existing pack: 76730, done.
> remote: Total 76730 (delta 0), reused 0 (delta 0) Receiving objects:
> 100% (76730/76730), 49.16 MiB | 193 KiB/s, done.
> Resolving deltas: 100% (34682/34682), done.
> warning: remote HEAD refers to nonexistent ref, unable to checkout.
>
> $ cd mahout-latest/
>
> $ sudo git branch -a
> remotes/origin/mahout-0.1
> remotes/origin/mahout-0.2
> remotes/origin/mahout-0.8
> remotes/origin/trunk
>
> $ sudo rm -rf mahout-latest
>
> $ sudo git clone -b trunk https://github.com/apache/mahout
> mahout-latest Cloning into 'mahout-latest'...
> remote: Reusing existing pack: 76730, done.
> remote: Total 76730 (delta 0), reused 0 (delta 0) Receiving objects:
> 100% (76730/76730), 49.16 MiB | 194 KiB/s, done.
> Resolving deltas: 100% (34682/34682), done.
> Checking out files: 100% (1475/1475), done.
>
> mvn -X install
>
> Apache Maven 3.2.1 (ea8b2b07643dbb1b84b6d16e1f08391b666bc1e9;
> 2014-02-15T04:37:52+10:00)
> Maven home: /usr/local/apache-maven/apache-maven-3.2.1
> Java version: 1.6.0_32, vendor: Sun Microsystems Inc.
> Java home: /usr/java/jdk1.6.0_32/jre
> Default locale: en_US, platform encoding: UTF-8 OS name: "linux",
> version: "2.6.18-274.el5", arch: "amd64", family: "unix"
> [INFO] Error stacktraces are turned on.
> [DEBUG] Reading global settings from
> /usr/local/apache-maven/apache-maven-3.2.1/conf/settings.xml
> [DEBUG] Reading user settings from /home/oracle/.m2/settings.xml
> [DEBUG] Using local repository at /home/oracle/.m2/repository [DEBUG]
> Using manager EnhancedLocalRepositoryManager with priority 10.0 for
> /home/oracle/.m2/repository [INFO] Scanning for projects...
> [DEBUG] Extension realms for project
> org.apache.mahout:mahout:pom:1.0-SNAPSHOT: (none) [DEBUG] Looking up
> lifecyle mappings for packaging pom from ClassRealm[plexus.core,
> parent: null] [DEBUG] Extension realms for project
> org.apache.mahout:mahout-buildtools:jar:1.0-SNAPSHOT: (none) [DEBUG]
> Looking up lifecyle mappings for packaging jar from
> ClassRealm[plexus.core, parent: null] [DEBUG] Extension realms for
> project
> org.apache.mahout:mahout-math:jar:1.0-SNAPSHOT: (none) [DEBUG] Looking
> up lifecyle mappings for packaging jar from ClassRealm[plexus.core,
> parent: null] [DEBUG] Extension realms for project
> org.apache.mahout:mahout-core:jar:1.0-SNAPSHOT: (none) [DEBUG] Looking
> up lifecyle mappings for packaging jar from ClassRealm[plexus.core,
> parent: null] [DEBUG] Extension realms for project
> org.apache.mahout:mahout-integration:jar:1.0-SNAPSHOT: (none) [DEBUG]
> Looking up lifecyle mappings for packaging jar from
> ClassRealm[plexus.core, parent: null] [DEBUG] Extension realms for
> project
> org.apache.mahout:mahout-examples:jar:1.0-SNAPSHOT: (none) [DEBUG]
> Looking up lifecyle mappings for packaging jar from
> ClassRealm[plexus.core, parent: null] [DEBUG] Extension realms for
> project
> org.apache.mahout:mahout-distribution:pom:1.0-SNAPSHOT: (none) [DEBUG]
> Looking up lifecyle mappings for packaging pom from
> ClassRealm[plexus.core, parent: null] [DEBUG] Extension realms for
> project
> org.apache.mahout:mahout-math-scala:jar:1.0-SNAPSHOT: (none) [DEBUG]
> Looking up lifecyle mappings for packaging jar from
> ClassRealm[plexus.core, parent: null] [DEBUG] Extension realms for
> project
> org.apache.mahout:mahout-spark:jar:1.0-SNAPSHOT: (none) [DEBUG]
> Looking up lifecyle mappings for packaging jar from
> ClassRealm[plexus.core, parent: null] [WARNING] [WARNING] Some
> problems were encountered while building the effective model for
> org.apache.mahout:mahout-spark:jar:1.0-SNAPSHOT
> [WARNING] 'build.plugins.plugin.version' for
> org.scala-tools:maven-scala-plugin is missing. @ line 108, column 15
> [WARNING] The expression ${pom.version} is deprecated. Please use
> ${project.version} instead.
> [WARNING] The expression ${pom.version} is deprecated. Please use
> ${project.version} instead.
> [WARNING] The expression ${pom.version} is deprecated. Please use
> ${project.version} instead.
> [WARNING] The expression ${pom.version} is deprecated. Please use
> ${project.version} instead.
> [WARNING]
> [WARNING] It is highly recommended to fix these problems because they
> threaten the stability of your build.
> [WARNING]
> [WARNING] For this reason, future Maven versions might no longer
> support building such malformed projects.
> [WARNING]
>
> ................ CUT OFF LINES ....
>
> [INFO]
> ----------------------------------------------------------------------
> --
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Mahout Build Tools ................................ FAILURE [
> 0.991 s]
> [INFO] Apache Mahout ..................................... SKIPPED
> [INFO] Mahout Math ....................................... SKIPPED
> [INFO] Mahout Core ....................................... SKIPPED
> [INFO] Mahout Integration ................................ SKIPPED
> [INFO] Mahout Examples ................................... SKIPPED
> [INFO] Mahout Release Package ............................ SKIPPED
> [INFO] Mahout Math/Scala wrappers ........................ SKIPPED
> [INFO] Mahout Spark bindings ............................. SKIPPED
> [INFO]
> ----------------------------------------------------------------------
> --
> [INFO] BUILD FAILURE
> [INFO]
> ----------------------------------------------------------------------
> --
> [INFO] Total time: 2.495 s
> [INFO] Finished at: 2014-04-04T14:04:56+10:00 [INFO] Final Memory:
> 9M/245M [INFO]
> ----------------------------------------------------------------------
> --
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-remote-resources-plugin:1.1:process
> (default) on project mahout-buildtools: Error finding remote resources
> manifests:
> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-latest/
> buildtools/target/maven-shared-archive-resources/META-INF/NOTICE
> (No such file or directory) -> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to
> execute goal
> org.apache.maven.plugins:maven-remote-resources-plugin:1.1:process
> (default) on project mahout-buildtools: Error finding remote resources
> manifests
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
> at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:3
> 56) Caused by: org.apache.maven.plugin.MojoExecutionException: Error
> finding remote resources manifests
> at
> org.apache.maven.plugin.resources.remote.ProcessRemoteResourcesMojo.processResourceBundles(ProcessRemoteResourcesMojo.java:1185)
> at
> org.apache.maven.plugin.resources.remote.ProcessRemoteResourcesMojo.execute(ProcessRemoteResourcesMojo.java:500)
> at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> ... 19 more
> Caused by: java.io.FileNotFoundException:
> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-latest/
> buildtools/target/maven-shared-archive-resources/META-INF/NOTICE
> (No such file or directory)
> at java.io.FileOutputStream.open(Native Method)
> at java.io.FileOutputStream.<init>(FileOutputStream.java:194)
> at java.io.FileOutputStream.<init>(FileOutputStream.java:145)
> at java.io.FileWriter.<init>(FileWriter.java:73)
> at
> org.apache.maven.plugin.resources.remote.ProcessRemoteResourcesMojo.processResourceBundles(ProcessRemoteResourcesMojo.java:1093)
> ... 22 more
> [ERROR]
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionExceptio
> n
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
> Thanks and Regards,
> Truong Phan
>
>
> P + 61 2 8576 5771
> M + 61 4 1463 7424
> E troung.phan@team.telstra.com
> W www.telstra.com
>
>
>
> -----Original Message-----
> From: Phan, Truong Q [mailto:Troung.Phan@team.telstra.com]
> Sent: Friday, 4 April 2014 11:03 AM
> To: user@mahout.apache.org
> Subject: RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
>
> Hi Gokhan,
>
> I having difficult to checkout the latest trunk using MVN.
> Here is my checkout issue.
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> $ sudo git config --global http.proxy http://58.162.7.28:3128 $ sudo
> git config --global http.sslVerify false $ sudo git clone
> https://github.com/apache/mahout Cloning into 'mahout'...
> remote: Reusing existing pack: 76730, done.
> remote: Total 76730 (delta 0), reused 0 (delta 0) Receiving objects:
> 100% (76730/76730), 49.16 MiB | 191 KiB/s, done.
> Resolving deltas: 100% (34682/34682), done.
> warning: remote HEAD refers to nonexistent ref, unable to checkout.
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Thanks and Regards,
> Truong Phan
>
>
> P + 61 2 8576 5771
> M + 61 4 1463 7424
> E troung.phan@team.telstra.com
> W www.telstra.com
>
>
>
> -----Original Message-----
> From: Gokhan Capan [mailto:gkhncpn@gmail.com]
> Sent: Friday, 4 April 2014 5:50 AM
> To: user@mahout.apache.org
> Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
>
> Could you checkout the latest trunk and build the project again?
>
> Sent from my iPhone
>
> > On Apr 2, 2014, at 9:50, Sean Owen <sr...@gmail.com> wrote:
> >
> > Not sure what's going on there. Your build is somehow internally
> > inconsistent at runtime since it fails on the client side due to
> > mismatching Hadoop versions. I can start making up increasingly
> > unlikely causes, like you are building against local copies of the
> > artifacts that are old? Running clean and install should help if so.
> >
> > You might debug the script to print exactly what it is running.
> > On Apr 2, 2014 7:59 AM, "Phan, Truong Q"
> > <Tr...@team.telstra.com>
> > wrote:
> >
> >> The build was successful with those "warning".
> >>
> >> I could not run a test case from this website:
> >> http://girlincomputerscience.blogspot.com.au/2010/11/apache-mahout.
> >> ht
> >> ml
> >>
> >> Here are my run with the error:
> >>
> >>
> >>
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> $ pwd
> >>
> >> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-dist
> >> ri
> >> bution-0.9
> >>
> >> $ echo $CLASSPATH
> >>
> >> $ echo $PATH
> >>
> >> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-dist
> >> ri
> >> bution-0.9/bin:/usr/local/apache-maven/apache-maven-3.2.1/bin:/usr/
> >> lo
> >> cal/bin:/bin:/usr/bin:/home/oracle/bin:.:/usr/java/jdk1.6.0_32/bin
> >>
> >> $ echo $JAVA_HOME
> >> /usr/java/jdk1.6.0_32
> >>
> >> $ env | grep HAD
> >> HADOOP_CMD=/usr/bin/hadoop
> >> HADOOP_HOME=/usr/lib/hadoop
> >>
> >> HADOOP_STREAMING=/usr/lib/hadoop-mapreduce/hadoop-streaming-2.2.0-c
> >> dh
> >> 5.0.0-beta-1.jar
> >>
> >> $ mahout recommenditembased --input mydata.dat --usersFile user.dat
> >> --numRecommendations 2 --output output/ --similarityClassname
> >> SIMILARITY_PEARSON_CORRELATION Running on hadoop, using
> >> /usr/lib/hadoop/bin/hadoop and HADOOP_CONF_DIR=
> >> MAHOUT-JOB:
> >> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-dist
> >> ri bution-0.9/examples/target/mahout-examples-0.9-job.jar
> >> 14/04/02 16:52:48 INFO common.AbstractJob: Command line arguments:
> >> {--booleanData=[false], --endPhase=[2147483647],
> >> --input=[mydata.dat], --maxPrefsInItemSimilarity=[500],
> >> --maxPrefsPerUser=[10], --maxSimilaritiesPerItem=[100],
> >> --minPrefsPerUser=[1], --numRecommendations=[2],
> >> --output=[output/],
> >> --similarityClassname=[SIMILARITY_PEARSON_CORRELATION],
> >> --startPhase=[0], --tempDir=[temp], --usersFile=[user.dat]}
> >> 14/04/02 16:52:48 INFO common.AbstractJob: Command line arguments:
> >> {--booleanData=[false], --endPhase=[2147483647],
> >> --input=[mydata.dat], --minPrefsPerUser=[1],
> >> --output=[temp/preparePreferenceMatrix],
> >> --ratingShift=[0.0], --startPhase=[0], --tempDir=[temp]}
> >> 14/04/02 16:52:49 INFO Configuration.deprecation: mapred.input.dir
> >> is deprecated. Instead, use
> >> mapreduce.input.fileinputformat.inputdir
> >> 14/04/02 16:52:49 INFO Configuration.deprecation:
> >> mapred.compress.map.output is deprecated. Instead, use
> >> mapreduce.map.output.compress
> >> 14/04/02 16:52:49 INFO Configuration.deprecation: mapred.output.dir
> >> is deprecated. Instead, use
> >> mapreduce.output.fileoutputformat.outputdir
> >> Exception in thread "main" java.lang.IncompatibleClassChangeError:
> >> Found interface org.apache.hadoop.mapreduce.JobContext, but class
> >> was
> expected
> >> at
> >>
> org.apache.mahout.common.HadoopUtil.getCustomJobName(HadoopUtil.java:1
> 74)
> >> at
> >> org.apache.mahout.common.AbstractJob.prepareJob(AbstractJob.java:614)
> >> at
> >>
> org.apache.mahout.cf.taste.hadoop.preparation.PreparePreferenceMatrixJ
> ob.run(PreparePreferenceMatrixJob.java:73)
> >> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> >> at
> >>
> org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJ
> ob.java:164)
> >> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> >> at
> >>
> org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(Recommender
> Job.java:322)
> >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >> at
> >>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:39)
> >> at
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccess
> orImpl.java:25)
> >> at java.lang.reflect.Method.invoke(Method.java:597)
> >> at
> >>
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(Program
> Driver.java:72)
> >> at
> org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
> >> at
> >> org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
> >> at
> >> org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
> >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >> at
> >>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:39)
> >> at
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccess
> orImpl.java:25)
> >> at java.lang.reflect.Method.invoke(Method.java:597)
> >> at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
> >> oracle@bpdevdmsdbs01: ----
> >> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-dist
> >> ri
> >> bution-0.9
> >> -----
> >>
> >>
> >> Thanks and Regards,
> >> Truong Phan
> >>
> >>
> >> P + 61 2 8576 5771
> >> M + 61 4 1463 7424
> >> E troung.phan@team.telstra.com
> >> W www.telstra.com
> >>
> >>
> >>
> >> -----Original Message-----
> >> From: Sean Owen [mailto:srowen@gmail.com]
> >> Sent: Wednesday, 2 April 2014 4:05 PM
> >> To: Mahout User List
> >> Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
> >>
> >> Hm, OK something sounds wrong with your directory structure, given
> >> the warnings. I assumed this was changed. It could be that the
> >> .tar.gz distribution isn't quite correctly set up for building from
> source.
> >>
> >> The compilation here is nothing to do with Hadoop. You show a
> >> successful build; what's the part that fails?
> >>
> >> On Wed, Apr 2, 2014 at 6:59 AM, Phan, Truong Q <
> >> Troung.Phan@team.telstra.com> wrote:
> >>> Where did I modifying the build?
> >>> Here are my steps of the build.
> >>> I got the source from one of the official mirror website and build it.
> >>> The only one exception here is that I am using the Cloudera CDH 5.0.
> >>> This latest CDHv5.0 might not work with Mahout v0.9.
> >>>
> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >>> Install Mahout
> >>>
> >>> $ javac -version
> >>> javac 1.6.0_32
> >>>
> >>> $ cd /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout
> >>>
> >>> $ wget
> >>> http://mirror.mel.bkb.net.au/pub/apache/mahout/0.9/mahout-distribu
> >>> ti
> >>> on
> >>> -0.9-src.tar.gz
> >>>
> >>> $ mv mahout-distribution-0.9 mahout-distribution-0.9.old
> >>>
> >>> $ tar xvf mahout-distribution-0.9-src.tar.gz
> >>>
> >>> $ cd mahout-distribution-0.9
> >>>
> >>> $ ls
> >>> bin buildtools core distribution examples integration
> >>> LICENSE.txt math math-scala NOTICE.txt pom.xml README.txt
> >>> src
> >>>
> >>> $ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1
> >> -DskipTests=true [INFO] Scanning for projects...
> >>> ............
> >>>
> >>> [INFO]
> >>> ------------------------------------------------------------------
> >>> --
> >>> --
> >>> --
> >>> [INFO] Reactor Summary:
> >>> [INFO]
> >>> [INFO] Mahout Build Tools ................................ SUCCESS
> >>> [
> >>> 7.235 s] [INFO] Apache Mahout .....................................
> >>> SUCCESS [ 1.017 s] [INFO] Mahout Math
> >>> ....................................... SUCCESS [15:46 min] [INFO]
> >>> Mahout Core ....................................... SUCCESS [24:29
> >>> min] [INFO] Mahout Integration ................................
> >>> SUCCESS [03:38 min] [INFO] Mahout Examples
> >>> ................................... SUCCESS [02:40 min] [INFO]
> >>> Mahout Release Package ............................ SUCCESS [
> >>> 0.075 s] [INFO] Mahout Math/Scala wrappers ........................
> >>> SUCCESS
> >>> [01:12 min] [INFO]
> >>> ------------------------------------------------------------------
> >>> --
> >>> --
> >>> --
> >>> [INFO] BUILD SUCCESS
> >>> [INFO]
> >>> ------------------------------------------------------------------
> >>> --
> >>> --
> >>> --
> >>> [INFO] Total time: 47:57 min
> >>> [INFO] Finished at: 2014-04-02T15:07:50+10:00 [INFO] Final Memory:
> >>> 49M/288M [INFO]
> >>> ------------------------------------------------------------------
> >>> --
> >>> --
> >>> --
> >>>
> >>>
> >>> Thanks and Regards,
> >>> Truong Phan
> >>>
> >>>
> >>> P + 61 2 8576 5771
> >>> M + 61 4 1463 7424
> >>> E troung.phan@team.telstra.com
> >>> W www.telstra.com
> >>>
> >>>
> >>>
> >>> -----Original Message-----
> >>> From: Sean Owen [mailto:srowen@gmail.com]
> >>> Sent: Wednesday, 2 April 2014 3:33 PM
> >>> To: Mahout User List
> >>> Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
> >>>
> >>> This may be getting to you're-on-your-own-territory since you're
> >> modifying the build. This error means your directory structure
> >> doesn't match up with declarations. You said somewhere that the
> >> parent of module X was Y, but the location given points to the pom
> >> of a
> module that isn't Y.
> >>>
> >>> On Wed, Apr 2, 2014 at 5:28 AM, Phan, Truong Q <
> >> Troung.Phan@team.telstra.com> wrote:
> >>>> Hi Sean,
> >>>>
> >>>> I am trying to build the Mahout again and got some WARNINGs so far.
> >>>> Can you give me some hints what I have done wrong here?
> >>>>
> >>>> Thanks for your help so far.
> >>
>
Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
Posted by Gokhan Capan <gk...@gmail.com>.
Hi,
Could you try that:
$ svn co http://svn.apache.org/repos/asf/mahout/trunk/ mahout-trunk
$ cd mahout-trunk
$ mvn package -DskipTests=true -Dhadoop2.version=<YOUR_VERSION>
Best
Gokhan
On Fri, Apr 4, 2014 at 6:20 AM, Phan, Truong Q <Troung.Phan@team.telstra.com
> wrote:
> Hi
>
> I have managed to pull down the latest trunk from (
> https://github.com/apache/mahout) but I now having another problem with
> the build from this latest branch ("trunk").
> Please see below for my steps and errors.
>
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> $ sudo git clone https://github.com/apache/mahout mahout-latest
> Cloning into 'mahout-latest'...
> remote: Reusing existing pack: 76730, done.
> remote: Total 76730 (delta 0), reused 0 (delta 0)
> Receiving objects: 100% (76730/76730), 49.16 MiB | 193 KiB/s, done.
> Resolving deltas: 100% (34682/34682), done.
> warning: remote HEAD refers to nonexistent ref, unable to checkout.
>
> $ cd mahout-latest/
>
> $ sudo git branch -a
> remotes/origin/mahout-0.1
> remotes/origin/mahout-0.2
> remotes/origin/mahout-0.8
> remotes/origin/trunk
>
> $ sudo rm -rf mahout-latest
>
> $ sudo git clone -b trunk https://github.com/apache/mahout mahout-latest
> Cloning into 'mahout-latest'...
> remote: Reusing existing pack: 76730, done.
> remote: Total 76730 (delta 0), reused 0 (delta 0)
> Receiving objects: 100% (76730/76730), 49.16 MiB | 194 KiB/s, done.
> Resolving deltas: 100% (34682/34682), done.
> Checking out files: 100% (1475/1475), done.
>
> mvn -X install
>
> Apache Maven 3.2.1 (ea8b2b07643dbb1b84b6d16e1f08391b666bc1e9;
> 2014-02-15T04:37:52+10:00)
> Maven home: /usr/local/apache-maven/apache-maven-3.2.1
> Java version: 1.6.0_32, vendor: Sun Microsystems Inc.
> Java home: /usr/java/jdk1.6.0_32/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "linux", version: "2.6.18-274.el5", arch: "amd64", family: "unix"
> [INFO] Error stacktraces are turned on.
> [DEBUG] Reading global settings from
> /usr/local/apache-maven/apache-maven-3.2.1/conf/settings.xml
> [DEBUG] Reading user settings from /home/oracle/.m2/settings.xml
> [DEBUG] Using local repository at /home/oracle/.m2/repository
> [DEBUG] Using manager EnhancedLocalRepositoryManager with priority 10.0
> for /home/oracle/.m2/repository
> [INFO] Scanning for projects...
> [DEBUG] Extension realms for project
> org.apache.mahout:mahout:pom:1.0-SNAPSHOT: (none)
> [DEBUG] Looking up lifecyle mappings for packaging pom from
> ClassRealm[plexus.core, parent: null]
> [DEBUG] Extension realms for project
> org.apache.mahout:mahout-buildtools:jar:1.0-SNAPSHOT: (none)
> [DEBUG] Looking up lifecyle mappings for packaging jar from
> ClassRealm[plexus.core, parent: null]
> [DEBUG] Extension realms for project
> org.apache.mahout:mahout-math:jar:1.0-SNAPSHOT: (none)
> [DEBUG] Looking up lifecyle mappings for packaging jar from
> ClassRealm[plexus.core, parent: null]
> [DEBUG] Extension realms for project
> org.apache.mahout:mahout-core:jar:1.0-SNAPSHOT: (none)
> [DEBUG] Looking up lifecyle mappings for packaging jar from
> ClassRealm[plexus.core, parent: null]
> [DEBUG] Extension realms for project
> org.apache.mahout:mahout-integration:jar:1.0-SNAPSHOT: (none)
> [DEBUG] Looking up lifecyle mappings for packaging jar from
> ClassRealm[plexus.core, parent: null]
> [DEBUG] Extension realms for project
> org.apache.mahout:mahout-examples:jar:1.0-SNAPSHOT: (none)
> [DEBUG] Looking up lifecyle mappings for packaging jar from
> ClassRealm[plexus.core, parent: null]
> [DEBUG] Extension realms for project
> org.apache.mahout:mahout-distribution:pom:1.0-SNAPSHOT: (none)
> [DEBUG] Looking up lifecyle mappings for packaging pom from
> ClassRealm[plexus.core, parent: null]
> [DEBUG] Extension realms for project
> org.apache.mahout:mahout-math-scala:jar:1.0-SNAPSHOT: (none)
> [DEBUG] Looking up lifecyle mappings for packaging jar from
> ClassRealm[plexus.core, parent: null]
> [DEBUG] Extension realms for project
> org.apache.mahout:mahout-spark:jar:1.0-SNAPSHOT: (none)
> [DEBUG] Looking up lifecyle mappings for packaging jar from
> ClassRealm[plexus.core, parent: null]
> [WARNING]
> [WARNING] Some problems were encountered while building the effective
> model for org.apache.mahout:mahout-spark:jar:1.0-SNAPSHOT
> [WARNING] 'build.plugins.plugin.version' for
> org.scala-tools:maven-scala-plugin is missing. @ line 108, column 15
> [WARNING] The expression ${pom.version} is deprecated. Please use
> ${project.version} instead.
> [WARNING] The expression ${pom.version} is deprecated. Please use
> ${project.version} instead.
> [WARNING] The expression ${pom.version} is deprecated. Please use
> ${project.version} instead.
> [WARNING] The expression ${pom.version} is deprecated. Please use
> ${project.version} instead.
> [WARNING]
> [WARNING] It is highly recommended to fix these problems because they
> threaten the stability of your build.
> [WARNING]
> [WARNING] For this reason, future Maven versions might no longer support
> building such malformed projects.
> [WARNING]
>
> ................ CUT OFF LINES ....
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Mahout Build Tools ................................ FAILURE [
> 0.991 s]
> [INFO] Apache Mahout ..................................... SKIPPED
> [INFO] Mahout Math ....................................... SKIPPED
> [INFO] Mahout Core ....................................... SKIPPED
> [INFO] Mahout Integration ................................ SKIPPED
> [INFO] Mahout Examples ................................... SKIPPED
> [INFO] Mahout Release Package ............................ SKIPPED
> [INFO] Mahout Math/Scala wrappers ........................ SKIPPED
> [INFO] Mahout Spark bindings ............................. SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 2.495 s
> [INFO] Finished at: 2014-04-04T14:04:56+10:00
> [INFO] Final Memory: 9M/245M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-remote-resources-plugin:1.1:process
> (default) on project mahout-buildtools: Error finding remote resources
> manifests:
> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-latest/buildtools/target/maven-shared-archive-resources/META-INF/NOTICE
> (No such file or directory) -> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal org.apache.maven.plugins:maven-remote-resources-plugin:1.1:process
> (default) on project mahout-buildtools: Error finding remote resources
> manifests
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
> at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
> Caused by: org.apache.maven.plugin.MojoExecutionException: Error finding
> remote resources manifests
> at
> org.apache.maven.plugin.resources.remote.ProcessRemoteResourcesMojo.processResourceBundles(ProcessRemoteResourcesMojo.java:1185)
> at
> org.apache.maven.plugin.resources.remote.ProcessRemoteResourcesMojo.execute(ProcessRemoteResourcesMojo.java:500)
> at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
> ... 19 more
> Caused by: java.io.FileNotFoundException:
> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-latest/buildtools/target/maven-shared-archive-resources/META-INF/NOTICE
> (No such file or directory)
> at java.io.FileOutputStream.open(Native Method)
> at java.io.FileOutputStream.<init>(FileOutputStream.java:194)
> at java.io.FileOutputStream.<init>(FileOutputStream.java:145)
> at java.io.FileWriter.<init>(FileWriter.java:73)
> at
> org.apache.maven.plugin.resources.remote.ProcessRemoteResourcesMojo.processResourceBundles(ProcessRemoteResourcesMojo.java:1093)
> ... 22 more
> [ERROR]
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
> Thanks and Regards,
> Truong Phan
>
>
> P + 61 2 8576 5771
> M + 61 4 1463 7424
> E troung.phan@team.telstra.com
> W www.telstra.com
>
>
>
> -----Original Message-----
> From: Phan, Truong Q [mailto:Troung.Phan@team.telstra.com]
> Sent: Friday, 4 April 2014 11:03 AM
> To: user@mahout.apache.org
> Subject: RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
>
> Hi Gokhan,
>
> I having difficult to checkout the latest trunk using MVN.
> Here is my checkout issue.
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> $ sudo git config --global http.proxy http://58.162.7.28:3128 $ sudo git
> config --global http.sslVerify false $ sudo git clone
> https://github.com/apache/mahout Cloning into 'mahout'...
> remote: Reusing existing pack: 76730, done.
> remote: Total 76730 (delta 0), reused 0 (delta 0) Receiving objects: 100%
> (76730/76730), 49.16 MiB | 191 KiB/s, done.
> Resolving deltas: 100% (34682/34682), done.
> warning: remote HEAD refers to nonexistent ref, unable to checkout.
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Thanks and Regards,
> Truong Phan
>
>
> P + 61 2 8576 5771
> M + 61 4 1463 7424
> E troung.phan@team.telstra.com
> W www.telstra.com
>
>
>
> -----Original Message-----
> From: Gokhan Capan [mailto:gkhncpn@gmail.com]
> Sent: Friday, 4 April 2014 5:50 AM
> To: user@mahout.apache.org
> Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
>
> Could you checkout the latest trunk and build the project again?
>
> Sent from my iPhone
>
> > On Apr 2, 2014, at 9:50, Sean Owen <sr...@gmail.com> wrote:
> >
> > Not sure what's going on there. Your build is somehow internally
> > inconsistent at runtime since it fails on the client side due to
> > mismatching Hadoop versions. I can start making up increasingly
> > unlikely causes, like you are building against local copies of the
> > artifacts that are old? Running clean and install should help if so.
> >
> > You might debug the script to print exactly what it is running.
> > On Apr 2, 2014 7:59 AM, "Phan, Truong Q"
> > <Tr...@team.telstra.com>
> > wrote:
> >
> >> The build was successful with those "warning".
> >>
> >> I could not run a test case from this website:
> >> http://girlincomputerscience.blogspot.com.au/2010/11/apache-mahout.ht
> >> ml
> >>
> >> Here are my run with the error:
> >>
> >>
> >>
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> $ pwd
> >>
> >> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distri
> >> bution-0.9
> >>
> >> $ echo $CLASSPATH
> >>
> >> $ echo $PATH
> >>
> >> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distri
> >> bution-0.9/bin:/usr/local/apache-maven/apache-maven-3.2.1/bin:/usr/lo
> >> cal/bin:/bin:/usr/bin:/home/oracle/bin:.:/usr/java/jdk1.6.0_32/bin
> >>
> >> $ echo $JAVA_HOME
> >> /usr/java/jdk1.6.0_32
> >>
> >> $ env | grep HAD
> >> HADOOP_CMD=/usr/bin/hadoop
> >> HADOOP_HOME=/usr/lib/hadoop
> >>
> >> HADOOP_STREAMING=/usr/lib/hadoop-mapreduce/hadoop-streaming-2.2.0-cdh
> >> 5.0.0-beta-1.jar
> >>
> >> $ mahout recommenditembased --input mydata.dat --usersFile user.dat
> >> --numRecommendations 2 --output output/ --similarityClassname
> >> SIMILARITY_PEARSON_CORRELATION Running on hadoop, using
> >> /usr/lib/hadoop/bin/hadoop and HADOOP_CONF_DIR=
> >> MAHOUT-JOB:
> >> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distri
> >> bution-0.9/examples/target/mahout-examples-0.9-job.jar
> >> 14/04/02 16:52:48 INFO common.AbstractJob: Command line arguments:
> >> {--booleanData=[false], --endPhase=[2147483647],
> >> --input=[mydata.dat], --maxPrefsInItemSimilarity=[500],
> >> --maxPrefsPerUser=[10], --maxSimilaritiesPerItem=[100],
> >> --minPrefsPerUser=[1], --numRecommendations=[2], --output=[output/],
> >> --similarityClassname=[SIMILARITY_PEARSON_CORRELATION],
> >> --startPhase=[0], --tempDir=[temp], --usersFile=[user.dat]}
> >> 14/04/02 16:52:48 INFO common.AbstractJob: Command line arguments:
> >> {--booleanData=[false], --endPhase=[2147483647],
> >> --input=[mydata.dat], --minPrefsPerUser=[1],
> >> --output=[temp/preparePreferenceMatrix],
> >> --ratingShift=[0.0], --startPhase=[0], --tempDir=[temp]}
> >> 14/04/02 16:52:49 INFO Configuration.deprecation: mapred.input.dir is
> >> deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
> >> 14/04/02 16:52:49 INFO Configuration.deprecation:
> >> mapred.compress.map.output is deprecated. Instead, use
> >> mapreduce.map.output.compress
> >> 14/04/02 16:52:49 INFO Configuration.deprecation: mapred.output.dir
> >> is deprecated. Instead, use
> >> mapreduce.output.fileoutputformat.outputdir
> >> Exception in thread "main" java.lang.IncompatibleClassChangeError:
> >> Found interface org.apache.hadoop.mapreduce.JobContext, but class was
> expected
> >> at
> >>
> org.apache.mahout.common.HadoopUtil.getCustomJobName(HadoopUtil.java:174)
> >> at
> >> org.apache.mahout.common.AbstractJob.prepareJob(AbstractJob.java:614)
> >> at
> >>
> org.apache.mahout.cf.taste.hadoop.preparation.PreparePreferenceMatrixJob.run(PreparePreferenceMatrixJob.java:73)
> >> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> >> at
> >>
> org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:164)
> >> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> >> at
> >>
> org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:322)
> >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >> at
> >>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> >> at
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >> at java.lang.reflect.Method.invoke(Method.java:597)
> >> at
> >>
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
> >> at
> org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
> >> at
> >> org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
> >> at
> >> org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
> >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >> at
> >>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> >> at
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >> at java.lang.reflect.Method.invoke(Method.java:597)
> >> at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
> >> oracle@bpdevdmsdbs01: ----
> >> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distri
> >> bution-0.9
> >> -----
> >>
> >>
> >> Thanks and Regards,
> >> Truong Phan
> >>
> >>
> >> P + 61 2 8576 5771
> >> M + 61 4 1463 7424
> >> E troung.phan@team.telstra.com
> >> W www.telstra.com
> >>
> >>
> >>
> >> -----Original Message-----
> >> From: Sean Owen [mailto:srowen@gmail.com]
> >> Sent: Wednesday, 2 April 2014 4:05 PM
> >> To: Mahout User List
> >> Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
> >>
> >> Hm, OK something sounds wrong with your directory structure, given
> >> the warnings. I assumed this was changed. It could be that the
> >> .tar.gz distribution isn't quite correctly set up for building from
> source.
> >>
> >> The compilation here is nothing to do with Hadoop. You show a
> >> successful build; what's the part that fails?
> >>
> >> On Wed, Apr 2, 2014 at 6:59 AM, Phan, Truong Q <
> >> Troung.Phan@team.telstra.com> wrote:
> >>> Where did I modifying the build?
> >>> Here are my steps of the build.
> >>> I got the source from one of the official mirror website and build it.
> >>> The only one exception here is that I am using the Cloudera CDH 5.0.
> >>> This latest CDHv5.0 might not work with Mahout v0.9.
> >>>
> >>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >>> Install Mahout
> >>>
> >>> $ javac -version
> >>> javac 1.6.0_32
> >>>
> >>> $ cd /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout
> >>>
> >>> $ wget
> >>> http://mirror.mel.bkb.net.au/pub/apache/mahout/0.9/mahout-distributi
> >>> on
> >>> -0.9-src.tar.gz
> >>>
> >>> $ mv mahout-distribution-0.9 mahout-distribution-0.9.old
> >>>
> >>> $ tar xvf mahout-distribution-0.9-src.tar.gz
> >>>
> >>> $ cd mahout-distribution-0.9
> >>>
> >>> $ ls
> >>> bin buildtools core distribution examples integration
> >>> LICENSE.txt math math-scala NOTICE.txt pom.xml README.txt src
> >>>
> >>> $ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1
> >> -DskipTests=true [INFO] Scanning for projects...
> >>> ............
> >>>
> >>> [INFO]
> >>> --------------------------------------------------------------------
> >>> --
> >>> --
> >>> [INFO] Reactor Summary:
> >>> [INFO]
> >>> [INFO] Mahout Build Tools ................................ SUCCESS [
> >>> 7.235 s] [INFO] Apache Mahout .....................................
> >>> SUCCESS [ 1.017 s] [INFO] Mahout Math
> >>> ....................................... SUCCESS [15:46 min] [INFO]
> >>> Mahout Core ....................................... SUCCESS [24:29
> >>> min] [INFO] Mahout Integration ................................
> >>> SUCCESS [03:38 min] [INFO] Mahout Examples
> >>> ................................... SUCCESS [02:40 min] [INFO]
> >>> Mahout Release Package ............................ SUCCESS [ 0.075
> >>> s] [INFO] Mahout Math/Scala wrappers ........................
> >>> SUCCESS
> >>> [01:12 min] [INFO]
> >>> --------------------------------------------------------------------
> >>> --
> >>> --
> >>> [INFO] BUILD SUCCESS
> >>> [INFO]
> >>> --------------------------------------------------------------------
> >>> --
> >>> --
> >>> [INFO] Total time: 47:57 min
> >>> [INFO] Finished at: 2014-04-02T15:07:50+10:00 [INFO] Final Memory:
> >>> 49M/288M [INFO]
> >>> --------------------------------------------------------------------
> >>> --
> >>> --
> >>>
> >>>
> >>> Thanks and Regards,
> >>> Truong Phan
> >>>
> >>>
> >>> P + 61 2 8576 5771
> >>> M + 61 4 1463 7424
> >>> E troung.phan@team.telstra.com
> >>> W www.telstra.com
> >>>
> >>>
> >>>
> >>> -----Original Message-----
> >>> From: Sean Owen [mailto:srowen@gmail.com]
> >>> Sent: Wednesday, 2 April 2014 3:33 PM
> >>> To: Mahout User List
> >>> Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
> >>>
> >>> This may be getting to you're-on-your-own-territory since you're
> >> modifying the build. This error means your directory structure
> >> doesn't match up with declarations. You said somewhere that the
> >> parent of module X was Y, but the location given points to the pom of a
> module that isn't Y.
> >>>
> >>> On Wed, Apr 2, 2014 at 5:28 AM, Phan, Truong Q <
> >> Troung.Phan@team.telstra.com> wrote:
> >>>> Hi Sean,
> >>>>
> >>>> I am trying to build the Mahout again and got some WARNINGs so far.
> >>>> Can you give me some hints what I have done wrong here?
> >>>>
> >>>> Thanks for your help so far.
> >>
>
RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
Posted by "Phan, Truong Q" <Tr...@team.telstra.com>.
Hi
I have managed to pull down the latest trunk from (https://github.com/apache/mahout) but I now having another problem with the build from this latest branch ("trunk").
Please see below for my steps and errors.
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
$ sudo git clone https://github.com/apache/mahout mahout-latest
Cloning into 'mahout-latest'...
remote: Reusing existing pack: 76730, done.
remote: Total 76730 (delta 0), reused 0 (delta 0)
Receiving objects: 100% (76730/76730), 49.16 MiB | 193 KiB/s, done.
Resolving deltas: 100% (34682/34682), done.
warning: remote HEAD refers to nonexistent ref, unable to checkout.
$ cd mahout-latest/
$ sudo git branch -a
remotes/origin/mahout-0.1
remotes/origin/mahout-0.2
remotes/origin/mahout-0.8
remotes/origin/trunk
$ sudo rm -rf mahout-latest
$ sudo git clone -b trunk https://github.com/apache/mahout mahout-latest
Cloning into 'mahout-latest'...
remote: Reusing existing pack: 76730, done.
remote: Total 76730 (delta 0), reused 0 (delta 0)
Receiving objects: 100% (76730/76730), 49.16 MiB | 194 KiB/s, done.
Resolving deltas: 100% (34682/34682), done.
Checking out files: 100% (1475/1475), done.
mvn -X install
Apache Maven 3.2.1 (ea8b2b07643dbb1b84b6d16e1f08391b666bc1e9; 2014-02-15T04:37:52+10:00)
Maven home: /usr/local/apache-maven/apache-maven-3.2.1
Java version: 1.6.0_32, vendor: Sun Microsystems Inc.
Java home: /usr/java/jdk1.6.0_32/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "2.6.18-274.el5", arch: "amd64", family: "unix"
[INFO] Error stacktraces are turned on.
[DEBUG] Reading global settings from /usr/local/apache-maven/apache-maven-3.2.1/conf/settings.xml
[DEBUG] Reading user settings from /home/oracle/.m2/settings.xml
[DEBUG] Using local repository at /home/oracle/.m2/repository
[DEBUG] Using manager EnhancedLocalRepositoryManager with priority 10.0 for /home/oracle/.m2/repository
[INFO] Scanning for projects...
[DEBUG] Extension realms for project org.apache.mahout:mahout:pom:1.0-SNAPSHOT: (none)
[DEBUG] Looking up lifecyle mappings for packaging pom from ClassRealm[plexus.core, parent: null]
[DEBUG] Extension realms for project org.apache.mahout:mahout-buildtools:jar:1.0-SNAPSHOT: (none)
[DEBUG] Looking up lifecyle mappings for packaging jar from ClassRealm[plexus.core, parent: null]
[DEBUG] Extension realms for project org.apache.mahout:mahout-math:jar:1.0-SNAPSHOT: (none)
[DEBUG] Looking up lifecyle mappings for packaging jar from ClassRealm[plexus.core, parent: null]
[DEBUG] Extension realms for project org.apache.mahout:mahout-core:jar:1.0-SNAPSHOT: (none)
[DEBUG] Looking up lifecyle mappings for packaging jar from ClassRealm[plexus.core, parent: null]
[DEBUG] Extension realms for project org.apache.mahout:mahout-integration:jar:1.0-SNAPSHOT: (none)
[DEBUG] Looking up lifecyle mappings for packaging jar from ClassRealm[plexus.core, parent: null]
[DEBUG] Extension realms for project org.apache.mahout:mahout-examples:jar:1.0-SNAPSHOT: (none)
[DEBUG] Looking up lifecyle mappings for packaging jar from ClassRealm[plexus.core, parent: null]
[DEBUG] Extension realms for project org.apache.mahout:mahout-distribution:pom:1.0-SNAPSHOT: (none)
[DEBUG] Looking up lifecyle mappings for packaging pom from ClassRealm[plexus.core, parent: null]
[DEBUG] Extension realms for project org.apache.mahout:mahout-math-scala:jar:1.0-SNAPSHOT: (none)
[DEBUG] Looking up lifecyle mappings for packaging jar from ClassRealm[plexus.core, parent: null]
[DEBUG] Extension realms for project org.apache.mahout:mahout-spark:jar:1.0-SNAPSHOT: (none)
[DEBUG] Looking up lifecyle mappings for packaging jar from ClassRealm[plexus.core, parent: null]
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.mahout:mahout-spark:jar:1.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.version' for org.scala-tools:maven-scala-plugin is missing. @ line 108, column 15
[WARNING] The expression ${pom.version} is deprecated. Please use ${project.version} instead.
[WARNING] The expression ${pom.version} is deprecated. Please use ${project.version} instead.
[WARNING] The expression ${pom.version} is deprecated. Please use ${project.version} instead.
[WARNING] The expression ${pom.version} is deprecated. Please use ${project.version} instead.
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
................ CUT OFF LINES ....
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Mahout Build Tools ................................ FAILURE [ 0.991 s]
[INFO] Apache Mahout ..................................... SKIPPED
[INFO] Mahout Math ....................................... SKIPPED
[INFO] Mahout Core ....................................... SKIPPED
[INFO] Mahout Integration ................................ SKIPPED
[INFO] Mahout Examples ................................... SKIPPED
[INFO] Mahout Release Package ............................ SKIPPED
[INFO] Mahout Math/Scala wrappers ........................ SKIPPED
[INFO] Mahout Spark bindings ............................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2.495 s
[INFO] Finished at: 2014-04-04T14:04:56+10:00
[INFO] Final Memory: 9M/245M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-remote-resources-plugin:1.1:process (default) on project mahout-buildtools: Error finding remote resources manifests: /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-latest/buildtools/target/maven-shared-archive-resources/META-INF/NOTICE (No such file or directory) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-remote-resources-plugin:1.1:process (default) on project mahout-buildtools: Error finding remote resources manifests
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Error finding remote resources manifests
at org.apache.maven.plugin.resources.remote.ProcessRemoteResourcesMojo.processResourceBundles(ProcessRemoteResourcesMojo.java:1185)
at org.apache.maven.plugin.resources.remote.ProcessRemoteResourcesMojo.execute(ProcessRemoteResourcesMojo.java:500)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: java.io.FileNotFoundException: /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-latest/buildtools/target/maven-shared-archive-resources/META-INF/NOTICE (No such file or directory)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.<init>(FileOutputStream.java:194)
at java.io.FileOutputStream.<init>(FileOutputStream.java:145)
at java.io.FileWriter.<init>(FileWriter.java:73)
at org.apache.maven.plugin.resources.remote.ProcessRemoteResourcesMojo.processResourceBundles(ProcessRemoteResourcesMojo.java:1093)
... 22 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Thanks and Regards,
Truong Phan
P + 61 2 8576 5771
M + 61 4 1463 7424
E troung.phan@team.telstra.com
W www.telstra.com
-----Original Message-----
From: Phan, Truong Q [mailto:Troung.Phan@team.telstra.com]
Sent: Friday, 4 April 2014 11:03 AM
To: user@mahout.apache.org
Subject: RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
Hi Gokhan,
I having difficult to checkout the latest trunk using MVN.
Here is my checkout issue.
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
$ sudo git config --global http.proxy http://58.162.7.28:3128 $ sudo git config --global http.sslVerify false $ sudo git clone https://github.com/apache/mahout Cloning into 'mahout'...
remote: Reusing existing pack: 76730, done.
remote: Total 76730 (delta 0), reused 0 (delta 0) Receiving objects: 100% (76730/76730), 49.16 MiB | 191 KiB/s, done.
Resolving deltas: 100% (34682/34682), done.
warning: remote HEAD refers to nonexistent ref, unable to checkout.
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Thanks and Regards,
Truong Phan
P + 61 2 8576 5771
M + 61 4 1463 7424
E troung.phan@team.telstra.com
W www.telstra.com
-----Original Message-----
From: Gokhan Capan [mailto:gkhncpn@gmail.com]
Sent: Friday, 4 April 2014 5:50 AM
To: user@mahout.apache.org
Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
Could you checkout the latest trunk and build the project again?
Sent from my iPhone
> On Apr 2, 2014, at 9:50, Sean Owen <sr...@gmail.com> wrote:
>
> Not sure what's going on there. Your build is somehow internally
> inconsistent at runtime since it fails on the client side due to
> mismatching Hadoop versions. I can start making up increasingly
> unlikely causes, like you are building against local copies of the
> artifacts that are old? Running clean and install should help if so.
>
> You might debug the script to print exactly what it is running.
> On Apr 2, 2014 7:59 AM, "Phan, Truong Q"
> <Tr...@team.telstra.com>
> wrote:
>
>> The build was successful with those "warning".
>>
>> I could not run a test case from this website:
>> http://girlincomputerscience.blogspot.com.au/2010/11/apache-mahout.ht
>> ml
>>
>> Here are my run with the error:
>>
>>
>> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> $ pwd
>>
>> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distri
>> bution-0.9
>>
>> $ echo $CLASSPATH
>>
>> $ echo $PATH
>>
>> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distri
>> bution-0.9/bin:/usr/local/apache-maven/apache-maven-3.2.1/bin:/usr/lo
>> cal/bin:/bin:/usr/bin:/home/oracle/bin:.:/usr/java/jdk1.6.0_32/bin
>>
>> $ echo $JAVA_HOME
>> /usr/java/jdk1.6.0_32
>>
>> $ env | grep HAD
>> HADOOP_CMD=/usr/bin/hadoop
>> HADOOP_HOME=/usr/lib/hadoop
>>
>> HADOOP_STREAMING=/usr/lib/hadoop-mapreduce/hadoop-streaming-2.2.0-cdh
>> 5.0.0-beta-1.jar
>>
>> $ mahout recommenditembased --input mydata.dat --usersFile user.dat
>> --numRecommendations 2 --output output/ --similarityClassname
>> SIMILARITY_PEARSON_CORRELATION Running on hadoop, using
>> /usr/lib/hadoop/bin/hadoop and HADOOP_CONF_DIR=
>> MAHOUT-JOB:
>> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distri
>> bution-0.9/examples/target/mahout-examples-0.9-job.jar
>> 14/04/02 16:52:48 INFO common.AbstractJob: Command line arguments:
>> {--booleanData=[false], --endPhase=[2147483647],
>> --input=[mydata.dat], --maxPrefsInItemSimilarity=[500],
>> --maxPrefsPerUser=[10], --maxSimilaritiesPerItem=[100],
>> --minPrefsPerUser=[1], --numRecommendations=[2], --output=[output/],
>> --similarityClassname=[SIMILARITY_PEARSON_CORRELATION],
>> --startPhase=[0], --tempDir=[temp], --usersFile=[user.dat]}
>> 14/04/02 16:52:48 INFO common.AbstractJob: Command line arguments:
>> {--booleanData=[false], --endPhase=[2147483647],
>> --input=[mydata.dat], --minPrefsPerUser=[1],
>> --output=[temp/preparePreferenceMatrix],
>> --ratingShift=[0.0], --startPhase=[0], --tempDir=[temp]}
>> 14/04/02 16:52:49 INFO Configuration.deprecation: mapred.input.dir is
>> deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
>> 14/04/02 16:52:49 INFO Configuration.deprecation:
>> mapred.compress.map.output is deprecated. Instead, use
>> mapreduce.map.output.compress
>> 14/04/02 16:52:49 INFO Configuration.deprecation: mapred.output.dir
>> is deprecated. Instead, use
>> mapreduce.output.fileoutputformat.outputdir
>> Exception in thread "main" java.lang.IncompatibleClassChangeError:
>> Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected
>> at
>> org.apache.mahout.common.HadoopUtil.getCustomJobName(HadoopUtil.java:174)
>> at
>> org.apache.mahout.common.AbstractJob.prepareJob(AbstractJob.java:614)
>> at
>> org.apache.mahout.cf.taste.hadoop.preparation.PreparePreferenceMatrixJob.run(PreparePreferenceMatrixJob.java:73)
>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>> at
>> org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:164)
>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>> at
>> org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:322)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>> at
>> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
>> at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
>> at
>> org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
>> at
>> org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>> at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
>> oracle@bpdevdmsdbs01: ----
>> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distri
>> bution-0.9
>> -----
>>
>>
>> Thanks and Regards,
>> Truong Phan
>>
>>
>> P + 61 2 8576 5771
>> M + 61 4 1463 7424
>> E troung.phan@team.telstra.com
>> W www.telstra.com
>>
>>
>>
>> -----Original Message-----
>> From: Sean Owen [mailto:srowen@gmail.com]
>> Sent: Wednesday, 2 April 2014 4:05 PM
>> To: Mahout User List
>> Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
>>
>> Hm, OK something sounds wrong with your directory structure, given
>> the warnings. I assumed this was changed. It could be that the
>> .tar.gz distribution isn't quite correctly set up for building from source.
>>
>> The compilation here is nothing to do with Hadoop. You show a
>> successful build; what's the part that fails?
>>
>> On Wed, Apr 2, 2014 at 6:59 AM, Phan, Truong Q <
>> Troung.Phan@team.telstra.com> wrote:
>>> Where did I modifying the build?
>>> Here are my steps of the build.
>>> I got the source from one of the official mirror website and build it.
>>> The only one exception here is that I am using the Cloudera CDH 5.0.
>>> This latest CDHv5.0 might not work with Mahout v0.9.
>>>
>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>> Install Mahout
>>>
>>> $ javac -version
>>> javac 1.6.0_32
>>>
>>> $ cd /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout
>>>
>>> $ wget
>>> http://mirror.mel.bkb.net.au/pub/apache/mahout/0.9/mahout-distributi
>>> on
>>> -0.9-src.tar.gz
>>>
>>> $ mv mahout-distribution-0.9 mahout-distribution-0.9.old
>>>
>>> $ tar xvf mahout-distribution-0.9-src.tar.gz
>>>
>>> $ cd mahout-distribution-0.9
>>>
>>> $ ls
>>> bin buildtools core distribution examples integration
>>> LICENSE.txt math math-scala NOTICE.txt pom.xml README.txt src
>>>
>>> $ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1
>> -DskipTests=true [INFO] Scanning for projects...
>>> ............
>>>
>>> [INFO]
>>> --------------------------------------------------------------------
>>> --
>>> --
>>> [INFO] Reactor Summary:
>>> [INFO]
>>> [INFO] Mahout Build Tools ................................ SUCCESS [
>>> 7.235 s] [INFO] Apache Mahout .....................................
>>> SUCCESS [ 1.017 s] [INFO] Mahout Math
>>> ....................................... SUCCESS [15:46 min] [INFO]
>>> Mahout Core ....................................... SUCCESS [24:29
>>> min] [INFO] Mahout Integration ................................
>>> SUCCESS [03:38 min] [INFO] Mahout Examples
>>> ................................... SUCCESS [02:40 min] [INFO]
>>> Mahout Release Package ............................ SUCCESS [ 0.075
>>> s] [INFO] Mahout Math/Scala wrappers ........................
>>> SUCCESS
>>> [01:12 min] [INFO]
>>> --------------------------------------------------------------------
>>> --
>>> --
>>> [INFO] BUILD SUCCESS
>>> [INFO]
>>> --------------------------------------------------------------------
>>> --
>>> --
>>> [INFO] Total time: 47:57 min
>>> [INFO] Finished at: 2014-04-02T15:07:50+10:00 [INFO] Final Memory:
>>> 49M/288M [INFO]
>>> --------------------------------------------------------------------
>>> --
>>> --
>>>
>>>
>>> Thanks and Regards,
>>> Truong Phan
>>>
>>>
>>> P + 61 2 8576 5771
>>> M + 61 4 1463 7424
>>> E troung.phan@team.telstra.com
>>> W www.telstra.com
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: Sean Owen [mailto:srowen@gmail.com]
>>> Sent: Wednesday, 2 April 2014 3:33 PM
>>> To: Mahout User List
>>> Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
>>>
>>> This may be getting to you're-on-your-own-territory since you're
>> modifying the build. This error means your directory structure
>> doesn't match up with declarations. You said somewhere that the
>> parent of module X was Y, but the location given points to the pom of a module that isn't Y.
>>>
>>> On Wed, Apr 2, 2014 at 5:28 AM, Phan, Truong Q <
>> Troung.Phan@team.telstra.com> wrote:
>>>> Hi Sean,
>>>>
>>>> I am trying to build the Mahout again and got some WARNINGs so far.
>>>> Can you give me some hints what I have done wrong here?
>>>>
>>>> Thanks for your help so far.
>>
RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
Posted by "Phan, Truong Q" <Tr...@team.telstra.com>.
Hi Gokhan,
I having difficult to checkout the latest trunk using MVN.
Here is my checkout issue.
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
$ sudo git config --global http.proxy http://58.162.7.28:3128
$ sudo git config --global http.sslVerify false
$ sudo git clone https://github.com/apache/mahout
Cloning into 'mahout'...
remote: Reusing existing pack: 76730, done.
remote: Total 76730 (delta 0), reused 0 (delta 0)
Receiving objects: 100% (76730/76730), 49.16 MiB | 191 KiB/s, done.
Resolving deltas: 100% (34682/34682), done.
warning: remote HEAD refers to nonexistent ref, unable to checkout.
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Thanks and Regards,
Truong Phan
P + 61 2 8576 5771
M + 61 4 1463 7424
E troung.phan@team.telstra.com
W www.telstra.com
-----Original Message-----
From: Gokhan Capan [mailto:gkhncpn@gmail.com]
Sent: Friday, 4 April 2014 5:50 AM
To: user@mahout.apache.org
Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
Could you checkout the latest trunk and build the project again?
Sent from my iPhone
> On Apr 2, 2014, at 9:50, Sean Owen <sr...@gmail.com> wrote:
>
> Not sure what's going on there. Your build is somehow internally
> inconsistent at runtime since it fails on the client side due to
> mismatching Hadoop versions. I can start making up increasingly
> unlikely causes, like you are building against local copies of the
> artifacts that are old? Running clean and install should help if so.
>
> You might debug the script to print exactly what it is running.
> On Apr 2, 2014 7:59 AM, "Phan, Truong Q"
> <Tr...@team.telstra.com>
> wrote:
>
>> The build was successful with those "warning".
>>
>> I could not run a test case from this website:
>> http://girlincomputerscience.blogspot.com.au/2010/11/apache-mahout.ht
>> ml
>>
>> Here are my run with the error:
>>
>>
>> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> $ pwd
>>
>> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distri
>> bution-0.9
>>
>> $ echo $CLASSPATH
>>
>> $ echo $PATH
>>
>> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distri
>> bution-0.9/bin:/usr/local/apache-maven/apache-maven-3.2.1/bin:/usr/lo
>> cal/bin:/bin:/usr/bin:/home/oracle/bin:.:/usr/java/jdk1.6.0_32/bin
>>
>> $ echo $JAVA_HOME
>> /usr/java/jdk1.6.0_32
>>
>> $ env | grep HAD
>> HADOOP_CMD=/usr/bin/hadoop
>> HADOOP_HOME=/usr/lib/hadoop
>>
>> HADOOP_STREAMING=/usr/lib/hadoop-mapreduce/hadoop-streaming-2.2.0-cdh
>> 5.0.0-beta-1.jar
>>
>> $ mahout recommenditembased --input mydata.dat --usersFile user.dat
>> --numRecommendations 2 --output output/ --similarityClassname
>> SIMILARITY_PEARSON_CORRELATION Running on hadoop, using
>> /usr/lib/hadoop/bin/hadoop and HADOOP_CONF_DIR=
>> MAHOUT-JOB:
>> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distri
>> bution-0.9/examples/target/mahout-examples-0.9-job.jar
>> 14/04/02 16:52:48 INFO common.AbstractJob: Command line arguments:
>> {--booleanData=[false], --endPhase=[2147483647],
>> --input=[mydata.dat], --maxPrefsInItemSimilarity=[500],
>> --maxPrefsPerUser=[10], --maxSimilaritiesPerItem=[100],
>> --minPrefsPerUser=[1], --numRecommendations=[2], --output=[output/],
>> --similarityClassname=[SIMILARITY_PEARSON_CORRELATION],
>> --startPhase=[0], --tempDir=[temp], --usersFile=[user.dat]}
>> 14/04/02 16:52:48 INFO common.AbstractJob: Command line arguments:
>> {--booleanData=[false], --endPhase=[2147483647],
>> --input=[mydata.dat], --minPrefsPerUser=[1],
>> --output=[temp/preparePreferenceMatrix],
>> --ratingShift=[0.0], --startPhase=[0], --tempDir=[temp]}
>> 14/04/02 16:52:49 INFO Configuration.deprecation: mapred.input.dir is
>> deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
>> 14/04/02 16:52:49 INFO Configuration.deprecation:
>> mapred.compress.map.output is deprecated. Instead, use
>> mapreduce.map.output.compress
>> 14/04/02 16:52:49 INFO Configuration.deprecation: mapred.output.dir
>> is deprecated. Instead, use
>> mapreduce.output.fileoutputformat.outputdir
>> Exception in thread "main" java.lang.IncompatibleClassChangeError:
>> Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected
>> at
>> org.apache.mahout.common.HadoopUtil.getCustomJobName(HadoopUtil.java:174)
>> at
>> org.apache.mahout.common.AbstractJob.prepareJob(AbstractJob.java:614)
>> at
>> org.apache.mahout.cf.taste.hadoop.preparation.PreparePreferenceMatrixJob.run(PreparePreferenceMatrixJob.java:73)
>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>> at
>> org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:164)
>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>> at
>> org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:322)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>> at
>> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
>> at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
>> at
>> org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
>> at
>> org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>> at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
>> oracle@bpdevdmsdbs01: ----
>> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distri
>> bution-0.9
>> -----
>>
>>
>> Thanks and Regards,
>> Truong Phan
>>
>>
>> P + 61 2 8576 5771
>> M + 61 4 1463 7424
>> E troung.phan@team.telstra.com
>> W www.telstra.com
>>
>>
>>
>> -----Original Message-----
>> From: Sean Owen [mailto:srowen@gmail.com]
>> Sent: Wednesday, 2 April 2014 4:05 PM
>> To: Mahout User List
>> Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
>>
>> Hm, OK something sounds wrong with your directory structure, given
>> the warnings. I assumed this was changed. It could be that the
>> .tar.gz distribution isn't quite correctly set up for building from source.
>>
>> The compilation here is nothing to do with Hadoop. You show a
>> successful build; what's the part that fails?
>>
>> On Wed, Apr 2, 2014 at 6:59 AM, Phan, Truong Q <
>> Troung.Phan@team.telstra.com> wrote:
>>> Where did I modifying the build?
>>> Here are my steps of the build.
>>> I got the source from one of the official mirror website and build it.
>>> The only one exception here is that I am using the Cloudera CDH 5.0.
>>> This latest CDHv5.0 might not work with Mahout v0.9.
>>>
>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>> Install Mahout
>>>
>>> $ javac -version
>>> javac 1.6.0_32
>>>
>>> $ cd /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout
>>>
>>> $ wget
>>> http://mirror.mel.bkb.net.au/pub/apache/mahout/0.9/mahout-distributi
>>> on
>>> -0.9-src.tar.gz
>>>
>>> $ mv mahout-distribution-0.9 mahout-distribution-0.9.old
>>>
>>> $ tar xvf mahout-distribution-0.9-src.tar.gz
>>>
>>> $ cd mahout-distribution-0.9
>>>
>>> $ ls
>>> bin buildtools core distribution examples integration
>>> LICENSE.txt math math-scala NOTICE.txt pom.xml README.txt src
>>>
>>> $ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1
>> -DskipTests=true [INFO] Scanning for projects...
>>> ............
>>>
>>> [INFO]
>>> --------------------------------------------------------------------
>>> --
>>> --
>>> [INFO] Reactor Summary:
>>> [INFO]
>>> [INFO] Mahout Build Tools ................................ SUCCESS [
>>> 7.235 s] [INFO] Apache Mahout .....................................
>>> SUCCESS [ 1.017 s] [INFO] Mahout Math
>>> ....................................... SUCCESS [15:46 min] [INFO]
>>> Mahout Core ....................................... SUCCESS [24:29
>>> min] [INFO] Mahout Integration ................................
>>> SUCCESS [03:38 min] [INFO] Mahout Examples
>>> ................................... SUCCESS [02:40 min] [INFO]
>>> Mahout Release Package ............................ SUCCESS [ 0.075
>>> s] [INFO] Mahout Math/Scala wrappers ........................
>>> SUCCESS
>>> [01:12 min] [INFO]
>>> --------------------------------------------------------------------
>>> --
>>> --
>>> [INFO] BUILD SUCCESS
>>> [INFO]
>>> --------------------------------------------------------------------
>>> --
>>> --
>>> [INFO] Total time: 47:57 min
>>> [INFO] Finished at: 2014-04-02T15:07:50+10:00 [INFO] Final Memory:
>>> 49M/288M [INFO]
>>> --------------------------------------------------------------------
>>> --
>>> --
>>>
>>>
>>> Thanks and Regards,
>>> Truong Phan
>>>
>>>
>>> P + 61 2 8576 5771
>>> M + 61 4 1463 7424
>>> E troung.phan@team.telstra.com
>>> W www.telstra.com
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: Sean Owen [mailto:srowen@gmail.com]
>>> Sent: Wednesday, 2 April 2014 3:33 PM
>>> To: Mahout User List
>>> Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
>>>
>>> This may be getting to you're-on-your-own-territory since you're
>> modifying the build. This error means your directory structure
>> doesn't match up with declarations. You said somewhere that the
>> parent of module X was Y, but the location given points to the pom of a module that isn't Y.
>>>
>>> On Wed, Apr 2, 2014 at 5:28 AM, Phan, Truong Q <
>> Troung.Phan@team.telstra.com> wrote:
>>>> Hi Sean,
>>>>
>>>> I am trying to build the Mahout again and got some WARNINGs so far.
>>>> Can you give me some hints what I have done wrong here?
>>>>
>>>> Thanks for your help so far.
>>
Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
Posted by Gokhan Capan <gk...@gmail.com>.
Could you checkout the latest trunk and build the project again?
Sent from my iPhone
> On Apr 2, 2014, at 9:50, Sean Owen <sr...@gmail.com> wrote:
>
> Not sure what's going on there. Your build is somehow internally
> inconsistent at runtime since it fails on the client side due to
> mismatching Hadoop versions. I can start making up increasingly unlikely
> causes, like you are building against local copies of the artifacts that
> are old? Running clean and install should help if so.
>
> You might debug the script to print exactly what it is running.
> On Apr 2, 2014 7:59 AM, "Phan, Truong Q" <Tr...@team.telstra.com>
> wrote:
>
>> The build was successful with those "warning".
>>
>> I could not run a test case from this website:
>> http://girlincomputerscience.blogspot.com.au/2010/11/apache-mahout.html
>>
>> Here are my run with the error:
>>
>>
>> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> $ pwd
>>
>> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9
>>
>> $ echo $CLASSPATH
>>
>> $ echo $PATH
>>
>> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/bin:/usr/local/apache-maven/apache-maven-3.2.1/bin:/usr/local/bin:/bin:/usr/bin:/home/oracle/bin:.:/usr/java/jdk1.6.0_32/bin
>>
>> $ echo $JAVA_HOME
>> /usr/java/jdk1.6.0_32
>>
>> $ env | grep HAD
>> HADOOP_CMD=/usr/bin/hadoop
>> HADOOP_HOME=/usr/lib/hadoop
>>
>> HADOOP_STREAMING=/usr/lib/hadoop-mapreduce/hadoop-streaming-2.2.0-cdh5.0.0-beta-1.jar
>>
>> $ mahout recommenditembased --input mydata.dat --usersFile user.dat
>> --numRecommendations 2 --output output/ --similarityClassname
>> SIMILARITY_PEARSON_CORRELATION
>> Running on hadoop, using /usr/lib/hadoop/bin/hadoop and HADOOP_CONF_DIR=
>> MAHOUT-JOB:
>> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/examples/target/mahout-examples-0.9-job.jar
>> 14/04/02 16:52:48 INFO common.AbstractJob: Command line arguments:
>> {--booleanData=[false], --endPhase=[2147483647], --input=[mydata.dat],
>> --maxPrefsInItemSimilarity=[500], --maxPrefsPerUser=[10],
>> --maxSimilaritiesPerItem=[100], --minPrefsPerUser=[1],
>> --numRecommendations=[2], --output=[output/],
>> --similarityClassname=[SIMILARITY_PEARSON_CORRELATION], --startPhase=[0],
>> --tempDir=[temp], --usersFile=[user.dat]}
>> 14/04/02 16:52:48 INFO common.AbstractJob: Command line arguments:
>> {--booleanData=[false], --endPhase=[2147483647], --input=[mydata.dat],
>> --minPrefsPerUser=[1], --output=[temp/preparePreferenceMatrix],
>> --ratingShift=[0.0], --startPhase=[0], --tempDir=[temp]}
>> 14/04/02 16:52:49 INFO Configuration.deprecation: mapred.input.dir is
>> deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
>> 14/04/02 16:52:49 INFO Configuration.deprecation:
>> mapred.compress.map.output is deprecated. Instead, use
>> mapreduce.map.output.compress
>> 14/04/02 16:52:49 INFO Configuration.deprecation: mapred.output.dir is
>> deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
>> Exception in thread "main" java.lang.IncompatibleClassChangeError: Found
>> interface org.apache.hadoop.mapreduce.JobContext, but class was expected
>> at
>> org.apache.mahout.common.HadoopUtil.getCustomJobName(HadoopUtil.java:174)
>> at
>> org.apache.mahout.common.AbstractJob.prepareJob(AbstractJob.java:614)
>> at
>> org.apache.mahout.cf.taste.hadoop.preparation.PreparePreferenceMatrixJob.run(PreparePreferenceMatrixJob.java:73)
>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>> at
>> org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:164)
>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>> at
>> org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:322)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>> at
>> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
>> at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
>> at
>> org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
>> at
>> org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>> at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
>> oracle@bpdevdmsdbs01: ----
>> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9
>> -----
>>
>>
>> Thanks and Regards,
>> Truong Phan
>>
>>
>> P + 61 2 8576 5771
>> M + 61 4 1463 7424
>> E troung.phan@team.telstra.com
>> W www.telstra.com
>>
>>
>>
>> -----Original Message-----
>> From: Sean Owen [mailto:srowen@gmail.com]
>> Sent: Wednesday, 2 April 2014 4:05 PM
>> To: Mahout User List
>> Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
>>
>> Hm, OK something sounds wrong with your directory structure, given the
>> warnings. I assumed this was changed. It could be that the .tar.gz
>> distribution isn't quite correctly set up for building from source.
>>
>> The compilation here is nothing to do with Hadoop. You show a successful
>> build; what's the part that fails?
>>
>> On Wed, Apr 2, 2014 at 6:59 AM, Phan, Truong Q <
>> Troung.Phan@team.telstra.com> wrote:
>>> Where did I modifying the build?
>>> Here are my steps of the build.
>>> I got the source from one of the official mirror website and build it.
>>> The only one exception here is that I am using the Cloudera CDH 5.0.
>>> This latest CDHv5.0 might not work with Mahout v0.9.
>>>
>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>>> Install Mahout
>>>
>>> $ javac -version
>>> javac 1.6.0_32
>>>
>>> $ cd /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout
>>>
>>> $ wget
>>> http://mirror.mel.bkb.net.au/pub/apache/mahout/0.9/mahout-distribution
>>> -0.9-src.tar.gz
>>>
>>> $ mv mahout-distribution-0.9 mahout-distribution-0.9.old
>>>
>>> $ tar xvf mahout-distribution-0.9-src.tar.gz
>>>
>>> $ cd mahout-distribution-0.9
>>>
>>> $ ls
>>> bin buildtools core distribution examples integration
>>> LICENSE.txt math math-scala NOTICE.txt pom.xml README.txt src
>>>
>>> $ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1
>> -DskipTests=true [INFO] Scanning for projects...
>>> ............
>>>
>>> [INFO]
>>> ----------------------------------------------------------------------
>>> --
>>> [INFO] Reactor Summary:
>>> [INFO]
>>> [INFO] Mahout Build Tools ................................ SUCCESS [
>>> 7.235 s] [INFO] Apache Mahout .....................................
>>> SUCCESS [ 1.017 s] [INFO] Mahout Math
>>> ....................................... SUCCESS [15:46 min] [INFO]
>>> Mahout Core ....................................... SUCCESS [24:29
>>> min] [INFO] Mahout Integration ................................
>>> SUCCESS [03:38 min] [INFO] Mahout Examples
>>> ................................... SUCCESS [02:40 min] [INFO] Mahout
>>> Release Package ............................ SUCCESS [ 0.075 s]
>>> [INFO] Mahout Math/Scala wrappers ........................ SUCCESS
>>> [01:12 min] [INFO]
>>> ----------------------------------------------------------------------
>>> --
>>> [INFO] BUILD SUCCESS
>>> [INFO]
>>> ----------------------------------------------------------------------
>>> --
>>> [INFO] Total time: 47:57 min
>>> [INFO] Finished at: 2014-04-02T15:07:50+10:00 [INFO] Final Memory:
>>> 49M/288M [INFO]
>>> ----------------------------------------------------------------------
>>> --
>>>
>>>
>>> Thanks and Regards,
>>> Truong Phan
>>>
>>>
>>> P + 61 2 8576 5771
>>> M + 61 4 1463 7424
>>> E troung.phan@team.telstra.com
>>> W www.telstra.com
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: Sean Owen [mailto:srowen@gmail.com]
>>> Sent: Wednesday, 2 April 2014 3:33 PM
>>> To: Mahout User List
>>> Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
>>>
>>> This may be getting to you're-on-your-own-territory since you're
>> modifying the build. This error means your directory structure doesn't
>> match up with declarations. You said somewhere that the parent of module X
>> was Y, but the location given points to the pom of a module that isn't Y.
>>>
>>> On Wed, Apr 2, 2014 at 5:28 AM, Phan, Truong Q <
>> Troung.Phan@team.telstra.com> wrote:
>>>> Hi Sean,
>>>>
>>>> I am trying to build the Mahout again and got some WARNINGs so far.
>>>> Can you give me some hints what I have done wrong here?
>>>>
>>>> Thanks for your help so far.
>>
RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
Posted by Sean Owen <sr...@gmail.com>.
Not sure what's going on there. Your build is somehow internally
inconsistent at runtime since it fails on the client side due to
mismatching Hadoop versions. I can start making up increasingly unlikely
causes, like you are building against local copies of the artifacts that
are old? Running clean and install should help if so.
You might debug the script to print exactly what it is running.
On Apr 2, 2014 7:59 AM, "Phan, Truong Q" <Tr...@team.telstra.com>
wrote:
> The build was successful with those "warning".
>
> I could not run a test case from this website:
> http://girlincomputerscience.blogspot.com.au/2010/11/apache-mahout.html
>
> Here are my run with the error:
>
>
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> $ pwd
>
> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9
>
> $ echo $CLASSPATH
>
> $ echo $PATH
>
> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/bin:/usr/local/apache-maven/apache-maven-3.2.1/bin:/usr/local/bin:/bin:/usr/bin:/home/oracle/bin:.:/usr/java/jdk1.6.0_32/bin
>
> $ echo $JAVA_HOME
> /usr/java/jdk1.6.0_32
>
> $ env | grep HAD
> HADOOP_CMD=/usr/bin/hadoop
> HADOOP_HOME=/usr/lib/hadoop
>
> HADOOP_STREAMING=/usr/lib/hadoop-mapreduce/hadoop-streaming-2.2.0-cdh5.0.0-beta-1.jar
>
> $ mahout recommenditembased --input mydata.dat --usersFile user.dat
> --numRecommendations 2 --output output/ --similarityClassname
> SIMILARITY_PEARSON_CORRELATION
> Running on hadoop, using /usr/lib/hadoop/bin/hadoop and HADOOP_CONF_DIR=
> MAHOUT-JOB:
> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/examples/target/mahout-examples-0.9-job.jar
> 14/04/02 16:52:48 INFO common.AbstractJob: Command line arguments:
> {--booleanData=[false], --endPhase=[2147483647], --input=[mydata.dat],
> --maxPrefsInItemSimilarity=[500], --maxPrefsPerUser=[10],
> --maxSimilaritiesPerItem=[100], --minPrefsPerUser=[1],
> --numRecommendations=[2], --output=[output/],
> --similarityClassname=[SIMILARITY_PEARSON_CORRELATION], --startPhase=[0],
> --tempDir=[temp], --usersFile=[user.dat]}
> 14/04/02 16:52:48 INFO common.AbstractJob: Command line arguments:
> {--booleanData=[false], --endPhase=[2147483647], --input=[mydata.dat],
> --minPrefsPerUser=[1], --output=[temp/preparePreferenceMatrix],
> --ratingShift=[0.0], --startPhase=[0], --tempDir=[temp]}
> 14/04/02 16:52:49 INFO Configuration.deprecation: mapred.input.dir is
> deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
> 14/04/02 16:52:49 INFO Configuration.deprecation:
> mapred.compress.map.output is deprecated. Instead, use
> mapreduce.map.output.compress
> 14/04/02 16:52:49 INFO Configuration.deprecation: mapred.output.dir is
> deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> Exception in thread "main" java.lang.IncompatibleClassChangeError: Found
> interface org.apache.hadoop.mapreduce.JobContext, but class was expected
> at
> org.apache.mahout.common.HadoopUtil.getCustomJobName(HadoopUtil.java:174)
> at
> org.apache.mahout.common.AbstractJob.prepareJob(AbstractJob.java:614)
> at
> org.apache.mahout.cf.taste.hadoop.preparation.PreparePreferenceMatrixJob.run(PreparePreferenceMatrixJob.java:73)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at
> org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:164)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at
> org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:322)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
> at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
> at
> org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
> at
> org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
> oracle@bpdevdmsdbs01: ----
> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9
> -----
>
>
> Thanks and Regards,
> Truong Phan
>
>
> P + 61 2 8576 5771
> M + 61 4 1463 7424
> E troung.phan@team.telstra.com
> W www.telstra.com
>
>
>
> -----Original Message-----
> From: Sean Owen [mailto:srowen@gmail.com]
> Sent: Wednesday, 2 April 2014 4:05 PM
> To: Mahout User List
> Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
>
> Hm, OK something sounds wrong with your directory structure, given the
> warnings. I assumed this was changed. It could be that the .tar.gz
> distribution isn't quite correctly set up for building from source.
>
> The compilation here is nothing to do with Hadoop. You show a successful
> build; what's the part that fails?
>
> On Wed, Apr 2, 2014 at 6:59 AM, Phan, Truong Q <
> Troung.Phan@team.telstra.com> wrote:
> > Where did I modifying the build?
> > Here are my steps of the build.
> > I got the source from one of the official mirror website and build it.
> > The only one exception here is that I am using the Cloudera CDH 5.0.
> > This latest CDHv5.0 might not work with Mahout v0.9.
> >
> > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> > Install Mahout
> >
> > $ javac -version
> > javac 1.6.0_32
> >
> > $ cd /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout
> >
> > $ wget
> > http://mirror.mel.bkb.net.au/pub/apache/mahout/0.9/mahout-distribution
> > -0.9-src.tar.gz
> >
> > $ mv mahout-distribution-0.9 mahout-distribution-0.9.old
> >
> > $ tar xvf mahout-distribution-0.9-src.tar.gz
> >
> > $ cd mahout-distribution-0.9
> >
> > $ ls
> > bin buildtools core distribution examples integration
> > LICENSE.txt math math-scala NOTICE.txt pom.xml README.txt src
> >
> > $ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1
> -DskipTests=true [INFO] Scanning for projects...
> > ............
> >
> > [INFO]
> > ----------------------------------------------------------------------
> > --
> > [INFO] Reactor Summary:
> > [INFO]
> > [INFO] Mahout Build Tools ................................ SUCCESS [
> > 7.235 s] [INFO] Apache Mahout .....................................
> > SUCCESS [ 1.017 s] [INFO] Mahout Math
> > ....................................... SUCCESS [15:46 min] [INFO]
> > Mahout Core ....................................... SUCCESS [24:29
> > min] [INFO] Mahout Integration ................................
> > SUCCESS [03:38 min] [INFO] Mahout Examples
> > ................................... SUCCESS [02:40 min] [INFO] Mahout
> > Release Package ............................ SUCCESS [ 0.075 s]
> > [INFO] Mahout Math/Scala wrappers ........................ SUCCESS
> > [01:12 min] [INFO]
> > ----------------------------------------------------------------------
> > --
> > [INFO] BUILD SUCCESS
> > [INFO]
> > ----------------------------------------------------------------------
> > --
> > [INFO] Total time: 47:57 min
> > [INFO] Finished at: 2014-04-02T15:07:50+10:00 [INFO] Final Memory:
> > 49M/288M [INFO]
> > ----------------------------------------------------------------------
> > --
> >
> >
> > Thanks and Regards,
> > Truong Phan
> >
> >
> > P + 61 2 8576 5771
> > M + 61 4 1463 7424
> > E troung.phan@team.telstra.com
> > W www.telstra.com
> >
> >
> >
> > -----Original Message-----
> > From: Sean Owen [mailto:srowen@gmail.com]
> > Sent: Wednesday, 2 April 2014 3:33 PM
> > To: Mahout User List
> > Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
> >
> > This may be getting to you're-on-your-own-territory since you're
> modifying the build. This error means your directory structure doesn't
> match up with declarations. You said somewhere that the parent of module X
> was Y, but the location given points to the pom of a module that isn't Y.
> >
> > On Wed, Apr 2, 2014 at 5:28 AM, Phan, Truong Q <
> Troung.Phan@team.telstra.com> wrote:
> >> Hi Sean,
> >>
> >> I am trying to build the Mahout again and got some WARNINGs so far.
> >> Can you give me some hints what I have done wrong here?
> >>
> >> Thanks for your help so far.
>
RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
Posted by "Phan, Truong Q" <Tr...@team.telstra.com>.
The build was successful with those "warning".
I could not run a test case from this website: http://girlincomputerscience.blogspot.com.au/2010/11/apache-mahout.html
Here are my run with the error:
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
$ pwd
/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9
$ echo $CLASSPATH
$ echo $PATH
/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/bin:/usr/local/apache-maven/apache-maven-3.2.1/bin:/usr/local/bin:/bin:/usr/bin:/home/oracle/bin:.:/usr/java/jdk1.6.0_32/bin
$ echo $JAVA_HOME
/usr/java/jdk1.6.0_32
$ env | grep HAD
HADOOP_CMD=/usr/bin/hadoop
HADOOP_HOME=/usr/lib/hadoop
HADOOP_STREAMING=/usr/lib/hadoop-mapreduce/hadoop-streaming-2.2.0-cdh5.0.0-beta-1.jar
$ mahout recommenditembased --input mydata.dat --usersFile user.dat --numRecommendations 2 --output output/ --similarityClassname SIMILARITY_PEARSON_CORRELATION
Running on hadoop, using /usr/lib/hadoop/bin/hadoop and HADOOP_CONF_DIR=
MAHOUT-JOB: /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/examples/target/mahout-examples-0.9-job.jar
14/04/02 16:52:48 INFO common.AbstractJob: Command line arguments: {--booleanData=[false], --endPhase=[2147483647], --input=[mydata.dat], --maxPrefsInItemSimilarity=[500], --maxPrefsPerUser=[10], --maxSimilaritiesPerItem=[100], --minPrefsPerUser=[1], --numRecommendations=[2], --output=[output/], --similarityClassname=[SIMILARITY_PEARSON_CORRELATION], --startPhase=[0], --tempDir=[temp], --usersFile=[user.dat]}
14/04/02 16:52:48 INFO common.AbstractJob: Command line arguments: {--booleanData=[false], --endPhase=[2147483647], --input=[mydata.dat], --minPrefsPerUser=[1], --output=[temp/preparePreferenceMatrix], --ratingShift=[0.0], --startPhase=[0], --tempDir=[temp]}
14/04/02 16:52:49 INFO Configuration.deprecation: mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
14/04/02 16:52:49 INFO Configuration.deprecation: mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
14/04/02 16:52:49 INFO Configuration.deprecation: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
Exception in thread "main" java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected
at org.apache.mahout.common.HadoopUtil.getCustomJobName(HadoopUtil.java:174)
at org.apache.mahout.common.AbstractJob.prepareJob(AbstractJob.java:614)
at org.apache.mahout.cf.taste.hadoop.preparation.PreparePreferenceMatrixJob.run(PreparePreferenceMatrixJob.java:73)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:164)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:322)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
oracle@bpdevdmsdbs01: ---- /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9 -----
Thanks and Regards,
Truong Phan
P + 61 2 8576 5771
M + 61 4 1463 7424
E troung.phan@team.telstra.com
W www.telstra.com
-----Original Message-----
From: Sean Owen [mailto:srowen@gmail.com]
Sent: Wednesday, 2 April 2014 4:05 PM
To: Mahout User List
Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
Hm, OK something sounds wrong with your directory structure, given the warnings. I assumed this was changed. It could be that the .tar.gz distribution isn't quite correctly set up for building from source.
The compilation here is nothing to do with Hadoop. You show a successful build; what's the part that fails?
On Wed, Apr 2, 2014 at 6:59 AM, Phan, Truong Q <Tr...@team.telstra.com> wrote:
> Where did I modifying the build?
> Here are my steps of the build.
> I got the source from one of the official mirror website and build it.
> The only one exception here is that I am using the Cloudera CDH 5.0.
> This latest CDHv5.0 might not work with Mahout v0.9.
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Install Mahout
>
> $ javac -version
> javac 1.6.0_32
>
> $ cd /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout
>
> $ wget
> http://mirror.mel.bkb.net.au/pub/apache/mahout/0.9/mahout-distribution
> -0.9-src.tar.gz
>
> $ mv mahout-distribution-0.9 mahout-distribution-0.9.old
>
> $ tar xvf mahout-distribution-0.9-src.tar.gz
>
> $ cd mahout-distribution-0.9
>
> $ ls
> bin buildtools core distribution examples integration
> LICENSE.txt math math-scala NOTICE.txt pom.xml README.txt src
>
> $ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1 -DskipTests=true [INFO] Scanning for projects...
> ............
>
> [INFO]
> ----------------------------------------------------------------------
> --
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Mahout Build Tools ................................ SUCCESS [
> 7.235 s] [INFO] Apache Mahout .....................................
> SUCCESS [ 1.017 s] [INFO] Mahout Math
> ....................................... SUCCESS [15:46 min] [INFO]
> Mahout Core ....................................... SUCCESS [24:29
> min] [INFO] Mahout Integration ................................
> SUCCESS [03:38 min] [INFO] Mahout Examples
> ................................... SUCCESS [02:40 min] [INFO] Mahout
> Release Package ............................ SUCCESS [ 0.075 s]
> [INFO] Mahout Math/Scala wrappers ........................ SUCCESS
> [01:12 min] [INFO]
> ----------------------------------------------------------------------
> --
> [INFO] BUILD SUCCESS
> [INFO]
> ----------------------------------------------------------------------
> --
> [INFO] Total time: 47:57 min
> [INFO] Finished at: 2014-04-02T15:07:50+10:00 [INFO] Final Memory:
> 49M/288M [INFO]
> ----------------------------------------------------------------------
> --
>
>
> Thanks and Regards,
> Truong Phan
>
>
> P + 61 2 8576 5771
> M + 61 4 1463 7424
> E troung.phan@team.telstra.com
> W www.telstra.com
>
>
>
> -----Original Message-----
> From: Sean Owen [mailto:srowen@gmail.com]
> Sent: Wednesday, 2 April 2014 3:33 PM
> To: Mahout User List
> Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
>
> This may be getting to you're-on-your-own-territory since you're modifying the build. This error means your directory structure doesn't match up with declarations. You said somewhere that the parent of module X was Y, but the location given points to the pom of a module that isn't Y.
>
> On Wed, Apr 2, 2014 at 5:28 AM, Phan, Truong Q <Tr...@team.telstra.com> wrote:
>> Hi Sean,
>>
>> I am trying to build the Mahout again and got some WARNINGs so far.
>> Can you give me some hints what I have done wrong here?
>>
>> Thanks for your help so far.
Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
Posted by Sean Owen <sr...@gmail.com>.
Hm, OK something sounds wrong with your directory structure, given the
warnings. I assumed this was changed. It could be that the .tar.gz
distribution isn't quite correctly set up for building from source.
The compilation here is nothing to do with Hadoop. You show a
successful build; what's the part that fails?
On Wed, Apr 2, 2014 at 6:59 AM, Phan, Truong Q
<Tr...@team.telstra.com> wrote:
> Where did I modifying the build?
> Here are my steps of the build.
> I got the source from one of the official mirror website and build it.
> The only one exception here is that I am using the Cloudera CDH 5.0.
> This latest CDHv5.0 might not work with Mahout v0.9.
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Install Mahout
>
> $ javac -version
> javac 1.6.0_32
>
> $ cd /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout
>
> $ wget http://mirror.mel.bkb.net.au/pub/apache/mahout/0.9/mahout-distribution-0.9-src.tar.gz
>
> $ mv mahout-distribution-0.9 mahout-distribution-0.9.old
>
> $ tar xvf mahout-distribution-0.9-src.tar.gz
>
> $ cd mahout-distribution-0.9
>
> $ ls
> bin buildtools core distribution examples integration LICENSE.txt math math-scala NOTICE.txt pom.xml README.txt src
>
> $ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1 -DskipTests=true [INFO] Scanning for projects...
> ............
>
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Mahout Build Tools ................................ SUCCESS [ 7.235 s]
> [INFO] Apache Mahout ..................................... SUCCESS [ 1.017 s]
> [INFO] Mahout Math ....................................... SUCCESS [15:46 min]
> [INFO] Mahout Core ....................................... SUCCESS [24:29 min]
> [INFO] Mahout Integration ................................ SUCCESS [03:38 min]
> [INFO] Mahout Examples ................................... SUCCESS [02:40 min]
> [INFO] Mahout Release Package ............................ SUCCESS [ 0.075 s]
> [INFO] Mahout Math/Scala wrappers ........................ SUCCESS [01:12 min]
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 47:57 min
> [INFO] Finished at: 2014-04-02T15:07:50+10:00
> [INFO] Final Memory: 49M/288M
> [INFO] ------------------------------------------------------------------------
>
>
> Thanks and Regards,
> Truong Phan
>
>
> P + 61 2 8576 5771
> M + 61 4 1463 7424
> E troung.phan@team.telstra.com
> W www.telstra.com
>
>
>
> -----Original Message-----
> From: Sean Owen [mailto:srowen@gmail.com]
> Sent: Wednesday, 2 April 2014 3:33 PM
> To: Mahout User List
> Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
>
> This may be getting to you're-on-your-own-territory since you're modifying the build. This error means your directory structure doesn't match up with declarations. You said somewhere that the parent of module X was Y, but the location given points to the pom of a module that isn't Y.
>
> On Wed, Apr 2, 2014 at 5:28 AM, Phan, Truong Q <Tr...@team.telstra.com> wrote:
>> Hi Sean,
>>
>> I am trying to build the Mahout again and got some WARNINGs so far.
>> Can you give me some hints what I have done wrong here?
>>
>> Thanks for your help so far.
RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
Posted by "Phan, Truong Q" <Tr...@team.telstra.com>.
Where did I modifying the build?
Here are my steps of the build.
I got the source from one of the official mirror website and build it.
The only one exception here is that I am using the Cloudera CDH 5.0.
This latest CDHv5.0 might not work with Mahout v0.9.
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Install Mahout
$ javac -version
javac 1.6.0_32
$ cd /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout
$ wget http://mirror.mel.bkb.net.au/pub/apache/mahout/0.9/mahout-distribution-0.9-src.tar.gz
$ mv mahout-distribution-0.9 mahout-distribution-0.9.old
$ tar xvf mahout-distribution-0.9-src.tar.gz
$ cd mahout-distribution-0.9
$ ls
bin buildtools core distribution examples integration LICENSE.txt math math-scala NOTICE.txt pom.xml README.txt src
$ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1 -DskipTests=true [INFO] Scanning for projects...
............
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Mahout Build Tools ................................ SUCCESS [ 7.235 s]
[INFO] Apache Mahout ..................................... SUCCESS [ 1.017 s]
[INFO] Mahout Math ....................................... SUCCESS [15:46 min]
[INFO] Mahout Core ....................................... SUCCESS [24:29 min]
[INFO] Mahout Integration ................................ SUCCESS [03:38 min]
[INFO] Mahout Examples ................................... SUCCESS [02:40 min]
[INFO] Mahout Release Package ............................ SUCCESS [ 0.075 s]
[INFO] Mahout Math/Scala wrappers ........................ SUCCESS [01:12 min]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 47:57 min
[INFO] Finished at: 2014-04-02T15:07:50+10:00
[INFO] Final Memory: 49M/288M
[INFO] ------------------------------------------------------------------------
Thanks and Regards,
Truong Phan
P + 61 2 8576 5771
M + 61 4 1463 7424
E troung.phan@team.telstra.com
W www.telstra.com
-----Original Message-----
From: Sean Owen [mailto:srowen@gmail.com]
Sent: Wednesday, 2 April 2014 3:33 PM
To: Mahout User List
Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
This may be getting to you're-on-your-own-territory since you're modifying the build. This error means your directory structure doesn't match up with declarations. You said somewhere that the parent of module X was Y, but the location given points to the pom of a module that isn't Y.
On Wed, Apr 2, 2014 at 5:28 AM, Phan, Truong Q <Tr...@team.telstra.com> wrote:
> Hi Sean,
>
> I am trying to build the Mahout again and got some WARNINGs so far.
> Can you give me some hints what I have done wrong here?
>
> Thanks for your help so far.
Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
Posted by Sean Owen <sr...@gmail.com>.
This may be getting to you're-on-your-own-territory since you're
modifying the build. This error means your directory structure doesn't
match up with declarations. You said somewhere that the parent of
module X was Y, but the location given points to the pom of a module
that isn't Y.
On Wed, Apr 2, 2014 at 5:28 AM, Phan, Truong Q
<Tr...@team.telstra.com> wrote:
> Hi Sean,
>
> I am trying to build the Mahout again and got some WARNINGs so far.
> Can you give me some hints what I have done wrong here?
>
> Thanks for your help so far.
RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
Posted by "Phan, Truong Q" <Tr...@team.telstra.com>.
Hi Sean,
I am trying to build the Mahout again and got some WARNINGs so far.
Can you give me some hints what I have done wrong here?
Thanks for your help so far.
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
$ mv mahout-distribution-0.9 mahout-distribution-0.9.old
$ tar xvf mahout-distribution-0.9-src.tar.gz
$ cd mahout-distribution-0.9
$ ls
bin buildtools core distribution examples integration LICENSE.txt math math-scala NOTICE.txt pom.xml README.txt src
$ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1 -DskipTests=true
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.mahout:mahout-math:jar:0.9
[WARNING] 'parent.relativePath' of POM org.apache.mahout:mahout:0.9 (/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml) points at org.apache.mahout:mahout-distribution instead of org.apache:apache, please verify your project structure @ org.apache.mahout:mahout:0.9, /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml, line 25, column 11
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.mahout:mahout-core:jar:0.9
[WARNING] 'parent.relativePath' of POM org.apache.mahout:mahout:0.9 (/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml) points at org.apache.mahout:mahout-distribution instead of org.apache:apache, please verify your project structure @ org.apache.mahout:mahout:0.9, /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml, line 25, column 11
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.mahout:mahout-integration:jar:0.9
[WARNING] 'parent.relativePath' of POM org.apache.mahout:mahout:0.9 (/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml) points at org.apache.mahout:mahout-distribution instead of org.apache:apache, please verify your project structure @ org.apache.mahout:mahout:0.9, /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml, line 25, column 11
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.mahout:mahout-examples:jar:0.9
[WARNING] 'parent.relativePath' of POM org.apache.mahout:mahout:0.9 (/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml) points at org.apache.mahout:mahout-distribution instead of org.apache:apache, please verify your project structure @ org.apache.mahout:mahout:0.9, /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml, line 25, column 11
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.mahout:mahout-distribution:pom:0.9
[WARNING] 'parent.relativePath' of POM org.apache.mahout:mahout:0.9 (/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml) points at org.apache.mahout:mahout-distribution instead of org.apache:apache, please verify your project structure @ org.apache.mahout:mahout:0.9, /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml, line 25, column 11
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.mahout:mahout-math-scala:jar:0.9
[WARNING] 'parent.relativePath' of POM org.apache.mahout:mahout:0.9 (/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml) points at org.apache.mahout:mahout-distribution instead of org.apache:apache, please verify your project structure @ org.apache.mahout:mahout:0.9, /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/pom.xml, line 25, column 11
[WARNING] 'build.plugins.plugin.version' for org.scala-tools:maven-scala-plugin is missing. @ line 108, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.mahout:mahout:pom:0.9
[WARNING] 'parent.relativePath' points at org.apache.mahout:mahout-distribution instead of org.apache:apache, please verify your project structure @ line 25, column 11
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
Thanks and Regards,
Truong Phan
P + 61 2 8576 5771
M + 61 4 1463 7424
E troung.phan@team.telstra.com
W www.telstra.com
-----Original Message-----
From: Sean Owen [mailto:srowen@gmail.com]
Sent: Wednesday, 2 April 2014 9:53 AM
To: Phan, Truong Q
Cc: Mahout User List
Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
This still means Hadoop version mismatch.
You shouldn't have to use CLASSPATH. To be safe use the .job file with all the dependencies including Hadoop client baked in.
I am guessing that you are picking up other versions of Mahout which are not compiled for Hadoop 2, in that CLASSPATH? Kind of a guess though. Your build invocation should set the Hadoop 2 profile and all that.
On Wed, Apr 2, 2014 at 12:41 AM, Phan, Truong Q <Tr...@team.telstra.com> wrote:
> Hi Sean,
>
> Thanks for reviewing my issue.
> Actually, the directory (/usr/lib/hadoop-0.20-mapreduce) contain Cloudera v5b1 which I believe it has been upgraded to Hadoop 2.2.
> I also have another Hadoop home directory (/usr/lib/hadoop-mapreduce/) which is also belong to Cloudera v5b1.
> Please see below for the content of these directories.
>
> For the sake of this testing I have pointed my CLASSPATH to (/usr/lib/hadoop-mapreduce/) and re-run the test again but I receive a different error.
> Please see below for the error.
>
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> $ env | grep HAD
> HADOOP_CMD=/usr/bin/hadoop
> HADOOP_HOME=/usr/lib/hadoop
> HADOOP_STREAMING=/usr/lib/hadoop-mapreduce/hadoop-streaming-2.2.0-cdh5
> .0.0-beta-1.jar
>
> $ echo $CLASSPATH
> :/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distri
> bution-0.9/core/target/mahout-core-0.9.jar:/ora/db002/stg001/BDMSL1D/h
> adoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/target/mahou
> t-core-0.9-job.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/ma
> hout/mahout-distribution-0.9/core/target/mahout-core-0.9-sources.jar:/
> ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribu
> tion-0.9/core/target/mahout-core-0.9-tests.jar:/ora/db002/stg001/BDMSL
> 1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/math/target/m
> ahout-math-0.9.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/ma
> hout/mahout-distribution-0.9/math/target/mahout-math-0.9-sources.jar:/
> ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribu
> tion-0.9/math/target/mahout-math-0.9-tests.jar:/ora/db002/stg001/BDMSL
> 1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/integration/t
> arget/mahout-integration-0.9.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-
> dms/devices/mahout/mahout-distribution-0.9/integration/target/mahout-i
> ntegration-0.9-sources.jar
>
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> $ mahout recommenditembased --input mydata.dat --usersFile user.dat
> --numRecommendations 2 --output output/ --similarityClassname
> SIMILARITY_PEARSON_CORRELATION Running on hadoop, using
> /usr/lib/hadoop/bin/hadoop and HADOOP_CONF_DIR=
> MAHOUT-JOB:
> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib
> ution-0.9/examples/target/mahout-examples-0.9-job.jar
> 14/04/01 17:17:06 INFO common.AbstractJob: Command line arguments:
> {--booleanData=[false], --endPhase=[2147483647], --input=[mydata.dat],
> --maxPrefsInItemSimilarity=[500], --maxPrefsPerUser=[10],
> --maxSimilaritiesPerItem=[100], --minPrefsPerUser=[1],
> --numRecommendations=[2], --output=[output/],
> --similarityClassname=[SIMILARITY_PEARSON_CORRELATION],
> --startPhase=[0], --tempDir=[temp], --usersFile=[user.dat]}
> 14/04/01 17:17:06 INFO common.AbstractJob: Command line arguments:
> {--booleanData=[false], --endPhase=[2147483647], --input=[mydata.dat],
> --minPrefsPerUser=[1], --output=[temp/preparePreferenceMatrix],
> --ratingShift=[0.0], --startPhase=[0], --tempDir=[temp]}
> 14/04/01 17:17:07 INFO Configuration.deprecation: mapred.input.dir is
> deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
> 14/04/01 17:17:07 INFO Configuration.deprecation:
> mapred.compress.map.output is deprecated. Instead, use
> mapreduce.map.output.compress
> 14/04/01 17:17:07 INFO Configuration.deprecation: mapred.output.dir is
> deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> Exception in thread "main" java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected
> at org.apache.mahout.common.HadoopUtil.getCustomJobName(HadoopUtil.java:174)
> at org.apache.mahout.common.AbstractJob.prepareJob(AbstractJob.java:614)
> at org.apache.mahout.cf.taste.hadoop.preparation.PreparePreferenceMatrixJob.run(PreparePreferenceMatrixJob.java:73)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:164)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:322)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
> at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
> at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
> at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
>
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> $ ls -al /usr/lib/hadoop-0.20-mapreduce total 3860
> drwxr-xr-x 10 root root 4096 Feb 5 07:08 .
> drwxr-xr-x 52 root root 12288 Feb 10 16:56 ..
> drwxr-xr-x 2 root root 4096 Feb 12 04:02 bin
> -rw-r--r-- 1 root root 348776 Oct 28 11:30 CHANGES.txt
> drwxr-xr-x 2 root root 4096 Feb 5 07:08 cloudera
> lrwxrwxrwx 1 root root 16 Feb 5 07:08 conf -> /etc/hadoop/conf
> drwxr-xr-x 6 root root 4096 Feb 5 07:08 contrib
> drwxr-xr-x 4 root root 4096 Feb 5 07:08 example-confs
> -rw-r--r-- 1 root root 6833 Oct 28 11:30 hadoop-ant-2.2.0-mr1-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 40 Feb 5 07:08 hadoop-ant.jar -> hadoop-ant-2.2.0-mr1-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 1757210 Oct 28 11:30 hadoop-core-2.2.0-mr1-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 41 Feb 5 07:08 hadoop-core.jar -> hadoop-core-2.2.0-mr1-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 142842 Oct 28 11:30 hadoop-examples-2.2.0-mr1-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 45 Feb 5 07:08 hadoop-examples.jar -> hadoop-examples-2.2.0-mr1-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 1413120 Oct 28 11:30 hadoop-test-2.2.0-mr1-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 41 Feb 5 07:08 hadoop-test.jar -> hadoop-test-2.2.0-mr1-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 175182 Oct 28 11:30 hadoop-tools-2.2.0-mr1-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 42 Feb 5 07:08 hadoop-tools.jar -> hadoop-tools-2.2.0-mr1-cdh5.0.0-beta-1.jar
> drwxr-xr-x 3 root root 4096 Feb 5 07:08 include
> drwxr-xr-x 5 root root 4096 Feb 5 07:08 lib
> -rw-r--r-- 1 root root 13366 Oct 28 11:30 LICENSE.txt
> -rw-r--r-- 1 root root 101 Oct 28 11:30 NOTICE.txt
> -rw-r--r-- 1 root root 1366 Oct 28 11:30 README.txt
> drwxr-xr-x 3 root root 4096 Feb 5 07:08 sbin
> drwxr-xr-x 5 root root 4096 Feb 5 07:08 webapps
>
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> $ ls -al /usr/lib/hadoop-mapreduce/
> total 5244
> drwxr-xr-x 6 root root 4096 Feb 5 07:05 .
> drwxr-xr-x 52 root root 12288 Feb 10 16:56 ..
> drwxr-xr-x 2 root root 4096 Feb 12 04:02 bin
> drwxr-xr-x 2 root root 4096 Feb 5 07:05 cloudera
> -rw-r--r-- 1 root root 21515 Oct 28 11:30 hadoop-archives-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 41 Feb 5 07:05 hadoop-archives.jar -> hadoop-archives-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 14574 Oct 28 11:30 hadoop-datajoin-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 41 Feb 5 07:05 hadoop-datajoin.jar -> hadoop-datajoin-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 80406 Oct 28 11:30 hadoop-distcp-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 39 Feb 5 07:05 hadoop-distcp.jar -> hadoop-distcp-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 62071 Oct 28 11:30 hadoop-extras-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 39 Feb 5 07:05 hadoop-extras.jar -> hadoop-extras-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 215375 Oct 28 11:30 hadoop-gridmix-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 40 Feb 5 07:05 hadoop-gridmix.jar -> hadoop-gridmix-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 482199 Oct 28 11:30 hadoop-mapreduce-client-app-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 53 Feb 5 07:05 hadoop-mapreduce-client-app.jar -> hadoop-mapreduce-client-app-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 656300 Oct 28 11:30 hadoop-mapreduce-client-common-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 56 Feb 5 07:05 hadoop-mapreduce-client-common.jar -> hadoop-mapreduce-client-common-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 1455612 Oct 28 11:30 hadoop-mapreduce-client-core-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 54 Feb 5 07:05 hadoop-mapreduce-client-core.jar -> hadoop-mapreduce-client-core-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 117249 Oct 28 11:30 hadoop-mapreduce-client-hs-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 52 Feb 5 07:05 hadoop-mapreduce-client-hs.jar -> hadoop-mapreduce-client-hs-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 4086 Oct 28 11:30 hadoop-mapreduce-client-hs-plugins-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 60 Feb 5 07:05 hadoop-mapreduce-client-hs-plugins.jar -> hadoop-mapreduce-client-hs-plugins-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 35237 Oct 28 11:30 hadoop-mapreduce-client-jobclient-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 1434812 Oct 28 11:30 hadoop-mapreduce-client-jobclient-2.2.0-cdh5.0.0-beta-1-tests.jar
> lrwxrwxrwx 1 root root 59 Feb 5 07:05 hadoop-mapreduce-client-jobclient.jar -> hadoop-mapreduce-client-jobclient-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 21566 Oct 28 11:30 hadoop-mapreduce-client-shuffle-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 57 Feb 5 07:05 hadoop-mapreduce-client-shuffle.jar -> hadoop-mapreduce-client-shuffle-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 270285 Oct 28 11:30 hadoop-mapreduce-examples-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 51 Feb 5 07:05 hadoop-mapreduce-examples.jar -> hadoop-mapreduce-examples-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 277597 Oct 28 11:30 hadoop-rumen-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 38 Feb 5 07:05 hadoop-rumen.jar -> hadoop-rumen-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 102813 Oct 28 11:30 hadoop-streaming-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 42 Feb 5 07:05 hadoop-streaming.jar -> hadoop-streaming-2.2.0-cdh5.0.0-beta-1.jar
> drwxr-xr-x 2 root root 4096 Feb 5 07:05 lib
> drwxr-xr-x 2 root root 4096 Feb 5 07:05 sbin
>
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
>
> Thanks and Regards,
> Truong Phan
>
>
> P + 61 2 8576 5771
> M + 61 4 1463 7424
> E troung.phan@team.telstra.com
> W www.telstra.com
>
>
>
> -----Original Message-----
> From: Sean Owen [mailto:srowen@gmail.com]
> Sent: Monday, 31 March 2014 7:05 PM
> To: Mahout User List
> Subject: RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
>
> But you have a bunch of Hadoop 0.20 jars on your classpath! Definitely a problem. Those should not be there.
> On Mar 31, 2014 7:09 AM, "Phan, Truong Q"
> <Tr...@team.telstra.com>
> wrote:
>
>> Yes, I did rebuild it.
>>
>> oracle@bpdevdmsdbs01: ----
>> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distri
>> b
>> ution-0.9
>> -----
>> $ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1
>> -DskipTests=true
>> [INFO] Scanning for projects...
>> ....
>> [INFO]
>> ---------------------------------------------------------------------
>> -
>> --
>> [INFO] Reactor Summary:
>> [INFO]
>> [INFO] Mahout Build Tools ................................ SUCCESS [
>> 8.215 s]
>> [INFO] Apache Mahout ..................................... SUCCESS [
>> 1.158 s]
>> [INFO] Mahout Math ....................................... SUCCESS
>> [16:21 min] [INFO] Mahout Core .......................................
>> SUCCESS [26:21 min] [INFO] Mahout Integration
>> ................................ SUCCESS [03:55 min] [INFO] Mahout
>> Examples ................................... SUCCESS [02:54 min]
>> [INFO] Mahout Release Package ............................ SUCCESS [
>> 0.084 s]
>> [INFO] Mahout Math/Scala wrappers ........................ SUCCESS
>> [01:16 min] [INFO]
>> ---------------------------------------------------------------------
>> -
>> --
>> [INFO] BUILD SUCCESS
>> [INFO]
>> ---------------------------------------------------------------------
>> -
>> --
>> [INFO] Total time: 50:59 min
>> [INFO] Finished at: 2014-03-31T14:25:27+10:00 [INFO] Final Memory:
>> 47M/250M [INFO]
>> ---------------------------------------------------------------------
>> -
>> --
>>
>>
>> Thanks and Regards,
>> Truong Phan
>>
>>
>> P + 61 2 8576 5771
>> M + 61 4 1463 7424
>> E troung.phan@team.telstra.com
>> W www.telstra.com
>>
>>
>> -----Original Message-----
>> From: Andrew Musselman [mailto:andrew.musselman@gmail.com]
>> Sent: Monday, 31 March 2014 2:44 PM
>> To: user@mahout.apache.org
>> Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
>>
>> Have you rebuilt Mahout for your version? We're not supporting
>> Hadoop version two yet.
>>
>> See here for some direction:
>> http://mail-archives.us.apache.org/mod_mbox/mahout-user/201403.mbox/%
>> 3
>> CCANg8BGD8Cm_=ESecQQ5mDL+6ybbNrR1Ce7i=PkuiMXMcktWgMg@mail.gmail.com%3
>> E
>>
>> > On Mar 30, 2014, at 7:28 PM, "Phan, Truong Q" <
>> Troung.Phan@team.telstra.com> wrote:
>> >
>> > Hi
>> >
>> > Does Mahout v0.9 supports Cloudera Hadoop v5 (2.2.0-cdh5.0.0-beta-1)?
>> > I have managed to installed and run all test cases under the Mahout
>> > v0.9
>> without any issue.
>> > Please see below for the evident of the test cases.
>> > However I have no success to run the example from
>> http://girlincomputerscience.blogspot.com.au/2010/11/apache-mahout.htmland got the following errors.
>> > Note: I have set the CLASSPATH to point to all of Mahout’s jar files.
>> >
>> > <snip>
>> > $ env | grep CLASS
>> > CLASSPATH=:/usr/lib/hadoop-0.20-mapreduce/lib:/usr/lib/hadoop-0.20-
>> > m
>> > ap
>> > reduce/lib:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/
>> > m
>> > ah
>> > out-distribution-0.9/core/target/mahout-core-0.9.jar:/ora/db002/stg
>> > 0
>> > 01
>> > /BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core
>> > /
>> > ta
>> > rget/mahout-core-0.9-job.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-d
>> > m
>> > s/
>> > devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9-
>> > s
>> > ou
>> > rces.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/ma
>> > h
>> > ou
>> > t-distribution-0.9/core/target/mahout-core-0.9-tests.jar:/ora/db002
>> > /
>> > st
>> > g001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/
>> > m
>> > at
>> > h/target/mahout-math-0.9.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-d
>> > m
>> > s/
>> > devices/mahout/mahout-distribution-0.9/math/target/mahout-math-0.9-
>> > s
>> > ou
>> > rces.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/ma
>> > h
>> > ou
>> > t-distribution-0.9/math/target/mahout-math-0.9-tests.jar:/ora/db002
>> > /
>> > st
>> > g001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/
>> > i
>> > nt
>> > egration/target/mahout-integration-0.9.jar:/ora/db002/stg001/BDMSL1
>> > D
>> > /h
>> > adoop/nem-dms/devices/mahout/mahout-distribution-0.9/integration/ta
>> > r ge t/mahout-integration-0.9-sources.jar
>> >
>> > $ export
>> > MAHOUT_HOME=/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout
>> > /
>> > ma
>> > hout-distribution-0.9
>> > $ export PATH=$MAHOUT_HOME/bin:$PATH
>> >
>> > oracle@bpdevdmsdbs01:BDMSSI1D1 ----
>> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-dist
>> > r ib ution-0.9/nem-dms ----- $ mahout recommenditembased --input
>> > mydata.dat --usersFile user.dat --numRecommendations 2 --output
>> > output/ --similarityClassname SIMILARITY_PEARSON_CORRELATION
>> > Running on hadoop, using /usr/lib/hadoop-0.20-mapreduce/bin/hadoop
>> > and HADOOP_CONF_DIR=
>> > MAHOUT-JOB:
>> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-dist
>> > r ib ution-0.9/examples/target/mahout-examples-0.9-job.jar
>> > Exception in thread "main" java.lang.NoClassDefFoundError:
>> > org/apache/hadoop/util/PlatformName
>> > Caused by: java.lang.ClassNotFoundException:
>> org.apache.hadoop.util.PlatformName
>> > at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>> > at java.security.AccessController.doPrivileged(Native Method)
>> > at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>> > Could not find the main class: org.apache.hadoop.util.PlatformName.
>> Program will exit.
>> > Exception in thread "main" java.lang.NoClassDefFoundError:
>> > org/apache/hadoop/util/RunJar Caused by:
>> java.lang.ClassNotFoundException: org.apache.hadoop.util.RunJar
>> > at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>> > at java.security.AccessController.doPrivileged(Native Method)
>> > at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>> > Could not find the main class: org.apache.hadoop.util.RunJar.
>> > Program
>> will exit.
>> > </snip>
>> >
>> > <snip>
>> > [INFO] --- maven-install-plugin:2.5.1:install (default-install) @
>> > mahout-math-scala --- [INFO] Installing
>> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-dist
>> > r ib ution-0.9/math-scala/target/mahout-math-scala-0.9.jar to
>> > /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9
>> > / ma hout-math-scala-0.9.jar [INFO] Installing
>> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-dist
>> > r
>> > ib
>> > ution-0.9/math-scala/pom.xml to
>> > /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9
>> > / ma hout-math-scala-0.9.pom [INFO] Installing
>> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-dist
>> > r ib ution-0.9/math-scala/target/mahout-math-scala-0.9-tests.jar to
>> > /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9
>> > / ma hout-math-scala-0.9-tests.jar [INFO] Installing
>> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-dist
>> > r ib ution-0.9/math-scala/target/mahout-math-scala-0.9-sources.jar
>> > to
>> > /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9
>> > / ma hout-math-scala-0.9-sources.jar [INFO]
>> > -------------------------------------------------------------------
>> > -
>> > --
>> > --
>> > [INFO] Reactor Summary:
>> > [INFO]
>> > [INFO] Mahout Build Tools ................................ SUCCESS
>> > [01:21 min] [INFO] Apache Mahout .....................................
>> > SUCCESS [ 6.898 s] [INFO] Mahout Math
>> > ....................................... SUCCESS [17:39 min] [INFO]
>> > Mahout Core ....................................... SUCCESS [
>> > 01:01 h] [INFO] Mahout Integration ................................
>> > SUCCESS
>> > [06:59 min] [INFO] Mahout Examples ...................................
>> > SUCCESS [03:15 min] [INFO] Mahout Release Package
>> > ............................ SUCCESS [ 0.026 s] [INFO] Mahout
>> > Math/Scala wrappers ........................ SUCCESS [03:39 min]
>> > [INFO]
>> > -------------------------------------------------------------------
>> > -
>> > --
>> > --
>> > [INFO] BUILD SUCCESS
>> > [INFO]
>> > -------------------------------------------------------------------
>> > -
>> > --
>> > --
>> > [INFO] Total time: 01:34 h
>> > [INFO] Finished at: 2014-03-28T13:10:48+10:00 [INFO] Final Memory:
>> > 49M/276M [INFO]
>> > -------------------------------------------------------------------
>> > -
>> > --
>> > --
>> > </snip>
>> >
>> > Thanks and Regards,
>> > Truong Phan
>> > Senior Technology Specialist
>> > Database Engineering
>> > Transport & Routing Engineering | Networks | Telstra Operations
>> >
>> > P + 61 2 8576 5771
>> > M + 61 4 1463 7424
>> > E troung.phan@team.telstra.com
>> > W www.telstra.com
>> > Love the movies? Telstra takes you there with $10 movie tickets,
>> > just to say thanks. Available now at telstra.com/movies This
>> > communication
>> may contain confidential or copyright information of Telstra
>> Corporation Limited (ABN 33 051 775 556). If you are not an intended
>> recipient, you must not keep, forward, copy, use, save or rely on
>> this communication, and any such action is unauthorised and
>> prohibited. If you have received this communication in error, please
>> reply to this email to notify the sender of its incorrect delivery, and then delete both it and your reply.
>> >
>> >
>>
Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
Posted by Sean Owen <sr...@gmail.com>.
This still means Hadoop version mismatch.
You shouldn't have to use CLASSPATH. To be safe use the .job file with
all the dependencies including Hadoop client baked in.
I am guessing that you are picking up other versions of Mahout which
are not compiled for Hadoop 2, in that CLASSPATH? Kind of a guess
though. Your build invocation should set the Hadoop 2 profile and all
that.
On Wed, Apr 2, 2014 at 12:41 AM, Phan, Truong Q
<Tr...@team.telstra.com> wrote:
> Hi Sean,
>
> Thanks for reviewing my issue.
> Actually, the directory (/usr/lib/hadoop-0.20-mapreduce) contain Cloudera v5b1 which I believe it has been upgraded to Hadoop 2.2.
> I also have another Hadoop home directory (/usr/lib/hadoop-mapreduce/) which is also belong to Cloudera v5b1.
> Please see below for the content of these directories.
>
> For the sake of this testing I have pointed my CLASSPATH to (/usr/lib/hadoop-mapreduce/) and re-run the test again but I receive a different error.
> Please see below for the error.
>
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> $ env | grep HAD
> HADOOP_CMD=/usr/bin/hadoop
> HADOOP_HOME=/usr/lib/hadoop
> HADOOP_STREAMING=/usr/lib/hadoop-mapreduce/hadoop-streaming-2.2.0-cdh5.0.0-beta-1.jar
>
> $ echo $CLASSPATH
> :/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9-job.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9-sources.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9-tests.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/math/target/mahout-math-0.9.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/math/target/mahout-math-0.9-sources.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/math/target/mahout-math-0.9-tests.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/integration/target/mahout-integration-0.9.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/integration/target/mahout-integration-0.9-sources.jar
>
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> $ mahout recommenditembased --input mydata.dat --usersFile user.dat --numRecommendations 2 --output output/ --similarityClassname SIMILARITY_PEARSON_CORRELATION
> Running on hadoop, using /usr/lib/hadoop/bin/hadoop and HADOOP_CONF_DIR=
> MAHOUT-JOB: /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/examples/target/mahout-examples-0.9-job.jar
> 14/04/01 17:17:06 INFO common.AbstractJob: Command line arguments: {--booleanData=[false], --endPhase=[2147483647], --input=[mydata.dat], --maxPrefsInItemSimilarity=[500], --maxPrefsPerUser=[10], --maxSimilaritiesPerItem=[100], --minPrefsPerUser=[1], --numRecommendations=[2], --output=[output/], --similarityClassname=[SIMILARITY_PEARSON_CORRELATION], --startPhase=[0], --tempDir=[temp], --usersFile=[user.dat]}
> 14/04/01 17:17:06 INFO common.AbstractJob: Command line arguments: {--booleanData=[false], --endPhase=[2147483647], --input=[mydata.dat], --minPrefsPerUser=[1], --output=[temp/preparePreferenceMatrix], --ratingShift=[0.0], --startPhase=[0], --tempDir=[temp]}
> 14/04/01 17:17:07 INFO Configuration.deprecation: mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
> 14/04/01 17:17:07 INFO Configuration.deprecation: mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
> 14/04/01 17:17:07 INFO Configuration.deprecation: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
> Exception in thread "main" java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected
> at org.apache.mahout.common.HadoopUtil.getCustomJobName(HadoopUtil.java:174)
> at org.apache.mahout.common.AbstractJob.prepareJob(AbstractJob.java:614)
> at org.apache.mahout.cf.taste.hadoop.preparation.PreparePreferenceMatrixJob.run(PreparePreferenceMatrixJob.java:73)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:164)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:322)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
> at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
> at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
> at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
>
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> $ ls -al /usr/lib/hadoop-0.20-mapreduce
> total 3860
> drwxr-xr-x 10 root root 4096 Feb 5 07:08 .
> drwxr-xr-x 52 root root 12288 Feb 10 16:56 ..
> drwxr-xr-x 2 root root 4096 Feb 12 04:02 bin
> -rw-r--r-- 1 root root 348776 Oct 28 11:30 CHANGES.txt
> drwxr-xr-x 2 root root 4096 Feb 5 07:08 cloudera
> lrwxrwxrwx 1 root root 16 Feb 5 07:08 conf -> /etc/hadoop/conf
> drwxr-xr-x 6 root root 4096 Feb 5 07:08 contrib
> drwxr-xr-x 4 root root 4096 Feb 5 07:08 example-confs
> -rw-r--r-- 1 root root 6833 Oct 28 11:30 hadoop-ant-2.2.0-mr1-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 40 Feb 5 07:08 hadoop-ant.jar -> hadoop-ant-2.2.0-mr1-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 1757210 Oct 28 11:30 hadoop-core-2.2.0-mr1-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 41 Feb 5 07:08 hadoop-core.jar -> hadoop-core-2.2.0-mr1-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 142842 Oct 28 11:30 hadoop-examples-2.2.0-mr1-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 45 Feb 5 07:08 hadoop-examples.jar -> hadoop-examples-2.2.0-mr1-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 1413120 Oct 28 11:30 hadoop-test-2.2.0-mr1-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 41 Feb 5 07:08 hadoop-test.jar -> hadoop-test-2.2.0-mr1-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 175182 Oct 28 11:30 hadoop-tools-2.2.0-mr1-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 42 Feb 5 07:08 hadoop-tools.jar -> hadoop-tools-2.2.0-mr1-cdh5.0.0-beta-1.jar
> drwxr-xr-x 3 root root 4096 Feb 5 07:08 include
> drwxr-xr-x 5 root root 4096 Feb 5 07:08 lib
> -rw-r--r-- 1 root root 13366 Oct 28 11:30 LICENSE.txt
> -rw-r--r-- 1 root root 101 Oct 28 11:30 NOTICE.txt
> -rw-r--r-- 1 root root 1366 Oct 28 11:30 README.txt
> drwxr-xr-x 3 root root 4096 Feb 5 07:08 sbin
> drwxr-xr-x 5 root root 4096 Feb 5 07:08 webapps
>
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> $ ls -al /usr/lib/hadoop-mapreduce/
> total 5244
> drwxr-xr-x 6 root root 4096 Feb 5 07:05 .
> drwxr-xr-x 52 root root 12288 Feb 10 16:56 ..
> drwxr-xr-x 2 root root 4096 Feb 12 04:02 bin
> drwxr-xr-x 2 root root 4096 Feb 5 07:05 cloudera
> -rw-r--r-- 1 root root 21515 Oct 28 11:30 hadoop-archives-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 41 Feb 5 07:05 hadoop-archives.jar -> hadoop-archives-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 14574 Oct 28 11:30 hadoop-datajoin-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 41 Feb 5 07:05 hadoop-datajoin.jar -> hadoop-datajoin-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 80406 Oct 28 11:30 hadoop-distcp-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 39 Feb 5 07:05 hadoop-distcp.jar -> hadoop-distcp-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 62071 Oct 28 11:30 hadoop-extras-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 39 Feb 5 07:05 hadoop-extras.jar -> hadoop-extras-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 215375 Oct 28 11:30 hadoop-gridmix-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 40 Feb 5 07:05 hadoop-gridmix.jar -> hadoop-gridmix-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 482199 Oct 28 11:30 hadoop-mapreduce-client-app-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 53 Feb 5 07:05 hadoop-mapreduce-client-app.jar -> hadoop-mapreduce-client-app-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 656300 Oct 28 11:30 hadoop-mapreduce-client-common-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 56 Feb 5 07:05 hadoop-mapreduce-client-common.jar -> hadoop-mapreduce-client-common-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 1455612 Oct 28 11:30 hadoop-mapreduce-client-core-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 54 Feb 5 07:05 hadoop-mapreduce-client-core.jar -> hadoop-mapreduce-client-core-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 117249 Oct 28 11:30 hadoop-mapreduce-client-hs-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 52 Feb 5 07:05 hadoop-mapreduce-client-hs.jar -> hadoop-mapreduce-client-hs-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 4086 Oct 28 11:30 hadoop-mapreduce-client-hs-plugins-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 60 Feb 5 07:05 hadoop-mapreduce-client-hs-plugins.jar -> hadoop-mapreduce-client-hs-plugins-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 35237 Oct 28 11:30 hadoop-mapreduce-client-jobclient-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 1434812 Oct 28 11:30 hadoop-mapreduce-client-jobclient-2.2.0-cdh5.0.0-beta-1-tests.jar
> lrwxrwxrwx 1 root root 59 Feb 5 07:05 hadoop-mapreduce-client-jobclient.jar -> hadoop-mapreduce-client-jobclient-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 21566 Oct 28 11:30 hadoop-mapreduce-client-shuffle-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 57 Feb 5 07:05 hadoop-mapreduce-client-shuffle.jar -> hadoop-mapreduce-client-shuffle-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 270285 Oct 28 11:30 hadoop-mapreduce-examples-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 51 Feb 5 07:05 hadoop-mapreduce-examples.jar -> hadoop-mapreduce-examples-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 277597 Oct 28 11:30 hadoop-rumen-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 38 Feb 5 07:05 hadoop-rumen.jar -> hadoop-rumen-2.2.0-cdh5.0.0-beta-1.jar
> -rw-r--r-- 1 root root 102813 Oct 28 11:30 hadoop-streaming-2.2.0-cdh5.0.0-beta-1.jar
> lrwxrwxrwx 1 root root 42 Feb 5 07:05 hadoop-streaming.jar -> hadoop-streaming-2.2.0-cdh5.0.0-beta-1.jar
> drwxr-xr-x 2 root root 4096 Feb 5 07:05 lib
> drwxr-xr-x 2 root root 4096 Feb 5 07:05 sbin
>
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
>
> Thanks and Regards,
> Truong Phan
>
>
> P + 61 2 8576 5771
> M + 61 4 1463 7424
> E troung.phan@team.telstra.com
> W www.telstra.com
>
>
>
> -----Original Message-----
> From: Sean Owen [mailto:srowen@gmail.com]
> Sent: Monday, 31 March 2014 7:05 PM
> To: Mahout User List
> Subject: RE: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
>
> But you have a bunch of Hadoop 0.20 jars on your classpath! Definitely a problem. Those should not be there.
> On Mar 31, 2014 7:09 AM, "Phan, Truong Q" <Tr...@team.telstra.com>
> wrote:
>
>> Yes, I did rebuild it.
>>
>> oracle@bpdevdmsdbs01: ----
>> /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib
>> ution-0.9
>> -----
>> $ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1
>> -DskipTests=true
>> [INFO] Scanning for projects...
>> ....
>> [INFO]
>> ----------------------------------------------------------------------
>> --
>> [INFO] Reactor Summary:
>> [INFO]
>> [INFO] Mahout Build Tools ................................ SUCCESS [
>> 8.215 s]
>> [INFO] Apache Mahout ..................................... SUCCESS [
>> 1.158 s]
>> [INFO] Mahout Math ....................................... SUCCESS
>> [16:21 min] [INFO] Mahout Core .......................................
>> SUCCESS [26:21 min] [INFO] Mahout Integration
>> ................................ SUCCESS [03:55 min] [INFO] Mahout
>> Examples ................................... SUCCESS [02:54 min]
>> [INFO] Mahout Release Package ............................ SUCCESS [
>> 0.084 s]
>> [INFO] Mahout Math/Scala wrappers ........................ SUCCESS
>> [01:16 min] [INFO]
>> ----------------------------------------------------------------------
>> --
>> [INFO] BUILD SUCCESS
>> [INFO]
>> ----------------------------------------------------------------------
>> --
>> [INFO] Total time: 50:59 min
>> [INFO] Finished at: 2014-03-31T14:25:27+10:00 [INFO] Final Memory:
>> 47M/250M [INFO]
>> ----------------------------------------------------------------------
>> --
>>
>>
>> Thanks and Regards,
>> Truong Phan
>>
>>
>> P + 61 2 8576 5771
>> M + 61 4 1463 7424
>> E troung.phan@team.telstra.com
>> W www.telstra.com
>>
>>
>> -----Original Message-----
>> From: Andrew Musselman [mailto:andrew.musselman@gmail.com]
>> Sent: Monday, 31 March 2014 2:44 PM
>> To: user@mahout.apache.org
>> Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1
>>
>> Have you rebuilt Mahout for your version? We're not supporting Hadoop
>> version two yet.
>>
>> See here for some direction:
>> http://mail-archives.us.apache.org/mod_mbox/mahout-user/201403.mbox/%3
>> CCANg8BGD8Cm_=ESecQQ5mDL+6ybbNrR1Ce7i=PkuiMXMcktWgMg@mail.gmail.com%3E
>>
>> > On Mar 30, 2014, at 7:28 PM, "Phan, Truong Q" <
>> Troung.Phan@team.telstra.com> wrote:
>> >
>> > Hi
>> >
>> > Does Mahout v0.9 supports Cloudera Hadoop v5 (2.2.0-cdh5.0.0-beta-1)?
>> > I have managed to installed and run all test cases under the Mahout
>> > v0.9
>> without any issue.
>> > Please see below for the evident of the test cases.
>> > However I have no success to run the example from
>> http://girlincomputerscience.blogspot.com.au/2010/11/apache-mahout.htmland got the following errors.
>> > Note: I have set the CLASSPATH to point to all of Mahout’s jar files.
>> >
>> > <snip>
>> > $ env | grep CLASS
>> > CLASSPATH=:/usr/lib/hadoop-0.20-mapreduce/lib:/usr/lib/hadoop-0.20-m
>> > ap
>> > reduce/lib:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/m
>> > ah
>> > out-distribution-0.9/core/target/mahout-core-0.9.jar:/ora/db002/stg0
>> > 01
>> > /BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/
>> > ta
>> > rget/mahout-core-0.9-job.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dm
>> > s/
>> > devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9-s
>> > ou
>> > rces.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mah
>> > ou
>> > t-distribution-0.9/core/target/mahout-core-0.9-tests.jar:/ora/db002/
>> > st
>> > g001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/m
>> > at
>> > h/target/mahout-math-0.9.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dm
>> > s/
>> > devices/mahout/mahout-distribution-0.9/math/target/mahout-math-0.9-s
>> > ou
>> > rces.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mah
>> > ou
>> > t-distribution-0.9/math/target/mahout-math-0.9-tests.jar:/ora/db002/
>> > st
>> > g001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/i
>> > nt
>> > egration/target/mahout-integration-0.9.jar:/ora/db002/stg001/BDMSL1D
>> > /h
>> > adoop/nem-dms/devices/mahout/mahout-distribution-0.9/integration/tar
>> > ge t/mahout-integration-0.9-sources.jar
>> >
>> > $ export
>> > MAHOUT_HOME=/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/
>> > ma
>> > hout-distribution-0.9
>> > $ export PATH=$MAHOUT_HOME/bin:$PATH
>> >
>> > oracle@bpdevdmsdbs01:BDMSSI1D1 ----
>> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distr
>> > ib ution-0.9/nem-dms ----- $ mahout recommenditembased --input
>> > mydata.dat --usersFile user.dat --numRecommendations 2 --output
>> > output/ --similarityClassname SIMILARITY_PEARSON_CORRELATION Running
>> > on hadoop, using /usr/lib/hadoop-0.20-mapreduce/bin/hadoop and
>> > HADOOP_CONF_DIR=
>> > MAHOUT-JOB:
>> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distr
>> > ib ution-0.9/examples/target/mahout-examples-0.9-job.jar
>> > Exception in thread "main" java.lang.NoClassDefFoundError:
>> > org/apache/hadoop/util/PlatformName
>> > Caused by: java.lang.ClassNotFoundException:
>> org.apache.hadoop.util.PlatformName
>> > at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>> > at java.security.AccessController.doPrivileged(Native Method)
>> > at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>> > Could not find the main class: org.apache.hadoop.util.PlatformName.
>> Program will exit.
>> > Exception in thread "main" java.lang.NoClassDefFoundError:
>> > org/apache/hadoop/util/RunJar Caused by:
>> java.lang.ClassNotFoundException: org.apache.hadoop.util.RunJar
>> > at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>> > at java.security.AccessController.doPrivileged(Native Method)
>> > at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> > at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>> > Could not find the main class: org.apache.hadoop.util.RunJar.
>> > Program
>> will exit.
>> > </snip>
>> >
>> > <snip>
>> > [INFO] --- maven-install-plugin:2.5.1:install (default-install) @
>> > mahout-math-scala --- [INFO] Installing
>> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distr
>> > ib ution-0.9/math-scala/target/mahout-math-scala-0.9.jar to
>> > /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/
>> > ma hout-math-scala-0.9.jar [INFO] Installing
>> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distr
>> > ib
>> > ution-0.9/math-scala/pom.xml to
>> > /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/
>> > ma hout-math-scala-0.9.pom [INFO] Installing
>> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distr
>> > ib ution-0.9/math-scala/target/mahout-math-scala-0.9-tests.jar to
>> > /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/
>> > ma hout-math-scala-0.9-tests.jar [INFO] Installing
>> > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distr
>> > ib ution-0.9/math-scala/target/mahout-math-scala-0.9-sources.jar to
>> > /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/
>> > ma hout-math-scala-0.9-sources.jar [INFO]
>> > --------------------------------------------------------------------
>> > --
>> > --
>> > [INFO] Reactor Summary:
>> > [INFO]
>> > [INFO] Mahout Build Tools ................................ SUCCESS
>> > [01:21 min] [INFO] Apache Mahout .....................................
>> > SUCCESS [ 6.898 s] [INFO] Mahout Math
>> > ....................................... SUCCESS [17:39 min] [INFO]
>> > Mahout Core ....................................... SUCCESS [ 01:01
>> > h] [INFO] Mahout Integration ................................
>> > SUCCESS
>> > [06:59 min] [INFO] Mahout Examples ...................................
>> > SUCCESS [03:15 min] [INFO] Mahout Release Package
>> > ............................ SUCCESS [ 0.026 s] [INFO] Mahout
>> > Math/Scala wrappers ........................ SUCCESS [03:39 min]
>> > [INFO]
>> > --------------------------------------------------------------------
>> > --
>> > --
>> > [INFO] BUILD SUCCESS
>> > [INFO]
>> > --------------------------------------------------------------------
>> > --
>> > --
>> > [INFO] Total time: 01:34 h
>> > [INFO] Finished at: 2014-03-28T13:10:48+10:00 [INFO] Final Memory:
>> > 49M/276M [INFO]
>> > --------------------------------------------------------------------
>> > --
>> > --
>> > </snip>
>> >
>> > Thanks and Regards,
>> > Truong Phan
>> > Senior Technology Specialist
>> > Database Engineering
>> > Transport & Routing Engineering | Networks | Telstra Operations
>> >
>> > P + 61 2 8576 5771
>> > M + 61 4 1463 7424
>> > E troung.phan@team.telstra.com
>> > W www.telstra.com
>> > Love the movies? Telstra takes you there with $10 movie tickets,
>> > just to say thanks. Available now at telstra.com/movies This
>> > communication
>> may contain confidential or copyright information of Telstra
>> Corporation Limited (ABN 33 051 775 556). If you are not an intended
>> recipient, you must not keep, forward, copy, use, save or rely on this
>> communication, and any such action is unauthorised and prohibited. If
>> you have received this communication in error, please reply to this
>> email to notify the sender of its incorrect delivery, and then delete both it and your reply.
>> >
>> >
>>