You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@mahout.apache.org by "patrick.J (JIRA)" <ji...@apache.org> on 2011/08/13 04:41:27 UTC

[jira] [Created] (MAHOUT-784) Exception at 20 Newsgroups examples

Exception at 20 Newsgroups examples
-----------------------------------

                 Key: MAHOUT-784
                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
             Project: Mahout
          Issue Type: Bug
          Components: Classification
         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
            Reporter: patrick.J


somebody may help,
   I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups)step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
   But when I going the step train the classifier on Hadoop, Exception was cast like:
$> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
java.lang.RuntimeException: Error in configuring object
	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
	at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
	... 5 more
Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
	at java.lang.Class.forName0(Native Method)
	at java.lang.Class.forName(Class.java:247)
	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
	... 10 more
Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
	... 17 more
   What happened? I just walked through the tutorials.......

  

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Re: [jira] [Updated] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by Lance Norskog <go...@gmail.com>.

The TokenStream class is part of Lucene. The Lucene jar is a separate
file that is not normally part of a Mahout job. There is something
missing in the class path for the Mahout job.

(Please just post this kind of error on the user@mahout mailing list.)

On Fri, Aug 12, 2011 at 7:41 PM, patrick.J (JIRA) <ji...@apache.org> wrote:
>
>     [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
>
> patrick.J updated MAHOUT-784:
> -----------------------------
>
>    Description:
> somebody may help,
>   I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>   But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
>        at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>        at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>        at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>        at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>        ... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
>        at java.lang.Class.forName0(Native Method)
>        at java.lang.Class.forName(Class.java:247)
>        at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
>        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
>        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
>        at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
>        at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>        ... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
>        at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>        at java.security.AccessController.doPrivileged(Native Method)
>        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>        at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>        ... 17 more
>   What happened? I just walked through the tutorials.......
>
>
>
>  was:
> somebody may help,
>   I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups)step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>   But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
>        at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>        at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>        at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>        at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>        ... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
>        at java.lang.Class.forName0(Native Method)
>        at java.lang.Class.forName(Class.java:247)
>        at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
>        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
>        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
>        at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
>        at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>        ... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
>        at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>        at java.security.AccessController.doPrivileged(Native Method)
>        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>        at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>        ... 17 more
>   What happened? I just walked through the tutorials.......
>
>
>
>
>> Exception at 20 Newsgroups examples
>> -----------------------------------
>>
>>                 Key: MAHOUT-784
>>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>>             Project: Mahout
>>          Issue Type: Bug
>>          Components: Classification
>>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5
>>            Reporter: patrick.J
>>
>> somebody may help,
>>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>>    But when I going the step train the classifier on Hadoop, Exception was cast like:
>> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
>> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
>> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
>> java.lang.RuntimeException: Error in configuring object
>>       at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
>>       at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
>>       at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
>>       at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
>>       at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
>>       at org.apache.hadoop.mapred.Child.main(Child.java:170)
>> Caused by: java.lang.reflect.InvocationTargetException
>>       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>       at java.lang.reflect.Method.invoke(Method.java:597)
>>       at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
>>       ... 5 more
>> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
>>       at java.lang.Class.forName0(Native Method)
>>       at java.lang.Class.forName(Class.java:247)
>>       at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
>>       at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
>>       at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
>>       at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
>>       at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
>>       ... 10 more
>> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
>>       at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>>       at java.security.AccessController.doPrivileged(Native Method)
>>       at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>>       at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>>       at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>       at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>>       ... 17 more
>>    What happened? I just walked through the tutorials.......
>>
>
> --
> This message is automatically generated by JIRA.
> For more information on JIRA, see: http://www.atlassian.com/software/jira
>
>
>



-- 
Lance Norskog
goksron@gmail.com

[jira] [Updated] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Sean Owen (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen updated MAHOUT-784:
-----------------------------

    Assignee: Robin Anil

I think this is a duplicate of other similar issues. Can you please try this again with the latest code from Subversion rather than 0.5? Robin, it would also be worth you looking at the wiki to confirm the instructions remain correct.

> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Robin Anil
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Joe Prasanna Kumar (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13206244#comment-13206244 ] 

Joe Prasanna Kumar commented on MAHOUT-784:
-------------------------------------------

Lance - I just checked the formatter that I used.. It says
<profile kind="CodeFormatterProfile" name="Lucene" version="11"> while the one referenced in our wiki is of version 12. <profile kind="CodeFormatterProfile" name="Lucene" version="12">

I'll get the latest formatter xml and apply formatting to the code and then upload the patch. 
sorry for the confusion..

regards
Joe.
                
> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Sean Owen
>             Fix For: 0.7
>
>         Attachments: MAHOUT-784.patch, MAHOUT-784.patch
>
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Joe Prasanna Kumar (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13145228#comment-13145228 ] 

Joe Prasanna Kumar commented on MAHOUT-784:
-------------------------------------------

Thx for your thoughts Lance. Since testclassifier outputs summary while running in a sequential mode while doesnt do so in mapreduce mode, it cud be confusing to user. I thought of adding cmdump to the classify-20newsgroup.sh so that users can get the summary but while specifying the output as text, it doesnt print the summary. When I tried html format for output, it did. 

Should we make the output of cmdump consistent ? ie make exportText and exportTable output similar info ? 
                
> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Robin Anil
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Lance Norskog (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13145166#comment-13145166 ] 

Lance Norskog commented on MAHOUT-784:
--------------------------------------

No, I meant that the script that runs 'mahout testclassifier' would then run 'mahout cmdump'. 

Sooner or later the command-line jobs have to be modular. We can't push every little feature into one program. (And 'cmdump/ConfusionMatrixDumper' is not a little feature.)
                
> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Robin Anil
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Joe Prasanna Kumar (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13148339#comment-13148339 ] 

Joe Prasanna Kumar commented on MAHOUT-784:
-------------------------------------------

Both patches are the same. I earlier forgot to click on "Grant ASF....." option button
                
> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Robin Anil
>         Attachments: MAHOUT-784.patch, MAHOUT-784.patch
>
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Joe Prasanna Kumar (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13128521#comment-13128521 ] 

Joe Prasanna Kumar commented on MAHOUT-784:
-------------------------------------------

Sean, thanks for the quick feedback. I have updated the wiki with instructions on using the script rather than manual steps. I am bit concerned with the TestClassifier since it doesnt seem to print a summary but just the confusion matrix. I'll look at the code of TestClassifier and see why this behavior happens and update this issue for any patches (if required)
                
> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Robin Anil
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "patrick.J (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13088160#comment-13088160 ] 

patrick.J commented on MAHOUT-784:
----------------------------------

OK , Sean, I'll try. Much appreciate. In addition to that, Mahout in action, truly a good book, I recommend it to most of my friends

> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Robin Anil
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Lance Norskog (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13148249#comment-13148249 ] 

Lance Norskog commented on MAHOUT-784:
--------------------------------------

Hi-

Yes, that sounds like a great idea. Please add it to ConfusionMatrixDumper.java and post a JIRA.
                
> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Robin Anil
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Joe Prasanna Kumar (Updated) (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Joe Prasanna Kumar updated MAHOUT-784:
--------------------------------------

    Attachment: MAHOUT-784.patch

Modified exportText in ConfusionMatrixDumper to print the summary of classification job. 

FYI - After formatting using the mahout format template, I see quite a few difference while comparing the code with prev ver..
                
> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Robin Anil
>         Attachments: MAHOUT-784.patch, MAHOUT-784.patch
>
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Sean Owen (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13128393#comment-13128393 ] 

Sean Owen commented on MAHOUT-784:
----------------------------------

Good to hear that this seems to work. Yes, let's update any instructions you see that are incomplete or out of date. Feel free to update the wiki. Do you need me to commit other script/doc changes?
                
> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Robin Anil
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Sean Owen (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13206377#comment-13206377 ] 

Sean Owen commented on MAHOUT-784:
----------------------------------

PS guys I had already committed the patch. I think the formatting changes were fine, so worth adding.
                
> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Sean Owen
>             Fix For: 0.7
>
>         Attachments: MAHOUT-784-unformatted.patch, MAHOUT-784.patch, MAHOUT-784.patch
>
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Lance Norskog (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13144924#comment-13144924 ] 

Lance Norskog commented on MAHOUT-784:
--------------------------------------

The tools are there to get this output. You need to add "--confusionMatrix file.seq" to the TestClassifier app. Then, you can run the 'cmdump' job to view the matrix. 
                
> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Robin Anil
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Joe Prasanna Kumar (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13206294#comment-13206294 ] 

Joe Prasanna Kumar commented on MAHOUT-784:
-------------------------------------------

To put this patch to actual use, I have modified the classify-20newsgroups.sh to use ConfusionMatrixDumper ("-cm" flag) and then output the confusion matrix by invoking cmdump. I'll probably open a new JIRA to upload this patch.
                
> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Sean Owen
>             Fix For: 0.7
>
>         Attachments: MAHOUT-784-unformatted.patch, MAHOUT-784.patch, MAHOUT-784.patch
>
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Joe Prasanna Kumar (Updated) (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Joe Prasanna Kumar updated MAHOUT-784:
--------------------------------------

    Attachment: MAHOUT-784.patch
    
> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Robin Anil
>         Attachments: MAHOUT-784.patch, MAHOUT-784.patch
>
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Joe Prasanna Kumar (Updated) (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Joe Prasanna Kumar updated MAHOUT-784:
--------------------------------------

    Attachment: MAHOUT-784-unformatted.patch

Lance, I am attaching the patch with no formatting. I still see a lot of diff when using the latest formatter xml referenced in our wiki. maybe after you review the code, it shud be formatted before committing ?
                
> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Sean Owen
>             Fix For: 0.7
>
>         Attachments: MAHOUT-784-unformatted.patch, MAHOUT-784.patch, MAHOUT-784.patch
>
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Lance Norskog (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13205019#comment-13205019 ] 

Lance Norskog commented on MAHOUT-784:
--------------------------------------

Hi-

This patch makes so many reformatting changes that it is hard to see the new code. Please pull the original and remake your change, without reformatting in any way.
.
                
> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Sean Owen
>             Fix For: 0.7
>
>         Attachments: MAHOUT-784.patch, MAHOUT-784.patch
>
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "patrick.J (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

patrick.J updated MAHOUT-784:
-----------------------------

    Description: 
somebody may help,
   I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
   But when I going the step train the classifier on Hadoop, Exception was cast like:
$> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
java.lang.RuntimeException: Error in configuring object
	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
	at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
	... 5 more
Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
	at java.lang.Class.forName0(Native Method)
	at java.lang.Class.forName(Class.java:247)
	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
	... 10 more
Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
	... 17 more
   What happened? I just walked through the tutorials.......

  

  was:
somebody may help,
   I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups)step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
   But when I going the step train the classifier on Hadoop, Exception was cast like:
$> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
java.lang.RuntimeException: Error in configuring object
	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
	at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
	... 5 more
Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
	at java.lang.Class.forName0(Native Method)
	at java.lang.Class.forName(Class.java:247)
	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
	... 10 more
Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
	... 17 more
   What happened? I just walked through the tutorials.......

  


> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Joe Prasanna Kumar (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13145012#comment-13145012 ] 

Joe Prasanna Kumar commented on MAHOUT-784:
-------------------------------------------

Thanks for the pointer Lance. I guess printing the summary should be a default feature as users would mostly like to see summary info. I am assuming we have some method in the class referenced by cmdump that'll print the summary. So I'll try to use it in TestClassifier to print the summary. 
                
> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Robin Anil
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Joe Prasanna Kumar (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13128391#comment-13128391 ] 

Joe Prasanna Kumar commented on MAHOUT-784:
-------------------------------------------

Patrick,
Just checking to see if you are still facing issues running the 20 newsgroups example ?
You can alternatively use the build-20news-bayes.sh script in examples/bin. This will download the 20-newsgroup data and run the Bayes classifier to train and test and finally print the confusion matrix.
I just ran the script and had no issues. I use hadoop 0.20.2 with the latest code of Mahout on a mac.

Steps to run
1. cd $MAHOUT_HOME
2. ./examples/bin/build-20news-bayes.sh

Sean,
Shud I change the wiki instructions to use the script rather than the n steps that it has now ?


                
> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Robin Anil
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Lance Norskog (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13206047#comment-13206047 ] 

Lance Norskog commented on MAHOUT-784:
--------------------------------------

Joe- which Mahout formatter do you use? It line-wraps the comments, and should not.
                
> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Sean Owen
>             Fix For: 0.7
>
>         Attachments: MAHOUT-784.patch, MAHOUT-784.patch
>
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Sean Owen (Resolved) (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen resolved MAHOUT-784.
------------------------------

       Resolution: Fixed
    Fix Version/s: 0.7
         Assignee: Sean Owen  (was: Robin Anil)
    
> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Sean Owen
>             Fix For: 0.7
>
>         Attachments: MAHOUT-784.patch, MAHOUT-784.patch
>
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13204663#comment-13204663 ] 

Hudson commented on MAHOUT-784:
-------------------------------

Integrated in Mahout-Quality #1343 (See [https://builds.apache.org/job/Mahout-Quality/1343/])
    MAHOUT-784 refine and make consistent the confusion matrix output

srowen : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1242323
Files : 
* /mahout/trunk/integration/src/main/java/org/apache/mahout/classifier/ConfusionMatrixDumper.java

                
> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Sean Owen
>             Fix For: 0.7
>
>         Attachments: MAHOUT-784.patch, MAHOUT-784.patch
>
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Joe Prasanna Kumar (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13141910#comment-13141910 ] 

Joe Prasanna Kumar commented on MAHOUT-784:
-------------------------------------------

The only concern I am having with this issue is that when we run TestClassifier in "mapreduce" method as opposed to the "sequential" method, the summary doesnt get printed in the output. I thought this would get addressed with MAHOUT-838 but i guess not. should we create a separate task for making the summary printed while running TestClassifier on "mapreduce" mode. If so, we can close this issue and open a new one.
                
> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Robin Anil
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Joe Prasanna Kumar (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13148247#comment-13148247 ] 

Joe Prasanna Kumar commented on MAHOUT-784:
-------------------------------------------

Lance,
Any thoughts on the above comments. Shud we make the data in text output and html output similar ?

                
> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Robin Anil
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Joe Prasanna Kumar (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13145137#comment-13145137 ] 

Joe Prasanna Kumar commented on MAHOUT-784:
-------------------------------------------

Lance, ConfusionMatrixDumper.printSummaryTable(matrix, System.out); wud print the summary info on the console. SO i tried adding this to BayesClassifierDriver and it is complaining about not able to find ConfusionMatrixDumper. I guess this has got to do something with project dependency. I followed instructions in https://cwiki.apache.org/MAHOUT/buildingmahout.html to download the mahout source and then import them into eclipse as sub-projects. 

Have you / anyone encountered this situation with dependencies between mahout-core and mahout-integration. If someone has tackled this problem, it'd be great if you can share ur thots / soln.

ps: I manually modified the build path to add mahout-integration in the projects tab. It solved the issue with compilation but mvn install -DskipTests complained about ConfusionMatrixDumper
                
> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Robin Anil
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAHOUT-784) Exception at 20 Newsgroups examples

Posted by "Lance Norskog (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAHOUT-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13206349#comment-13206349 ] 

Lance Norskog commented on MAHOUT-784:
--------------------------------------

I'm sure there are a lot of diffs. My general practice is to remove those from the patch by hand and only include the part that does real code. This makes it much easier for someone else to review it. Some committers always rewrite it anyway, so this must makes it easier. Also, every code change can break other uncommitted patches in the same file.

This is my patch-generating script. It makes 5 surrounding lines, ignores white-space and doesn't make those a/ and b/ paths. 
{code}
git diff -w -U5 --no-prefix trunk "$@"
{code}

Open Source develops by nibbling at the edges :)
                
> Exception at 20 Newsgroups examples
> -----------------------------------
>
>                 Key: MAHOUT-784
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-784
>             Project: Mahout
>          Issue Type: Bug
>          Components: Classification
>         Environment: Ubuntu 11.04 / Hadoop 0.20.2 / Maven 3.0.3 / mahout-distribution-0.5 
>            Reporter: patrick.J
>            Assignee: Sean Owen
>             Fix For: 0.7
>
>         Attachments: MAHOUT-784-unformatted.patch, MAHOUT-784.patch, MAHOUT-784.patch
>
>
> somebody may help,
>    I run"Twenty Newsgroups Classification Example"(from https://cwiki.apache.org/confluence/display/MAHOUT/Twenty+Newsgroups) step by step.And the Environment variables(HADOOP_HOME,MAHOUT_HOME,HADOOP_CONF_DIR) all set in ~/.bashrc.
>    But when I going the step train the classifier on Hadoop, Exception was cast like:
> $> $MAHOUT_HOME/bin/mahout trainclassifier   -i 20news-input/bayes-train-input   -o newsmodel   -type bayes   -ng 3   -source hdfs:
> 11/08/13 09:37:54 INFO mapred.JobClient:  map 0% reduce 0%
> 11/08/13 09:38:04 INFO mapred.JobClient: Task Id : attempt_201108130934_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: Error in configuring object
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> 	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> 	... 5 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/lucene/analysis/TokenStream
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:247)
> 	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:807)
> 	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:833)
> 	at org.apache.hadoop.mapred.JobConf.getMapperClass(JobConf.java:772)
> 	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
> 	... 10 more
> Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.TokenStream
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> 	... 17 more
>    What happened? I just walked through the tutorials.......
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira