You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by lu_jin_hong <lu...@163.com> on 2015/01/18 12:47:49 UTC

ClassNotFoundException : SolrDeleteDuplicates$SolrInputFormat

Hi, all.


I run nutch in local mode and it’s good. 
But when I run the nutch in deploy mode, I found this exception.
Why ClassNotFoundException happened? 
thanks.




SOLR dedup -> http://ip:8983/solr
15/01/18 18:08:09 INFO solr.SolrDeleteDuplicates: SolrDeleteDuplicates: starting...
15/01/18 18:08:09 INFO solr.SolrDeleteDuplicates: SolrDeleteDuplicates: Solr url: http://182.92.160.44:8583/solr
15/01/18 18:08:10 WARN mapred.JobClient: No job jar file set.  User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
15/01/18 18:08:11 INFO mapred.JobClient: Running job: job_201501181122_0034
15/01/18 18:08:12 INFO mapred.JobClient:  map 0% reduce 0%
15/01/18 18:08:24 INFO mapred.JobClient: Task Id : attempt_201501181122_0034_m_000000_0, Status : FAILED
java.lang.RuntimeException: java.lang.ClassNotFoundException: org.apache.nutch.indexer.solr.SolrDeleteDuplicates$SolrInputFormat
        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:857)
        at org.apache.hadoop.mapreduce.JobContext.getInputFormatClass(JobContext.java:187)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:722)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:364)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
        at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.ClassNotFoundException: org.apache.nutch.indexer.solr.SolrDeleteDuplicates$SolrInputFormat
        at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:270)
        at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:810)
        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:855)
        ... 8 more


Re: ClassNotFoundException : SolrDeleteDuplicates$SolrInputFormat

Posted by Talat Uyarer <ta...@uyarer.com>.
Do you check this class in your class path ?

2015-01-18 13:47 GMT+02:00 lu_jin_hong <lu...@163.com>:
> Hi, all.
>
>
> I run nutch in local mode and it’s good.
> But when I run the nutch in deploy mode, I found this exception.
> Why ClassNotFoundException happened?
> thanks.
>
>
>
>
> SOLR dedup -> http://ip:8983/solr
> 15/01/18 18:08:09 INFO solr.SolrDeleteDuplicates: SolrDeleteDuplicates: starting...
> 15/01/18 18:08:09 INFO solr.SolrDeleteDuplicates: SolrDeleteDuplicates: Solr url: http://182.92.160.44:8583/solr
> 15/01/18 18:08:10 WARN mapred.JobClient: No job jar file set.  User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
> 15/01/18 18:08:11 INFO mapred.JobClient: Running job: job_201501181122_0034
> 15/01/18 18:08:12 INFO mapred.JobClient:  map 0% reduce 0%
> 15/01/18 18:08:24 INFO mapred.JobClient: Task Id : attempt_201501181122_0034_m_000000_0, Status : FAILED
> java.lang.RuntimeException: java.lang.ClassNotFoundException: org.apache.nutch.indexer.solr.SolrDeleteDuplicates$SolrInputFormat
>         at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:857)
>         at org.apache.hadoop.mapreduce.JobContext.getInputFormatClass(JobContext.java:187)
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:722)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:364)
>         at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:415)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
>         at org.apache.hadoop.mapred.Child.main(Child.java:249)
> Caused by: java.lang.ClassNotFoundException: org.apache.nutch.indexer.solr.SolrDeleteDuplicates$SolrInputFormat
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>         at java.lang.Class.forName0(Native Method)
>         at java.lang.Class.forName(Class.java:270)
>         at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:810)
>         at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:855)
>         ... 8 more
>



-- 
Talat UYARER
Websitesi: http://talat.uyarer.com
Twitter: http://twitter.com/talatuyarer
Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304