You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Adam Borkowski <bo...@3miasto.net> on 2006/10/06 15:32:46 UTC

java.lang.NoSuchMethodError while indexing

Question from then newbie.

I've just downloaded version 0.8.1 and going trough the tutorial.
Almost got to the end, but after index command:

bin/nutch index crawl/indexes crawl/crawldb crawl/linkdb crawl/segments/*

I've got this exception:
Exception in thread "main" java.io.IOException: Job failed!
        at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:357)
        at org.apache.nutch.indexer.Indexer.index(Indexer.java:296)
        at org.apache.nutch.indexer.Indexer.main(Indexer.java:313)

And in the hadoop.log:
2006-10-06 14:12:17,077 INFO  indexer.IndexingFilters - Adding
org.apache.nutch.indexer.basic.BasicIndexingFilter
2006-10-06 14:12:17,256 WARN  mapred.LocalJobRunner - job_53smzx
java.lang.NoSuchMethodError:
org.apache.lucene.index.IndexWriter.setMergeFactor(I)V
        at
org.apache.nutch.indexer.Indexer$OutputFormat.getRecordWriter(Indexer.java:95)
        at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:230)
        at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:112)

Any clues?

Adam
-- 
View this message in context: http://www.nabble.com/java.lang.NoSuchMethodError-while-indexing-tf2395561.html#a6679304
Sent from the Nutch - User mailing list archive at Nabble.com.


Re: java.lang.NoSuchMethodError while indexing

Posted by Adam Borkowski <bo...@3miasto.net>.
It's ok now. It was my fault. I unfortunatelly mixed Xalan jar with nutch
distribution. After cleaning classpath, everything went ok.

----- Original Message -----
From: "Dennis Kubes" <nu...@dragonflymc.com>
To: <nu...@lucene.apache.org>
Sent: Tuesday, October 10, 2006 4:35 PM
Subject: Re: java.lang.NoSuchMethodError while indexing


> What java version are you using.  Might be needing java 5?
>
> Dennis
>
> Adam Borkowski wrote:
> > Question from then newbie.
> >
> > I've just downloaded version 0.8.1 and going trough the tutorial.
> > Almost got to the end, but after index command:
> >
> > bin/nutch index crawl/indexes crawl/crawldb crawl/linkdb
crawl/segments/*
> >
> > I've got this exception:
> > Exception in thread "main" java.io.IOException: Job failed!
> >         at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:357)
> >         at org.apache.nutch.indexer.Indexer.index(Indexer.java:296)
> >         at org.apache.nutch.indexer.Indexer.main(Indexer.java:313)
> >
> > And in the hadoop.log:
> > 2006-10-06 14:12:17,077 INFO  indexer.IndexingFilters - Adding
> > org.apache.nutch.indexer.basic.BasicIndexingFilter
> > 2006-10-06 14:12:17,256 WARN  mapred.LocalJobRunner - job_53smzx
> > java.lang.NoSuchMethodError:
> > org.apache.lucene.index.IndexWriter.setMergeFactor(I)V
> >         at
> >
org.apache.nutch.indexer.Indexer$OutputFormat.getRecordWriter(Indexer.java:9
5)
> >         at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:230)
> >         at
> > org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:112)
> >
> > Any clues?
> >
> > Adam
> >
>


RE: java.lang.NoSuchMethodError while indexing

Posted by "NG-Marketing, M.Schneider" <sc...@ng-marketing.com>.
IOException and setmergeFaktor...? You may check your config and have a look
at your merging faktor. Set it to 50.

> 
> What java version are you using.  Might be needing java 5?
> 
> Dennis
> 
> Adam Borkowski wrote:
> > Question from then newbie.
> >
> > I've just downloaded version 0.8.1 and going trough the tutorial.
> > Almost got to the end, but after index command:
> >
> > bin/nutch index crawl/indexes crawl/crawldb crawl/linkdb
crawl/segments/*
> >
> > I've got this exception:
> > Exception in thread "main" java.io.IOException: Job failed!
> >         at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:357)
> >         at org.apache.nutch.indexer.Indexer.index(Indexer.java:296)
> >         at org.apache.nutch.indexer.Indexer.main(Indexer.java:313)
> >
> > And in the hadoop.log:
> > 2006-10-06 14:12:17,077 INFO  indexer.IndexingFilters - Adding
> > org.apache.nutch.indexer.basic.BasicIndexingFilter
> > 2006-10-06 14:12:17,256 WARN  mapred.LocalJobRunner - job_53smzx
> > java.lang.NoSuchMethodError:
> > org.apache.lucene.index.IndexWriter.setMergeFactor(I)V
> >         at
> >
>
org.apache.nutch.indexer.Indexer$OutputFormat.getRecordWriter(Indexer.java:9
5)
> >         at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:230)
> >         at
> > org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:112)
> >
> > Any clues?
> >
> > Adam
> >


Re: java.lang.NoSuchMethodError while indexing

Posted by Dennis Kubes <nu...@dragonflymc.com>.
What java version are you using.  Might be needing java 5?

Dennis

Adam Borkowski wrote:
> Question from then newbie.
>
> I've just downloaded version 0.8.1 and going trough the tutorial.
> Almost got to the end, but after index command:
>
> bin/nutch index crawl/indexes crawl/crawldb crawl/linkdb crawl/segments/*
>
> I've got this exception:
> Exception in thread "main" java.io.IOException: Job failed!
>         at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:357)
>         at org.apache.nutch.indexer.Indexer.index(Indexer.java:296)
>         at org.apache.nutch.indexer.Indexer.main(Indexer.java:313)
>
> And in the hadoop.log:
> 2006-10-06 14:12:17,077 INFO  indexer.IndexingFilters - Adding
> org.apache.nutch.indexer.basic.BasicIndexingFilter
> 2006-10-06 14:12:17,256 WARN  mapred.LocalJobRunner - job_53smzx
> java.lang.NoSuchMethodError:
> org.apache.lucene.index.IndexWriter.setMergeFactor(I)V
>         at
> org.apache.nutch.indexer.Indexer$OutputFormat.getRecordWriter(Indexer.java:95)
>         at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:230)
>         at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:112)
>
> Any clues?
>
> Adam
>