nutch crawler

[Uygar BAYAR <uy...@beriltech.com>]

i used latest release 1.0

$nutch_dir/nutch generate $webdb_dir $segments_dir $topn -adddays $adddays
-numFetchers 20

after this code 

Hadoop job_200903301320_0011 on eagle
User: nutch
Job Name: generate: select crawled/segments/20090330145645
Job File:
hdfs://eagle:9000/home/nutch/filesystem/mapreduce/system/job_200903301320_0011/job.xml
Job Setup: Successful
Status: Succeeded
Started at: Mon Mar 30 14:56:47 EEST 2009
Finished at: Mon Mar 30 14:57:22 EEST 2009
Finished in: 35sec
Job Cleanup: Successful
 
and gives this error ????
my tmp dir owner nutch and 777 

Injector: starting
Injector: crawlDb: crawled/crawldb
Injector: urlDir: urls
Injector: Converting injected urls to crawl db entries.
Injector: Merging injected urls into crawl db.
Injector: done
Generator: Selecting best-scoring urls due for fetch.
Generator: starting
Generator: segment: crawled/segments/20090330145645
Generator: filtering: true

Generator: java.io.IOException: Cannot open filename
/home/nutch/tmp/hadoop-nutch/mapred/temp/generate-temp-1238414204902/_logs
	at
org.apache.hadoop.hdfs.DFSClient$DFSInputStream.openInfo(DFSClient.java:1394)
	at
org.apache.hadoop.hdfs.DFSClient$DFSInputStream.<init>(DFSClient.java:1385)
	at org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:338)
	at
org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:171)
	at
org.apache.hadoop.io.SequenceFile$Reader.openFile(SequenceFile.java:1437)
	at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1424)
	at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1417)
	at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1412)
	at
org.apache.hadoop.mapred.SequenceFileOutputFormat.getReaders(SequenceFileOutputFormat.java:88)
	at org.apache.nutch.crawl.Generator.generate(Generator.java:479)
	at org.apache.nutch.crawl.Generator.run(Generator.java:618)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
	at org.apache.nutch.crawl.Generator.main(Generator.java:581)

-- 
View this message in context: http://www.nabble.com/nutch-crawler-tp22781878p22781878.html
Sent from the Nutch - User mailing list archive at Nabble.com.

Re: nutch crawler

[kherwa <ra...@gmail.com>]

hi,
did you find solution to this problem,
i am facing same problem



-- 
View this message in context: http://www.nabble.com/nutch-crawler-tp22781878p25803642.html
Sent from the Nutch - User mailing list archive at Nabble.com.