You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by ramires <uy...@beriltech.com> on 2010/09/15 13:04:04 UTC

nutch 1.2 fetch error

hı 
 I use nutch 1.2 rev 997274. My paltform debian lenny 64-bit. ı use
sun-java6-bin  6.21-1. When ı try to fetch 18659 url first cycle is good but
second cycle gives this error:            

2010-09-15 13:17:12,146 WARN  mapred.LocalJobRunner - job_local_0001
org.apache.hadoop.fs.ChecksumException: Checksum Error
	at
org.apache.hadoop.mapred.IFileInputStream.doRead(IFileInputStream.java:164)
	at
org.apache.hadoop.mapred.IFileInputStream.read(IFileInputStream.java:101)
	at org.apache.hadoop.mapred.IFile$Reader.readData(IFile.java:328)
	at org.apache.hadoop.mapred.IFile$Reader.rejigData(IFile.java:358)
	at org.apache.hadoop.mapred.IFile$Reader.readNextBlock(IFile.java:342)
	at org.apache.hadoop.mapred.IFile$Reader.next(IFile.java:404)
	at org.apache.hadoop.mapred.Merger$Segment.next(Merger.java:220)
	at
org.apache.hadoop.mapred.Merger$MergeQueue.adjustPriorityQueue(Merger.java:330)
	at org.apache.hadoop.mapred.Merger$MergeQueue.next(Merger.java:350)
	at org.apache.hadoop.mapred.Merger.writeFile(Merger.java:156)
	at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.mergeParts(MapTask.java:1535)
	at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1154)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:359)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
2010-09-15 13:17:12,471 ERROR fetcher.Fetcher - Fetcher:
java.io.IOException: Job failed!
	at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1252)
	at org.apache.nutch.fetcher.Fetcher.fetch(Fetcher.java:1107)
	at org.apache.nutch.fetcher.Fetcher.run(Fetcher.java:1145)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
	at org.apache.nutch.fetcher.Fetcher.main(Fetcher.java:1116)

-- 
View this message in context: http://lucene.472066.n3.nabble.com/nutch-1-2-fetch-error-tp1479068p1479068.html
Sent from the Nutch - User mailing list archive at Nabble.com.