You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by jeff <je...@gmail.com> on 2010/12/05 06:51:56 UTC
Nutch 1.2 job failed
Hi,
I am starting to use Nutch 1.2, but encountered my first problem when
trying to run it. I am using Ubuntu. The errors down below are shown in
the hadoop.log file:
2010-12-05 00:46:44,912 INFO crawl.Crawl - crawl started in: crawl_data
2010-12-05 00:46:44,913 INFO crawl.Crawl - rootUrlDir = urls
2010-12-05 00:46:44,913 INFO crawl.Crawl - threads = 10
2010-12-05 00:46:44,913 INFO crawl.Crawl - depth = 5
2010-12-05 00:46:44,913 INFO crawl.Crawl - indexer=lucene
2010-12-05 00:46:44,913 INFO crawl.Crawl - topN = 10
2010-12-05 00:46:44,960 INFO crawl.Injector - Injector: starting at
2010-12-05 00:46:44
2010-12-05 00:46:44,960 INFO crawl.Injector - Injector: crawlDb:
crawl_data/crawldb
2010-12-05 00:46:44,960 INFO crawl.Injector - Injector: urlDir: urls
2010-12-05 00:46:45,044 INFO crawl.Injector - Injector: Converting
injected urls to crawl db entries.
2010-12-05 00:46:45,205 WARN mapred.JobClient - Use
GenericOptionsParser for parsing the arguments. Applications should
implement Tool for the same.
2010-12-05 00:46:46,428 INFO plugin.PluginRepository - Plugins: looking
in: /usr/lib/nutch/plugins
2010-12-05 00:46:46,661 INFO plugin.PluginRepository - Plugin
Auto-activation mode: [true]
2010-12-05 00:46:46,661 INFO plugin.PluginRepository - Registered
Plugins:
2010-12-05 00:46:46,662 INFO plugin.PluginRepository - NONE
2010-12-05 00:46:46,662 INFO plugin.PluginRepository - Registered
Extension-Points:
2010-12-05 00:46:46,662 INFO plugin.PluginRepository - NONE
2010-12-05 00:46:46,665 WARN mapred.LocalJobRunner - job_local_0001
java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.LocalJobRunner
$Job.run(LocalJobRunner.java:177)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 5 more
Caused by: java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 10 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 13 more
Caused by: java.lang.RuntimeException: x point
org.apache.nutch.net.URLNormalizer not found.
at org.apache.nutch.net.URLNormalizers.<init>(URLNormalizers.java:122)
at org.apache.nutch.crawl.Injector
$InjectMapper.configure(Injector.java:70)
... 18 more
The errors down below are shown in the terminal window:
jeff@jeff-laptop:/usr/lib/nutch$ bin/nutch crawl urls -dir crawl_data
-depth 5 -topN 10
crawl started in: crawl_data
rootUrlDir = urls
threads = 10
depth = 5
indexer=lucene
topN = 10
Injector: starting at 2010-12-05 00:46:44
Injector: crawlDb: crawl_data/crawldb
Injector: urlDir: urls
Injector: Converting injected urls to crawl db entries.
Exception in thread "main" java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1252)
at org.apache.nutch.crawl.Injector.inject(Injector.java:217)
at org.apache.nutch.crawl.Crawl.main(Crawl.java:124)