You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Bryan Woliner <br...@gmail.com> on 2006/06/20 01:25:31 UTC
Error when calling bin/nutch inject -- java.io.IOException: config()
On June 13th, I downloaded the trunk version of nutch-0.8-dev and then built
it using ant.
I then created a valid urls file and put it in the urlsdir subdirectory of
my nutch directory. I also made sure that my conf/regex-urlfilter.txt file
was valid.
At that point, I tried to do my first whole-web crawl using 0.8, so I called
the command:
bin/nutch inject testcrawl/crawldb urlsdir
However, when calling this command, the logged output included the following
error (more logged output included below):
2006-06-14 18:02:32,401 DEBUG conf.Configuration
(Configuration.java:<init>(67))
- java.io.IOException: config()
at org.apache.hadoop.conf.Configuration.<init>(Configuration.java
:67)
at org.apache.nutch.util.NutchConfiguration.create(
NutchConfiguration.java:50)
at org.apache.nutch.crawl.Injector.main(Injector.java:148)
What am I doing wrong?
Are there any configuration files or environment variables that I need to
modify?
Thanks for any helpful suggestions anyone can provide!
-Bryan
LOGGED OUTPUT:
2006-06-19 18:02:32,401 DEBUG conf.Configuration
(Configuration.java:<init>(67))
- java.io.IOException: config()
at org.apache.hadoop.conf.Configuration.<init>(Configuration.java
:67)
at org.apache.nutch.util.NutchConfiguration.create(
NutchConfiguration.java:50)
at org.apache.nutch.crawl.Injector.main(Injector.java:148)
2006-06-19 18:02:32,407 INFO crawl.Injector (Injector.java:inject(110)) -
Injector: starting
2006-06-19 18:02:32,410 INFO crawl.Injector (Injector.java:inject(111)) -
Injector: crawlDb: crawl8/crawldb
2006-06-19 18:02:32,410 INFO crawl.Injector (Injector.java:inject(112)) -
Injector: urlDir: urlsdir
2006-06-19 18:02:32,696 INFO conf.Configuration (
Configuration.java:loadResource(397)) - parsing
jar:file:/home/bryan/nutch-8d/lib/hadoop-0.3.2.jar!/hadoop$
2006-06-19 18:02:32,816 INFO conf.Configuration (
Configuration.java:loadResource(397)) - parsing
file:/home/bryan/nutch-8d/conf/nutch-default.xml
2006-06-19 18:02:32,861 INFO conf.Configuration (
Configuration.java:loadResource(397)) - parsing
file:/home/bryan/nutch-8d/conf/nutch-site.xml
2006-06-19 18:02:32,872 INFO conf.Configuration (
Configuration.java:loadResource(397)) - parsing
file:/home/bryan/nutch-8d/conf/hadoop-site.xml
2006-06-19 18:02:32,873 INFO crawl.Injector (Injector.java:inject(120)) -
Injector: Converting injected urls to crawl db entries.
2006-06-19 18:02:32,876 DEBUG conf.Configuration
(Configuration.java:<init>(76))
- java.io.IOException: config(config)
at org.apache.hadoop.conf.Configuration.<init>(Configuration.java
:76)
at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:86)
at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:97)
at org.apache.nutch.util.NutchJob.<init>(NutchJob.java:26)
at org.apache.nutch.crawl.Injector.inject(Injector.java:121)
at org.apache.nutch.crawl.Injector.main(Injector.java:155)
2006-06-19 18:02:32,889 INFO conf.Configuration (
Configuration.java:loadResource(397)) - parsing
jar:file:/home/bryan/nutch-8d/lib/hadoop-0.3.2.jar!/hadoop$
2006-06-19 18:02:32,914 INFO conf.Configuration (
Configuration.java:loadResource(397)) - parsing
file:/home/bryan/nutch-8d/conf/nutch-default.xml
2006-06-19 18:02:32,930 INFO conf.Configuration (
Configuration.java:loadResource(397)) - parsing
jar:file:/home/bryan/nutch-8d/lib/hadoop-0.3.2.jar!/mapred$
2006-06-19 18:02:32,933 INFO conf.Configuration (
Configuration.java:loadResource(397)) - parsing
jar:file:/home/bryan/nutch-8d/lib/hadoop-0.3.2.jar!/mapred$
2006-06-19 18:02:32,937 INFO conf.Configuration (
Configuration.java:loadResource(397)) - parsing
file:/home/bryan/nutch-8d/conf/nutch-site.xml
2006-06-19 18:02:32,940 INFO conf.Configuration (
Configuration.java:loadResource(397)) - parsing
file:/home/bryan/nutch-8d/conf/hadoop-site.xml
2006-06-19 18:02:33,503 DEBUG conf.Configuration
(Configuration.java:<init>(76))
- java.io.IOException: config(config)
at org.apache.hadoop.conf.Configuration.<init>(Configuration.java
:76)
at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:86)
at org.apache.hadoop.mapred.LocalJobRunner$Job.<init>(
LocalJobRunner.java:57)
at org.apache.hadoop.mapred.LocalJobRunner.submitJob(
LocalJobRunner.java:181)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:277)
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:312)
at org.apache.nutch.crawl.Injector.inject(Injector.java:131)
at org.apache.nutch.crawl.Injector.main(Injector.java:155)