You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Bryan Woliner <br...@gmail.com> on 2006/06/20 01:25:31 UTC

Error when calling bin/nutch inject -- java.io.IOException: config()

On June 13th, I downloaded the trunk version of nutch-0.8-dev and then built
it using ant.

I then created a valid urls file and put it in the urlsdir subdirectory of
my nutch directory. I also made sure that my conf/regex-urlfilter.txt file
was valid.

At that point, I tried to do my first whole-web crawl using 0.8, so I called
the command:

bin/nutch inject testcrawl/crawldb urlsdir

However, when calling this command, the logged output included the following
error (more logged output included below):

2006-06-14 18:02:32,401 DEBUG conf.Configuration
(Configuration.java:<init>(67))
- java.io.IOException: config()
        at org.apache.hadoop.conf.Configuration.<init>(Configuration.java
:67)
        at org.apache.nutch.util.NutchConfiguration.create(
NutchConfiguration.java:50)
        at org.apache.nutch.crawl.Injector.main(Injector.java:148)

What am I doing wrong?

Are there any configuration files or environment variables that I need to
modify?

Thanks for any helpful suggestions anyone can provide!

-Bryan

LOGGED OUTPUT:


2006-06-19 18:02:32,401 DEBUG conf.Configuration
(Configuration.java:<init>(67))
- java.io.IOException: config()
        at org.apache.hadoop.conf.Configuration.<init>(Configuration.java
:67)
        at org.apache.nutch.util.NutchConfiguration.create(
NutchConfiguration.java:50)
        at org.apache.nutch.crawl.Injector.main(Injector.java:148)

2006-06-19 18:02:32,407 INFO  crawl.Injector (Injector.java:inject(110)) -
Injector: starting
2006-06-19 18:02:32,410 INFO  crawl.Injector (Injector.java:inject(111)) -
Injector: crawlDb: crawl8/crawldb
2006-06-19 18:02:32,410 INFO  crawl.Injector (Injector.java:inject(112)) -
Injector: urlDir: urlsdir
2006-06-19 18:02:32,696 INFO  conf.Configuration (
Configuration.java:loadResource(397)) - parsing
jar:file:/home/bryan/nutch-8d/lib/hadoop-0.3.2.jar!/hadoop$
2006-06-19 18:02:32,816 INFO  conf.Configuration (
Configuration.java:loadResource(397)) - parsing
file:/home/bryan/nutch-8d/conf/nutch-default.xml
2006-06-19 18:02:32,861 INFO  conf.Configuration (
Configuration.java:loadResource(397)) - parsing
file:/home/bryan/nutch-8d/conf/nutch-site.xml
2006-06-19 18:02:32,872 INFO  conf.Configuration (
Configuration.java:loadResource(397)) - parsing
file:/home/bryan/nutch-8d/conf/hadoop-site.xml
2006-06-19 18:02:32,873 INFO  crawl.Injector (Injector.java:inject(120)) -
Injector: Converting injected urls to crawl db entries.
2006-06-19 18:02:32,876 DEBUG conf.Configuration
(Configuration.java:<init>(76))
- java.io.IOException: config(config)
        at org.apache.hadoop.conf.Configuration.<init>(Configuration.java
:76)
        at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:86)
        at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:97)
        at org.apache.nutch.util.NutchJob.<init>(NutchJob.java:26)
        at org.apache.nutch.crawl.Injector.inject(Injector.java:121)
        at org.apache.nutch.crawl.Injector.main(Injector.java:155)

2006-06-19 18:02:32,889 INFO  conf.Configuration (
Configuration.java:loadResource(397)) - parsing
jar:file:/home/bryan/nutch-8d/lib/hadoop-0.3.2.jar!/hadoop$
2006-06-19 18:02:32,914 INFO  conf.Configuration (
Configuration.java:loadResource(397)) - parsing
file:/home/bryan/nutch-8d/conf/nutch-default.xml
2006-06-19 18:02:32,930 INFO  conf.Configuration (
Configuration.java:loadResource(397)) - parsing
jar:file:/home/bryan/nutch-8d/lib/hadoop-0.3.2.jar!/mapred$
2006-06-19 18:02:32,933 INFO  conf.Configuration (
Configuration.java:loadResource(397)) - parsing
jar:file:/home/bryan/nutch-8d/lib/hadoop-0.3.2.jar!/mapred$
2006-06-19 18:02:32,937 INFO  conf.Configuration (
Configuration.java:loadResource(397)) - parsing
file:/home/bryan/nutch-8d/conf/nutch-site.xml
2006-06-19 18:02:32,940 INFO  conf.Configuration (
Configuration.java:loadResource(397)) - parsing
file:/home/bryan/nutch-8d/conf/hadoop-site.xml
2006-06-19 18:02:33,503 DEBUG conf.Configuration
(Configuration.java:<init>(76))
- java.io.IOException: config(config)
        at org.apache.hadoop.conf.Configuration.<init>(Configuration.java
:76)
        at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:86)
        at org.apache.hadoop.mapred.LocalJobRunner$Job.<init>(
LocalJobRunner.java:57)
        at org.apache.hadoop.mapred.LocalJobRunner.submitJob(
LocalJobRunner.java:181)
        at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:277)
        at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:312)
        at org.apache.nutch.crawl.Injector.inject(Injector.java:131)
        at org.apache.nutch.crawl.Injector.main(Injector.java:155)