You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by RP <rp...@earthlink.net> on 2006/12/21 02:30:51 UTC

Nutch 0.9 logging to catalina.out fails

No changes to logging configuration that worked fine at 0.8 but at 0.9 I 
get this once I do a query (query returns just fine....):

INFO: Server startup in 1947 ms
log4j:ERROR setFile(null,true) call failed.
java.io.FileNotFoundException: / (Is a directory)
        at java.io.FileOutputStream.openAppend(Native Method)
        at java.io.FileOutputStream.<init>(FileOutputStream.java:177)
        at java.io.FileOutputStream.<init>(FileOutputStream.java:102)
        at org.apache.log4j.FileAppender.setFile(FileAppender.java:289)
        at 
org.apache.log4j.FileAppender.activateOptions(FileAppender.java:163)
        at 
org.apache.log4j.DailyRollingFileAppender.activateOptions(DailyRollingFileAppender.java:215)
        at 
org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:256)
        at 
org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:132)
        at 
org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:96)
        at 
org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.java:654)
        at 
org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:612)
        at 
org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyConfigurator.java:509)
        at 
org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:415)
        at 
org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:441)
        at 
org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:468)
        at org.apache.log4j.LogManager.<clinit>(LogManager.java:122)
        at org.apache.log4j.Logger.getLogger(Logger.java:104)
        at 
org.apache.commons.logging.impl.Log4JLogger.getLogger(Log4JLogger.java:229)
        at 
org.apache.commons.logging.impl.Log4JLogger.<init>(Log4JLogger.java:65)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native 
Method)
        at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
        at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:494)
        at 
org.apache.commons.logging.impl.LogFactoryImpl.newInstance(LogFactoryImpl.java:529)
        at 
org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:235)
        at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:370)
        at 
org.apache.hadoop.conf.Configuration.<clinit>(Configuration.java:73)
        at 
org.apache.nutch.util.NutchConfiguration.create(NutchConfiguration.java:51)
        at 
org.apache.nutch.util.NutchConfiguration.get(NutchConfiguration.java:73)
        at org.apache.jsp.search_jsp._jspService(search_jsp.java:81)
        at 
org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:98)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:803)
        at 
org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:390)
        at 
org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:320)
        at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:266)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:803)
        at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
        at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:228)
        at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:175)
        at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128)
        at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
        at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
        at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:212)
        at 
org.apache.coyote.http11.Http11AprProcessor.process(Http11AprProcessor.java:867)
        at 
org.apache.coyote.http11.Http11AprProtocol$Http11ConnectionHandler.process(Http11AprProtocol.java:706)
        at 
org.apache.tomcat.util.net.AprEndpoint$Worker.run(AprEndpoint.java:1487)
        at java.lang.Thread.run(Thread.java:595)
log4j:ERROR Either File or DatePattern options are not set for appender 
[DRFA].

-- 
rp



Re: Nutch 0.9 logging to catalina.out fails

Posted by RP <rp...@earthlink.net>.
That took out the error (thanks!) but my log file does not show what it 
did in the past (below) and all I did was switch from 0.8 to 0.9..??  
Current log just has the server startup and nothing from Nutch..??

0.8 logging

INFO: Server startup in 36336 ms
2006-11-28 16:14:16,685 INFO  Configuration - parsing 
jar:file:/opt/tomcat/webapps/ROOT/WEB-INF/lib/hadoop-0.4.0-patched.jar!/hadoop-default.x
ml
2006-11-28 16:14:16,726 INFO  Configuration - parsing 
file:/opt/tomcat/webapps/ROOT/WEB-INF/classes/nutch-default.xml
2006-11-28 16:14:16,768 INFO  Configuration - parsing 
file:/opt/tomcat/webapps/ROOT/WEB-INF/classes/nutch-site.xml
2006-11-28 16:14:16,774 INFO  Configuration - parsing 
file:/opt/tomcat/webapps/ROOT/WEB-INF/classes/hadoop-site.xml
2006-11-28 16:14:16,816 INFO  PluginRepository - Plugins: looking in: 
/opt/tomcat/webapps/ROOT/WEB-INF/classes/plugins
2006-11-28 16:14:17,328 INFO  PluginRepository - Plugin Auto-activation 
mode: [true]
2006-11-28 16:14:17,329 INFO  PluginRepository - Registered Plugins:
2006-11-28 16:14:17,329 INFO  PluginRepository -        CyberNeko HTML 
Parser (lib-nekohtml)
2006-11-28 16:14:17,329 INFO  PluginRepository -        Site Query 
Filter (query-site)
2006-11-28 16:14:17,329 INFO  PluginRepository -        Html Parse 
Plug-in (parse-html)
2006-11-28 16:14:17,329 INFO  PluginRepository -        Regex URL Filter 
Framework (lib-regex-filter)
2006-11-28 16:14:17,329 INFO  PluginRepository -        Basic Indexing 
Filter (index-basic)
2006-11-28 16:14:17,329 INFO  PluginRepository -        Basic Summarizer 
Plug-in (summary-basic)
2006-11-28 16:14:17,329 INFO  PluginRepository -        Text Parse 
Plug-in (parse-text)
2006-11-28 16:14:17,329 INFO  PluginRepository -        JavaScript 
Parser (parse-js)
2006-11-28 16:14:17,330 INFO  PluginRepository -        Regex URL Filter 
(urlfilter-regex)
2006-11-28 16:14:17,330 INFO  PluginRepository -        Basic Query 
Filter (query-basic)
2006-11-28 16:14:17,330 INFO  PluginRepository -        HTTP Framework 
(lib-http)
2006-11-28 16:14:17,330 INFO  PluginRepository -        URL Query Filter 
(query-url)
2006-11-28 16:14:17,330 INFO  PluginRepository -        Http Protocol 
Plug-in (protocol-http)
2006-11-28 16:14:17,330 INFO  PluginRepository -        the nutch core 
extension points (nutch-extensionpoints)
2006-11-28 16:14:17,330 INFO  PluginRepository -        OPIC Scoring 
Plug-in (scoring-opic)
2006-11-28 16:14:17,330 INFO  PluginRepository - Registered 
Extension-Points:
2006-11-28 16:14:17,330 INFO  PluginRepository -        Nutch Summarizer 
(org.apache.nutch.searcher.Summarizer)
2006-11-28 16:14:17,331 INFO  PluginRepository -        Nutch Scoring 
(org.apache.nutch.scoring.ScoringFilter)
2006-11-28 16:14:17,331 INFO  PluginRepository -        Nutch Protocol 
(org.apache.nutch.protocol.Protocol)
2006-11-28 16:14:17,331 INFO  PluginRepository -        Nutch URL Filter 
(org.apache.nutch.net.URLFilter)
2006-11-28 16:14:17,331 INFO  PluginRepository -        HTML Parse 
Filter (org.apache.nutch.parse.HtmlParseFilter)
2006-11-28 16:14:17,331 INFO  PluginRepository -        Nutch Online 
Search Results Clustering Plugin (org.apache.nutch.clustering.OnlineClust
erer)
2006-11-28 16:14:17,331 INFO  PluginRepository -        Nutch Indexing 
Filter (org.apache.nutch.indexer.IndexingFilter)
2006-11-28 16:14:17,331 INFO  PluginRepository -        Nutch Content 
Parser (org.apache.nutch.parse.Parser)
2006-11-28 16:14:17,331 INFO  PluginRepository -        Ontology Model 
Loader (org.apache.nutch.ontology.Ontology)
2006-11-28 16:14:17,331 INFO  PluginRepository -        Nutch Analysis 
(org.apache.nutch.analysis.NutchAnalyzer)
2006-11-28 16:14:17,332 INFO  PluginRepository -        Nutch Query 
Filter (org.apache.nutch.searcher.QueryFilter)
2006-11-28 16:14:17,378 INFO  NutchBean - creating new bean
2006-11-28 16:14:17,435 INFO  NutchBean - opening indexes in crawl/indexes
2006-11-28 16:14:17,662 INFO  Configuration - found resource 
common-terms.utf8 at 
file:/opt/tomcat/webapps/ROOT/WEB-INF/classes/common-terms.u
tf8
2006-11-28 16:14:17,692 INFO  NutchBean - opening segments in crawl/segments
2006-11-28 16:14:17,757 INFO  SummarizerFactory - Using the first 
summarizer extension found: Basic Summarizer
2006-11-28 16:14:17,758 INFO  NutchBean - opening linkdb in crawl/linkdb
2006-11-28 16:14:17,785 INFO  NutchBean - query request from 0:0:0:0:0:0:0:1
2006-11-28 16:14:17,865 INFO  NutchBean - query: changhe
2006-11-28 16:14:17,866 INFO  NutchBean - lang: en
2006-11-28 16:14:17,992 INFO  NutchBean - searching for 20 raw hits
2006-11-28 16:14:18,196 INFO  NutchBean - total hits: 0

0.9 logging

...Dec 21, 2006 9:51:50 AM org.apache.catalina.startup.HostConfig deployWAR
INFO: Deploying web application archive ROOT.war
Dec 21, 2006 9:51:55 AM org.apache.coyote.http11.Http11AprProtocol start
INFO: Starting Coyote HTTP/1.1 on http-8080
Dec 21, 2006 9:51:55 AM org.apache.coyote.ajp.AjpAprProtocol start
INFO: Starting Coyote AJP/1.3 on ajp-8009
Dec 21, 2006 9:51:55 AM org.apache.catalina.startup.Catalina start
INFO: Server startup in 5967 ms


Andrzej Bialecki wrote:
> RP wrote:
>> No changes to logging configuration that worked fine at 0.8 but at 
>> 0.9 I get this once I do a query (query returns just fine....):
>>
>> INFO: Server startup in 1947 ms
>> log4j:ERROR setFile(null,true) call failed.
>> java.io.FileNotFoundException: / (Is a directory)
>
> Most likely your "hadoop.log.dir" env. property is null. Just add 
> "-Dhadoop.log.dir=/some/path" to your JVM options.
>

-- 
rp



Re: Nutch 0.9 logging to catalina.out fails

Posted by Andrzej Bialecki <ab...@getopt.org>.
RP wrote:
> No changes to logging configuration that worked fine at 0.8 but at 0.9 
> I get this once I do a query (query returns just fine....):
>
> INFO: Server startup in 1947 ms
> log4j:ERROR setFile(null,true) call failed.
> java.io.FileNotFoundException: / (Is a directory)

Most likely your "hadoop.log.dir" env. property is null. Just add 
"-Dhadoop.log.dir=/some/path" to your JVM options.

-- 
Best regards,
Andrzej Bialecki     <><
 ___. ___ ___ ___ _ _   __________________________________
[__ || __|__/|__||\/|  Information Retrieval, Semantic Web
___|||__||  \|  ||  |  Embedded Unix, System Integration
http://www.sigram.com  Contact: info at sigram dot com