You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Bai Shen <ba...@gmail.com> on 2011/11/08 15:53:15 UTC
Re: Fetch log error
I just noticed this in the log. Not sure if it'll help.
2011-11-07 00:19:23,258 ERROR util.LogUtil - Cannot init log methods
java.lang.NoSuchMethodException: org.slf4j.Logger.trace(java.lang.Object)
at java.lang.Class.getMethod(Unknown Source)
at org.apache.nutch.util.LogUtil.<clinit>(LogUtil.java:48)
at
org.apache.nutch.protocol.http.api.HttpBase.getProtocolOutput(HttpBase.java:197)
at org.apache.nutch.fetcher.Fetcher$FetcherThread.run(Fetcher.java:665)
Also, here's the other stack trace.
2011-11-07 00:19:23,259 ERROR util.LogUtil - Cannot log with method [null]
java.lang.NullPointerException
at org.apache.nutch.util.LogUtil$1.flush(LogUtil.java:103)
at java.io.PrintStream.write(Unknown Source)
at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source)
at sun.nio.cs.StreamEncoder.implFlushBuffer(Unknown Source)
at sun.nio.cs.StreamEncoder.flushBuffer(Unknown Source)
at java.io.OutputStreamWriter.flushBuffer(Unknown Source)
at java.io.PrintStream.newLine(Unknown Source)
at java.io.PrintStream.println(Unknown Source)
at java.lang.Throwable.printStackTrace(Throwable.java:461)
at
org.apache.nutch.protocol.http.api.HttpBase.getProtocolOutput(HttpBase.java:197)
at org.apache.nutch.fetcher.Fetcher$FetcherThread.run(Fetcher.java:665)
On Mon, Oct 31, 2011 at 1:29 PM, lewis john mcgibbney <
lewis.mcgibbney@gmail.com> wrote:
> So are you getting the bad output when using the fetcher? Do you have any
> local changes on your working dist of Nutch? Please check with svn status
> or svn diff
>
> I would have expected the output to have shown you which classes were
> causing the problem... there can always be one or two that slip through the
> net.
>
> On Mon, Oct 31, 2011 at 4:47 PM, Bai Shen <ba...@gmail.com> wrote:
>
> > We just did an ant clean and rebuilt nutch and we're still seeing the
> same
> > error in the logs.
> >
> > On Fri, Oct 28, 2011 at 11:12 AM, Markus Jelsma
> > <ma...@openindex.io>wrote:
> >
> > > Have you also tried ant clean before building?
> > >
> > > On Friday 28 October 2011 17:06:12 Bai Shen wrote:
> > > > Ah, okay. Missed that part.
> > > >
> > > > And yes, It's consistent.
> > > >
> > > > On Fri, Oct 28, 2011 at 10:12 AM, lewis john mcgibbney <
> > > >
> > > > lewis.mcgibbney@gmail.com> wrote:
> > > > > Hi Bai,
> > > > >
> > > > > OK so the FATAL logging in LogUtil relates to the following [1]. As
> > you
> > > > > can see, although there is a FATAL tag, it actualy logs 'error'
> > > anyway.
> > > > > If you look at the JIRA issues, I've committed myself to removing
> > > > > LogUtil from both
> > > > > trunk and Nutchgora, this will allow us to leverage full
> > functionality
> > > > > from the Slf4j and Log4j framework we currently have implemented
> on a
> > > > > majority basis.
> > > > >
> > > > > With regards to the NPE as Markus suggested can you reproduce
> > > > > consistently?
> > > > >
> > > > > [1]
> > > > >
> > > > >
> > >
> >
> http://svn.apache.org/viewvc/nutch/trunk/src/java/org/apache/nutch/util/L
> > > > > ogUtil.java?r1=1175075&r2=1177290&diff_format=h
> > > > >
> > > > > On Fri, Oct 28, 2011 at 3:53 PM, Markus Jelsma
> > > > >
> > > > > <ma...@openindex.io>wrote:
> > > > > > Do you get this consistently? Are you compiling from svn?
> > > > > >
> > > > > > On Friday 28 October 2011 15:30:42 Bai Shen wrote:
> > > > > > > I'm running the latest version of 1.4 and I'm seeing the error
> > > Markus
> > > > > > > described in Nutch bug 1078. I'm not sure exactly what's
> causing
> > > it,
> > > > >
> > > > > but
> > > > >
> > > > > > I
> > > > > >
> > > > > > > also wanted to point out that LogUtil still contains FATAL
> > > > > > > references.
> > > > > > >
> > > > > > > 2011-09-22 19:36:02,046 ERROR org.apache.nutch.util.LogUtil:
> > Cannot
> > > > > > > log with method [null]
> > > > > > > java.lang.NullPointerException
> > > > > > >
> > > > > > > at
> org.apache.nutch.util.LogUtil$1.flush(LogUtil.java:103)
> > > > > > > at java.io.PrintStream.write(PrintStream.java:432)
> > > > > > > at
> > > sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:202)
> > > > > > > at
> > > > >
> > > > > sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:272)
> > > > >
> > > > > > > at
> > > sun.nio.cs.StreamEncoder.flushBuffer(StreamEncoder.java:85)
> > > > > > > at
> > > > > >
> > > > > >
> java.io.OutputStreamWriter.flushBuffer(OutputStreamWriter.java:168)
> > > > > >
> > > > > > > at java.io.PrintStream.newLine(PrintStream.java:496)
> > > > > > > at java.io.PrintStream.println(PrintStream.java:774)
> > > > > > > at
> java.lang.Throwable.printStackTrace(Throwable.java:461)
> > > > > > > at
> > > > >
> > > > >
> > >
> org.apache.nutch.protocol.http.api.HttpBase.getProtocolOutput(HttpBase.ja
> > > > > v
> > > > >
> > > > > > > a:197) at
> > > > > > >
> > > org.apache.nutch.fetcher.Fetcher$FetcherThread.run(Fetcher.java:665)
> > > > > >
> > > > > > --
> > > > > > Markus Jelsma - CTO - Openindex
> > > > > > http://www.linkedin.com/in/markus17
> > > > > > 050-8536620 / 06-50258350
> > > > >
> > > > > --
> > > > > *Lewis*
> > >
> > > --
> > > Markus Jelsma - CTO - Openindex
> > > http://www.linkedin.com/in/markus17
> > > 050-8536620 / 06-50258350
> > >
> >
>
>
>
> --
> *Lewis*
>
Re: Fetch log error
Posted by Bai Shen <ba...@gmail.com>.
I downloaded 1.4 from the trunk a couple of weeks ago. Once 1.4 is
released, I'll change to that and let you know if the problem persists.
On Tue, Nov 8, 2011 at 3:26 PM, Lewis John Mcgibbney <
lewis.mcgibbney@gmail.com> wrote:
> Can we clarify if you are using trunk (now 1.5), or 1.4 branch? You
> mentioned that you were using 1.4 but there have been changes to its code
> base recently so I am slightly confused. Our SVN area is going through a
> bit of a transition just now as well so please clarify which codebase you
> are working from.
> Thank you
>
> Lewis
>
> On Tue, Nov 8, 2011 at 6:53 AM, Bai Shen <ba...@gmail.com> wrote:
>
> > I just noticed this in the log. Not sure if it'll help.
> >
> > 2011-11-07 00:19:23,258 ERROR util.LogUtil - Cannot init log methods
> > java.lang.NoSuchMethodException: org.slf4j.Logger.trace(java.lang.Object)
> > at java.lang.Class.getMethod(Unknown Source)
> > at org.apache.nutch.util.LogUtil.<clinit>(LogUtil.java:48)
> > at
> >
> >
> org.apache.nutch.protocol.http.api.HttpBase.getProtocolOutput(HttpBase.java:197)
> > at
> org.apache.nutch.fetcher.Fetcher$FetcherThread.run(Fetcher.java:665)
> >
> >
> > Also, here's the other stack trace.
> >
> > 2011-11-07 00:19:23,259 ERROR util.LogUtil - Cannot log with method
> [null]
> > java.lang.NullPointerException
> > at org.apache.nutch.util.LogUtil$1.flush(LogUtil.java:103)
> > at java.io.PrintStream.write(Unknown Source)
> > at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source)
> > at sun.nio.cs.StreamEncoder.implFlushBuffer(Unknown Source)
> > at sun.nio.cs.StreamEncoder.flushBuffer(Unknown Source)
> > at java.io.OutputStreamWriter.flushBuffer(Unknown Source)
> > at java.io.PrintStream.newLine(Unknown Source)
> > at java.io.PrintStream.println(Unknown Source)
> > at java.lang.Throwable.printStackTrace(Throwable.java:461)
> > at
> >
> >
> org.apache.nutch.protocol.http.api.HttpBase.getProtocolOutput(HttpBase.java:197)
> > at
> org.apache.nutch.fetcher.Fetcher$FetcherThread.run(Fetcher.java:665)
> >
> >
> > On Mon, Oct 31, 2011 at 1:29 PM, lewis john mcgibbney <
> > lewis.mcgibbney@gmail.com> wrote:
> >
> > > So are you getting the bad output when using the fetcher? Do you have
> any
> > > local changes on your working dist of Nutch? Please check with svn
> status
> > > or svn diff
> > >
> > > I would have expected the output to have shown you which classes were
> > > causing the problem... there can always be one or two that slip through
> > the
> > > net.
> > >
> > > On Mon, Oct 31, 2011 at 4:47 PM, Bai Shen <ba...@gmail.com>
> > wrote:
> > >
> > > > We just did an ant clean and rebuilt nutch and we're still seeing the
> > > same
> > > > error in the logs.
> > > >
> > > > On Fri, Oct 28, 2011 at 11:12 AM, Markus Jelsma
> > > > <ma...@openindex.io>wrote:
> > > >
> > > > > Have you also tried ant clean before building?
> > > > >
> > > > > On Friday 28 October 2011 17:06:12 Bai Shen wrote:
> > > > > > Ah, okay. Missed that part.
> > > > > >
> > > > > > And yes, It's consistent.
> > > > > >
> > > > > > On Fri, Oct 28, 2011 at 10:12 AM, lewis john mcgibbney <
> > > > > >
> > > > > > lewis.mcgibbney@gmail.com> wrote:
> > > > > > > Hi Bai,
> > > > > > >
> > > > > > > OK so the FATAL logging in LogUtil relates to the following
> [1].
> > As
> > > > you
> > > > > > > can see, although there is a FATAL tag, it actualy logs
> 'error'
> > > > > anyway.
> > > > > > > If you look at the JIRA issues, I've committed myself to
> removing
> > > > > > > LogUtil from both
> > > > > > > trunk and Nutchgora, this will allow us to leverage full
> > > > functionality
> > > > > > > from the Slf4j and Log4j framework we currently have
> implemented
> > > on a
> > > > > > > majority basis.
> > > > > > >
> > > > > > > With regards to the NPE as Markus suggested can you reproduce
> > > > > > > consistently?
> > > > > > >
> > > > > > > [1]
> > > > > > >
> > > > > > >
> > > > >
> > > >
> > >
> >
> http://svn.apache.org/viewvc/nutch/trunk/src/java/org/apache/nutch/util/L
> > > > > > > ogUtil.java?r1=1175075&r2=1177290&diff_format=h
> > > > > > >
> > > > > > > On Fri, Oct 28, 2011 at 3:53 PM, Markus Jelsma
> > > > > > >
> > > > > > > <ma...@openindex.io>wrote:
> > > > > > > > Do you get this consistently? Are you compiling from svn?
> > > > > > > >
> > > > > > > > On Friday 28 October 2011 15:30:42 Bai Shen wrote:
> > > > > > > > > I'm running the latest version of 1.4 and I'm seeing the
> > error
> > > > > Markus
> > > > > > > > > described in Nutch bug 1078. I'm not sure exactly what's
> > > causing
> > > > > it,
> > > > > > >
> > > > > > > but
> > > > > > >
> > > > > > > > I
> > > > > > > >
> > > > > > > > > also wanted to point out that LogUtil still contains FATAL
> > > > > > > > > references.
> > > > > > > > >
> > > > > > > > > 2011-09-22 19:36:02,046 ERROR
> org.apache.nutch.util.LogUtil:
> > > > Cannot
> > > > > > > > > log with method [null]
> > > > > > > > > java.lang.NullPointerException
> > > > > > > > >
> > > > > > > > > at
> > > org.apache.nutch.util.LogUtil$1.flush(LogUtil.java:103)
> > > > > > > > > at java.io.PrintStream.write(PrintStream.java:432)
> > > > > > > > > at
> > > > > sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:202)
> > > > > > > > > at
> > > > > > >
> > > > > > >
> sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:272)
> > > > > > >
> > > > > > > > > at
> > > > > sun.nio.cs.StreamEncoder.flushBuffer(StreamEncoder.java:85)
> > > > > > > > > at
> > > > > > > >
> > > > > > > >
> > > java.io.OutputStreamWriter.flushBuffer(OutputStreamWriter.java:168)
> > > > > > > >
> > > > > > > > > at java.io.PrintStream.newLine(PrintStream.java:496)
> > > > > > > > > at java.io.PrintStream.println(PrintStream.java:774)
> > > > > > > > > at
> > > java.lang.Throwable.printStackTrace(Throwable.java:461)
> > > > > > > > > at
> > > > > > >
> > > > > > >
> > > > >
> > >
> org.apache.nutch.protocol.http.api.HttpBase.getProtocolOutput(HttpBase.ja
> > > > > > > v
> > > > > > >
> > > > > > > > > a:197) at
> > > > > > > > >
> > > > >
> org.apache.nutch.fetcher.Fetcher$FetcherThread.run(Fetcher.java:665)
> > > > > > > >
> > > > > > > > --
> > > > > > > > Markus Jelsma - CTO - Openindex
> > > > > > > > http://www.linkedin.com/in/markus17
> > > > > > > > 050-8536620 / 06-50258350
> > > > > > >
> > > > > > > --
> > > > > > > *Lewis*
> > > > >
> > > > > --
> > > > > Markus Jelsma - CTO - Openindex
> > > > > http://www.linkedin.com/in/markus17
> > > > > 050-8536620 / 06-50258350
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > *Lewis*
> > >
> >
>
>
>
> --
> *Lewis*
>
Re: Fetch log error
Posted by Lewis John Mcgibbney <le...@gmail.com>.
Can we clarify if you are using trunk (now 1.5), or 1.4 branch? You
mentioned that you were using 1.4 but there have been changes to its code
base recently so I am slightly confused. Our SVN area is going through a
bit of a transition just now as well so please clarify which codebase you
are working from.
Thank you
Lewis
On Tue, Nov 8, 2011 at 6:53 AM, Bai Shen <ba...@gmail.com> wrote:
> I just noticed this in the log. Not sure if it'll help.
>
> 2011-11-07 00:19:23,258 ERROR util.LogUtil - Cannot init log methods
> java.lang.NoSuchMethodException: org.slf4j.Logger.trace(java.lang.Object)
> at java.lang.Class.getMethod(Unknown Source)
> at org.apache.nutch.util.LogUtil.<clinit>(LogUtil.java:48)
> at
>
> org.apache.nutch.protocol.http.api.HttpBase.getProtocolOutput(HttpBase.java:197)
> at org.apache.nutch.fetcher.Fetcher$FetcherThread.run(Fetcher.java:665)
>
>
> Also, here's the other stack trace.
>
> 2011-11-07 00:19:23,259 ERROR util.LogUtil - Cannot log with method [null]
> java.lang.NullPointerException
> at org.apache.nutch.util.LogUtil$1.flush(LogUtil.java:103)
> at java.io.PrintStream.write(Unknown Source)
> at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source)
> at sun.nio.cs.StreamEncoder.implFlushBuffer(Unknown Source)
> at sun.nio.cs.StreamEncoder.flushBuffer(Unknown Source)
> at java.io.OutputStreamWriter.flushBuffer(Unknown Source)
> at java.io.PrintStream.newLine(Unknown Source)
> at java.io.PrintStream.println(Unknown Source)
> at java.lang.Throwable.printStackTrace(Throwable.java:461)
> at
>
> org.apache.nutch.protocol.http.api.HttpBase.getProtocolOutput(HttpBase.java:197)
> at org.apache.nutch.fetcher.Fetcher$FetcherThread.run(Fetcher.java:665)
>
>
> On Mon, Oct 31, 2011 at 1:29 PM, lewis john mcgibbney <
> lewis.mcgibbney@gmail.com> wrote:
>
> > So are you getting the bad output when using the fetcher? Do you have any
> > local changes on your working dist of Nutch? Please check with svn status
> > or svn diff
> >
> > I would have expected the output to have shown you which classes were
> > causing the problem... there can always be one or two that slip through
> the
> > net.
> >
> > On Mon, Oct 31, 2011 at 4:47 PM, Bai Shen <ba...@gmail.com>
> wrote:
> >
> > > We just did an ant clean and rebuilt nutch and we're still seeing the
> > same
> > > error in the logs.
> > >
> > > On Fri, Oct 28, 2011 at 11:12 AM, Markus Jelsma
> > > <ma...@openindex.io>wrote:
> > >
> > > > Have you also tried ant clean before building?
> > > >
> > > > On Friday 28 October 2011 17:06:12 Bai Shen wrote:
> > > > > Ah, okay. Missed that part.
> > > > >
> > > > > And yes, It's consistent.
> > > > >
> > > > > On Fri, Oct 28, 2011 at 10:12 AM, lewis john mcgibbney <
> > > > >
> > > > > lewis.mcgibbney@gmail.com> wrote:
> > > > > > Hi Bai,
> > > > > >
> > > > > > OK so the FATAL logging in LogUtil relates to the following [1].
> As
> > > you
> > > > > > can see, although there is a FATAL tag, it actualy logs 'error'
> > > > anyway.
> > > > > > If you look at the JIRA issues, I've committed myself to removing
> > > > > > LogUtil from both
> > > > > > trunk and Nutchgora, this will allow us to leverage full
> > > functionality
> > > > > > from the Slf4j and Log4j framework we currently have implemented
> > on a
> > > > > > majority basis.
> > > > > >
> > > > > > With regards to the NPE as Markus suggested can you reproduce
> > > > > > consistently?
> > > > > >
> > > > > > [1]
> > > > > >
> > > > > >
> > > >
> > >
> >
> http://svn.apache.org/viewvc/nutch/trunk/src/java/org/apache/nutch/util/L
> > > > > > ogUtil.java?r1=1175075&r2=1177290&diff_format=h
> > > > > >
> > > > > > On Fri, Oct 28, 2011 at 3:53 PM, Markus Jelsma
> > > > > >
> > > > > > <ma...@openindex.io>wrote:
> > > > > > > Do you get this consistently? Are you compiling from svn?
> > > > > > >
> > > > > > > On Friday 28 October 2011 15:30:42 Bai Shen wrote:
> > > > > > > > I'm running the latest version of 1.4 and I'm seeing the
> error
> > > > Markus
> > > > > > > > described in Nutch bug 1078. I'm not sure exactly what's
> > causing
> > > > it,
> > > > > >
> > > > > > but
> > > > > >
> > > > > > > I
> > > > > > >
> > > > > > > > also wanted to point out that LogUtil still contains FATAL
> > > > > > > > references.
> > > > > > > >
> > > > > > > > 2011-09-22 19:36:02,046 ERROR org.apache.nutch.util.LogUtil:
> > > Cannot
> > > > > > > > log with method [null]
> > > > > > > > java.lang.NullPointerException
> > > > > > > >
> > > > > > > > at
> > org.apache.nutch.util.LogUtil$1.flush(LogUtil.java:103)
> > > > > > > > at java.io.PrintStream.write(PrintStream.java:432)
> > > > > > > > at
> > > > sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:202)
> > > > > > > > at
> > > > > >
> > > > > > sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:272)
> > > > > >
> > > > > > > > at
> > > > sun.nio.cs.StreamEncoder.flushBuffer(StreamEncoder.java:85)
> > > > > > > > at
> > > > > > >
> > > > > > >
> > java.io.OutputStreamWriter.flushBuffer(OutputStreamWriter.java:168)
> > > > > > >
> > > > > > > > at java.io.PrintStream.newLine(PrintStream.java:496)
> > > > > > > > at java.io.PrintStream.println(PrintStream.java:774)
> > > > > > > > at
> > java.lang.Throwable.printStackTrace(Throwable.java:461)
> > > > > > > > at
> > > > > >
> > > > > >
> > > >
> > org.apache.nutch.protocol.http.api.HttpBase.getProtocolOutput(HttpBase.ja
> > > > > > v
> > > > > >
> > > > > > > > a:197) at
> > > > > > > >
> > > > org.apache.nutch.fetcher.Fetcher$FetcherThread.run(Fetcher.java:665)
> > > > > > >
> > > > > > > --
> > > > > > > Markus Jelsma - CTO - Openindex
> > > > > > > http://www.linkedin.com/in/markus17
> > > > > > > 050-8536620 / 06-50258350
> > > > > >
> > > > > > --
> > > > > > *Lewis*
> > > >
> > > > --
> > > > Markus Jelsma - CTO - Openindex
> > > > http://www.linkedin.com/in/markus17
> > > > 050-8536620 / 06-50258350
> > > >
> > >
> >
> >
> >
> > --
> > *Lewis*
> >
>
--
*Lewis*