You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Bai Shen <ba...@gmail.com> on 2011/09/27 22:31:34 UTC
NumberFormatException
So I added the Nutch fields to my Solr schema and reran solrindex. However,
now I'm getting a NumberFormatException. Nutch is apparently sending
"123456 " to Solr to be parsed as a TrieLong.
Any ideas what would cause this and where to look to fix it?
Thanks.
Re: NumberFormatException
Posted by Bai Shen <ba...@gmail.com>.
This is what I get in the hadoop.log in Nutch.
2011-09-27 16:08:38,279 INFO indexer.IndexingFilters - Adding
org.apache.nutch.indexer.more.MoreIndexingFilter
2011-09-27 16:08:38,401 INFO solr.SolrMappingReader - source: content dest:
content
2011-09-27 16:08:38,402 INFO solr.SolrMappingReader - source: site dest:
site
2011-09-27 16:08:38,402 INFO solr.SolrMappingReader - source: title dest:
title
2011-09-27 16:08:38,402 INFO solr.SolrMappingReader - source: host dest:
host
2011-09-27 16:08:38,402 INFO solr.SolrMappingReader - source: segment dest:
segment
2011-09-27 16:08:38,402 INFO solr.SolrMappingReader - source: boost dest:
boost
2011-09-27 16:08:38,402 INFO solr.SolrMappingReader - source: digest dest:
digest
2011-09-27 16:08:38,402 INFO solr.SolrMappingReader - source: tstamp dest:
tstamp
2011-09-27 16:08:38,402 INFO solr.SolrMappingReader - source: url dest: id
2011-09-27 16:08:38,402 INFO solr.SolrMappingReader - source: url dest: url
2011-09-27 16:09:38,009 WARN more.MoreIndexingFilter -
http://www.americanprogress.org/experts/GudeKen.html/repository/capportrait/item760555734:
can't parse erroneous date: 2008-03-05T16:19:54
2011-09-27 16:09:38,012 WARN more.MoreIndexingFilter -
http://www.americanprogress.org/experts/KorbLawrence.html/repository/capportrait/item808695475:
can't parse erroneous date: 2008-03-05T16:05:25
2011-09-27 16:11:42,559 WARN mapred.LocalJobRunner - job_local_0001
org.apache.solr.common.SolrException: For input string: "17456 "
java.lang.NumberFormatException: For input string: "17456 " at
java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
at java.lang.Long.parseLong(Long.java:419) at
java.lang.Long.parseLong(Long.java:468) at
org.apache.solr.schema.TrieField.createField(TrieField.java:381) at
org.apache.solr.schema.SchemaField.createField(SchemaField.java:104) at
org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:203)
at
org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:276)
at
org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:60)
at
org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:115)
at org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:158)
at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:79) at
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:67)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1368) at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerW
For input string: "17456 " java.lang.NumberFormatException: For input
string: "17456 " at
java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
at java.lang.Long.parseLong(Long.java:419) at
java.lang.Long.parseLong(Long.java:468) at
org.apache.solr.schema.TrieField.createField(TrieField.java:381) at
org.apache.solr.schema.SchemaField.createField(SchemaField.java:104) at
org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:203)
at
org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:276)
at
org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:60)
at
org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:115)
at org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:158)
at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:79) at
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:67)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1368) at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerW
request: http://127.0.0.1:8983/solr/update?wt=javabin&version=2
at
org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:436)
at
org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:245)
at
org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:105)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:49)
at org.apache.nutch.indexer.solr.SolrWriter.write(SolrWriter.java:71)
at
org.apache.nutch.indexer.IndexerOutputFormat$1.write(IndexerOutputFormat.java:54)
at
org.apache.nutch.indexer.IndexerOutputFormat$1.write(IndexerOutputFormat.java:44)
at org.apache.hadoop.mapred.ReduceTask$3.collect(ReduceTask.java:440)
at
org.apache.nutch.indexer.IndexerMapReduce.reduce(IndexerMapReduce.java:159)
at
org.apache.nutch.indexer.IndexerMapReduce.reduce(IndexerMapReduce.java:50)
at
org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216)
2011-09-27 16:11:43,161 ERROR solr.SolrIndexer - java.io.IOException: Job
failed!
On Wed, Sep 28, 2011 at 2:44 PM, Markus Jelsma
<ma...@openindex.io>wrote:
> Check Solr's log, it's there.
>
> > I don't know. It doesn't say as far as I can tell. Is there a way to
> look
> > at the logs or data to determine?
> >
> > On Tue, Sep 27, 2011 at 4:55 PM, Markus Jelsma
> >
> > <ma...@openindex.io>wrote:
> > > For which field do you get this issue? At least one such issue is fixed
> > > in 1.4-dev.
> > >
> > > > So I added the Nutch fields to my Solr schema and reran solrindex.
> > > > However, now I'm getting a NumberFormatException. Nutch is
> apparently
> > > > sending "123456 " to Solr to be parsed as a TrieLong.
> > > >
> > > > Any ideas what would cause this and where to look to fix it?
> > > >
> > > > Thanks.
>
Re: NumberFormatException
Posted by Bai Shen <ba...@gmail.com>.
Okay, it looks like Solr only outputs to the console when you're running it
from the start.jar Here's the output. It seems the same as what came out
of the Nutch log.
Sep 27, 2011 4:11:42 PM org.apache.solr.update.processor.LogUpdateProcessor
finish
INFO: {add=[http://www.example.com/, ... (611 adds)]} 0 718
Sep 27, 2011 4:11:42 PM org.apache.solr.common.SolrException log
SEVERE: java.lang.NumberFormatException: For input string: "17456 "
at
java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
at java.lang.Long.parseLong(Long.java:419)
at java.lang.Long.parseLong(Long.java:468)
at org.apache.solr.schema.TrieField.createField(TrieField.java:381)
at org.apache.solr.schema.SchemaField.createField(SchemaField.java:104)
at
org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:203)
at
org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:276)
at
org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:60)
at
org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:115)
at org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:158)
at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:79)
at
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:67)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1368)
at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at
org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:843)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at
org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
at
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
Sep 27, 2011 4:11:42 PM org.apache.solr.core.SolrCore execute
INFO: [] webapp=/solr path=/update params={wt=javabin&version=2} status=500
QTime=718
Sep 27, 2011 4:11:42 PM org.apache.solr.common.SolrException log
SEVERE: java.lang.NumberFormatException: For input string: "17456 "
at
java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
at java.lang.Long.parseLong(Long.java:419)
at java.lang.Long.parseLong(Long.java:468)
at org.apache.solr.schema.TrieField.createField(TrieField.java:381)
at org.apache.solr.schema.SchemaField.createField(SchemaField.java:104)
at
org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:203)
at
org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:276)
at
org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:60)
at
org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:115)
at org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:158)
at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:79)
at
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:67)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1368)
at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at
org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:843)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at
org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
at
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
On Wed, Sep 28, 2011 at 2:44 PM, Markus Jelsma
<ma...@openindex.io>wrote:
> Check Solr's log, it's there.
>
> > I don't know. It doesn't say as far as I can tell. Is there a way to
> look
> > at the logs or data to determine?
> >
> > On Tue, Sep 27, 2011 at 4:55 PM, Markus Jelsma
> >
> > <ma...@openindex.io>wrote:
> > > For which field do you get this issue? At least one such issue is fixed
> > > in 1.4-dev.
> > >
> > > > So I added the Nutch fields to my Solr schema and reran solrindex.
> > > > However, now I'm getting a NumberFormatException. Nutch is
> apparently
> > > > sending "123456 " to Solr to be parsed as a TrieLong.
> > > >
> > > > Any ideas what would cause this and where to look to fix it?
> > > >
> > > > Thanks.
>
Re: NumberFormatException
Posted by Markus Jelsma <ma...@openindex.io>.
Most likely content length.
BTW: shooting themselves in the foot? Thought that was a dutch expression :P
> Take #2 : What are these fields and which plugin generates them?
>
> On 29 September 2011 15:22, Bai Shen <ba...@gmail.com> wrote:
> > I'm running stock Nutch 1.3 and Solr 3.4 The only change I've made was
> > to add the Nutch fields to the Solr schema instead of using just the
> > Nutch schema. I haven't added any plugins.
> >
> > On Thu, Sep 29, 2011 at 9:43 AM, Julien Nioche <
> >
> > lists.digitalpebble@gmail.com> wrote:
> > > What produced these fields? Your own plugin? If so - it is up to you to
> > > enforce a check of the content in your IndexingFilter. Nutch can't
> > > really be
> > > expected to prevent people from shooting themselves in the foot.
> > >
> > > If the fields are generated by a Nutch plugin then file a JIRA
> > >
> > > On 29 September 2011 14:38, Bai Shen <ba...@gmail.com> wrote:
> > > > I can't find a Solr log. I looked in example\logs and the directory
> > > > is empty. I'm running 3.4 using java -jar start.jar and the only
> > > > thing I changed was to add the Nutch fields to the schema.
> > > >
> > > > On Wed, Sep 28, 2011 at 2:44 PM, Markus Jelsma
> > > >
> > > > <ma...@openindex.io>wrote:
> > > > > Check Solr's log, it's there.
> > > > >
> > > > > > I don't know. It doesn't say as far as I can tell. Is there a
> > > > > > way
> > >
> > > to
> > >
> > > > > look
> > > > >
> > > > > > at the logs or data to determine?
> > > > > >
> > > > > > On Tue, Sep 27, 2011 at 4:55 PM, Markus Jelsma
> > > > > >
> > > > > > <ma...@openindex.io>wrote:
> > > > > > > For which field do you get this issue? At least one such issue
> > > > > > > is
> > > >
> > > > fixed
> > > >
> > > > > > > in 1.4-dev.
> > > > > > >
> > > > > > > > So I added the Nutch fields to my Solr schema and reran
> > >
> > > solrindex.
> > >
> > > > > > > > However, now I'm getting a NumberFormatException. Nutch is
> > > > >
> > > > > apparently
> > > > >
> > > > > > > > sending "123456 " to Solr to be parsed as a TrieLong.
> > > > > > > >
> > > > > > > > Any ideas what would cause this and where to look to fix it?
> > > > > > > >
> > > > > > > > Thanks.
> > >
> > > --
> > > *
> > > *Open Source Solutions for Text Engineering
> > >
> > > http://digitalpebble.blogspot.com/
> > > http://www.digitalpebble.com
Re: NumberFormatException
Posted by Markus Jelsma <ma...@openindex.io>.
You're right, it's not in the logs. I also had to track a specific number from
the logs to a Nutch document and found it it was the content length. You need
Nutch 1.4-dev, it has a fix for this issue.
> I don't know. That's what I'm trying to figure out. Markus says the info
> is in the logs, but I can't seem to find it.
>
> On Thu, Sep 29, 2011 at 10:41 AM, Julien Nioche <
>
> lists.digitalpebble@gmail.com> wrote:
> > Take #2 : What are these fields and which plugin generates them?
> >
> > On 29 September 2011 15:22, Bai Shen <ba...@gmail.com> wrote:
> > > I'm running stock Nutch 1.3 and Solr 3.4 The only change I've made was
> >
> > to
> >
> > > add the Nutch fields to the Solr schema instead of using just the Nutch
> > > schema. I haven't added any plugins.
> > >
> > > On Thu, Sep 29, 2011 at 9:43 AM, Julien Nioche <
> > >
> > > lists.digitalpebble@gmail.com> wrote:
> > > > What produced these fields? Your own plugin? If so - it is up to you
> > > > to enforce a check of the content in your IndexingFilter. Nutch
> > > > can't
> >
> > really
> >
> > > > be
> > > > expected to prevent people from shooting themselves in the foot.
> > > >
> > > > If the fields are generated by a Nutch plugin then file a JIRA
> > > >
> > > > On 29 September 2011 14:38, Bai Shen <ba...@gmail.com> wrote:
> > > > > I can't find a Solr log. I looked in example\logs and the
> > > > > directory
> >
> > is
> >
> > > > > empty. I'm running 3.4 using java -jar start.jar and the only
> > > > > thing
> >
> > I
> >
> > > > > changed was to add the Nutch fields to the schema.
> > > > >
> > > > > On Wed, Sep 28, 2011 at 2:44 PM, Markus Jelsma
> > > > >
> > > > > <ma...@openindex.io>wrote:
> > > > > > Check Solr's log, it's there.
> > > > > >
> > > > > > > I don't know. It doesn't say as far as I can tell. Is there a
> >
> > way
> >
> > > > to
> > > >
> > > > > > look
> > > > > >
> > > > > > > at the logs or data to determine?
> > > > > > >
> > > > > > > On Tue, Sep 27, 2011 at 4:55 PM, Markus Jelsma
> > > > > > >
> > > > > > > <ma...@openindex.io>wrote:
> > > > > > > > For which field do you get this issue? At least one such
> > > > > > > > issue
> >
> > is
> >
> > > > > fixed
> > > > >
> > > > > > > > in 1.4-dev.
> > > > > > > >
> > > > > > > > > So I added the Nutch fields to my Solr schema and reran
> > > >
> > > > solrindex.
> > > >
> > > > > > > > > However, now I'm getting a NumberFormatException. Nutch is
> > > > > >
> > > > > > apparently
> > > > > >
> > > > > > > > > sending "123456 " to Solr to be parsed as a TrieLong.
> > > > > > > > >
> > > > > > > > > Any ideas what would cause this and where to look to fix
> > > > > > > > > it?
> > > > > > > > >
> > > > > > > > > Thanks.
> > > >
> > > > --
> > > > *
> > > > *Open Source Solutions for Text Engineering
> > > >
> > > > http://digitalpebble.blogspot.com/
> > > > http://www.digitalpebble.com
> >
> > --
> > *
> > *Open Source Solutions for Text Engineering
> >
> > http://digitalpebble.blogspot.com/
> > http://www.digitalpebble.com
Re: NumberFormatException
Posted by Bai Shen <ba...@gmail.com>.
I don't know. That's what I'm trying to figure out. Markus says the info
is in the logs, but I can't seem to find it.
On Thu, Sep 29, 2011 at 10:41 AM, Julien Nioche <
lists.digitalpebble@gmail.com> wrote:
> Take #2 : What are these fields and which plugin generates them?
>
> On 29 September 2011 15:22, Bai Shen <ba...@gmail.com> wrote:
>
> > I'm running stock Nutch 1.3 and Solr 3.4 The only change I've made was
> to
> > add the Nutch fields to the Solr schema instead of using just the Nutch
> > schema. I haven't added any plugins.
> >
> > On Thu, Sep 29, 2011 at 9:43 AM, Julien Nioche <
> > lists.digitalpebble@gmail.com> wrote:
> >
> > > What produced these fields? Your own plugin? If so - it is up to you to
> > > enforce a check of the content in your IndexingFilter. Nutch can't
> really
> > > be
> > > expected to prevent people from shooting themselves in the foot.
> > >
> > > If the fields are generated by a Nutch plugin then file a JIRA
> > >
> > > On 29 September 2011 14:38, Bai Shen <ba...@gmail.com> wrote:
> > >
> > > > I can't find a Solr log. I looked in example\logs and the directory
> is
> > > > empty. I'm running 3.4 using java -jar start.jar and the only thing
> I
> > > > changed was to add the Nutch fields to the schema.
> > > >
> > > > On Wed, Sep 28, 2011 at 2:44 PM, Markus Jelsma
> > > > <ma...@openindex.io>wrote:
> > > >
> > > > > Check Solr's log, it's there.
> > > > >
> > > > > > I don't know. It doesn't say as far as I can tell. Is there a
> way
> > > to
> > > > > look
> > > > > > at the logs or data to determine?
> > > > > >
> > > > > > On Tue, Sep 27, 2011 at 4:55 PM, Markus Jelsma
> > > > > >
> > > > > > <ma...@openindex.io>wrote:
> > > > > > > For which field do you get this issue? At least one such issue
> is
> > > > fixed
> > > > > > > in 1.4-dev.
> > > > > > >
> > > > > > > > So I added the Nutch fields to my Solr schema and reran
> > > solrindex.
> > > > > > > > However, now I'm getting a NumberFormatException. Nutch is
> > > > > apparently
> > > > > > > > sending "123456 " to Solr to be parsed as a TrieLong.
> > > > > > > >
> > > > > > > > Any ideas what would cause this and where to look to fix it?
> > > > > > > >
> > > > > > > > Thanks.
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > *
> > > *Open Source Solutions for Text Engineering
> > >
> > > http://digitalpebble.blogspot.com/
> > > http://www.digitalpebble.com
> > >
> >
>
>
>
> --
> *
> *Open Source Solutions for Text Engineering
>
> http://digitalpebble.blogspot.com/
> http://www.digitalpebble.com
>
Re: NumberFormatException
Posted by Julien Nioche <li...@gmail.com>.
Take #2 : What are these fields and which plugin generates them?
On 29 September 2011 15:22, Bai Shen <ba...@gmail.com> wrote:
> I'm running stock Nutch 1.3 and Solr 3.4 The only change I've made was to
> add the Nutch fields to the Solr schema instead of using just the Nutch
> schema. I haven't added any plugins.
>
> On Thu, Sep 29, 2011 at 9:43 AM, Julien Nioche <
> lists.digitalpebble@gmail.com> wrote:
>
> > What produced these fields? Your own plugin? If so - it is up to you to
> > enforce a check of the content in your IndexingFilter. Nutch can't really
> > be
> > expected to prevent people from shooting themselves in the foot.
> >
> > If the fields are generated by a Nutch plugin then file a JIRA
> >
> > On 29 September 2011 14:38, Bai Shen <ba...@gmail.com> wrote:
> >
> > > I can't find a Solr log. I looked in example\logs and the directory is
> > > empty. I'm running 3.4 using java -jar start.jar and the only thing I
> > > changed was to add the Nutch fields to the schema.
> > >
> > > On Wed, Sep 28, 2011 at 2:44 PM, Markus Jelsma
> > > <ma...@openindex.io>wrote:
> > >
> > > > Check Solr's log, it's there.
> > > >
> > > > > I don't know. It doesn't say as far as I can tell. Is there a way
> > to
> > > > look
> > > > > at the logs or data to determine?
> > > > >
> > > > > On Tue, Sep 27, 2011 at 4:55 PM, Markus Jelsma
> > > > >
> > > > > <ma...@openindex.io>wrote:
> > > > > > For which field do you get this issue? At least one such issue is
> > > fixed
> > > > > > in 1.4-dev.
> > > > > >
> > > > > > > So I added the Nutch fields to my Solr schema and reran
> > solrindex.
> > > > > > > However, now I'm getting a NumberFormatException. Nutch is
> > > > apparently
> > > > > > > sending "123456 " to Solr to be parsed as a TrieLong.
> > > > > > >
> > > > > > > Any ideas what would cause this and where to look to fix it?
> > > > > > >
> > > > > > > Thanks.
> > > >
> > >
> >
> >
> >
> > --
> > *
> > *Open Source Solutions for Text Engineering
> >
> > http://digitalpebble.blogspot.com/
> > http://www.digitalpebble.com
> >
>
--
*
*Open Source Solutions for Text Engineering
http://digitalpebble.blogspot.com/
http://www.digitalpebble.com
Re: NumberFormatException
Posted by Bai Shen <ba...@gmail.com>.
I'm running stock Nutch 1.3 and Solr 3.4 The only change I've made was to
add the Nutch fields to the Solr schema instead of using just the Nutch
schema. I haven't added any plugins.
On Thu, Sep 29, 2011 at 9:43 AM, Julien Nioche <
lists.digitalpebble@gmail.com> wrote:
> What produced these fields? Your own plugin? If so - it is up to you to
> enforce a check of the content in your IndexingFilter. Nutch can't really
> be
> expected to prevent people from shooting themselves in the foot.
>
> If the fields are generated by a Nutch plugin then file a JIRA
>
> On 29 September 2011 14:38, Bai Shen <ba...@gmail.com> wrote:
>
> > I can't find a Solr log. I looked in example\logs and the directory is
> > empty. I'm running 3.4 using java -jar start.jar and the only thing I
> > changed was to add the Nutch fields to the schema.
> >
> > On Wed, Sep 28, 2011 at 2:44 PM, Markus Jelsma
> > <ma...@openindex.io>wrote:
> >
> > > Check Solr's log, it's there.
> > >
> > > > I don't know. It doesn't say as far as I can tell. Is there a way
> to
> > > look
> > > > at the logs or data to determine?
> > > >
> > > > On Tue, Sep 27, 2011 at 4:55 PM, Markus Jelsma
> > > >
> > > > <ma...@openindex.io>wrote:
> > > > > For which field do you get this issue? At least one such issue is
> > fixed
> > > > > in 1.4-dev.
> > > > >
> > > > > > So I added the Nutch fields to my Solr schema and reran
> solrindex.
> > > > > > However, now I'm getting a NumberFormatException. Nutch is
> > > apparently
> > > > > > sending "123456 " to Solr to be parsed as a TrieLong.
> > > > > >
> > > > > > Any ideas what would cause this and where to look to fix it?
> > > > > >
> > > > > > Thanks.
> > >
> >
>
>
>
> --
> *
> *Open Source Solutions for Text Engineering
>
> http://digitalpebble.blogspot.com/
> http://www.digitalpebble.com
>
Re: NumberFormatException
Posted by Julien Nioche <li...@gmail.com>.
What produced these fields? Your own plugin? If so - it is up to you to
enforce a check of the content in your IndexingFilter. Nutch can't really be
expected to prevent people from shooting themselves in the foot.
If the fields are generated by a Nutch plugin then file a JIRA
On 29 September 2011 14:38, Bai Shen <ba...@gmail.com> wrote:
> I can't find a Solr log. I looked in example\logs and the directory is
> empty. I'm running 3.4 using java -jar start.jar and the only thing I
> changed was to add the Nutch fields to the schema.
>
> On Wed, Sep 28, 2011 at 2:44 PM, Markus Jelsma
> <ma...@openindex.io>wrote:
>
> > Check Solr's log, it's there.
> >
> > > I don't know. It doesn't say as far as I can tell. Is there a way to
> > look
> > > at the logs or data to determine?
> > >
> > > On Tue, Sep 27, 2011 at 4:55 PM, Markus Jelsma
> > >
> > > <ma...@openindex.io>wrote:
> > > > For which field do you get this issue? At least one such issue is
> fixed
> > > > in 1.4-dev.
> > > >
> > > > > So I added the Nutch fields to my Solr schema and reran solrindex.
> > > > > However, now I'm getting a NumberFormatException. Nutch is
> > apparently
> > > > > sending "123456 " to Solr to be parsed as a TrieLong.
> > > > >
> > > > > Any ideas what would cause this and where to look to fix it?
> > > > >
> > > > > Thanks.
> >
>
--
*
*Open Source Solutions for Text Engineering
http://digitalpebble.blogspot.com/
http://www.digitalpebble.com
Re: NumberFormatException
Posted by Bai Shen <ba...@gmail.com>.
I can't find a Solr log. I looked in example\logs and the directory is
empty. I'm running 3.4 using java -jar start.jar and the only thing I
changed was to add the Nutch fields to the schema.
On Wed, Sep 28, 2011 at 2:44 PM, Markus Jelsma
<ma...@openindex.io>wrote:
> Check Solr's log, it's there.
>
> > I don't know. It doesn't say as far as I can tell. Is there a way to
> look
> > at the logs or data to determine?
> >
> > On Tue, Sep 27, 2011 at 4:55 PM, Markus Jelsma
> >
> > <ma...@openindex.io>wrote:
> > > For which field do you get this issue? At least one such issue is fixed
> > > in 1.4-dev.
> > >
> > > > So I added the Nutch fields to my Solr schema and reran solrindex.
> > > > However, now I'm getting a NumberFormatException. Nutch is
> apparently
> > > > sending "123456 " to Solr to be parsed as a TrieLong.
> > > >
> > > > Any ideas what would cause this and where to look to fix it?
> > > >
> > > > Thanks.
>
Re: NumberFormatException
Posted by Markus Jelsma <ma...@openindex.io>.
Check Solr's log, it's there.
> I don't know. It doesn't say as far as I can tell. Is there a way to look
> at the logs or data to determine?
>
> On Tue, Sep 27, 2011 at 4:55 PM, Markus Jelsma
>
> <ma...@openindex.io>wrote:
> > For which field do you get this issue? At least one such issue is fixed
> > in 1.4-dev.
> >
> > > So I added the Nutch fields to my Solr schema and reran solrindex.
> > > However, now I'm getting a NumberFormatException. Nutch is apparently
> > > sending "123456 " to Solr to be parsed as a TrieLong.
> > >
> > > Any ideas what would cause this and where to look to fix it?
> > >
> > > Thanks.
Re: NumberFormatException
Posted by Bai Shen <ba...@gmail.com>.
I don't know. It doesn't say as far as I can tell. Is there a way to look
at the logs or data to determine?
On Tue, Sep 27, 2011 at 4:55 PM, Markus Jelsma
<ma...@openindex.io>wrote:
> For which field do you get this issue? At least one such issue is fixed in
> 1.4-dev.
>
>
>
> > So I added the Nutch fields to my Solr schema and reran solrindex.
> > However, now I'm getting a NumberFormatException. Nutch is apparently
> > sending "123456 " to Solr to be parsed as a TrieLong.
> >
> > Any ideas what would cause this and where to look to fix it?
> >
> > Thanks.
>
Re: NumberFormatException
Posted by Markus Jelsma <ma...@openindex.io>.
For which field do you get this issue? At least one such issue is fixed in
1.4-dev.
> So I added the Nutch fields to my Solr schema and reran solrindex.
> However, now I'm getting a NumberFormatException. Nutch is apparently
> sending "123456 " to Solr to be parsed as a TrieLong.
>
> Any ideas what would cause this and where to look to fix it?
>
> Thanks.