You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by kumar8anuj <ku...@gmail.com> on 2011/09/01 11:44:20 UTC
index not created
Hi,
I am trying to index some documents through ExtractingRequestHandler.
everything works fine with the jetty server but when i configure it with
tomcat then my documents are not getting indexed only ids are getting index.
means text field is blank but id field is having values though there is no
error in the catalina.out file. Here is the command and output of the
catalina.out
I have multicore architecture and schema.xml is default which is there for
examples in solr. Please help.....
*command to index*
curl
"http://localhost:8080/solr/client/update/extract?literal.id=doc1&commit=true"
-F "myfile=@README.txt"
*output of calalina.out*
Sep 1, 2011 3:09:53 PM org.apache.solr.core.SolrDeletionPolicy onInit
INFO: SolrDeletionPolicy.onInit: commits:num=1
commit{dir=/opt/solr/hh_scraper/client/data/index,segFN=segments_3,version=1314863371898,generation=3,filenames=[_0.tis,
_0.nrm, _0.fnm, _1.tis, _1.frq, _1_1.del, _1.fnm, _1.fdx, _1.prx, _0.tii,
_1.fdt, _0.frq, _1.tii, _0.fdx, _0.prx, _1.nrm, segments_3, _0.fdt]
Sep 1, 2011 3:09:53 PM org.apache.solr.core.SolrDeletionPolicy updateCommits
INFO: newest commit = 1314863371898
Sep 1, 2011 3:09:53 PM org.apache.solr.update.DirectUpdateHandler2 commit
INFO: start
commit(optimize=false,waitFlush=false,waitSearcher=true,expungeDeletes=false)
Sep 1, 2011 3:09:53 PM org.apache.solr.core.SolrDeletionPolicy onCommit
INFO: SolrDeletionPolicy.onCommit: commits:num=2
commit{dir=/opt/solr/hh_scraper/client/data/index,segFN=segments_3,version=1314863371898,generation=3,filenames=[_0.tis,
_0.nrm, _0.fnm, _1.tis, _1.frq, _1_1.del, _1.fnm, _1.fdx, _1.prx, _0.tii,
_1.fdt, _0.frq, _1.tii, _0.fdx, _0.prx, _1.nrm, segments_3, _0.fdt]
commit{dir=/opt/solr/hh_scraper/client/data/index,segFN=segments_4,version=1314863371899,generation=4,filenames=[_0.tis,
_1.frq, _2.tii, _1.fnm, _1.tii, _0.prx, _0.nrm, _0.fnm, _1.tis, _2.prx,
_2.fdt, _0_1.del, _2.frq, _1_1.del, _2.fdx, _2.fnm, _1.prx, _1.fdx, _2.tis,
_0.tii, _1.fdt, _0.frq, _0.fdx, _0.fdt, _1.nrm, _2.nrm, segments_4]
Sep 1, 2011 3:09:53 PM org.apache.solr.core.SolrDeletionPolicy updateCommits
INFO: newest commit = 1314863371899
Sep 1, 2011 3:09:53 PM org.apache.solr.search.SolrIndexSearcher <init>
INFO: Opening Searcher@1510d96 main
Sep 1, 2011 3:09:53 PM org.apache.solr.update.DirectUpdateHandler2 commit
INFO: end_commit_flush
Sep 1, 2011 3:09:53 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming Searcher@1510d96 main from Searcher@88a970 main
fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Sep 1, 2011 3:09:53 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming result for Searcher@1510d96 main
fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Sep 1, 2011 3:09:53 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming Searcher@1510d96 main from Searcher@88a970 main
filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Sep 1, 2011 3:09:53 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming result for Searcher@1510d96 main
filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Sep 1, 2011 3:09:53 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming Searcher@1510d96 main from Searcher@88a970 main
queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Sep 1, 2011 3:09:53 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming result for Searcher@1510d96 main
queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Sep 1, 2011 3:09:53 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming Searcher@1510d96 main from Searcher@88a970 main
documentCache{lookups=2,hits=1,hitratio=0.50,inserts=1,evictions=0,size=1,warmupTime=0,cumulative_lookups=10,cumulative_hits=8,cumulative_hitratio=0.80,cumulative_inserts=2,cumulative_evictions=0}
Sep 1, 2011 3:09:53 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming result for Searcher@1510d96 main
documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=10,cumulative_hits=8,cumulative_hitratio=0.80,cumulative_inserts=2,cumulative_evictions=0}
Sep 1, 2011 3:09:53 PM org.apache.solr.core.QuerySenderListener newSearcher
INFO: QuerySenderListener sending requests to Searcher@1510d96 main
Sep 1, 2011 3:09:53 PM org.apache.solr.core.QuerySenderListener newSearcher
INFO: QuerySenderListener done.
Sep 1, 2011 3:09:53 PM
org.apache.solr.handler.component.SpellCheckComponent$SpellCheckerListener
buildSpellIndex
INFO: Building spell index for spell checker: default
Sep 1, 2011 3:09:53 PM org.apache.solr.core.SolrCore registerSearcher
INFO: [client] Registered new searcher Searcher@1510d96 main
Sep 1, 2011 3:09:53 PM org.apache.solr.search.SolrIndexSearcher close
INFO: Closing Searcher@88a970 main
fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
documentCache{lookups=2,hits=1,hitratio=0.50,inserts=1,evictions=0,size=1,warmupTime=0,cumulative_lookups=10,cumulative_hits=8,cumulative_hitratio=0.80,cumulative_inserts=2,cumulative_evictions=0}
Sep 1, 2011 3:09:53 PM org.apache.solr.update.processor.LogUpdateProcessor
finish
INFO: {add=[doc1],commit=} 0 691
Sep 1, 2011 3:09:53 PM org.apache.solr.core.SolrCore execute
INFO: [client] webapp=/solr path=/update/extract
params={commit=true&literal.id=doc1} status=0 QTime=691
--
View this message in context: http://lucene.472066.n3.nabble.com/index-not-created-tp3300744p3300744.html
Sent from the Solr - User mailing list archive at Nabble.com.
RE: index not created
Posted by "Jaeger, Jay - DOT" <Ja...@dot.wi.gov>.
> changed the configuration to point it to my solr dir and started it again
You might look in your logs to see where Solr thinks the Solr home directory is and/or if it complains about not being able to find it. As a guess, it can't find it, perhaps because solr.solr.home does not point to the right place. As a result, the servlet can't actually find the Solr code, and isn't really indexing anything at all.
For my tomcat install test, I put the following in startup.bat (Windows, but the Linux startup script startup.sh would be similar).
set "JAVA_OPTS=-Dsolr.solr.home=C:/pro/apache-solr-3.3.0/example/solr"
(my JAVA_OPTS has a bunch of other stuff for security, waffle, etc., but this is the one that would matter in your case).
JRJ
-----Original Message-----
From: kumar8anuj [mailto:kumar.anuj8@gmail.com]
Sent: Wednesday, September 14, 2011 4:21 AM
To: solr-user@lucene.apache.org
Subject: Re: index not created
Hi Erick,
I have not done anything different. I downloaded the solr tar
from one of the mirror and then extracted it in the home directory started
jetty and it works fine.
For tomcat I copied the war file in my webapps folder and restarted
tomcat changed the configuration to point it to my solr dir and started it
again. Same setup everything is same. Even this time i have tried it with
the example solr folder without multicore setup and in solrconfig.xml all
the lib paths are same which were for jetty. But still nothing is getting
indexed it shows that 1 document is there but text field doesn't show
anything in it and nothing comes when i search for something from the
document.
Am i doing something wrong ? Please let me know. I have to implement it
ASAP. Please help me or if you can give me document to implement the same in
tomcat then i would try that way ....
Thanks,
--
View this message in context: http://lucene.472066.n3.nabble.com/index-not-created-tp3300744p3335291.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: index not created
Posted by kumar8anuj <ku...@gmail.com>.
Hi Erick,
I have not done anything different. I downloaded the solr tar
from one of the mirror and then extracted it in the home directory started
jetty and it works fine.
For tomcat I copied the war file in my webapps folder and restarted
tomcat changed the configuration to point it to my solr dir and started it
again. Same setup everything is same. Even this time i have tried it with
the example solr folder without multicore setup and in solrconfig.xml all
the lib paths are same which were for jetty. But still nothing is getting
indexed it shows that 1 document is there but text field doesn't show
anything in it and nothing comes when i search for something from the
document.
Am i doing something wrong ? Please let me know. I have to implement it
ASAP. Please help me or if you can give me document to implement the same in
tomcat then i would try that way ....
Thanks,
--
View this message in context: http://lucene.472066.n3.nabble.com/index-not-created-tp3300744p3335291.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: index not created
Posted by Erick Erickson <er...@gmail.com>.
You're on a multicore setup, are you sure you're indexing and searching
to the same core?
the fact that it works for you in Jetty but not Tomcat sure looks like
you've set your Tomcat instance up differently, there shouldn't be any
difference between the two from a Solr perspective.
Best
Erick
On Fri, Sep 2, 2011 at 11:11 AM, kumar8anuj <ku...@gmail.com> wrote:
> status of both the fields are mentioned below, which clearly shows there is
> no document in text field. I have also tried to search some terms mentioned
> in the documents but their is no results.
>
> *Field: id*
>
> Field Type: string
>
> Properties: Indexed, Stored, Omit Norms, undefined, Sort Missing Last
>
> Schema: Indexed, Stored, Omit Norms, undefined, Sort Missing Last
>
> Index: Indexed, Stored, Omit Norms
>
> Index Analyzer: org.apache.solr.schema.FieldType$DefaultAnalyzer
>
> Query Analyzer: org.apache.solr.schema.FieldType$DefaultAnalyzer
>
> Docs: 3
>
> *Field Type: text*
>
> Properties: Indexed, Tokenized, Multivalued
>
> Schema: Indexed, Tokenized, Multivalued
>
> Copied From: cat manu name features includes
>
> Position Increment Gap: 100
>
> Index Analyzer: org.apache.solr.analysis.TokenizerChain Details
>
> Query Analyzer: org.apache.solr.analysis.TokenizerChain Details
>
> Docs: 0
>
>
>
>
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/index-not-created-tp3300744p3304497.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
Re: index not created
Posted by kumar8anuj <ku...@gmail.com>.
status of both the fields are mentioned below, which clearly shows there is
no document in text field. I have also tried to search some terms mentioned
in the documents but their is no results.
*Field: id*
Field Type: string
Properties: Indexed, Stored, Omit Norms, undefined, Sort Missing Last
Schema: Indexed, Stored, Omit Norms, undefined, Sort Missing Last
Index: Indexed, Stored, Omit Norms
Index Analyzer: org.apache.solr.schema.FieldType$DefaultAnalyzer
Query Analyzer: org.apache.solr.schema.FieldType$DefaultAnalyzer
Docs: 3
*Field Type: text*
Properties: Indexed, Tokenized, Multivalued
Schema: Indexed, Tokenized, Multivalued
Copied From: cat manu name features includes
Position Increment Gap: 100
Index Analyzer: org.apache.solr.analysis.TokenizerChain Details
Query Analyzer: org.apache.solr.analysis.TokenizerChain Details
Docs: 0
--
View this message in context: http://lucene.472066.n3.nabble.com/index-not-created-tp3300744p3304497.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: index not created
Posted by Erick Erickson <er...@gmail.com>.
What is your evidence that the text field isn't indexed? The default
schema does not store the text field data, so if you specify
fl=text you won't see anything. But you can still search on the
text field.
This confuses a lot of people. Try looking in the admin/schema browser
link and exploring the contents of your index, that might help you get
a feel for what's happening.
Best
Erick
On Thu, Sep 1, 2011 at 5:44 AM, kumar8anuj <ku...@gmail.com> wrote:
> Hi,
>
> I am trying to index some documents through ExtractingRequestHandler.
> everything works fine with the jetty server but when i configure it with
> tomcat then my documents are not getting indexed only ids are getting index.
> means text field is blank but id field is having values though there is no
> error in the catalina.out file. Here is the command and output of the
> catalina.out
>
> I have multicore architecture and schema.xml is default which is there for
> examples in solr. Please help.....
>
> *command to index*
>
> curl
> "http://localhost:8080/solr/client/update/extract?literal.id=doc1&commit=true"
> -F "myfile=@README.txt"
>
>
> *output of calalina.out*
>
>
> Sep 1, 2011 3:09:53 PM org.apache.solr.core.SolrDeletionPolicy onInit
> INFO: SolrDeletionPolicy.onInit: commits:num=1
>
> commit{dir=/opt/solr/hh_scraper/client/data/index,segFN=segments_3,version=1314863371898,generation=3,filenames=[_0.tis,
> _0.nrm, _0.fnm, _1.tis, _1.frq, _1_1.del, _1.fnm, _1.fdx, _1.prx, _0.tii,
> _1.fdt, _0.frq, _1.tii, _0.fdx, _0.prx, _1.nrm, segments_3, _0.fdt]
> Sep 1, 2011 3:09:53 PM org.apache.solr.core.SolrDeletionPolicy updateCommits
> INFO: newest commit = 1314863371898
> Sep 1, 2011 3:09:53 PM org.apache.solr.update.DirectUpdateHandler2 commit
> INFO: start
> commit(optimize=false,waitFlush=false,waitSearcher=true,expungeDeletes=false)
> Sep 1, 2011 3:09:53 PM org.apache.solr.core.SolrDeletionPolicy onCommit
> INFO: SolrDeletionPolicy.onCommit: commits:num=2
>
> commit{dir=/opt/solr/hh_scraper/client/data/index,segFN=segments_3,version=1314863371898,generation=3,filenames=[_0.tis,
> _0.nrm, _0.fnm, _1.tis, _1.frq, _1_1.del, _1.fnm, _1.fdx, _1.prx, _0.tii,
> _1.fdt, _0.frq, _1.tii, _0.fdx, _0.prx, _1.nrm, segments_3, _0.fdt]
>
> commit{dir=/opt/solr/hh_scraper/client/data/index,segFN=segments_4,version=1314863371899,generation=4,filenames=[_0.tis,
> _1.frq, _2.tii, _1.fnm, _1.tii, _0.prx, _0.nrm, _0.fnm, _1.tis, _2.prx,
> _2.fdt, _0_1.del, _2.frq, _1_1.del, _2.fdx, _2.fnm, _1.prx, _1.fdx, _2.tis,
> _0.tii, _1.fdt, _0.frq, _0.fdx, _0.fdt, _1.nrm, _2.nrm, segments_4]
> Sep 1, 2011 3:09:53 PM org.apache.solr.core.SolrDeletionPolicy updateCommits
> INFO: newest commit = 1314863371899
> Sep 1, 2011 3:09:53 PM org.apache.solr.search.SolrIndexSearcher <init>
> INFO: Opening Searcher@1510d96 main
> Sep 1, 2011 3:09:53 PM org.apache.solr.update.DirectUpdateHandler2 commit
> INFO: end_commit_flush
> Sep 1, 2011 3:09:53 PM org.apache.solr.search.SolrIndexSearcher warm
> INFO: autowarming Searcher@1510d96 main from Searcher@88a970 main
>
> fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
> Sep 1, 2011 3:09:53 PM org.apache.solr.search.SolrIndexSearcher warm
> INFO: autowarming result for Searcher@1510d96 main
>
> fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
> Sep 1, 2011 3:09:53 PM org.apache.solr.search.SolrIndexSearcher warm
> INFO: autowarming Searcher@1510d96 main from Searcher@88a970 main
>
> filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
> Sep 1, 2011 3:09:53 PM org.apache.solr.search.SolrIndexSearcher warm
> INFO: autowarming result for Searcher@1510d96 main
>
> filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
> Sep 1, 2011 3:09:53 PM org.apache.solr.search.SolrIndexSearcher warm
> INFO: autowarming Searcher@1510d96 main from Searcher@88a970 main
>
> queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
> Sep 1, 2011 3:09:53 PM org.apache.solr.search.SolrIndexSearcher warm
> INFO: autowarming result for Searcher@1510d96 main
>
> queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
> Sep 1, 2011 3:09:53 PM org.apache.solr.search.SolrIndexSearcher warm
> INFO: autowarming Searcher@1510d96 main from Searcher@88a970 main
>
> documentCache{lookups=2,hits=1,hitratio=0.50,inserts=1,evictions=0,size=1,warmupTime=0,cumulative_lookups=10,cumulative_hits=8,cumulative_hitratio=0.80,cumulative_inserts=2,cumulative_evictions=0}
> Sep 1, 2011 3:09:53 PM org.apache.solr.search.SolrIndexSearcher warm
> INFO: autowarming result for Searcher@1510d96 main
>
> documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=10,cumulative_hits=8,cumulative_hitratio=0.80,cumulative_inserts=2,cumulative_evictions=0}
> Sep 1, 2011 3:09:53 PM org.apache.solr.core.QuerySenderListener newSearcher
> INFO: QuerySenderListener sending requests to Searcher@1510d96 main
> Sep 1, 2011 3:09:53 PM org.apache.solr.core.QuerySenderListener newSearcher
> INFO: QuerySenderListener done.
> Sep 1, 2011 3:09:53 PM
> org.apache.solr.handler.component.SpellCheckComponent$SpellCheckerListener
> buildSpellIndex
> INFO: Building spell index for spell checker: default
> Sep 1, 2011 3:09:53 PM org.apache.solr.core.SolrCore registerSearcher
> INFO: [client] Registered new searcher Searcher@1510d96 main
> Sep 1, 2011 3:09:53 PM org.apache.solr.search.SolrIndexSearcher close
> INFO: Closing Searcher@88a970 main
>
> fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
>
> filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
>
> queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
>
> documentCache{lookups=2,hits=1,hitratio=0.50,inserts=1,evictions=0,size=1,warmupTime=0,cumulative_lookups=10,cumulative_hits=8,cumulative_hitratio=0.80,cumulative_inserts=2,cumulative_evictions=0}
> Sep 1, 2011 3:09:53 PM org.apache.solr.update.processor.LogUpdateProcessor
> finish
> INFO: {add=[doc1],commit=} 0 691
> Sep 1, 2011 3:09:53 PM org.apache.solr.core.SolrCore execute
> INFO: [client] webapp=/solr path=/update/extract
> params={commit=true&literal.id=doc1} status=0 QTime=691
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/index-not-created-tp3300744p3300744.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>