You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by neha <pn...@yahoo.com> on 2011/03/17 22:15:42 UTC
DIH Issue(newbie to solr)
I am a newbie to solr I have an issue with DIH but unable to pinpoint what is
causing the issue. I am using the demo jetty installation of Solr and tried
to create a project with new schema.xml, solrconfig.xml and data-config.xml
files. when I run
"http://131.187.88.221:8983/solr/dataimport?command=full-import" this is
what I get:
I am unable to index documents(it doesn't throw any error though).
##############
−
0
0
−
−
test-data-config.xml
full-import
idle
−
0
1
0
2011-03-17 17:07:18
−
Indexing completed. Added/Updated: 0 documents. Deleted 0 documents.
2011-03-17 17:07:18
2011-03-17 17:07:18
0
0:0:0.119
−
This response format is experimental. It is likely to change in the future.
#########################
I do not find any log files(except on the console). And here are the
messages from the console:
###########
INFO: Starting Full Import
Mar 17, 2011 5:08:20 PM org.apache.solr.handler.dataimport.SolrWriter
readIndexerProperties
INFO: Read dataimport.properties
Mar 17, 2011 5:08:20 PM org.apache.solr.update.DirectUpdateHandler2
deleteAll
INFO: [] REMOVING ALL DOCUMENTS FROM INDEX
Mar 17, 2011 5:08:20 PM org.apache.solr.core.SolrDeletionPolicy onInit
INFO: SolrDeletionPolicy.onInit: commits:num=1
commit{dir=/local/home/neha/ruby/Solr/apache-solr-1.4.1/example/solr/data/index,segFN=segments_k,version=1300286691490,generation=20,filenames=[segments_k]
Mar 17, 2011 5:08:20 PM org.apache.solr.core.SolrDeletionPolicy
updateCommits
INFO: newest commit = 1300286691490
Mar 17, 2011 5:08:20 PM org.apache.solr.handler.dataimport.DocBuilder finish
INFO: Import completed successfully
Mar 17, 2011 5:08:20 PM org.apache.solr.update.DirectUpdateHandler2 commit
INFO: start
commit(optimize=true,waitFlush=false,waitSearcher=true,expungeDeletes=false)
Mar 17, 2011 5:08:20 PM org.apache.solr.core.SolrDeletionPolicy onCommit
INFO: SolrDeletionPolicy.onCommit: commits:num=2
commit{dir=/local/home/neha/ruby/Solr/apache-solr-1.4.1/example/solr/data/index,segFN=segments_k,version=1300286691490,generation=20,filenames=[segments_k]
commit{dir=/local/home/neha/ruby/Solr/apache-solr-1.4.1/example/solr/data/index,segFN=segments_l,version=1300286691491,generation=21,filenames=[segments_l]
Mar 17, 2011 5:08:20 PM org.apache.solr.core.SolrDeletionPolicy
updateCommits
INFO: newest commit = 1300286691491
Mar 17, 2011 5:08:20 PM org.apache.solr.search.SolrIndexSearcher
INFO: Opening Searcher@d1329 main
Mar 17, 2011 5:08:20 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming Searcher@d1329 main from Searcher@1dcc2a3 main
fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=8,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0,item_subject_topic_facet={field=subject_topic_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_subject_geo_facet={field=subject_geo_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_subject_era_facet={field=subject_era_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_pub_date={field=pub_date,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_language_facet={field=language_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_lc_b4cutter_facet={field=lc_b4cutter_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_lc_alpha_facet={field=lc_alpha_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_lc_1letter_facet={field=lc_1letter_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2}}
Mar 17, 2011 5:08:20 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming result for Searcher@d1329 main
fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming Searcher@d1329 main from Searcher@1dcc2a3 main
filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=2,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming result for Searcher@d1329 main
filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=2,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming Searcher@d1329 main from Searcher@1dcc2a3 main
queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=2,evictions=0,size=2,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming result for Searcher@d1329 main
queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=2,evictions=0,size=2,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming Searcher@d1329 main from Searcher@1dcc2a3 main
documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming result for Searcher@d1329 main
documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.core.QuerySenderListener newSearcher
INFO: QuerySenderListener sending requests to Searcher@d1329 main
Mar 17, 2011 5:08:20 PM org.apache.solr.request.UnInvertedField uninvert
INFO: UnInverted multi-valued field
{field=lc_1letter_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.request.UnInvertedField uninvert
INFO: UnInverted multi-valued field
{field=lc_alpha_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.request.UnInvertedField uninvert
INFO: UnInverted multi-valued field
{field=lc_b4cutter_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.request.UnInvertedField uninvert
INFO: UnInverted multi-valued field
{field=language_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.request.UnInvertedField uninvert
INFO: UnInverted multi-valued field
{field=pub_date,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.request.UnInvertedField uninvert
INFO: UnInverted multi-valued field
{field=subject_era_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.request.UnInvertedField uninvert
INFO: UnInverted multi-valued field
{field=subject_geo_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.request.UnInvertedField uninvert
INFO: UnInverted multi-valued field
{field=subject_topic_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.core.SolrCore execute
INFO: [] webapp=null path=null
params={facet=true&fl=score&facet.mincount=1&event=newSearcher&f.lc_1letter_facet.facet.sort=false&facet.limit=10&facet.field=format&facet.field=lc_1letter_facet&facet.field=lc_alpha_facet&facet.field=lc_b4cutter_facet&facet.field=language_facet&facet.field=pub_date&facet.field=subject_era_facet&facet.field=subject_geo_facet&facet.field=subject_topic_facet&rows=0}
hits=0 status=0 QTime=2
Mar 17, 2011 5:08:20 PM org.apache.solr.core.SolrCore execute
INFO: [] webapp=null path=null
params={facet=true&fl=score&facet.mincount=1&event=newSearcher&f.lc_1letter_facet.facet.sort=false&q=id:00282214&facet.limit=10&facet.field=format&facet.field=lc_1letter_facet&facet.field=lc_alpha_facet&facet.field=lc_b4cutter_facet&facet.field=language_facet&facet.field=pub_date&facet.field=subject_era_facet&facet.field=subject_geo_facet&facet.field=subject_topic_facet&qt=standard&rows=0}
hits=0 status=0 QTime=0
Mar 17, 2011 5:08:20 PM org.apache.solr.core.QuerySenderListener newSearcher
INFO: QuerySenderListener done.
Mar 17, 2011 5:08:20 PM
org.apache.solr.handler.component.SpellCheckComponent$SpellCheckerListener
newSearcher
INFO: Index is not optimized therefore skipping building spell check index
for: default
Mar 17, 2011 5:08:20 PM
org.apache.solr.handler.component.SpellCheckComponent$SpellCheckerListener
newSearcher
INFO: Index is not optimized therefore skipping building spell check index
for: author
Mar 17, 2011 5:08:20 PM
org.apache.solr.handler.component.SpellCheckComponent$SpellCheckerListener
newSearcher
INFO: Index is not optimized therefore skipping building spell check index
for: subject
Mar 17, 2011 5:08:20 PM
org.apache.solr.handler.component.SpellCheckComponent$SpellCheckerListener
newSearcher
INFO: Index is not optimized therefore skipping building spell check index
for: title
Mar 17, 2011 5:08:20 PM org.apache.solr.core.SolrCore registerSearcher
INFO: [] Registered new searcher Searcher@d1329 main
Mar 17, 2011 5:08:20 PM org.apache.solr.search.SolrIndexSearcher close
INFO: Closing Searcher@1dcc2a3 main
fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=8,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0,item_subject_topic_facet={field=subject_topic_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_subject_geo_facet={field=subject_geo_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_subject_era_facet={field=subject_era_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_pub_date={field=pub_date,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_language_facet={field=language_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_lc_b4cutter_facet={field=lc_b4cutter_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_lc_alpha_facet={field=lc_alpha_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_lc_1letter_facet={field=lc_1letter_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2}}
filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=2,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=2,evictions=0,size=2,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.update.DirectUpdateHandler2 commit
INFO: end_commit_flush
Mar 17, 2011 5:08:20 PM org.apache.solr.handler.dataimport.SolrWriter
readIndexerProperties
INFO: Read dataimport.properties
Mar 17, 2011 5:08:20 PM org.apache.solr.handler.dataimport.SolrWriter
persist
INFO: Wrote last indexed time to dataimport.properties
Mar 17, 2011 5:08:20 PM org.apache.solr.handler.dataimport.DocBuilder
execute
INFO: Time taken = 0:0:0.24
##########################
Link to schema.xml and solconfig.xml files are
https://github.com/projectblacklight/blacklight-jetty/blob/master/solr/conf/schema.xml
https://github.com/projectblacklight/blacklight-jetty/blob/master/solr/conf/solrconfig.xml
data-config.xml file
#############
-
######################
PLease help me with this issue.
Thanks,
Neha
--
View this message in context: http://lucene.472066.n3.nabble.com/DIH-Issue-newbie-to-solr-tp2695340p2695340.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: DIH Issue(newbie to solr)
Posted by neha <pn...@yahoo.com>.
Hello Gora,
I have a new Issue:
http://lucene.472066.n3.nabble.com/Concatenate-multivalued-DIH-fields-td2749988.html
I haven't got enough help on this issue, Please could you advice me on
solving this.
Thanks,
Neha
-----
Thanks,
Neha
--
View this message in context: http://lucene.472066.n3.nabble.com/DIH-Issue-newbie-to-solr-tp2695407p2758500.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: DIH Issue(newbie to solr)
Posted by Gora Mohanty <go...@mimirtech.com>.
On Mon, Mar 21, 2011 at 10:59 PM, neha <pn...@yahoo.com> wrote:
> Thanks Gora it works..!!! Thanks again. One last question, the documents get
> indexed well and all but when I issue full-import command it still says
> Total Requests made to DataSource 0
[...]
Not sure why that is, but would guess that it is something to do with
how a FileDataSource is used. Unfortunately, I do not have the time
to test this right now, but you could check if you get the same zero
requests with the RSS indexing example in example/example-DIH/solr/rss/
in the Solr distribution?
Regards,
Gora
Re: DIH Issue(newbie to solr)
Posted by neha <pn...@yahoo.com>.
Thanks Gora it works..!!! Thanks again. One last question, the documents get
indexed well and all but when I issue full-import command it still says
Total Requests made to DataSource 0
Would you know why this could happen.
Neha
--
View this message in context: http://lucene.472066.n3.nabble.com/DIH-Issue-newbie-to-solr-tp2695407p2710876.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: DIH Issue(newbie to solr)
Posted by neha <pn...@yahoo.com>.
Thanks Gora...it works..!!!! Thanks again..:)
Neha
--
View this message in context: http://lucene.472066.n3.nabble.com/DIH-Issue-newbie-to-solr-tp2695407p2710864.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: DIH Issue(newbie to solr)
Posted by Gora Mohanty <go...@mimirtech.com>.
On Mon, Mar 21, 2011 at 9:45 PM, neha <pn...@yahoo.com> wrote:
> Hi Gora,
> The absolute path solved the issue, but in a weird situation though.
Great. That should be most of your issue solved.
> The
> index files are being written to ..../example/solr/data/index instead of
> .....example/test/solr/data/index.
>
> I run start jetty with ./test/solr/ as home would you know why this is
> happening.
>
> PS: While starting with creating anew project /test/solr/ I copied the data
> directory from ..../example/solr/data/index. DO you think that is causing an
> issue, if yes what needs to be changed.
Just copying the data directory should not have made a difference,
though you did not need to do that: Starting Jetty would create a
data directory if it did not already exist.
What I suspect has also happened is that you are using a solrconfig.xml
from elsewhere. solrconfig.xml has a dataDir attribute that notes where
the Solr index is to be stored.
Regards,
Gora
Re: DIH Issue(newbie to solr)
Posted by neha <pn...@yahoo.com>.
Hi Gora,
The absolute path solved the issue, but in a weird situation though. The
index files are being written to ..../example/solr/data/index instead of
.....example/test/solr/data/index.
I run start jetty with ./test/solr/ as home would you know why this is
happening.
PS: While starting with creating anew project /test/solr/ I copied the data
directory from ..../example/solr/data/index. DO you think that is causing an
issue, if yes what needs to be changed.
Thanks,
Neha
--
View this message in context: http://lucene.472066.n3.nabble.com/DIH-Issue-newbie-to-solr-tp2695407p2710560.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: DIH Issue(newbie to solr)
Posted by Lance Norskog <go...@gmail.com>.
In general, it works best to start with one of the examples and slowly
change it to match what you want.
On Sun, Mar 20, 2011 at 10:16 PM, Gora Mohanty <go...@mimirtech.com> wrote:
> (Sorry for the delay in replying: Was a little busy this weekend.)
> On Sun, Mar 20, 2011 at 5:20 AM, neha <pn...@yahoo.com> wrote:
>> The path is correct and also the base dir points to the list of .xml files
>> not just a single file.
>
> OK.
>
>> This is the link to the xml file:
>
> Another thing that I see is that the xpath in your field entries
> is a relative one. I think, though am not 100% sure, that it needs
> to be an absolute one, i.e., xpath="/sciserv/sci_article/journal/issn",
> instead of xpath="/journal/issn".
>
> Please take a look at the setup for XPathEntityProcessor in
> example/example-DIH/solr/rss/conf/rss-data-config.xml under
> the main Solr data directory. You can compare the xpath
> definitions to the structure of the XML in the Atom feed that
> it indexes.
>
> Regards,
> Gora
>
--
Lance Norskog
goksron@gmail.com
Re: DIH Issue(newbie to solr)
Posted by Gora Mohanty <go...@mimirtech.com>.
(Sorry for the delay in replying: Was a little busy this weekend.)
On Sun, Mar 20, 2011 at 5:20 AM, neha <pn...@yahoo.com> wrote:
> The path is correct and also the base dir points to the list of .xml files
> not just a single file.
OK.
> This is the link to the xml file:
Another thing that I see is that the xpath in your field entries
is a relative one. I think, though am not 100% sure, that it needs
to be an absolute one, i.e., xpath="/sciserv/sci_article/journal/issn",
instead of xpath="/journal/issn".
Please take a look at the setup for XPathEntityProcessor in
example/example-DIH/solr/rss/conf/rss-data-config.xml under
the main Solr data directory. You can compare the xpath
definitions to the structure of the XML in the Atom feed that
it indexes.
Regards,
Gora
Re: DIH Issue(newbie to solr)
Posted by neha <pn...@yahoo.com>.
The path is correct and also the base dir points to the list of .xml files
not just a single file.
This is the link to the xml file:
http://pastebin.com/7EzRUj9L
Thanks,
Neha
--
View this message in context: http://lucene.472066.n3.nabble.com/DIH-Issue-newbie-to-solr-tp2695407p2704182.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: DIH Issue(newbie to solr)
Posted by Gora Mohanty <go...@mimirtech.com>.
On Fri, Mar 18, 2011 at 11:52 PM, neha <pn...@yahoo.com> wrote:
> Here are the links to the file
[...]
> Data-config.xml
>
> http://pastebin.com/ncXr1LzV
[...]
One thing that immediately jumps out is the baseDir
attribute in your top-level entry. You have
baseDir=/local/home/abc/ruby/Solr/apache-solr-1.4.1/example/test/solr/data/data/ejc_xml
This should be the path to the directory containing
the .xml files that you are indexing, and not a path
to an individual file. Also, the path '... /data/data ...
looks a little suspect, and does not seem to match
the paths indicated in your Solr log files, though it
is hard for us to tell whether the path is correct.
If the above suggestions do not fix your problems,
could you please also share a sample .xml file
that you are trying to index?
Regards,
Gora
Re: DIH Issue(newbie to solr)
Posted by neha <pn...@yahoo.com>.
Here are the links to the file
SOlr Response
http://pastebin.com/3KJhAe2q
Schema.xml
https://github.com/projectblacklight/blacklight-jetty/blob/master/solr/conf/schema.xml
SOlrConfil.xml
https://github.com/projectblacklight/blacklight-jetty/blob/master/solr/conf/solrconfig.xml
Data-config.xml
http://pastebin.com/ncXr1LzV
An observation, not sure if it is helpful to pinpoint the issue, I get this
message when i try too do a full import
SolrDeletionPolicy.onInit: commits:num=1 error
Stack Trace:
####################
INFO: SolrDeletionPolicy.onInit: commits:num=1
commit{dir=/local/home/abc/ruby/Solr/apache-solr-1.4.1/example/solr/data/index,segFN=segments_k,version=1300286691490,generation=20,filenames=[segments_k]
Mar 17, 2011 5:08:20 PM org.apache.solr.core.SolrDeletionPolicy
updateCommits
INFO: newest commit = 1300286691490
Mar 17, 2011 5:08:20 PM org.apache.solr.handler.dataimport.DocBuilder finish
INFO: Import completed successfully
Mar 17, 2011 5:08:20 PM org.apache.solr.update.DirectUpdateHandler2 commit
INFO: start
commit(optimize=true,waitFlush=false,waitSearcher=true,expungeDeletes=false)
Mar 17, 2011 5:08:20 PM org.apache.solr.core.SolrDeletionPolicy onCommit
INFO: SolrDeletionPolicy.onCommit: commits:num=2
commit{dir=/local/home/abc/ruby/Solr/apache-solr-1.4.1/example/solr/data/index,segFN=segments_k,version=1300286691490,generation=20,filenames=[segments_k]
commit{dir=/local/home/abc/ruby/Solr/apache-solr-1.4.1/example/solr/data/index,segFN=segments_l,version=1300286691491,generation=21,filenames=[segments_l]
Mar 17, 2011 5:08:20 PM org.apache.solr.core.SolrDeletionPolicy
updateCommits
INFO: newest commit = 1300286691491
Mar 17, 2011 5:08:20 PM org.apache.solr.search.SolrIndexSearcher
INFO: Opening Searcher@d1329 main
Mar 17, 2011 5:08:20 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming Searcher@d1329 main from Searcher@1dcc2a3 main
fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=8,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0,item_subject_topic_facet={field=subject_topic_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_subject_geo_facet={field=subject_geo_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_subject_era_facet={field=subject_era_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_pub_date={field=pub_date,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_language_facet={field=language_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_lc_b4cutter_facet={field=lc_b4cutter_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_lc_alpha_facet={field=lc_alpha_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_lc_1letter_facet={field=lc_1letter_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2}}
Mar 17, 2011 5:08:20 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming result for Searcher@d1329 main
fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming Searcher@d1329 main from Searcher@1dcc2a3 main
filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=2,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming result for Searcher@d1329 main
filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=2,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming Searcher@d1329 main from Searcher@1dcc2a3 main
queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=2,evictions=0,size=2,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming result for Searcher@d1329 main
queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=2,evictions=0,size=2,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming Searcher@d1329 main from Searcher@1dcc2a3 main
documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.search.SolrIndexSearcher warm
INFO: autowarming result for Searcher@d1329 main
documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.core.QuerySenderListener newSearcher
INFO: QuerySenderListener sending requests to Searcher@d1329 main
Mar 17, 2011 5:08:20 PM org.apache.solr.request.UnInvertedField uninvert
INFO: UnInverted multi-valued field
{field=lc_1letter_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.request.UnInvertedField uninvert
INFO: UnInverted multi-valued field
{field=lc_alpha_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.request.UnInvertedField uninvert
INFO: UnInverted multi-valued field
{field=lc_b4cutter_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.request.UnInvertedField uninvert
INFO: UnInverted multi-valued field
{field=language_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.request.UnInvertedField uninvert
INFO: UnInverted multi-valued field
{field=pub_date,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.request.UnInvertedField uninvert
INFO: UnInverted multi-valued field
{field=subject_era_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.request.UnInvertedField uninvert
INFO: UnInverted multi-valued field
{field=subject_geo_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.request.UnInvertedField uninvert
INFO: UnInverted multi-valued field
{field=subject_topic_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.core.SolrCore execute
INFO: [] webapp=null path=null
params={facet=true&fl=score&facet.mincount=1&event=newSearcher&f.lc_1letter_facet.facet.sort=false&facet.limit=10&facet.field=format&facet.field=lc_1letter_facet&facet.field=lc_alpha_facet&facet.field=lc_b4cutter_facet&facet.field=language_facet&facet.field=pub_date&facet.field=subject_era_facet&facet.field=subject_geo_facet&facet.field=subject_topic_facet&rows=0}
hits=0 status=0 QTime=2
Mar 17, 2011 5:08:20 PM org.apache.solr.core.SolrCore execute
INFO: [] webapp=null path=null
params={facet=true&fl=score&facet.mincount=1&event=newSearcher&f.lc_1letter_facet.facet.sort=false&q=id:00282214&facet.limit=10&facet.field=format&facet.field=lc_1letter_facet&facet.field=lc_alpha_facet&facet.field=lc_b4cutter_facet&facet.field=language_facet&facet.field=pub_date&facet.field=subject_era_facet&facet.field=subject_geo_facet&facet.field=subject_topic_facet&qt=standard&rows=0}
hits=0 status=0 QTime=0
Mar 17, 2011 5:08:20 PM org.apache.solr.core.QuerySenderListener newSearcher
INFO: QuerySenderListener done.
Mar 17, 2011 5:08:20 PM
org.apache.solr.handler.component.SpellCheckComponent$SpellCheckerListener
newSearcher
INFO: Index is not optimized therefore skipping building spell check index
for: default
Mar 17, 2011 5:08:20 PM
org.apache.solr.handler.component.SpellCheckComponent$SpellCheckerListener
newSearcher
INFO: Index is not optimized therefore skipping building spell check index
for: author
Mar 17, 2011 5:08:20 PM
org.apache.solr.handler.component.SpellCheckComponent$SpellCheckerListener
newSearcher
INFO: Index is not optimized therefore skipping building spell check index
for: subject
Mar 17, 2011 5:08:20 PM
org.apache.solr.handler.component.SpellCheckComponent$SpellCheckerListener
newSearcher
INFO: Index is not optimized therefore skipping building spell check index
for: title
Mar 17, 2011 5:08:20 PM org.apache.solr.core.SolrCore registerSearcher
INFO: [] Registered new searcher Searcher@d1329 main
Mar 17, 2011 5:08:20 PM org.apache.solr.search.SolrIndexSearcher close
INFO: Closing Searcher@1dcc2a3 main
fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=8,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0,item_subject_topic_facet={field=subject_topic_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_subject_geo_facet={field=subject_geo_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_subject_era_facet={field=subject_era_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_pub_date={field=pub_date,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_language_facet={field=language_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_lc_b4cutter_facet={field=lc_b4cutter_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_lc_alpha_facet={field=lc_alpha_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2},item_lc_1letter_facet={field=lc_1letter_facet,memSize=4224,tindexSize=32,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=2}}
filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=2,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=2,evictions=0,size=2,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Mar 17, 2011 5:08:20 PM org.apache.solr.update.DirectUpdateHandler2 commit
INFO: end_commit_flush
Mar 17, 2011 5:08:20 PM org.apache.solr.handler.dataimport.SolrWriter
readIndexerProperties
INFO: Read dataimport.properties
Mar 17, 2011 5:08:20 PM org.apache.solr.handler.dataimport.SolrWriter
persist
INFO: Wrote last indexed time to dataimport.properties
Mar 17, 2011 5:08:20 PM org.apache.solr.handler.dataimport.DocBuilder
execute
INFO: Time taken = 0:0:0.24
##############
Thanks,
Neha
--
View this message in context: http://lucene.472066.n3.nabble.com/DIH-Issue-newbie-to-solr-tp2695407p2699042.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: DIH Issue(newbie to solr)
Posted by Gora Mohanty <go...@mimirtech.com>.
On Fri, Mar 18, 2011 at 2:45 AM, neha <pn...@yahoo.com> wrote:
> I am a newbie to solr I have an issue with DIH but unable to pinpoint what is
> causing the issue. I am using the demo jetty installation of Solr and tried
> to create a project with new schema.xml, solrconfig.xml and data-config.xml
> files. when I run
> "http://131.187.88.221:8983/solr/dataimport?command=full-import" this is
> what I get:
> I am unable to index documents(it doesn't throw any error though).
[...]
> Indexing completed. Added/Updated: 0 documents. Deleted 0 documents.
[...]
Looks like no documents are getting selected. Could you show us
data-config.xml and schema.xml, preferably by uploading them to
pastebin.com, and posting the links here?
Regards,
Gora
P.S. You might want to hide the IP address of your Solr when posting
to a public list.