You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by sunnyfr <jo...@gmail.com> on 2009/02/19 11:17:41 UTC
delta-import or update for one special ID
Hi
I looked for a book that I couldn't find in solr's databe.
How can I update just this one by the command in the Url ... I tried :
But it doesn't seems to work ??
dataimport?command=full-import&clean=false&start=11289500&rows=100
Is there another way ??? maybe the book can't be updated but how can I check
why ??
Thanks a lot
--
View this message in context: http://www.nabble.com/delta-import-or-update-for-one-special-ID-tp22097433p22097433.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: delta-import or update for one special ID
Posted by sunnyfr <jo...@gmail.com>.
It looks like books which have no link with entity are not took in
consideration ???
part of my data-config.xml:
<entity name="rel_group_ids"
query="SELECT group_id AS rel_group_ids FROM group_has_books
WHERE book_id=${book.id} AND pending='n'" />
Is it normal ?
sunnyfr wrote:
>
> Hi,
> Thanks Paul
>
> I did that :
> book/dataimport?command=full-import&clean=false&start=9327553&rows=1&debugQuery=true
>
> but it stays stuck like that :
> <lst name="statusMessages">
> <str name="Time Elapsed">0:2:10.979</str>
> <str name="Total Requests made to DataSource">1</str>
> <str name="Total Rows Fetched">0</str>
> <str name="Total Documents Processed">0</str>
> <str name="Total Documents Skipped">0</str>
> <str name="Full Dump Started">2009-02-19 13:06:23</str>
> </lst>
>
> but with another Id it works and I've no error ...? and if I make the
> request straight in MySql database i've the row which come up properly.
>
> what else can I do ... check ??
>
> thanks a lot,
>
>
> Noble Paul നോബിള് नोब्ळ् wrote:
>>
>> the start and rows is supposed to work . If you put it into debug you
>> may see what is happening
>>
>> On Thu, Feb 19, 2009 at 3:47 PM, sunnyfr <jo...@gmail.com> wrote:
>>>
>>> Hi
>>>
>>> I looked for a book that I couldn't find in solr's databe.
>>> How can I update just this one by the command in the Url ... I tried :
>>> But it doesn't seems to work ??
>>>
>>> dataimport?command=full-import&clean=false&start=11289500&rows=100
>>>
>>> Is there another way ??? maybe the book can't be updated but how can I
>>> check
>>> why ??
>>>
>>> Thanks a lot
>>> --
>>> View this message in context:
>>> http://www.nabble.com/delta-import-or-update-for-one-special-ID-tp22097433p22097433.html
>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>
>>>
>>
>>
>>
>> --
>> --Noble Paul
>>
>>
>
>
--
View this message in context: http://www.nabble.com/delta-import-or-update-for-one-special-ID-tp22097433p22099470.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: delta-import or update for one special ID
Posted by sunnyfr <jo...@gmail.com>.
It looks like it did update the document,
I've just done :
book/dataimport?command=full-import&clean=false&start=9327553&rows=1&debug=on&verbose=true&commit=true
and I've :
Feb 19 15:20:02 search-07 jsvc.exec[3233]: Feb 19, 2009 3:20:02 PM
org.apache.solr.core.SolrCore execute INFO: [group] webapp=null path=null
params={q=static+newSearcher+warming+query+from+solrconfig.xml} hits=1103
status=0 QTime=17 Feb 19, 2009 3:20:02 PM
org.apache.solr.core.QuerySenderListener newSearcher INFO:
QuerySenderListener done. Feb 19, 2009 3:20:02 PM
org.apache.solr.core.SolrCore registerSearcher INFO: [group] Registered new
searcher Searcher@69c01ba9 main Feb 19, 2009 3:20:02 PM
org.apache.solr.search.SolrIndexSearcher close INFO: Closing
Searcher@34fe315d main
^IfilterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
^IqueryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=2,evictions=0,size=2,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
^IdocumentCache{lookups=0,hits=0,hitratio=0.00,inse
Feb 19 15:20:02 search-07 jsvc.exec[3233]:
0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Feb 19 15:20:02 search-07 jsvc.exec[3233]: Feb 19, 2009 3:20:02 PM
org.apache.solr.update.processor.LogUpdateProcessor finish INFO: {commit=} 0
268
Feb 19 15:20:02 search-07 jsvc.exec[3233]: Feb 19, 2009 3:20:02 PM
org.apache.solr.core.SolrCore execute INFO: [group] webapp=/solr
path=/update params={} status=0 QTime=268
Feb 19 15:24:09 search-07 jsvc.exec[3233]: Feb 19, 2009 3:24:09 PM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a
connection for entity rel_group_ids with URL:
jdbc:mysql://master-spare.vip.dailymotion.com/dailymotion?characterEncoding=UTF-8&characterSetResults=UTF-8
Feb 19 15:24:09 search-07 jsvc.exec[3233]: Feb 19, 2009 3:24:09 PM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken
for getConnection(): 12
Feb 19 15:24:09 search-07 jsvc.exec[3233]: Feb 19, 2009 3:24:09 PM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a
connection for entity rel_playlist_ids with URL:
jdbc:mysql://master-spare.vip.dailymotion.com/dailymotion?characterEncoding=UTF-8&characterSetResults=UTF-8
Feb 19 15:24:09 search-07 jsvc.exec[3233]: Feb 19, 2009 3:24:09 PM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken
for getConnection(): 5
Feb 19 15:24:09 search-07 jsvc.exec[3233]: Feb 19, 2009 3:24:09 PM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a
connection for entity rel_fan_ids with URL:
jdbc:mysql://master-spare.vip.dailymotion.com/dailymotion?characterEncoding=UTF-8&characterSetResults=UTF-8
Feb 19 15:24:09 search-07 jsvc.exec[3233]: Feb 19, 2009 3:24:09 PM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken
for getConnection(): 5
Feb 19 15:24:09 search-07 jsvc.exec[3233]: Feb 19, 2009 3:24:09 PM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a
connection for entity rel_featured_home_country with URL:
jdbc:mysql://master-spare.vip.dailymotion.com/dailymotion?characterEncoding=UTF-8&characterSetResults=UTF-8
Feb 19 15:24:09 search-07 jsvc.exec[3233]: Feb 19, 2009 3:24:09 PM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken
for getConnection(): 5
Feb 19 15:24:09 search-07 jsvc.exec[3233]: Feb 19, 2009 3:24:09 PM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a
connection for entity rel_featured_user_ids with URL:
jdbc:mysql://master-spare.vip.dailymotion.com/dailymotion?characterEncoding=UTF-8&characterSetResults=UTF-8
Feb 19 15:24:09 search-07 jsvc.exec[3233]: Feb 19, 2009 3:24:09 PM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken
for getConnection(): 5
Feb 19 15:24:09 search-07 jsvc.exec[3233]: Feb 19, 2009 3:24:09 PM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a
connection for entity rel_featured_group_ids with URL:
jdbc:mysql://master-spare.vip.dailymotion.com/dailymotion?characterEncoding=UTF-8&characterSetResults=UTF-8
Feb 19 15:24:09 search-07 jsvc.exec[3233]: Feb 19, 2009 3:24:09 PM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken
for getConnection(): 6
Feb 19 15:24:10 search-07 jsvc.exec[3233]: Feb 19, 2009 3:24:10 PM
org.apache.solr.core.SolrDeletionPolicy onInit INFO:
SolrDeletionPolicy.onInit: commits:num=1
^Icommit{dir=/data/solr/book/data/index,segFN=segments_4zo9,version=1228743261094,generation=232857,filenames=[segments_4zo9,
_5k9m.fnm, _5k9m.frq, _5k9m.prx, _5k9m.tis, _5k9m.tii, _5k9m.nrm, _5k9m.tvx,
_5k9m.tvf, _5k9m.tvd, _5k9m.fdx, _5k9m.fdt]
Feb 19 15:24:10 search-07 jsvc.exec[3233]: Feb 19, 2009 3:24:10 PM
org.apache.solr.core.SolrDeletionPolicy updateCommits INFO: last commit =
1228743261094
Feb 19 15:24:10 search-07 jsvc.exec[3233]: Feb 19, 2009 3:24:10 PM
org.apache.solr.handler.dataimport.DataImportHandler$1 upload INFO: Indexing
stopped at docCount = 1
Feb 19 15:24:10 search-07 jsvc.exec[3233]: Feb 19, 2009 3:24:10 PM
org.apache.solr.handler.dataimport.SolrWriter readIndexerProperties INFO:
Read dataimport.properties
Feb 19 15:24:10 search-07 jsvc.exec[3233]: Feb 19, 2009 3:24:10 PM
org.apache.solr.handler.dataimport.SolrWriter persistStartTime INFO: Wrote
last indexed time to dataimport.properties
Feb 19 15:24:10 search-07 jsvc.exec[3233]: Feb 19, 2009 3:24:10 PM
org.apache.solr.handler.dataimport.DocBuilder commit INFO: Full Import
completed successfully
Feb 19 15:24:10 search-07 jsvc.exec[3233]: Feb 19, 2009 3:24:10 PM
org.apache.solr.update.DirectUpdateHandler2 commit INFO: start
commit(optimize=true,waitFlush=false,waitSearcher=true)
Feb 19 15:25:12 search-07 /USR/SBIN/CRON[4329]: (root) CMD ([ -x
/usr/lib/sysstat/sa1 ] && { [ -r "$DEFAULT" ] && . "$DEFAULT" ; [ "$ENABLED"
= "true" ] && exec /usr/lib/sysstat/sa1 $SA1_OPTIONS 1 1 ; })
Feb 19 15:25:13 search-07 jsvc.exec[3233]: Feb 19, 2009 3:25:13 PM
org.apache.solr.update.DirectUpdateHandler2 commit INFO: start
commit(optimize=false,waitFlush=false,waitSearcher=true)
Feb 19 15:25:13 search-07 jsvc.exec[3233]: Feb 19, 2009 3:25:13 PM
org.apache.solr.search.SolrIndexSearcher <init> INFO: Opening
Searcher@6d3136e5 main
Feb 19 15:25:13 search-07 jsvc.exec[3233]: Feb 19, 2009 3:25:13 PM
org.apache.solr.update.DirectUpdateHandler2 commit INFO: end_commit_flush
Feb 19, 2009 3:25:13 PM org.apache.solr.search.SolrIndexSearcher warm INFO:
autowarming Searcher@6d3136e5 main from Searcher@5fa13338 main
^IfilterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Feb 19 15:25:13 search-07 jsvc.exec[3233]: Feb 19, 2009 3:25:13 PM
org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming result for
Searcher@6d3136e5 main
^IfilterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Feb 19 15:25:13 search-07 jsvc.exec[3233]: Feb 19, 2009 3:25:13 PM
org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming
Searcher@6d3136e5 main from Searcher@5fa13338 main
^IqueryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=3,evictions=0,size=3,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Feb 19 15:25:13 search-07 jsvc.exec[3233]: Feb 19, 2009 3:25:13 PM
org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming result for
Searcher@6d3136e5 main
^IqueryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Feb 19 15:25:13 search-07 jsvc.exec[3233]: Feb 19, 2009 3:25:13 PM
org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming
Searcher@6d3136e5 main from Searcher@5fa13338 main
^IdocumentCache{lookups=0,hits=0,hitratio=0.00,inserts=29,evictions=0,size=29,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Feb 19 15:25:13 search-07 jsvc.exec[3233]: Feb 19, 2009 3:25:13 PM
org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming result for
Searcher@6d3136e5 main
^IdocumentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0}
Feb 19 15:25:13 search-07 jsvc.exec[3233]: Feb 19, 2009 3:25:13 PM
org.apache.solr.core.QuerySenderListener newSearcher INFO:
QuerySenderListener sending requests to Searcher@6d3136e5 main
Feb 19 15:25:13 search-07 jsvc.exec[3233]: Feb 19, 2009 3:25:13 PM
org.apache.solr.core.SolrCore execute INFO: [user] webapp=null path=null
params={start=0&q=solr&rows=10} hits=9 status=0 QTime=1 Feb 19, 2009
3:25:13 PM org.apache.solr.core.SolrCore execute INFO: [user] webapp=null
path=null params={start=0&q=rocks&rows=10} hits=16983 status=0 QTime=2
But when I look for it, it doesn't appear :
:8180/solr/book/select?q=id:9327553
response>
−
<lst name="responseHeader">
<int name="status">0</int>
<int name="QTime">12</int>
−
<lst name="params">
<str name="q">id:9327553</str>
</lst>
</lst>
<result name="response" numFound="0" start="0"/>
</response>
Maybe the warmup, but I've no warmup maybe just 30 so almost nothing.
Noble Paul നോബിള് नोब्ळ् wrote:
>
> I was referring to the DIH debug page.
>
> But apparently, in some cases it seems to be working for you. can you
> elaborate , when does it work and when it doesn't?
>
> On Thu, Feb 19, 2009 at 5:38 PM, sunnyfr <jo...@gmail.com> wrote:
>>
>> Hi,
>> Thanks Paul
>>
>> I did that :
>> book/dataimport?command=full-import&clean=false&start=9327553&rows=1&debugQuery=true
>>
>> but it stays stuck like that :
>> <lst name="statusMessages">
>> <str name="Time Elapsed">0:2:10.979</str>
>> <str name="Total Requests made to DataSource">1</str>
>> <str name="Total Rows Fetched">0</str>
>> <str name="Total Documents Processed">0</str>
>> <str name="Total Documents Skipped">0</str>
>> <str name="Full Dump Started">2009-02-19 13:06:23</str>
>> </lst>
>>
>> but with another Id it works and I've no error ...? and if I make the
>> request straight in MySql database i've the row which come up properly.
>>
>> what else can I do ... check ??
>>
>> thanks a lot,
>>
>>
>> Noble Paul നോബിള് नोब्ळ् wrote:
>>>
>>> the start and rows is supposed to work . If you put it into debug you
>>> may see what is happening
>>>
>>> On Thu, Feb 19, 2009 at 3:47 PM, sunnyfr <jo...@gmail.com> wrote:
>>>>
>>>> Hi
>>>>
>>>> I looked for a book that I couldn't find in solr's databe.
>>>> How can I update just this one by the command in the Url ... I tried :
>>>> But it doesn't seems to work ??
>>>>
>>>> dataimport?command=full-import&clean=false&start=11289500&rows=100
>>>>
>>>> Is there another way ??? maybe the book can't be updated but how can I
>>>> check
>>>> why ??
>>>>
>>>> Thanks a lot
>>>> --
>>>> View this message in context:
>>>> http://www.nabble.com/delta-import-or-update-for-one-special-ID-tp22097433p22097433.html
>>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>>
>>>>
>>>
>>>
>>>
>>> --
>>> --Noble Paul
>>>
>>>
>>
>> --
>> View this message in context:
>> http://www.nabble.com/delta-import-or-update-for-one-special-ID-tp22097433p22099000.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
>>
>
>
>
> --
> --Noble Paul
>
>
--
View this message in context: http://www.nabble.com/delta-import-or-update-for-one-special-ID-tp22097433p22101733.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: delta-import or update for one special ID
Posted by Noble Paul നോബിള് नोब्ळ् <no...@gmail.com>.
I was referring to the DIH debug page.
But apparently, in some cases it seems to be working for you. can you
elaborate , when does it work and when it doesn't?
On Thu, Feb 19, 2009 at 5:38 PM, sunnyfr <jo...@gmail.com> wrote:
>
> Hi,
> Thanks Paul
>
> I did that :
> book/dataimport?command=full-import&clean=false&start=9327553&rows=1&debugQuery=true
>
> but it stays stuck like that :
> <lst name="statusMessages">
> <str name="Time Elapsed">0:2:10.979</str>
> <str name="Total Requests made to DataSource">1</str>
> <str name="Total Rows Fetched">0</str>
> <str name="Total Documents Processed">0</str>
> <str name="Total Documents Skipped">0</str>
> <str name="Full Dump Started">2009-02-19 13:06:23</str>
> </lst>
>
> but with another Id it works and I've no error ...? and if I make the
> request straight in MySql database i've the row which come up properly.
>
> what else can I do ... check ??
>
> thanks a lot,
>
>
> Noble Paul നോബിള് नोब्ळ् wrote:
>>
>> the start and rows is supposed to work . If you put it into debug you
>> may see what is happening
>>
>> On Thu, Feb 19, 2009 at 3:47 PM, sunnyfr <jo...@gmail.com> wrote:
>>>
>>> Hi
>>>
>>> I looked for a book that I couldn't find in solr's databe.
>>> How can I update just this one by the command in the Url ... I tried :
>>> But it doesn't seems to work ??
>>>
>>> dataimport?command=full-import&clean=false&start=11289500&rows=100
>>>
>>> Is there another way ??? maybe the book can't be updated but how can I
>>> check
>>> why ??
>>>
>>> Thanks a lot
>>> --
>>> View this message in context:
>>> http://www.nabble.com/delta-import-or-update-for-one-special-ID-tp22097433p22097433.html
>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>
>>>
>>
>>
>>
>> --
>> --Noble Paul
>>
>>
>
> --
> View this message in context: http://www.nabble.com/delta-import-or-update-for-one-special-ID-tp22097433p22099000.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
--
--Noble Paul
Re: delta-import or update for one special ID
Posted by sunnyfr <jo...@gmail.com>.
Hi,
Thanks Paul
I did that :
book/dataimport?command=full-import&clean=false&start=9327553&rows=1&debugQuery=true
but it stays stuck like that :
<lst name="statusMessages">
<str name="Time Elapsed">0:2:10.979</str>
<str name="Total Requests made to DataSource">1</str>
<str name="Total Rows Fetched">0</str>
<str name="Total Documents Processed">0</str>
<str name="Total Documents Skipped">0</str>
<str name="Full Dump Started">2009-02-19 13:06:23</str>
</lst>
but with another Id it works and I've no error ...? and if I make the
request straight in MySql database i've the row which come up properly.
what else can I do ... check ??
thanks a lot,
Noble Paul നോബിള് नोब्ळ् wrote:
>
> the start and rows is supposed to work . If you put it into debug you
> may see what is happening
>
> On Thu, Feb 19, 2009 at 3:47 PM, sunnyfr <jo...@gmail.com> wrote:
>>
>> Hi
>>
>> I looked for a book that I couldn't find in solr's databe.
>> How can I update just this one by the command in the Url ... I tried :
>> But it doesn't seems to work ??
>>
>> dataimport?command=full-import&clean=false&start=11289500&rows=100
>>
>> Is there another way ??? maybe the book can't be updated but how can I
>> check
>> why ??
>>
>> Thanks a lot
>> --
>> View this message in context:
>> http://www.nabble.com/delta-import-or-update-for-one-special-ID-tp22097433p22097433.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
>>
>
>
>
> --
> --Noble Paul
>
>
--
View this message in context: http://www.nabble.com/delta-import-or-update-for-one-special-ID-tp22097433p22099000.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: delta-import or update for one special ID
Posted by Noble Paul നോബിള് नोब्ळ् <no...@gmail.com>.
the start and rows is supposed to work . If you put it into debug you
may see what is happening
On Thu, Feb 19, 2009 at 3:47 PM, sunnyfr <jo...@gmail.com> wrote:
>
> Hi
>
> I looked for a book that I couldn't find in solr's databe.
> How can I update just this one by the command in the Url ... I tried :
> But it doesn't seems to work ??
>
> dataimport?command=full-import&clean=false&start=11289500&rows=100
>
> Is there another way ??? maybe the book can't be updated but how can I check
> why ??
>
> Thanks a lot
> --
> View this message in context: http://www.nabble.com/delta-import-or-update-for-one-special-ID-tp22097433p22097433.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
--
--Noble Paul