You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by sunnyfr <jo...@gmail.com> on 2008/10/06 14:52:24 UTC
command still running ??? delta-import
Hi,
A command is still running... How can I know exactly what does it do ?
Cuz really , it looks like it does something, but I've cron job for
delta-import every five minutes and nothing change ..
last 20 minutes I would say, nothing changed at all, row fetched or request
made ..
And I checked log files, no exception there.
It's the first time this delta import has been started after a tomcat
restart, so maybe it's normal.
How can I check what does it really do right now ?
root@solr-test:/data/solr/books/data# ps aux | grep solr
tomcat55 18780 0.0 0.0 9452 1512 ? S 10:45 0:00 /bin/bash
/data/solr/video/bin/snapshooter
root 18786 0.0 0.0 23112 1216 ? S 10:45 0:00 sudo -u
root /data/solr/video/bin/snapshooter
root 18851 0.0 0.0 3944 620 pts/1 S+ 11:17 0:00 grep solr
Thanks a lot guys for all your help,
</lst>
<str name="status">busy</str>
<str name="importResponse">A command is still running...</str>
−
<lst name="statusMessages">
<str name="Time Elapsed">0:28:38.8</str>
<str name="Total Requests made to DataSource">393</str>
<str name="Total Rows Fetched">9184</str>
<str name="Total Documents Processed">55</str>
<str name="Total Documents Skipped">0</str>
<str name="Delta Dump started">2008-10-06 10:45:01</str>
<str name="Identifying Delta">2008-10-06 10:45:01</str>
<str name="Deltas Obtained">2008-10-06 10:45:44</str>
<str name="Building documents">2008-10-06 10:45:44</str>
<str name="Total Changed Documents">8863</str>
</lst>
−
Still the same, 3hours later :
<str name="status">busy</str>
<str name="importResponse">A command is still running...</str>
−
<lst name="statusMessages">
<str name="Time Elapsed">4:1:51.416</str>
<str name="Total Requests made to DataSource">393</str>
<str name="Total Rows Fetched">9184</str>
<str name="Total Documents Processed">55</str>
<str name="Total Documents Skipped">0</str>
<str name="Delta Dump started">2008-10-06 10:45:01</str>
<str name="Identifying Delta">2008-10-06 10:45:01</str>
<str name="Deltas Obtained">2008-10-06 10:45:44</str>
<str name="Building documents">2008-10-06 10:45:44</str>
<str name="Total Changed Documents">8863</str>
</lst>
And my logs :
Oct 6 10:45:01 solr-test /USR/SBIN/CRON[18775]: (root) CMD (/usr/bin/wget
-q --output-document=/home/tot.txt
http://solr-test.adm.dailymotion.com:8180/solr/video/dataimport?command=delta-import&entity=b)
Oct 6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={command=delta-import} status=0 QTime=0 Oct 6, 2008
10:45:01 AM org.apache.solr.handler.dataimport.DataImporter doDeltaImport
INFO: Starting Delta Import
Oct 6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.SolrWriter readIndexerProperties INFO:
Read dataimport.properties
Oct 6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder doDelta INFO: Starting delta
collection.
Oct 6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Running
ModifiedRowKey() for Entity: rel_group_ids
Oct 6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
ModifiedRowKey for Entity: rel_group_ids rows obtained : 0
Oct 6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Running
DeletedRowKey() for Entity: rel_group_ids
Oct 6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
DeletedRowKey for Entity: rel_group_ids rows obtained : 0
Oct 6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
parentDeltaQuery for Entity: rel_group_ids Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Running
ModifiedRowKey() for Entity: rel_playlist_ids Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
ModifiedRowKey for Entity: rel_playlist_ids rows obtained : 0 Oct 6, 2008
10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO:
Running DeletedRowKey() for Entity: rel_playlist_ids Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
DeletedRowKey for Entity: rel_playlist_ids rows obtained : 0 Oct 6, 2008
10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO:
Completed parentDeltaQuery for Entity: rel_playlist_ids Oct 6, 2008 10:45:01
AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Ru
Oct 6 10:45:01 solr-test jsvc.exec[18716]: fan_ids Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
ModifiedRowKey for Entity: rel_fan_ids rows obtained : 0 Oct 6, 2008
10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO:
Running DeletedRowKey() for Entity: rel_fan_ids Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
DeletedRowKey for Entity: rel_fan_ids rows obtained : 0 Oct 6, 2008 10:45:01
AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO:
Completed parentDeltaQuery for Entity: rel_fan_ids Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Running
ModifiedRowKey() for Entity: rel_featured_home_country Oct 6, 2008 10:45:01
AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO:
Completed ModifiedRowKey for Entity: rel_featured_home_country rows obtained
: 0 Oct 6, 2008 10:45:01 AM org.apache.solr.handler.dataimport.DocBuil
Oct 6 10:45:01 solr-test jsvc.exec[18716]: owKey() for Entity:
rel_featured_home_country Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
DeletedRowKey for Entity: rel_featured_home_country rows obtained : 0 Oct 6,
2008 10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta
INFO: Completed parentDeltaQuery for Entity: rel_featured_home_country Oct
6, 2008 10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder
collectDelta INFO: Running ModifiedRowKey() for Entity:
rel_featured_user_ids Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
ModifiedRowKey for Entity: rel_featured_user_ids rows obtained : 0 Oct 6,
2008 10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta
INFO: Running DeletedRowKey() for Entity: rel_featured_user_ids Oct 6, 2008
10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO:
Completed DeletedRowKey for Entity: rel_featured_user_ids rows ob
Oct 6 10:45:01 solr-test jsvc.exec[18716]:
apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
parentDeltaQuery for Entity: rel_featured_user_ids Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Running
ModifiedRowKey() for Entity: rel_featured_group_ids Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
ModifiedRowKey for Entity: rel_featured_group_ids rows obtained : 0 Oct 6,
2008 10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta
INFO: Running DeletedRowKey() for Entity: rel_featured_group_ids Oct 6, 2008
10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO:
Completed DeletedRowKey for Entity: rel_featured_group_ids rows obtained : 0
Oct 6, 2008 10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder
collectDelta INFO: Completed parentDeltaQuery for Entity:
rel_featured_group_ids Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelt
Oct 6 10:45:01 solr-test jsvc.exec[18716]: tity: video Oct 6, 2008 10:45:01
AM org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a
connection for entity video with URL:
jdbc:mysql://master-spare.vip.dailymotion.com/dailymotion Oct 6, 2008
10:45:01 AM org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO:
Time taken for getConnection(): 0
Oct 6 10:45:42 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:42 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
ModifiedRowKey for Entity: video rows obtained : 8863
Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Running
DeletedRowKey() for Entity: video
Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
DeletedRowKey for Entity: video rows obtained : 0
Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
parentDeltaQuery for Entity: video
Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a
connection for entity video with URL:
jdbc:mysql://master-spare.vip.dailymotion.com/dailymotion
Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken
for getConnection(): 0
Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a
connection for entity rel_group_ids with URL:
jdbc:mysql://master-spare.vip.dailymotion.com/dailymotion
Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken
for getConnection(): 0
Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a
connection for entity rel_playlist_ids with URL:
jdbc:mysql://master-spare.vip.dailymotion.com/dailymotion
Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken
for getConnection(): 0
Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a
connection for entity rel_fan_ids with URL:
jdbc:mysql://master-spare.vip.dailymotion.com/dailymotion
Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken
for getConnection(): 0
Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a
connection for entity rel_featured_home_country with URL:
jdbc:mysql://master-spare.vip.dailymotion.com/dailymotion
Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken
for getConnection(): 0
Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a
connection for entity rel_featured_user_ids with URL:
jdbc:mysql://master-spare.vip.dailymotion.com/dailymotion
Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken
for getConnection(): 0
Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a
connection for entity rel_featured_group_ids with URL:
jdbc:mysql://master-spare.vip.dailymotion.com/dailymotion
Oct 6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken
for getConnection(): 0
Oct 6 10:45:45 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:45 AM
org.apache.solr.update.DirectUpdateHandler2 commit INFO: start
commit(optimize=false,waitFlush=true,waitSearcher=true)
Oct 6 10:47:22 solr-test jsvc.exec[18716]: Oct 6, 2008 10:47:22 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct 6 10:48:02 solr-test jsvc.exec[18716]: Oct 6, 2008 10:48:02 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct 6 10:50:01 solr-test /USR/SBIN/CRON[18788]: (root) CMD (/root/memmon.sh
>> /root/memmon.txt)
Oct 6 10:50:01 solr-test /USR/SBIN/CRON[18791]: (root) CMD (/usr/bin/wget
-q --output-document=/home/tot.txt
http://solr-test.adm.dailymotion.com:8180/solr/video/dataimport?command=delta-import&entity=b)
Oct 6 10:50:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:50:01 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={command=delta-import} status=0 QTime=0
.....
Oct 6 11:17:01 solr-test /USR/SBIN/CRON[18844]: (root) CMD ( cd / &&
run-parts --report /etc/cron.hourly)
Oct 6 11:17:02 solr-test ntpdate[18849]: adjust time server 195.8.215.137
offset -0.036227 sec
Oct 6 11:20:01 solr-test /USR/SBIN/CRON[18853]: (root) CMD (/root/memmon.sh
>> /root/memmon.txt)
Oct 6 11:20:01 solr-test /USR/SBIN/CRON[18856]: (root) CMD (/usr/bin/wget
-q --output-document=/home/tot.txt
http://solr-test.adm.dailymotion.com:8180/solr/video/dataimport?command=delta-import&entity=b)
Oct 6 11:20:01 solr-test jsvc.exec[18716]: Oct 6, 2008 11:20:01 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={command=delta-import} status=0 QTime=0
Oct 6 11:24:08 solr-test jsvc.exec[18716]: Oct 6, 2008 11:24:08 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct 6 11:24:16 solr-test jsvc.exec[18716]: Oct 6, 2008 11:24:16 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct 6 11:24:19 solr-test jsvc.exec[18716]: Oct 6, 2008 11:24:19 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct 6 11:25:01 solr-test /USR/SBIN/CRON[18864]: (root) CMD ([ -x
/usr/lib/sysstat/sa1 ] && { [ -r "$DEFAULT" ] && . "$DEFAULT" ; [ "$ENABLED"
= "true" ] && exec /usr/lib/sysstat/sa1 $SA1_OPTIONS 1 1 ; })
Oct 6 11:25:01 solr-test /USR/SBIN/CRON[18866]: (root) CMD (/usr/bin/wget
-q --output-document=/home/tot.txt
http://solr-test.adm.dailymotion.com:8180/solr/video/dataimport?command=delta-import&entity=b)
Oct 6 11:25:01 solr-test jsvc.exec[18716]: Oct 6, 2008 11:25:01 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={command=delta-import} status=0 QTime=0
Oct 6 11:30:01 solr-test /USR/SBIN/CRON[18870]: (root) CMD (/root/memmon.sh
>> /root/memmon.txt)
Oct 6 11:30:01 solr-test /USR/SBIN/CRON[18872]: (root) CMD (/usr/bin/wget
-q --output-document=/home/tot.txt
http://solr-test.adm.dailymotion.com:8180/solr/video/dataimport?command=delta-import&entity=b)
Oct 6 11:30:01 solr-test jsvc.exec[18716]: Oct 6, 2008 11:30:01 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={command=delta-import} status=0 QTime=0
Oct 6 11:33:29 solr-test jsvc.exec[18716]: Oct 6, 2008 11:33:29 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct 6 11:33:30 solr-test jsvc.exec[18716]: Oct 6, 2008 11:33:30 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct 6 11:33:30 solr-test jsvc.exec[18716]: Oct 6, 2008 11:33:30 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct 6 11:35:01 solr-test /USR/SBIN/CRON[18880]: (root) CMD ([ -x
/usr/lib/sysstat/sa1 ] && { [ -r "$DEFAULT" ] && . "$DEFAULT" ; [ "$ENABLED"
= "true" ] && exec /usr/lib/sysstat/sa1 $SA1_OPTIONS 1 1 ; })
Oct 6 11:35:01 solr-test /USR/SBIN/CRON[18882]: (root) CMD (/usr/bin/wget
-q --output-document=/home/tot.txt
http://solr-test.adm.dailymotion.com:8180/solr/video/dataimport?command=delta-import&entity=b)
Oct 6 11:35:01 solr-test jsvc.exec[18716]: Oct 6, 2008 11:35:01 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={command=delta-import} status=0 QTime=0
Oct 6 11:36:26 solr-test jsvc.exec[18716]: Oct 6, 2008 11:36:26 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct 6 11:36:36 solr-test jsvc.exec[18716]: Oct 6, 2008 11:36:36 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct 6 11:36:37 solr-test jsvc.exec[18716]: Oct 6, 2008 11:36:37 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct 6 11:40:01 solr-test /USR/SBIN/CRON[18885]: (root) CMD (/root/memmon.sh
>> /root/memmon.txt)
Oct 6 11:40:01 solr-test /USR/SBIN/CRON[18888]: (root) CMD (/usr/bin/wget
-q --output-document=/home/tot.txt
http://solr-test.adm.dailymotion.com:8180/solr/video/dataimport?command=delta-import&entity=b)
Oct 6 11:40:01 solr-test jsvc.exec[18716]: Oct 6, 2008 11:40:01 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={command=delta-import} status=0 QTime=0
Oct 6 11:45:01 solr-test /USR/SBIN/CRON[18896]: (root) CMD ([ -x
/usr/lib/sysstat/sa1 ] && { [ -r "$DEFAULT" ] && . "$DEFAULT" ; [ "$ENABLED"
= "true" ] && exec /usr/lib/sysstat/sa1 $SA1_OPTIONS 1 1 ; })
Oct 6 11:45:01 solr-test /USR/SBIN/CRON[18898]: (root) CMD (/usr/bin/wget
-q --output-document=/home/tot.txt
http://solr-test.adm.dailymotion.com:8180/solr/video/dataimport?command=delta-import&entity=b)
Oct 6 11:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 11:45:01 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={command=delta-import} status=0 QTime=0
--
View this message in context: http://www.nabble.com/command-still-running-----delta-import-tp19837337p19837337.html
Sent from the Solr - User mailing list archive at Nabble.com.