You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by deniz <de...@gmail.com> on 2012/09/07 10:17:46 UTC
SOLR 4.0 DataImport frozen or fails with WARNING: Unable to read:
dataimport.properties?
Hi all,
I have been trying to index my data from mysql db, but somehow i cant index
anything, and dont see any exception / error in logs, except a warning which
is highlighted below...
Here is my db-config's connection string:
<dataSource type="JdbcDataSource" driver="com.mysql.jdbc.Driver"
url="jdbc:mysql://dbhost:3396/myDB" user="XXX" password="XXX" />
(I can connect to the db from command line by using the above settings)
and after i start dataimport i see these in the log:
INFO: Starting Full Import
Sep 07, 2012 4:08:21 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:08:21 PM
org.apache.solr.handler.dataimport.SimplePropertiesWriter
readIndexerProperties
*WARNING: Unable to read: dataimport.properties*
Sep 07, 2012 4:08:21 PM org.apache.solr.handler.dataimport.JdbcDataSource$1
call
INFO: Creating a connection for entity user with URL:
jdbc:mysql://10.60.1.157:3396/poppen
Sep 07, 2012 4:08:22 PM org.apache.solr.handler.dataimport.JdbcDataSource$1
call
INFO: Time taken for getConnection(): 802
Sep 07, 2012 4:08:23 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=1
Sep 07, 2012 4:08:25 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=1
Sep 07, 2012 4:08:27 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:08:29 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=1
Sep 07, 2012 4:08:31 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:08:33 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:08:36 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=1
Sep 07, 2012 4:08:38 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=1
Sep 07, 2012 4:08:40 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=1
Sep 07, 2012 4:08:42 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:08:44 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:08:46 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=1
Sep 07, 2012 4:08:49 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:08:51 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:08:53 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:08:55 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:08:58 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:09:00 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:09:02 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:09:06 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:09:08 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:09:10 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:09:12 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:09:16 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:09:18 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:09:20 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=1
Sep 07, 2012 4:09:22 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=1
Sep 07, 2012 4:09:26 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:09:28 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:09:30 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:09:32 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:09:34 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=1
Sep 07, 2012 4:09:38 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:09:40 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:09:42 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=1
Sep 07, 2012 4:09:44 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:09:46 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:09:48 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:10:07 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=257
Sep 07, 2012 4:10:10 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:10:12 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:10:14 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:10:16 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:10:18 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:10:20 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=0
Sep 07, 2012 4:10:37 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=1
Sep 07, 2012 4:10:39 PM org.apache.solr.core.SolrCore execute
INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
status=0 QTime=1
there is nothing else in the logs... i have tried both using direct command
and also the one on the admin interface... but still nothing happens
any ideas about this one?
-----
Zeki ama calismiyor... Calissa yapar...
--
View this message in context: http://lucene.472066.n3.nabble.com/SOLR-4-0-DataImport-frozen-or-fails-with-WARNING-Unable-to-read-dataimport-properties-tp4006077.html
Sent from the Solr - User mailing list archive at Nabble.com.
答复: SOLR 4.0 DataImport frozen or fails with WARNING: Unable to read: dataimport.properties?
Posted by 百岁 <ba...@taobao.com>.
Hi everybody，I am a freshman here，hope to make friends with you
thank you so much travis, it is working so smoothly right now
-----
Zeki ama calismiyor... Calissa yapar...
--
View this message in context: http://lucene.472066.n3.nabble.com/SOLR-4-0-DataImport-frozen-or-fails-with-WARNING-Unable-to-read-dataimport-properties-tp4006077p4006506.html
Sent from the Solr - User mailing list archive at Nabble.com.
________________________________
This email (including any attachments) is confidential and may be legally privileged. If you received this email in error, please delete it immediately and do not copy it or use it for any purpose or disclose its contents to any other person. Thank you.
本电邮(包括任何附件)可能含有机密资料并受法律保护。如您不是正确的收件人，请您立即删除本邮件。请不要将本电邮进行复制并用作任何其他用途、或透露本邮件之内容。谢谢。
Re: SOLR 4.0 DataImport frozen or fails with WARNING: Unable to
read: dataimport.properties?
Posted by deniz <de...@gmail.com>.
thank you so much travis, it is working so smoothly right now
-----
Zeki ama calismiyor... Calissa yapar...
--
View this message in context: http://lucene.472066.n3.nabble.com/SOLR-4-0-DataImport-frozen-or-fails-with-WARNING-Unable-to-read-dataimport-properties-tp4006077p4006506.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: SOLR 4.0 DataImport frozen or fails with WARNING: Unable to read: dataimport.properties?
Posted by Travis Low <tl...@4centurion.com>.
Change your data-config.xml connection XML to this:
<dataSource type="JdbcDataSource" driver="com.mysql.jdbc.Driver"
url="jdbc:mysql://dbhost:3396/myDB" user="XXX" password="XXX"
batchSize="-1" />
Then try again. This keeps the driver from trying to fetch the entire
result set at the same time.
cheers,
Travis
On Fri, Sep 7, 2012 at 4:17 AM, deniz <de...@gmail.com> wrote:
> Hi all,
>
> I have been trying to index my data from mysql db, but somehow i cant
> index
> anything, and dont see any exception / error in logs, except a warning
> which
> is highlighted below...
>
> Here is my db-config's connection string:
>
> <dataSource type="JdbcDataSource" driver="com.mysql.jdbc.Driver"
> url="jdbc:mysql://dbhost:3396/myDB" user="XXX" password="XXX" />
>
> (I can connect to the db from command line by using the above settings)
>
> and after i start dataimport i see these in the log:
>
> INFO: Starting Full Import
> Sep 07, 2012 4:08:21 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:08:21 PM
> org.apache.solr.handler.dataimport.SimplePropertiesWriter
> readIndexerProperties
> *WARNING: Unable to read: dataimport.properties*
> Sep 07, 2012 4:08:21 PM org.apache.solr.handler.dataimport.JdbcDataSource$1
> call
> INFO: Creating a connection for entity user with URL:
> jdbc:mysql://10.60.1.157:3396/poppen
> Sep 07, 2012 4:08:22 PM org.apache.solr.handler.dataimport.JdbcDataSource$1
> call
> INFO: Time taken for getConnection(): 802
> Sep 07, 2012 4:08:23 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=1
> Sep 07, 2012 4:08:25 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=1
> Sep 07, 2012 4:08:27 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:08:29 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=1
> Sep 07, 2012 4:08:31 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:08:33 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:08:36 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=1
> Sep 07, 2012 4:08:38 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=1
> Sep 07, 2012 4:08:40 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=1
> Sep 07, 2012 4:08:42 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:08:44 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:08:46 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=1
> Sep 07, 2012 4:08:49 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:08:51 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:08:53 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:08:55 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:08:58 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:09:00 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:09:02 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:09:06 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:09:08 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:09:10 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:09:12 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:09:16 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:09:18 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:09:20 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=1
> Sep 07, 2012 4:09:22 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=1
> Sep 07, 2012 4:09:26 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:09:28 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:09:30 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:09:32 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:09:34 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=1
> Sep 07, 2012 4:09:38 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:09:40 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:09:42 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=1
> Sep 07, 2012 4:09:44 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:09:46 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:09:48 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:10:07 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=257
> Sep 07, 2012 4:10:10 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:10:12 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:10:14 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:10:16 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:10:18 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:10:20 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=0
> Sep 07, 2012 4:10:37 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=1
> Sep 07, 2012 4:10:39 PM org.apache.solr.core.SolrCore execute
> INFO: [collection1] webapp=/solr path=/dataimport params={command=status}
> status=0 QTime=1
>
> there is nothing else in the logs... i have tried both using direct command
> and also the one on the admin interface... but still nothing happens
>
>
> any ideas about this one?
>
>
>
>
> -----
> Zeki ama calismiyor... Calissa yapar...
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/SOLR-4-0-DataImport-frozen-or-fails-with-WARNING-Unable-to-read-dataimport-properties-tp4006077.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
--
**
*Travis Low, Director of Development*
** <tl...@4centurion.com>* *
*Centurion Research Solutions, LLC*
*14048 ParkEast Circle *•* Suite 100 *•* Chantilly, VA 20151*
*703-956-6276 *•* 703-378-4474 (fax)*
*http://www.centurionresearch.com* <http://www.centurionresearch.com>
**The information contained in this email message is confidential and
protected from disclosure. If you are not the intended recipient, any use
or dissemination of this communication, including attachments, is strictly
prohibited. If you received this email message in error, please delete it
and immediately notify the sender.
This email message and any attachments have been scanned and are believed
to be free of malicious software and defects that might affect any computer
system in which they are received and opened. No responsibility is accepted
by Centurion Research Solutions, LLC for any loss or damage arising from
the content of this email.