You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by djain101 <dh...@yahoo.com> on 2009/08/16 01:49:34 UTC
delta-import using a full-import command is not working
Hi,
I am following the example on
http://wiki.apache.org/solr/DataImportHandlerFaq#fullimportdelta
http://wiki.apache.org/solr/DataImportHandlerFaq#fullimportdelta and i
configured my data-config.xml in the similar way as mentioned in the example
on this link. the findDelta entity tag looks like as:
<entity name="findDelta" query="select emp_id as id from employee where
LAST_UPDATED_TIMESTAMP >
to_date('${dataimporter.last_index_time}','YYYY-MM-DD HH24:MI:SS')"
rootEntity="false">
When i try to index using command=full-import&clean=false, it responds with
message "Indexing completed. Added/Updated: 0 documents. Deleted 0
documents." When I looked at the query, it looks like as:
select party_id as id from core_party where LAST_UPDATED_TIMESTAMP >
to_date('','YYYY-MM-DD HH24:MI:SS')
Looks like Solr is not able to replace ${dataimporter.last_index_time} with
the timestamp from dataimport.properties. This file exist in my conf folder
and gets updated everytime i do full-import. So there is no issue with the
timestamp in dataimport.properties file. Somehow, it is not getting replaced
in sql query.
Please help !!!
--
View this message in context: http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p24989144.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: delta-import using a full-import command is not working
Posted by Noble Paul നോബിള് नोब्ळ् <no...@corp.aol.com>.
The only way is to backport the patch to 1.3 . If you are confortable
doing that just modify the relevant code and do an "ant dist" to get
the jar
On Tue, Aug 18, 2009 at 11:42 AM, djain101<dh...@yahoo.com> wrote:
>
> How can i get the version of DIH which fixes this issue and is compatible
> with 1.3?
>
>
> Noble Paul നോബിള് नोब्ळ्-2 wrote:
>>
>> OK, I thought you were using an older version of 1.4. the new DIH is
>> not compatible with 1.3
>>
>> On Tue, Aug 18, 2009 at 11:37 AM, djain101<dh...@yahoo.com>
>> wrote:
>>>
>>> I replaced the dataimporthandler.jar from 8/7/2009 build in WEB-INF/lib
>>> of
>>> solr.war but on restarting of JBOSS, it threw me following exception but
>>> if
>>> i revert back to 1.3 jar then it loads the class fine. Is there any
>>> compatibilty issue between latest dataimporthandler.jar and solr1.3.war?
>>>
>>> INFO: xsltCacheLifetimeSeconds=5
>>> 23:04:00,442 ERROR [STDERR] Aug 17, 2009 11:04:00 PM
>>> org.apache.solr.common.SolrException log
>>> SEVERE: java.lang.NoClassDefFoundError: Could not initialize class
>>> org.apache.solr.handler.dataimport.DataImportHandler
>>> at java.lang.Class.forName0(Native Method)
>>> at java.lang.Class.forName(Class.java:247)
>>> at
>>> org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader.java:257)
>>> at
>>> org.apache.solr.core.SolrResourceLoader.newInstance(SolrResourceLoader.java:278)
>>>
>>>
>>> Noble Paul നോബിള് नोब्ळ्-2 wrote:
>>>>
>>>> http://people.apache.org/builds/lucene/solr/nightly/
>>>>
>>>> you can just replace the dataimporthandler jar in your current
>>>> installation and it should be fine
>>>>
>>>> On Tue, Aug 18, 2009 at 11:18 AM, djain101<dh...@yahoo.com>
>>>> wrote:
>>>>>
>>>>> Can you please point me to the url for downloading latest DIH? Thanks
>>>>> for
>>>>> your help.
>>>>>
>>>>>
>>>>> Noble Paul നോബിള് नोब्ळ्-2 wrote:
>>>>>>
>>>>>> you can take a nightly of DIH jar alone. It is quite stable
>>>>>>
>>>>>> On Tue, Aug 18, 2009 at 8:21 AM, djain101<dh...@yahoo.com>
>>>>>> wrote:
>>>>>>>
>>>>>>> Looks like this issue has been fixed on Sept 20, 2008 against issue
>>>>>>> SOLR-768.
>>>>>>> Can someone please let me know which one is a stable jar after Sept
>>>>>>> 20,
>>>>>>> 2008.
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> djain101 wrote:
>>>>>>>>
>>>>>>>> After debugging dataimporter code, i found that it is a bug in the
>>>>>>>> dataimporter 1.3 code itself. doFullImport() in DataImporter class
>>>>>>>> is
>>>>>>>> not
>>>>>>>> loading last index time where as doDeltaImport() is. The code
>>>>>>>> snippet
>>>>>>>> from
>>>>>>>> doFullImport() is:
>>>>>>>>
>>>>>>>> if (requestParams.commit)
>>>>>>>> setIndexStartTime(new Date());
>>>>>>>>
>>>>>>>>
>>>>>>>> where as in doDeltaImport() is:
>>>>>>>>
>>>>>>>> if (requestParams.commit) {
>>>>>>>> Date lastModified = writer.loadIndexStartTime();
>>>>>>>> setIndexStartTime(new Date());
>>>>>>>> setLastIndexTime(lastModified);
>>>>>>>> }
>>>>>>>>
>>>>>>>> Looks like it is fixed in latest version of DataImporter.java. I
>>>>>>>> will
>>>>>>>> test
>>>>>>>> with that.
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> View this message in context:
>>>>>>> http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25017612.html
>>>>>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> -----------------------------------------------------
>>>>>> Noble Paul | Principal Engineer| AOL | http://aol.com
>>>>>>
>>>>>>
>>>>>
>>>>> --
>>>>> View this message in context:
>>>>> http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25018880.html
>>>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>>>
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> -----------------------------------------------------
>>>> Noble Paul | Principal Engineer| AOL | http://aol.com
>>>>
>>>>
>>>
>>> --
>>> View this message in context:
>>> http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25019032.html
>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>
>>>
>>
>>
>>
>> --
>> -----------------------------------------------------
>> Noble Paul | Principal Engineer| AOL | http://aol.com
>>
>>
>
> --
> View this message in context: http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25019071.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
--
-----------------------------------------------------
Noble Paul | Principal Engineer| AOL | http://aol.com
Re: delta-import using a full-import command is not working
Posted by djain101 <dh...@yahoo.com>.
How can i get the version of DIH which fixes this issue and is compatible
with 1.3?
Noble Paul നോബിള് नोब्ळ्-2 wrote:
>
> OK, I thought you were using an older version of 1.4. the new DIH is
> not compatible with 1.3
>
> On Tue, Aug 18, 2009 at 11:37 AM, djain101<dh...@yahoo.com>
> wrote:
>>
>> I replaced the dataimporthandler.jar from 8/7/2009 build in WEB-INF/lib
>> of
>> solr.war but on restarting of JBOSS, it threw me following exception but
>> if
>> i revert back to 1.3 jar then it loads the class fine. Is there any
>> compatibilty issue between latest dataimporthandler.jar and solr1.3.war?
>>
>> INFO: xsltCacheLifetimeSeconds=5
>> 23:04:00,442 ERROR [STDERR] Aug 17, 2009 11:04:00 PM
>> org.apache.solr.common.SolrException log
>> SEVERE: java.lang.NoClassDefFoundError: Could not initialize class
>> org.apache.solr.handler.dataimport.DataImportHandler
>> at java.lang.Class.forName0(Native Method)
>> at java.lang.Class.forName(Class.java:247)
>> at
>> org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader.java:257)
>> at
>> org.apache.solr.core.SolrResourceLoader.newInstance(SolrResourceLoader.java:278)
>>
>>
>> Noble Paul നോബിള് नोब्ळ्-2 wrote:
>>>
>>> http://people.apache.org/builds/lucene/solr/nightly/
>>>
>>> you can just replace the dataimporthandler jar in your current
>>> installation and it should be fine
>>>
>>> On Tue, Aug 18, 2009 at 11:18 AM, djain101<dh...@yahoo.com>
>>> wrote:
>>>>
>>>> Can you please point me to the url for downloading latest DIH? Thanks
>>>> for
>>>> your help.
>>>>
>>>>
>>>> Noble Paul നോബിള് नोब्ळ्-2 wrote:
>>>>>
>>>>> you can take a nightly of DIH jar alone. It is quite stable
>>>>>
>>>>> On Tue, Aug 18, 2009 at 8:21 AM, djain101<dh...@yahoo.com>
>>>>> wrote:
>>>>>>
>>>>>> Looks like this issue has been fixed on Sept 20, 2008 against issue
>>>>>> SOLR-768.
>>>>>> Can someone please let me know which one is a stable jar after Sept
>>>>>> 20,
>>>>>> 2008.
>>>>>>
>>>>>>
>>>>>>
>>>>>> djain101 wrote:
>>>>>>>
>>>>>>> After debugging dataimporter code, i found that it is a bug in the
>>>>>>> dataimporter 1.3 code itself. doFullImport() in DataImporter class
>>>>>>> is
>>>>>>> not
>>>>>>> loading last index time where as doDeltaImport() is. The code
>>>>>>> snippet
>>>>>>> from
>>>>>>> doFullImport() is:
>>>>>>>
>>>>>>> if (requestParams.commit)
>>>>>>> setIndexStartTime(new Date());
>>>>>>>
>>>>>>>
>>>>>>> where as in doDeltaImport() is:
>>>>>>>
>>>>>>> if (requestParams.commit) {
>>>>>>> Date lastModified = writer.loadIndexStartTime();
>>>>>>> setIndexStartTime(new Date());
>>>>>>> setLastIndexTime(lastModified);
>>>>>>> }
>>>>>>>
>>>>>>> Looks like it is fixed in latest version of DataImporter.java. I
>>>>>>> will
>>>>>>> test
>>>>>>> with that.
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> --
>>>>>> View this message in context:
>>>>>> http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25017612.html
>>>>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> -----------------------------------------------------
>>>>> Noble Paul | Principal Engineer| AOL | http://aol.com
>>>>>
>>>>>
>>>>
>>>> --
>>>> View this message in context:
>>>> http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25018880.html
>>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>>
>>>>
>>>
>>>
>>>
>>> --
>>> -----------------------------------------------------
>>> Noble Paul | Principal Engineer| AOL | http://aol.com
>>>
>>>
>>
>> --
>> View this message in context:
>> http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25019032.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
>>
>
>
>
> --
> -----------------------------------------------------
> Noble Paul | Principal Engineer| AOL | http://aol.com
>
>
--
View this message in context: http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25019071.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: delta-import using a full-import command is not working
Posted by Noble Paul നോബിള് नोब्ळ् <no...@corp.aol.com>.
OK, I thought you were using an older version of 1.4. the new DIH is
not compatible with 1.3
On Tue, Aug 18, 2009 at 11:37 AM, djain101<dh...@yahoo.com> wrote:
>
> I replaced the dataimporthandler.jar from 8/7/2009 build in WEB-INF/lib of
> solr.war but on restarting of JBOSS, it threw me following exception but if
> i revert back to 1.3 jar then it loads the class fine. Is there any
> compatibilty issue between latest dataimporthandler.jar and solr1.3.war?
>
> INFO: xsltCacheLifetimeSeconds=5
> 23:04:00,442 ERROR [STDERR] Aug 17, 2009 11:04:00 PM
> org.apache.solr.common.SolrException log
> SEVERE: java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.solr.handler.dataimport.DataImportHandler
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:247)
> at
> org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader.java:257)
> at
> org.apache.solr.core.SolrResourceLoader.newInstance(SolrResourceLoader.java:278)
>
>
> Noble Paul നോബിള് नोब्ळ्-2 wrote:
>>
>> http://people.apache.org/builds/lucene/solr/nightly/
>>
>> you can just replace the dataimporthandler jar in your current
>> installation and it should be fine
>>
>> On Tue, Aug 18, 2009 at 11:18 AM, djain101<dh...@yahoo.com>
>> wrote:
>>>
>>> Can you please point me to the url for downloading latest DIH? Thanks for
>>> your help.
>>>
>>>
>>> Noble Paul നോബിള് नोब्ळ्-2 wrote:
>>>>
>>>> you can take a nightly of DIH jar alone. It is quite stable
>>>>
>>>> On Tue, Aug 18, 2009 at 8:21 AM, djain101<dh...@yahoo.com>
>>>> wrote:
>>>>>
>>>>> Looks like this issue has been fixed on Sept 20, 2008 against issue
>>>>> SOLR-768.
>>>>> Can someone please let me know which one is a stable jar after Sept 20,
>>>>> 2008.
>>>>>
>>>>>
>>>>>
>>>>> djain101 wrote:
>>>>>>
>>>>>> After debugging dataimporter code, i found that it is a bug in the
>>>>>> dataimporter 1.3 code itself. doFullImport() in DataImporter class is
>>>>>> not
>>>>>> loading last index time where as doDeltaImport() is. The code snippet
>>>>>> from
>>>>>> doFullImport() is:
>>>>>>
>>>>>> if (requestParams.commit)
>>>>>> setIndexStartTime(new Date());
>>>>>>
>>>>>>
>>>>>> where as in doDeltaImport() is:
>>>>>>
>>>>>> if (requestParams.commit) {
>>>>>> Date lastModified = writer.loadIndexStartTime();
>>>>>> setIndexStartTime(new Date());
>>>>>> setLastIndexTime(lastModified);
>>>>>> }
>>>>>>
>>>>>> Looks like it is fixed in latest version of DataImporter.java. I will
>>>>>> test
>>>>>> with that.
>>>>>>
>>>>>>
>>>>>
>>>>> --
>>>>> View this message in context:
>>>>> http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25017612.html
>>>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>>>
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> -----------------------------------------------------
>>>> Noble Paul | Principal Engineer| AOL | http://aol.com
>>>>
>>>>
>>>
>>> --
>>> View this message in context:
>>> http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25018880.html
>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>
>>>
>>
>>
>>
>> --
>> -----------------------------------------------------
>> Noble Paul | Principal Engineer| AOL | http://aol.com
>>
>>
>
> --
> View this message in context: http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25019032.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
--
-----------------------------------------------------
Noble Paul | Principal Engineer| AOL | http://aol.com
Re: delta-import using a full-import command is not working
Posted by djain101 <dh...@yahoo.com>.
I replaced the dataimporthandler.jar from 8/7/2009 build in WEB-INF/lib of
solr.war but on restarting of JBOSS, it threw me following exception but if
i revert back to 1.3 jar then it loads the class fine. Is there any
compatibilty issue between latest dataimporthandler.jar and solr1.3.war?
INFO: xsltCacheLifetimeSeconds=5
23:04:00,442 ERROR [STDERR] Aug 17, 2009 11:04:00 PM
org.apache.solr.common.SolrException log
SEVERE: java.lang.NoClassDefFoundError: Could not initialize class
org.apache.solr.handler.dataimport.DataImportHandler
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at
org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader.java:257)
at
org.apache.solr.core.SolrResourceLoader.newInstance(SolrResourceLoader.java:278)
Noble Paul നോബിള് नोब्ळ्-2 wrote:
>
> http://people.apache.org/builds/lucene/solr/nightly/
>
> you can just replace the dataimporthandler jar in your current
> installation and it should be fine
>
> On Tue, Aug 18, 2009 at 11:18 AM, djain101<dh...@yahoo.com>
> wrote:
>>
>> Can you please point me to the url for downloading latest DIH? Thanks for
>> your help.
>>
>>
>> Noble Paul നോബിള് नोब्ळ्-2 wrote:
>>>
>>> you can take a nightly of DIH jar alone. It is quite stable
>>>
>>> On Tue, Aug 18, 2009 at 8:21 AM, djain101<dh...@yahoo.com>
>>> wrote:
>>>>
>>>> Looks like this issue has been fixed on Sept 20, 2008 against issue
>>>> SOLR-768.
>>>> Can someone please let me know which one is a stable jar after Sept 20,
>>>> 2008.
>>>>
>>>>
>>>>
>>>> djain101 wrote:
>>>>>
>>>>> After debugging dataimporter code, i found that it is a bug in the
>>>>> dataimporter 1.3 code itself. doFullImport() in DataImporter class is
>>>>> not
>>>>> loading last index time where as doDeltaImport() is. The code snippet
>>>>> from
>>>>> doFullImport() is:
>>>>>
>>>>> if (requestParams.commit)
>>>>> setIndexStartTime(new Date());
>>>>>
>>>>>
>>>>> where as in doDeltaImport() is:
>>>>>
>>>>> if (requestParams.commit) {
>>>>> Date lastModified = writer.loadIndexStartTime();
>>>>> setIndexStartTime(new Date());
>>>>> setLastIndexTime(lastModified);
>>>>> }
>>>>>
>>>>> Looks like it is fixed in latest version of DataImporter.java. I will
>>>>> test
>>>>> with that.
>>>>>
>>>>>
>>>>
>>>> --
>>>> View this message in context:
>>>> http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25017612.html
>>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>>
>>>>
>>>
>>>
>>>
>>> --
>>> -----------------------------------------------------
>>> Noble Paul | Principal Engineer| AOL | http://aol.com
>>>
>>>
>>
>> --
>> View this message in context:
>> http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25018880.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
>>
>
>
>
> --
> -----------------------------------------------------
> Noble Paul | Principal Engineer| AOL | http://aol.com
>
>
--
View this message in context: http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25019032.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: delta-import using a full-import command is not working
Posted by Noble Paul നോബിള് नोब्ळ् <no...@corp.aol.com>.
http://people.apache.org/builds/lucene/solr/nightly/
you can just replace the dataimporthandler jar in your current
installation and it should be fine
On Tue, Aug 18, 2009 at 11:18 AM, djain101<dh...@yahoo.com> wrote:
>
> Can you please point me to the url for downloading latest DIH? Thanks for
> your help.
>
>
> Noble Paul നോബിള് नोब्ळ्-2 wrote:
>>
>> you can take a nightly of DIH jar alone. It is quite stable
>>
>> On Tue, Aug 18, 2009 at 8:21 AM, djain101<dh...@yahoo.com> wrote:
>>>
>>> Looks like this issue has been fixed on Sept 20, 2008 against issue
>>> SOLR-768.
>>> Can someone please let me know which one is a stable jar after Sept 20,
>>> 2008.
>>>
>>>
>>>
>>> djain101 wrote:
>>>>
>>>> After debugging dataimporter code, i found that it is a bug in the
>>>> dataimporter 1.3 code itself. doFullImport() in DataImporter class is
>>>> not
>>>> loading last index time where as doDeltaImport() is. The code snippet
>>>> from
>>>> doFullImport() is:
>>>>
>>>> if (requestParams.commit)
>>>> setIndexStartTime(new Date());
>>>>
>>>>
>>>> where as in doDeltaImport() is:
>>>>
>>>> if (requestParams.commit) {
>>>> Date lastModified = writer.loadIndexStartTime();
>>>> setIndexStartTime(new Date());
>>>> setLastIndexTime(lastModified);
>>>> }
>>>>
>>>> Looks like it is fixed in latest version of DataImporter.java. I will
>>>> test
>>>> with that.
>>>>
>>>>
>>>
>>> --
>>> View this message in context:
>>> http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25017612.html
>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>
>>>
>>
>>
>>
>> --
>> -----------------------------------------------------
>> Noble Paul | Principal Engineer| AOL | http://aol.com
>>
>>
>
> --
> View this message in context: http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25018880.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
--
-----------------------------------------------------
Noble Paul | Principal Engineer| AOL | http://aol.com
Re: delta-import using a full-import command is not working
Posted by djain101 <dh...@yahoo.com>.
Can you please point me to the url for downloading latest DIH? Thanks for
your help.
Noble Paul നോബിള് नोब्ळ्-2 wrote:
>
> you can take a nightly of DIH jar alone. It is quite stable
>
> On Tue, Aug 18, 2009 at 8:21 AM, djain101<dh...@yahoo.com> wrote:
>>
>> Looks like this issue has been fixed on Sept 20, 2008 against issue
>> SOLR-768.
>> Can someone please let me know which one is a stable jar after Sept 20,
>> 2008.
>>
>>
>>
>> djain101 wrote:
>>>
>>> After debugging dataimporter code, i found that it is a bug in the
>>> dataimporter 1.3 code itself. doFullImport() in DataImporter class is
>>> not
>>> loading last index time where as doDeltaImport() is. The code snippet
>>> from
>>> doFullImport() is:
>>>
>>> if (requestParams.commit)
>>> setIndexStartTime(new Date());
>>>
>>>
>>> where as in doDeltaImport() is:
>>>
>>> if (requestParams.commit) {
>>> Date lastModified = writer.loadIndexStartTime();
>>> setIndexStartTime(new Date());
>>> setLastIndexTime(lastModified);
>>> }
>>>
>>> Looks like it is fixed in latest version of DataImporter.java. I will
>>> test
>>> with that.
>>>
>>>
>>
>> --
>> View this message in context:
>> http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25017612.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
>>
>
>
>
> --
> -----------------------------------------------------
> Noble Paul | Principal Engineer| AOL | http://aol.com
>
>
--
View this message in context: http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25018880.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: delta-import using a full-import command is not working
Posted by Noble Paul നോബിള് नोब्ळ् <no...@corp.aol.com>.
you can take a nightly of DIH jar alone. It is quite stable
On Tue, Aug 18, 2009 at 8:21 AM, djain101<dh...@yahoo.com> wrote:
>
> Looks like this issue has been fixed on Sept 20, 2008 against issue SOLR-768.
> Can someone please let me know which one is a stable jar after Sept 20,
> 2008.
>
>
>
> djain101 wrote:
>>
>> After debugging dataimporter code, i found that it is a bug in the
>> dataimporter 1.3 code itself. doFullImport() in DataImporter class is not
>> loading last index time where as doDeltaImport() is. The code snippet from
>> doFullImport() is:
>>
>> if (requestParams.commit)
>> setIndexStartTime(new Date());
>>
>>
>> where as in doDeltaImport() is:
>>
>> if (requestParams.commit) {
>> Date lastModified = writer.loadIndexStartTime();
>> setIndexStartTime(new Date());
>> setLastIndexTime(lastModified);
>> }
>>
>> Looks like it is fixed in latest version of DataImporter.java. I will test
>> with that.
>>
>>
>
> --
> View this message in context: http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25017612.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
--
-----------------------------------------------------
Noble Paul | Principal Engineer| AOL | http://aol.com
Re: delta-import using a full-import command is not working
Posted by djain101 <dh...@yahoo.com>.
Looks like this issue has been fixed on Sept 20, 2008 against issue SOLR-768.
Can someone please let me know which one is a stable jar after Sept 20,
2008.
djain101 wrote:
>
> After debugging dataimporter code, i found that it is a bug in the
> dataimporter 1.3 code itself. doFullImport() in DataImporter class is not
> loading last index time where as doDeltaImport() is. The code snippet from
> doFullImport() is:
>
> if (requestParams.commit)
> setIndexStartTime(new Date());
>
>
> where as in doDeltaImport() is:
>
> if (requestParams.commit) {
> Date lastModified = writer.loadIndexStartTime();
> setIndexStartTime(new Date());
> setLastIndexTime(lastModified);
> }
>
> Looks like it is fixed in latest version of DataImporter.java. I will test
> with that.
>
>
--
View this message in context: http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25017612.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: delta-import using a full-import command is not working
Posted by djain101 <dh...@yahoo.com>.
After debugging dataimporter code, i found that it is a bug in the
dataimporter code itself. doFullImport() in DataImporter class is not
loading last index time where as doDeltaImport() is. The code snippet from
doFullImport() is:
if (requestParams.commit)
setIndexStartTime(new Date());
where as in doDeltaImport() is:
if (requestParams.commit) {
Date lastModified = writer.loadIndexStartTime();
setIndexStartTime(new Date());
setLastIndexTime(lastModified);
}
Looks like it is fixed in latest version of DataImporter.java. I will test
with that.
--
View this message in context: http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25016765.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: delta-import using a full-import command is not working
Posted by djain101 <dh...@yahoo.com>.
Yes, database and Solr are different machines and their dates are not
synchronized. Could that be the issue? Why the date difference between Solr
and DB machine fails to put the timestamp from dataimport.properties file?
Thanks,
Dharmveer
Avlesh Singh wrote:
>
> Solr and your database are different machines? If yes, are their dates
> synchronized?
> If you have access to your database server logs, looking at the queries
> that
> DIH generated might help.
>
> Cheers
> Avlesh
>
> On Mon, Aug 17, 2009 at 11:40 PM, djain101 <dh...@yahoo.com>
> wrote:
>
>>
>> Any help?
>> --
>> View this message in context:
>> http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25011540.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
>>
>
>
--
View this message in context: http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25012532.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: delta-import using a full-import command is not working
Posted by Avlesh Singh <av...@gmail.com>.
Solr and your database are different machines? If yes, are their dates
synchronized?
If you have access to your database server logs, looking at the queries that
DIH generated might help.
Cheers
Avlesh
On Mon, Aug 17, 2009 at 11:40 PM, djain101 <dh...@yahoo.com> wrote:
>
> Any help?
> --
> View this message in context:
> http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25011540.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
Re: delta-import using a full-import command is not working
Posted by djain101 <dh...@yahoo.com>.
Any help?
--
View this message in context: http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p25011540.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: delta-import using a full-import command is not working
Posted by djain101 <dh...@yahoo.com>.
Thanks for your response. It is not empty, it contains following:
#Sat Aug 15 16:44:18 PDT 2009
last_index_time=2009-08-15 16\:44\:17
Noble Paul നോബിള് नोब्ळ्-2 wrote:
>
> actually your dataimport.properties is empty , I guess that is the reason
>
> On Sun, Aug 16, 2009 at 5:19 AM, djain101<dh...@yahoo.com> wrote:
>>
>> Hi,
>>
>> I am following the example on
>> http://wiki.apache.org/solr/DataImportHandlerFaq#fullimportdelta
>> http://wiki.apache.org/solr/DataImportHandlerFaq#fullimportdelta and i
>> configured my data-config.xml in the similar way as mentioned in the
>> example
>> on this link. the findDelta entity tag looks like as:
>>
>> <entity name="findDelta" query="select emp_id as id from employee where
>> LAST_UPDATED_TIMESTAMP >
>> to_date('${dataimporter.last_index_time}','YYYY-MM-DD HH24:MI:SS')"
>> rootEntity="false">
>>
>> When i try to index using command=full-import&clean=false, it responds
>> with
>> message "Indexing completed. Added/Updated: 0 documents. Deleted 0
>> documents." When I looked at the query, it looks like as:
>> select party_id as id from core_party where LAST_UPDATED_TIMESTAMP >
>> to_date('','YYYY-MM-DD HH24:MI:SS')
>>
>> Looks like Solr is not able to replace ${dataimporter.last_index_time}
>> with
>> the timestamp from dataimport.properties. This file exist in my conf
>> folder
>> and gets updated everytime i do full-import. So there is no issue with
>> the
>> timestamp in dataimport.properties file. Somehow, it is not getting
>> replaced
>> in sql query.
>>
>> Please help !!!
>> --
>> View this message in context:
>> http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p24989144.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
>>
>
>
>
> --
> -----------------------------------------------------
> Noble Paul | Principal Engineer| AOL | http://aol.com
>
>
--
View this message in context: http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p24994120.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: delta-import using a full-import command is not working
Posted by Noble Paul നോബിള് नोब्ळ् <no...@corp.aol.com>.
actually your dataimport.properties is empty , I guess that is the reason
On Sun, Aug 16, 2009 at 5:19 AM, djain101<dh...@yahoo.com> wrote:
>
> Hi,
>
> I am following the example on
> http://wiki.apache.org/solr/DataImportHandlerFaq#fullimportdelta
> http://wiki.apache.org/solr/DataImportHandlerFaq#fullimportdelta and i
> configured my data-config.xml in the similar way as mentioned in the example
> on this link. the findDelta entity tag looks like as:
>
> <entity name="findDelta" query="select emp_id as id from employee where
> LAST_UPDATED_TIMESTAMP >
> to_date('${dataimporter.last_index_time}','YYYY-MM-DD HH24:MI:SS')"
> rootEntity="false">
>
> When i try to index using command=full-import&clean=false, it responds with
> message "Indexing completed. Added/Updated: 0 documents. Deleted 0
> documents." When I looked at the query, it looks like as:
> select party_id as id from core_party where LAST_UPDATED_TIMESTAMP >
> to_date('','YYYY-MM-DD HH24:MI:SS')
>
> Looks like Solr is not able to replace ${dataimporter.last_index_time} with
> the timestamp from dataimport.properties. This file exist in my conf folder
> and gets updated everytime i do full-import. So there is no issue with the
> timestamp in dataimport.properties file. Somehow, it is not getting replaced
> in sql query.
>
> Please help !!!
> --
> View this message in context: http://www.nabble.com/delta-import-using-a-full-import-command-is-not-working-tp24989144p24989144.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
--
-----------------------------------------------------
Noble Paul | Principal Engineer| AOL | http://aol.com