You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-dev@lucene.apache.org by Noble Paul നോബിള് नोब्ळ् <no...@corp.aol.com> on 2009/10/01 20:44:07 UTC
Re: [jira] Commented: (SOLR-1426) Allow delta-import to run
continously until aborted
the lastIndexTime is removed from DataImporter because it is redundant.
On Thu, Oct 1, 2009 at 11:42 PM, Abdul Chaudhry (JIRA) <ji...@apache.org> wrote:
>
> [ https://issues.apache.org/jira/browse/SOLR-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12761289#action_12761289 ]
>
> Abdul Chaudhry commented on SOLR-1426:
> --------------------------------------
>
> NOTE: the last_index_time is broken with the perpetual patch
>
> I hacked around this by changing the data-config.xml file for the deltaQuery to do something like this:-
>
> WHERE updated_at > DATE_SUB('${dataimporter.last_index_time}',INTERVAL 10 SECOND)
>
> This is because of the time discrepancy between the sleep and the writers last_index_time.
>
> However, it looks like the delta-import is broken in the latest build of solr trunk revision 820731. It looks like the lastIndexTime in the DataImporter is not populated after a delta and so if you used ${dataimporter.last_index_time} then the deltaQuery uses the wrong time.
>
> I am going to wait until delta-import is fixed before I update a patch.
>
>
>> Allow delta-import to run continously until aborted
>> ---------------------------------------------------
>>
>> Key: SOLR-1426
>> URL: https://issues.apache.org/jira/browse/SOLR-1426
>> Project: Solr
>> Issue Type: Improvement
>> Components: contrib - DataImportHandler
>> Affects Versions: 1.4
>> Reporter: Abdul Chaudhry
>> Assignee: Noble Paul
>> Fix For: 1.5
>>
>> Attachments: delta-import-perpetual.patch
>>
>>
>> Modify the delta-import so that it takes a perpetual flag that makes it run continuously until its aborted.
>> http://localhost:8985/solr/select/?command=delta-import&clean=false&qt=/dataimport&commit=true&perpetual=true
>> perpetual means the delta import will keep running and pause for a few seconds when running queries.
>> The only way to stop delta import will be to explicitly issue an abort like so:-
>> http://localhost:8985/solr/tickets/select/?command=abort
>
> --
> This message is automatically generated by JIRA.
> -
> You can reply to this email to add a comment to the issue online.
>
>
--
-----------------------------------------------------
Noble Paul | Principal Engineer| AOL | http://aol.com