You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-dev@lucene.apache.org by "Jeremy Hinegardner (JIRA)" <ji...@apache.org> on 2008/07/04 04:13:45 UTC
[jira] Commented: (SOLR-469) Data Import RequestHandler
[ https://issues.apache.org/jira/browse/SOLR-469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12610418#action_12610418 ]
Jeremy Hinegardner commented on SOLR-469:
-----------------------------------------
I think there is a bug in the -contrib patch. setting {{optimize=false}} as a request parameter appears to turn off clean instead of turning off optimize.
{code:title=DataImporter.java line 496}
if (requestParams.containsKey("clean"))
clean = Boolean.parseBoolean((String) requestParams.get("clean"));
if (requestParams.containsKey("optimize"))
clean = Boolean.parseBoolean((String) requestParams.get("optimize"));
{code}
> Data Import RequestHandler
> --------------------------
>
> Key: SOLR-469
> URL: https://issues.apache.org/jira/browse/SOLR-469
> Project: Solr
> Issue Type: New Feature
> Components: update
> Affects Versions: 1.3
> Reporter: Noble Paul
> Assignee: Grant Ingersoll
> Fix For: 1.3
>
> Attachments: SOLR-469-contrib.patch, SOLR-469-contrib.patch, SOLR-469-contrib.patch, SOLR-469-contrib.patch, SOLR-469-contrib.patch, SOLR-469-contrib.patch, SOLR-469.patch, SOLR-469.patch, SOLR-469.patch, SOLR-469.patch, SOLR-469.patch, SOLR-469.patch, SOLR-469.patch, SOLR-469.patch, SOLR-469.patch
>
>
> We need a RequestHandler Which can import data from a DB or other dataSources into the Solr index .Think of it as an advanced form of SqlUpload Plugin (SOLR-103).
> The way it works is as follows.
> * Provide a configuration file (xml) to the Handler which takes in the necessary SQL queries and mappings to a solr schema
> - It also takes in a properties file for the data source configuraution
> * Given the configuration it can also generate the solr schema.xml
> * It is registered as a RequestHandler which can take two commands do-full-import, do-delta-import
> - do-full-import - dumps all the data from the Database into the index (based on the SQL query in configuration)
> - do-delta-import - dumps all the data that has changed since last import. (We assume a modified-timestamp column in tables)
> * It provides a admin page
> - where we can schedule it to be run automatically at regular intervals
> - It shows the status of the Handler (idle, full-import, delta-import)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
Re: [jira] Commented: (SOLR-469) Data Import RequestHandler
Posted by Noble Paul നോബിള് नोब्ळ् <no...@gmail.com>.
Nice catch..
We will fix it.
--Noble
On Fri, Jul 4, 2008 at 7:43 AM, Jeremy Hinegardner (JIRA)
<ji...@apache.org> wrote:
>
> [ https://issues.apache.org/jira/browse/SOLR-469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12610418#action_12610418 ]
>
> Jeremy Hinegardner commented on SOLR-469:
> -----------------------------------------
>
> I think there is a bug in the -contrib patch. setting {{optimize=false}} as a request parameter appears to turn off clean instead of turning off optimize.
>
>
> {code:title=DataImporter.java line 496}
> if (requestParams.containsKey("clean"))
> clean = Boolean.parseBoolean((String) requestParams.get("clean"));
> if (requestParams.containsKey("optimize"))
> clean = Boolean.parseBoolean((String) requestParams.get("optimize"));
> {code}
>
>
>
>
>> Data Import RequestHandler
>> --------------------------
>>
>> Key: SOLR-469
>> URL: https://issues.apache.org/jira/browse/SOLR-469
>> Project: Solr
>> Issue Type: New Feature
>> Components: update
>> Affects Versions: 1.3
>> Reporter: Noble Paul
>> Assignee: Grant Ingersoll
>> Fix For: 1.3
>>
>> Attachments: SOLR-469-contrib.patch, SOLR-469-contrib.patch, SOLR-469-contrib.patch, SOLR-469-contrib.patch, SOLR-469-contrib.patch, SOLR-469-contrib.patch, SOLR-469.patch, SOLR-469.patch, SOLR-469.patch, SOLR-469.patch, SOLR-469.patch, SOLR-469.patch, SOLR-469.patch, SOLR-469.patch, SOLR-469.patch
>>
>>
>> We need a RequestHandler Which can import data from a DB or other dataSources into the Solr index .Think of it as an advanced form of SqlUpload Plugin (SOLR-103).
>> The way it works is as follows.
>> * Provide a configuration file (xml) to the Handler which takes in the necessary SQL queries and mappings to a solr schema
>> - It also takes in a properties file for the data source configuraution
>> * Given the configuration it can also generate the solr schema.xml
>> * It is registered as a RequestHandler which can take two commands do-full-import, do-delta-import
>> - do-full-import - dumps all the data from the Database into the index (based on the SQL query in configuration)
>> - do-delta-import - dumps all the data that has changed since last import. (We assume a modified-timestamp column in tables)
>> * It provides a admin page
>> - where we can schedule it to be run automatically at regular intervals
>> - It shows the status of the Handler (idle, full-import, delta-import)
>
> --
> This message is automatically generated by JIRA.
> -
> You can reply to this email to add a comment to the issue online.
>
>
--
--Noble Paul