You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Shalin Shekhar Mangar (JIRA)" <ji...@apache.org> on 2013/07/08 13:43:48 UTC
[jira] [Assigned] (SOLR-4386) Variable expansion doesn't work in
DIH SimplePropertiesWriter's filename
[ https://issues.apache.org/jira/browse/SOLR-4386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shalin Shekhar Mangar reassigned SOLR-4386:
-------------------------------------------
Assignee: Shalin Shekhar Mangar
> Variable expansion doesn't work in DIH SimplePropertiesWriter's filename
> ------------------------------------------------------------------------
>
> Key: SOLR-4386
> URL: https://issues.apache.org/jira/browse/SOLR-4386
> Project: Solr
> Issue Type: Bug
> Components: contrib - DataImportHandler
> Affects Versions: 4.1
> Reporter: Jonas Birgander
> Assignee: Shalin Shekhar Mangar
> Labels: dataimport
> Attachments: SOLR-4386.patch
>
>
> I'm testing Solr 4.1, but I've run into some problems with DataImportHandler's new propertyWriter tag.
> I'm trying to use variable expansion in the `filename` field when using SimplePropertiesWriter.
> Here are the relevant parts of my configuration:
> conf/solrconfig.xml
> -----------------------------------------------------------------------------
> <requestHandler name="/dataimport" class="org.apache.solr.handler.dataimport.DataImportHandler">
> <lst name="defaults">
> <str name="config">db-data-config.xml</str>
> </lst>
> <lst name="invariants">
> <!-- country_code is available -->
> <str name="country_code">${country_code}</str>
> <!-- In the real config, more variables are set here -->
> </lst>
> </requestHandler>
> conf/db-data-config.xml
> -----------------------------------------------------------------------------
> <dataConfig>
> <propertyWriter
> dateFormat="yyyy-MM-dd HH:mm:ss"
> type="SimplePropertiesWriter"
> directory="conf"
> filename="${dataimporter.request.country_code}.dataimport.properties"
> />
> <dataSource type="JdbcDataSource"
> driver="${dataimporter.request.db_driver}"
> url="${dataimporter.request.db_url}"
> user="${dataimporter.request.db_user}"
> password="${dataimporter.request.db_password}"
> batchSize="${dataimporter.request.db_batch_size}" />
> <document>
> <entity name="item"
> query="my normal SQL, not really relevant
> -- country=${dataimporter.request.country_code}">
> <field column="id"/>
> <!-- ...more field tags... -->
> <field column="$deleteDocById"/>
> <field column="$skipDoc"/>
> </entity>
> </document>
> </dataConfig>
> If country_code is set to "gb", I want the last_index_time to be read and written in the file conf/gb.dataimport.properties, instead of the default conf/dataimport.properties
> The variable expansion works perfectly in the SQL and setup of the data source, but not in the property writer's filename field.
> When initiating an import, the log file shows:
> Jan 30, 2013 11:25:42 AM org.apache.solr.handler.dataimport.DataImporter maybeReloadConfiguration
> INFO: Loading DIH Configuration: db-data-config.xml
> Jan 30, 2013 11:25:42 AM org.apache.solr.handler.dataimport.config.ConfigParseUtil verifyWithSchema
> INFO: The field :$skipDoc present in DataConfig does not have a counterpart in Solr Schema
> Jan 30, 2013 11:25:42 AM org.apache.solr.handler.dataimport.config.ConfigParseUtil verifyWithSchema
> INFO: The field :$deleteDocById present in DataConfig does not have a counterpart in Solr Schema
> Jan 30, 2013 11:25:42 AM org.apache.solr.handler.dataimport.DataImporter loadDataConfig
> INFO: Data Configuration loaded successfully
> Jan 30, 2013 11:25:42 AM org.apache.solr.handler.dataimport.DataImporter doFullImport
> INFO: Starting Full Import
> Jan 30, 2013 11:25:42 AM org.apache.solr.handler.dataimport.SimplePropertiesWriter readIndexerProperties
> WARNING: Unable to read: ${dataimporter.request.country_code}.dataimport.properties
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org