[jira] [Created] (SOLR-4386) Variable expansion doesn't work in DIH SimplePropertiesWriter's filename

["Jonas Birgander (JIRA)" <ji...@apache.org>]

Jonas Birgander created SOLR-4386:
-------------------------------------

             Summary: Variable expansion doesn't work in DIH SimplePropertiesWriter's filename
                 Key: SOLR-4386
                 URL: https://issues.apache.org/jira/browse/SOLR-4386
             Project: Solr
          Issue Type: Bug
          Components: contrib - DataImportHandler
    Affects Versions: 4.1
            Reporter: Jonas Birgander


I'm testing Solr 4.1, but I've run into some problems with DataImportHandler's new propertyWriter tag.
I'm trying to use variable expansion in the `filename` field when using SimplePropertiesWriter.

Here are the relevant parts of my configuration:

conf/solrconfig.xml
-----------------------------------------------------------------------------
<requestHandler name="/dataimport" class="org.apache.solr.handler.dataimport.DataImportHandler">
  <lst name="defaults">
    <str name="config">db-data-config.xml</str>
  </lst>

  <lst name="invariants">
    <!-- country_code is available -->
    <str name="country_code">${country_code}</str>
    <!-- In the real config, more variables are set here -->
  </lst>
</requestHandler>


conf/db-data-config.xml
-----------------------------------------------------------------------------
<dataConfig>
  <propertyWriter
    dateFormat="yyyy-MM-dd HH:mm:ss"
    type="SimplePropertiesWriter"
    directory="conf"
    filename="${dataimporter.request.country_code}.dataimport.properties"
    />

  <dataSource type="JdbcDataSource"
    driver="${dataimporter.request.db_driver}"
    url="${dataimporter.request.db_url}"
    user="${dataimporter.request.db_user}"
    password="${dataimporter.request.db_password}"
    batchSize="${dataimporter.request.db_batch_size}" />
  <document>
    <entity name="item"
      query="my normal SQL, not really relevant
            -- country=${dataimporter.request.country_code}">
      <field column="id"/>
        <!-- ...more field tags... -->

        <field column="$deleteDocById"/>
      <field column="$skipDoc"/>
    </entity>
  </document>
</dataConfig>




If country_code is set to "gb", I want the last_index_time to be read and written in the file conf/gb.dataimport.properties, instead of the default conf/dataimport.properties

The variable expansion works perfectly in the SQL and setup of the data source, but not in the property writer's filename field.

When initiating an import, the log file shows:

Jan 30, 2013 11:25:42 AM org.apache.solr.handler.dataimport.DataImporter maybeReloadConfiguration
INFO: Loading DIH Configuration: db-data-config.xml
Jan 30, 2013 11:25:42 AM org.apache.solr.handler.dataimport.config.ConfigParseUtil verifyWithSchema
INFO: The field :$skipDoc present in DataConfig does not have a counterpart in Solr Schema
Jan 30, 2013 11:25:42 AM org.apache.solr.handler.dataimport.config.ConfigParseUtil verifyWithSchema
INFO: The field :$deleteDocById present in DataConfig does not have a counterpart in Solr Schema
Jan 30, 2013 11:25:42 AM org.apache.solr.handler.dataimport.DataImporter loadDataConfig
INFO: Data Configuration loaded successfully
Jan 30, 2013 11:25:42 AM org.apache.solr.handler.dataimport.DataImporter doFullImport
INFO: Starting Full Import
Jan 30, 2013 11:25:42 AM org.apache.solr.handler.dataimport.SimplePropertiesWriter readIndexerProperties
WARNING: Unable to read: ${dataimporter.request.country_code}.dataimport.properties



--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org