Invoking an updateRequestProcessorChain from updateHandler

[Jan <ja...@dsto.defence.gov.au>]

Hi all,

I'm wondering if it's possible to configure solrconfig.xml so that the
updateHandler invokes an updateRequestProcessorChain? 

At the moment I have modified the /update requestHandler to invoke an
updateRequestProcessorChain, which is working nicely. The catch is that I
have to POST documents to Solr in order to invoke the /update
requestHandler. The portion of my solrconfig.xml file that achieves what
I've just described is as follows:

...
<requestHandler class="solr.XmlUpdateRequestHandler" name="/update">
  <lst name="defaults">
    <str name="update.chain">uima</str>
  </lst>
</requestHandler>
...
<updateRequestProcessorChain name="uima">
  <processor
class="org.apache.solr.uima.processor.UIMAUpdateRequestProcessorFactory">
    <lst name="uimaConfig">
      <lst name="runtimeParameters"/>
      <str name="analysisEngine">/descriptors/CustomAnnotator.xml</str>
      ... etc etc etc ...
    </lst>
  </processor>
  <processor class="solr.LogUpdateProcessorFactory"/>
  <processor class="solr.RunUpdateProcessorFactory"/>
</updateRequestProcessorChain>
...

I'm currently using LucidWorks Enterprise (LWE) to crawl document
collections, and as far as I can tell LWE is using the updateHandler to add
documents into Solr. The /update requestHandler I've experimented with above
is not being invoked. I would therefore like the updateRequestProcessorChain
to execute during the LWE crawl, which is the reason for my original
question: is it possible to configure solrconfig.xml so that the
updateHandler invokes an updateRequestProcessorChain? I've tried the
following in solrconfig.xml but the updateRequestProcessorChain didn't
execute:

...
<updateHandler class="solr.DirectUpdateHandler2">
  <maxPendingDeletes>100000</maxPendingDeletes>
  <autoCommit>
    <maxTime>3600000</maxTime>
  </autoCommit>
  <lst name="defaults">
    <str name="update.chain">uima</str>
  </lst>
</updateHandler>
...

Can anyone help me out here? Does what I'm trying to do even make sense from
a Solr perspective? I have already viewed the Solr Wiki entry for
solrconfig.xml 
http://wiki.apache.org/solr/SolrConfigXml#Update_Handler_Section here .

Thank you,
Jan

--
View this message in context: http://lucene.472066.n3.nabble.com/Invoking-an-updateRequestProcessorChain-from-updateHandler-tp3566159p3566159.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Invoking an updateRequestProcessorChain from updateHandler

[Mark Miller <ma...@gmail.com>]

You should use the LWE forums for questions about it.

The crawlers are hard coded to use the lucid-update-chain currently. If you want them to use the UIMA processor you will have to modify that chain definition to include it.

On Dec 6, 2011, at 8:16 PM, Jan wrote:

> Hi all,
> 
> I'm wondering if it's possible to configure solrconfig.xml so that the
> updateHandler invokes an updateRequestProcessorChain? 
> 
> At the moment I have modified the /update requestHandler to invoke an
> updateRequestProcessorChain, which is working nicely. The catch is that I
> have to POST documents to Solr in order to invoke the /update
> requestHandler. The portion of my solrconfig.xml file that achieves what
> I've just described is as follows:
> 
> ...
> <requestHandler class="solr.XmlUpdateRequestHandler" name="/update">
>  <lst name="defaults">
>    <str name="update.chain">uima</str>
>  </lst>
> </requestHandler>
> ...
> <updateRequestProcessorChain name="uima">
>  <processor
> class="org.apache.solr.uima.processor.UIMAUpdateRequestProcessorFactory">
>    <lst name="uimaConfig">
>      <lst name="runtimeParameters"/>
>      <str name="analysisEngine">/descriptors/CustomAnnotator.xml</str>
>      ... etc etc etc ...
>    </lst>
>  </processor>
>  <processor class="solr.LogUpdateProcessorFactory"/>
>  <processor class="solr.RunUpdateProcessorFactory"/>
> </updateRequestProcessorChain>
> ...
> 
> I'm currently using LucidWorks Enterprise (LWE) to crawl document
> collections, and as far as I can tell LWE is using the updateHandler to add
> documents into Solr. The /update requestHandler I've experimented with above
> is not being invoked. I would therefore like the updateRequestProcessorChain
> to execute during the LWE crawl, which is the reason for my original
> question: is it possible to configure solrconfig.xml so that the
> updateHandler invokes an updateRequestProcessorChain? I've tried the
> following in solrconfig.xml but the updateRequestProcessorChain didn't
> execute:
> 
> ...
> <updateHandler class="solr.DirectUpdateHandler2">
>  <maxPendingDeletes>100000</maxPendingDeletes>
>  <autoCommit>
>    <maxTime>3600000</maxTime>
>  </autoCommit>
>  <lst name="defaults">
>    <str name="update.chain">uima</str>
>  </lst>
> </updateHandler>
> ...
> 
> Can anyone help me out here? Does what I'm trying to do even make sense from
> a Solr perspective? I have already viewed the Solr Wiki entry for
> solrconfig.xml 
> http://wiki.apache.org/solr/SolrConfigXml#Update_Handler_Section here .
> 
> Thank you,
> Jan
> 
> --
> View this message in context: http://lucene.472066.n3.nabble.com/Invoking-an-updateRequestProcessorChain-from-updateHandler-tp3566159p3566159.html
> Sent from the Solr - User mailing list archive at Nabble.com.

- Mark Miller
lucidimagination.com