Solr now supports UIMA

[Jörn Kottmann <ko...@gmail.com>]

Hi all,

some might already know it, the new Solr 3.1 has now support for UIMA:
http://wiki.apache.org/solr/SolrUIMA

Jörn

Re: Solr now supports UIMA

[Tommaso Teofili <to...@gmail.com>]

yes it is, you find the code here:
http://svn.apache.org/repos/asf/lucene/dev/branches/branch_4x/solr/contrib/uima/.

Tommaso


2012/11/30 mike.vogel <mi...@knowledgent.com>

> Is use of UIMA supported for Solr 4?
>
>

Re: Solr now supports UIMA

["mike.vogel" <mi...@knowledgent.com>]

Is use of UIMA supported for Solr 4?

Re: Solr now supports UIMA

[Jens Grivolla <j+...@grivolla.net>]

On 04/04/2011 06:23 PM, Tommaso Teofili wrote:

> The current implementation runs UIMA pipelines with the simplest way an
> external app could do [1] but it'd be good to provide support to add support
> for CPEs and UIMA-AS, so anyone interested in helping with that is welcome.

Doesn't UIMA-AS already work through JMS descriptors?

Jens

Re: Solr now supports UIMA

[Tommaso Teofili <to...@gmail.com>]

2011/4/5 Jörn Kottmann <ko...@gmail.com>
>
> If the analysis pipeline should be scaled with UIMA AS the Solrcas AE can
> be placed at the end of the pipeline to send the results to a Solr
> instance.
>
>
Right Jörn, Solrcas [1] is a UIMA CAS Consumer and it can be used just like
any other UIMA component within CPEs/UIMA-AS.

While Solrcas writes annotations to a separate Solr instance, the
integration inside Solr 3.1 instantiates an AnalysisEngine, creates the CAS,
executes the engine and maps annotations to Solr index from within Solr
itself so there are usecases when the latter is needed and one still wants
more scaling capabilities; for example in near real time indexing then
usually one wants to handle the whole indexing process from within Solr (so
having CPEs/UIMA-AS support could be nice).

Depending on the usecase one may want to use Solrcas or the Solr-UIMA
integration inside Solr 3.1.

Cheers,
Tommaso

[1] : http://uima.apache.org/sandbox.html#solrcas.consumer

Re: Solr now supports UIMA

[Jörn Kottmann <ko...@gmail.com>]

On 4/4/11 6:23 PM, Tommaso Teofili wrote:
> The current implementation runs UIMA pipelines with the simplest way an
> external app could do [1] but it'd be good to provide support to add support
> for CPEs and UIMA-AS, so anyone interested in helping with that is welcome.

If the analysis pipeline should be scaled with UIMA AS the Solrcas AE can
be placed at the end of the pipeline to send the results to a Solr instance.

Jörn

Re: Solr now supports UIMA

[Tommaso Teofili <to...@gmail.com>]

Hi all,

as you may see reading the wiki page linked by Jörn that integration enables
calling a UIMA pipeline from inside a Solr instance.
This is done via a dedicated component one can add to the chain of
UpdateRequestProcessors that are responsible of processing documents when
they come to Solr to be indexed.

So, if you add the UIMAUpdateRequestProcessor to the Solr update chain, the
flow goes like:
1. Document is sent to Solr to be indexed
2. Solr reads the (configurable) fields which contain text to be sent to
UIMA inside the CAS
3. Solr sends the CAS to an AnalysisEngine (configurable)
4. Once the UIMA pipeline has ended, Solr writes UIMA annotations' feature
values to the Solr document's fields (the mapping is configurable)
5. Solr sends the enriched document to the next processor of the Solr update
chain (which leads finally to the actual writing to the index)

The aggregate Analysis Engine shipped with Solr uses some Sandbox, aka UIMA
Addons, components (WhitespaceTokenizer, HMMTagger, AlchemyAPIAnnotator,
OpenCalaisAnnotator) to demonstrate some basic enrichment capabilities. That
can obviously be changed/extended as one wish.

The current implementation runs UIMA pipelines with the simplest way an
external app could do [1] but it'd be good to provide support to add support
for CPEs and UIMA-AS, so anyone interested in helping with that is welcome.

Obviously, any feedback is welcome too :)

Tommaso

[1] :
http://uima.apache.org/d/uimaj-2.3.1/tutorials_and_users_guides.html#ugr.tug.application.using_aes

2011/4/4 Jörn Kottmann <ko...@gmail.com>

> Hi all,
>
> some might already know it, the new Solr 3.1 has now support for UIMA:
> http://wiki.apache.org/solr/SolrUIMA
>
> Jörn
>