You are viewing a plain text version of this content. The canonical link for it is here.
Posted to general@lucene.apache.org by PacoPeralta <pa...@hotmail.com> on 2011/07/03 19:17:55 UTC
UIMA without API key
Hi.
I would like to know if there is ths possibility of executing UIMA
components inside Solr without to configure Alchemy APi key and Calais API
key to avoid tje internet connection.
Thanks Best Regards
pacoperalta@hotmail.com
--
View this message in context: http://lucene.472066.n3.nabble.com/UIMA-without-API-key-tp3135299p3135299.html
Sent from the Lucene - General mailing list archive at Nabble.com.
Re: UIMA without API key
Posted by Tommaso Teofili <to...@gmail.com>.
No, sorry maybe my explanation was just too abstract.
What I was suggesting is an alternative way of extracting language based on
stopwords dictionaries (using one DictionaryAnnotator instance for each
language) and a custom Annotator to evaluate which dictionary collected more
hits.
In general extracting language with UIMA without having an internet
connection can be done in various ways, if you need help on this however it
may be better asking about it on UIMA mailing list ( dev@uima.apache.org ).
Another option for language identification task which does not use UIMA but
exploits Tika capabilities is being discussed/developed on
https://issues.apache.org/jira/browse/SOLR-1979
Hope this helps,
Tommaso
2011/7/4 PacoPeralta <pa...@hotmail.com>
>
>
> Sorry for my insistence...
> If I have configured into the uima_config in the solrconfig.xml:
>
> <lst name="type">
> <str
> name="name">org.apache.uima.alchemy.ts.language.LanguageFS</str>
> <lst name="mapping">
> <str name="feature">language</str>
> <str name="field">language</str>
> </lst>
> </lst>
>
> <lst name="type">
> <str name="name">org.apache.uima.DictionaryEntry</str>
> <lst name="mapping">
> <str name="feature">coveredText</str>
> <str name="field">tag</str>
> </lst>
> </lst>
>
> And I follow the steps that you listed, Could I extract language and
> dictionary entries form the indexed documents?
>
> Excuse my ignorance...
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/UIMA-without-API-key-tp3135299p3137478.html
> Sent from the Lucene - General mailing list archive at Nabble.com.
>
Re: UIMA without API key
Posted by PacoPeralta <pa...@hotmail.com>.
Sorry for my insistence...
If I have configured into the uima_config in the solrconfig.xml:
<lst name="type">
<str
name="name">org.apache.uima.alchemy.ts.language.LanguageFS</str>
<lst name="mapping">
<str name="feature">language</str>
<str name="field">language</str>
</lst>
</lst>
<lst name="type">
<str name="name">org.apache.uima.DictionaryEntry</str>
<lst name="mapping">
<str name="feature">coveredText</str>
<str name="field">tag</str>
</lst>
</lst>
And I follow the steps that you listed, Could I extract language and
dictionary entries form the indexed documents?
Excuse my ignorance...
--
View this message in context: http://lucene.472066.n3.nabble.com/UIMA-without-API-key-tp3135299p3137478.html
Sent from the Lucene - General mailing list archive at Nabble.com.
Re: UIMA without API key
Posted by Tommaso Teofili <to...@gmail.com>.
Right, with the approach described above you don't need internet connection
nor API keys.
Tommaso
2011/7/4 PacoPeralta <pa...@hotmail.com>
> Hi Tommaso
> And Would I to use some UIMa modules without to configure
> runtimeParameters?, for example by implementing core uima in local?:
> <str name="keyword_apikey">API_KEY</str>
> <str name="concept_apikey">API_KEY</str>
> <str name="lang_apikey">API_KEY</str>
> <str name="cat_apikey">API_KEY</str>
> <str name="entities_apikey">API_KEY</str>
> <str name="oc_licenseID">API_KEY</str>
>
>
> I would like to avoid having to connect to internet to validate APIKey...
>
> Best Regards
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/UIMA-without-API-key-tp3135299p3137209.html
> Sent from the Lucene - General mailing list archive at Nabble.com.
>
Re: UIMA without API key
Posted by PacoPeralta <pa...@hotmail.com>.
Hi Tommaso
And Would I to use some UIMa modules without to configure
runtimeParameters?, for example by implementing core uima in local?:
<str name="keyword_apikey">API_KEY</str>
<str name="concept_apikey">API_KEY</str>
<str name="lang_apikey">API_KEY</str>
<str name="cat_apikey">API_KEY</str>
<str name="entities_apikey">API_KEY</str>
<str name="oc_licenseID">API_KEY</str>
I would like to avoid having to connect to internet to validate APIKey...
Best Regards
--
View this message in context: http://lucene.472066.n3.nabble.com/UIMA-without-API-key-tp3135299p3137209.html
Sent from the Lucene - General mailing list archive at Nabble.com.
Re: UIMA without API key
Posted by Tommaso Teofili <to...@gmail.com>.
Of course you can.
For example you could use the Solr stopwords.txt or a new stopwords
dictionary file for each language along with DicitonaryAnnotator then
identify which dictionary generated more hits.
Regards,
Tommaso
2011/7/3 PacoPeralta <pa...@hotmail.com>
> Hi Tommaso, thanks for your reply.
> And could do some analysis as language detection or analysis engine based
> on
> dictionary entries from local, without validating Api key??
> Thanks best regards
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/UIMA-without-API-key-tp3135299p3135355.html
> Sent from the Lucene - General mailing list archive at Nabble.com.
>
Re: UIMA without API key
Posted by PacoPeralta <pa...@hotmail.com>.
Hi Tommaso, thanks for your reply.
And could do some analysis as language detection or analysis engine based on
dictionary entries from local, without validating Api key??
Thanks best regards
--
View this message in context: http://lucene.472066.n3.nabble.com/UIMA-without-API-key-tp3135299p3135355.html
Sent from the Lucene - General mailing list archive at Nabble.com.
Re: UIMA without API key
Posted by Tommaso Teofili <to...@gmail.com>.
Hello Paco,
you can just disable the AlchemyAPI/OpenCalais analysis engines executed in
the aggregate analysis engine you are using, so if you're using
OverridingParamsExtServicesAE.xml [1] you can just comment the lines
flowConstraints>
<fixedFlow>
<node>
AggregateSentenceAE
</node>
<!--<node>
OpenCalaisAnnotator
</node>-->
<!--<node>
TextKeywordExtractionAEDescriptor
</node>-->
<!--<node>
TextLanguageDetectionAEDescriptor
</node>-->
<!--<node>
TextCategorizationAEDescriptor
</node>-->
<!--<node>
TextConceptTaggingAEDescriptor
</node>-->
<!--<node>
TextRankedEntityExtractionAEDescriptor
</node>-->
</fixedFlow>
</flowConstraints>
Hope this helps,
Tommaso
[1] :
http://svn.apache.org/repos/asf/lucene/dev/tags/lucene_solr_3_3/solr/contrib/uima/src/main/resources/org/apache/uima/desc/OverridingParamsExtServicesAE.xml