You are viewing a plain text version of this content. The canonical link for it is here.
Posted to general@lucene.apache.org by nn...@transaxtions.com on 2014/09/09 18:00:02 UTC

[Announce] Apache Solr 4.10 with RankingAlgorithm 1.5.4 available now with complex-lsa algorithm (simulates human language acquisition and recognition)

Hi!

I am very excited to announce the availability of Apache Solr 4.10 with
RankingAlgorithm 1.5.4. 

Solr 4.10.0 with RankingAlgorithm 1.5.4 includes support for complex-lsa.
complex-lsa simulates human language acquisition and recognition (see demo
<http://solr-ra.tgels.org/rankingsearchlsa.jsp> ) and can retrieve
semantically related/hidden relationships between terms, sentences,
paragraphs, chapters, books, images, etc. Three new similarities,
TERM_SIMILARITY, DOCUMENT_SIMILARITY, TERM_DOCUMENT_SIMILARITY enable these
with improved precision.  A query for “holy AND ghost” returns jesus/christ
as the top results for the bible corpus with no effort to introduce this
relationship (see demo <http://solr-ra.tgels.org/rankingsearchlsa.jsp> ).

 

This version adds support for  multiple linear algebra libraries.
complex-lsa does a large amount of this calcs so speeding this up should
speed up the retrieval etc. EJML is the fastest if you are using complex-lsa
for a smaller set of documents, while MTJ is faster as your document
collection becomes bigger. MTJ can also use BLAS/LAPACK, etc installed on
your system to further improve performance with native execution. The
performance is similar to a C/C++ application. It can also make use of GPUs
or Intel's mkl library if you have access to it.

RankingAlgorithm 1.5.4 with complex-lsa supports the entire Lucene Query
Syntax , ± and/or boolean/dismax/glob/regular
expression/wildcard/fuzzy/prefix/suffix queries with boosting, etc. This
version increases performance, with increased accuracy and relevance for
Document similarity, fixes problems with phrase queries,  Boolean queries,
etc.


You can get more information about complex-lsa and realtime-search
performance from here: 
http://solr-ra.tgels.org/wiki/en/Complex-lsa-demo

You can download Solr 4.10 with RankingAlgorithm 1.5.4 from here: 
http://solr-ra.tgels.org

Please download and give the new version a try.

Regards, 

Nagendra Nagarajayya 
http://solr-ra.tgels.org 
http://elasticsearch-ra.tgels.org 
http://rankingalgorithm.tgels.org 

Note: 
1. Apache Solr 4.10 with RankingAlgorithm 1.5.4 is an external project. 




RE: [Announce] Apache Solr 4.10 with RankingAlgorithm 1.5.4 available now with complex-lsa algorithm (simulates human language acquisition and recognition)

Posted by nn...@transaxtions.com.
Hi Deigo:

Not sure of solr-sense, but complex-lsa is an enhanced lsa implementation with TERM-DOCUMENT Similarity, etc. (not found in lsa).  The relevance/ranking is again different and is more accurate as it uses the RankingAlgorithm scoring model. The query performance gain with this version is significant from the last release, a TERM-SIMILARITY query that used to take about 8-9 seconds now takes just 30ms to 80ms. Lot of performance improvements ...

Warm Regards,

Nagendra Nagarajayya
 http://solr-ra.tgels.org
 http://elasticsearch-ra.tgels.org
 http://rankingalgorithm.tgels.org
(accurate and relevant, simulates human language acquisition and recognition)

-----Original Message-----
From: Diego Fernandez [mailto:difernan@redhat.com] 
Sent: Tuesday, September 9, 2014 10:38 AM
To: solr-user@lucene.apache.org
Cc: general@lucene.apache.org
Subject: Re: [Announce] Apache Solr 4.10 with RankingAlgorithm 1.5.4 available now with complex-lsa algorithm (simulates human language acquisition and recognition)

Interesting.  Does anyone know how that compares to this http://www.searchbox.com/products/searchbox-plugins/solr-sense/?

Diego Fernandez - 爱国
Software Engineer
US GSS Supportability - Diagnostics


----- Original Message -----
> Hi!
> 
> I am very excited to announce the availability of Apache Solr 4.10 
> with RankingAlgorithm 1.5.4.
> 
> Solr 4.10.0 with RankingAlgorithm 1.5.4 includes support for complex-lsa.
> complex-lsa simulates human language acquisition and recognition (see 
> demo <http://solr-ra.tgels.org/rankingsearchlsa.jsp> ) and can 
> retrieve semantically related/hidden relationships between terms, 
> sentences, paragraphs, chapters, books, images, etc. Three new 
> similarities, TERM_SIMILARITY, DOCUMENT_SIMILARITY, 
> TERM_DOCUMENT_SIMILARITY enable these with improved precision.  A 
> query for “holy AND ghost” returns jesus/christ as the top results for 
> the bible corpus with no effort to introduce this relationship (see demo <http://solr-ra.tgels.org/rankingsearchlsa.jsp> ).
> 
>  
> 
> This version adds support for  multiple linear algebra libraries.
> complex-lsa does a large amount of this calcs so speeding this up 
> should speed up the retrieval etc. EJML is the fastest if you are 
> using complex-lsa for a smaller set of documents, while MTJ is faster 
> as your document collection becomes bigger. MTJ can also use 
> BLAS/LAPACK, etc installed on your system to further improve 
> performance with native execution. The performance is similar to a 
> C/C++ application. It can also make use of GPUs or Intel's mkl library if you have access to it.
> 
> RankingAlgorithm 1.5.4 with complex-lsa supports the entire Lucene 
> Query Syntax , ± and/or boolean/dismax/glob/regular 
> expression/wildcard/fuzzy/prefix/suffix queries with boosting, etc. 
> This version increases performance, with increased accuracy and 
> relevance for Document similarity, fixes problems with phrase queries,  
> Boolean queries, etc.
> 
> 
> You can get more information about complex-lsa and realtime-search 
> performance from here:
> http://solr-ra.tgels.org/wiki/en/Complex-lsa-demo
> 
> You can download Solr 4.10 with RankingAlgorithm 1.5.4 from here:
> http://solr-ra.tgels.org
> 
> Please download and give the new version a try.
> 
> Regards,
> 
> Nagendra Nagarajayya
> http://solr-ra.tgels.org
> http://elasticsearch-ra.tgels.org
> http://rankingalgorithm.tgels.org
> 
> Note:
> 1. Apache Solr 4.10 with RankingAlgorithm 1.5.4 is an external project.
> 
> 
> 
> 


Re: [Announce] Apache Solr 4.10 with RankingAlgorithm 1.5.4 available now with complex-lsa algorithm (simulates human language acquisition and recognition)

Posted by Alexandre Rafalovitch <ar...@gmail.com>.
On Tue, Sep 9, 2014 at 1:38 PM, Diego Fernandez <di...@redhat.com> wrote:
> Interesting.  Does anyone know how that compares to this http://www.searchbox.com/products/searchbox-plugins/solr-sense/?

Well, for one, the Solr-sense pricing seems to be so sense-tive that
you have to contact the sales team to find it out. The version
announced here is free for public and commercial use AFAIK.

I have not tested either one yet.

Regards,
   Alex.

Personal: http://www.outerthoughts.com/ and @arafalov
Solr resources and newsletter: http://www.solr-start.com/ and @solrstart
Solr popularizers community: https://www.linkedin.com/groups?gid=6713853

RE: [Announce] Apache Solr 4.10 with RankingAlgorithm 1.5.4 available now with complex-lsa algorithm (simulates human language acquisition and recognition)

Posted by nn...@transaxtions.com.
Hi Deigo:

Not sure of solr-sense, but complex-lsa is an enhanced lsa implementation with TERM-DOCUMENT Similarity, etc. (not found in lsa).  The relevance/ranking is again different and is more accurate as it uses the RankingAlgorithm scoring model. The query performance gain with this version is significant from the last release, a TERM-SIMILARITY query that used to take about 8-9 seconds now takes just 30ms to 80ms. Lot of performance improvements ...

Warm Regards,

Nagendra Nagarajayya
 http://solr-ra.tgels.org
 http://elasticsearch-ra.tgels.org
 http://rankingalgorithm.tgels.org
(accurate and relevant, simulates human language acquisition and recognition)

-----Original Message-----
From: Diego Fernandez [mailto:difernan@redhat.com] 
Sent: Tuesday, September 9, 2014 10:38 AM
To: solr-user@lucene.apache.org
Cc: general@lucene.apache.org
Subject: Re: [Announce] Apache Solr 4.10 with RankingAlgorithm 1.5.4 available now with complex-lsa algorithm (simulates human language acquisition and recognition)

Interesting.  Does anyone know how that compares to this http://www.searchbox.com/products/searchbox-plugins/solr-sense/?

Diego Fernandez - 爱国
Software Engineer
US GSS Supportability - Diagnostics


----- Original Message -----
> Hi!
> 
> I am very excited to announce the availability of Apache Solr 4.10 
> with RankingAlgorithm 1.5.4.
> 
> Solr 4.10.0 with RankingAlgorithm 1.5.4 includes support for complex-lsa.
> complex-lsa simulates human language acquisition and recognition (see 
> demo <http://solr-ra.tgels.org/rankingsearchlsa.jsp> ) and can 
> retrieve semantically related/hidden relationships between terms, 
> sentences, paragraphs, chapters, books, images, etc. Three new 
> similarities, TERM_SIMILARITY, DOCUMENT_SIMILARITY, 
> TERM_DOCUMENT_SIMILARITY enable these with improved precision.  A 
> query for “holy AND ghost” returns jesus/christ as the top results for 
> the bible corpus with no effort to introduce this relationship (see demo <http://solr-ra.tgels.org/rankingsearchlsa.jsp> ).
> 
>  
> 
> This version adds support for  multiple linear algebra libraries.
> complex-lsa does a large amount of this calcs so speeding this up 
> should speed up the retrieval etc. EJML is the fastest if you are 
> using complex-lsa for a smaller set of documents, while MTJ is faster 
> as your document collection becomes bigger. MTJ can also use 
> BLAS/LAPACK, etc installed on your system to further improve 
> performance with native execution. The performance is similar to a 
> C/C++ application. It can also make use of GPUs or Intel's mkl library if you have access to it.
> 
> RankingAlgorithm 1.5.4 with complex-lsa supports the entire Lucene 
> Query Syntax , ± and/or boolean/dismax/glob/regular 
> expression/wildcard/fuzzy/prefix/suffix queries with boosting, etc. 
> This version increases performance, with increased accuracy and 
> relevance for Document similarity, fixes problems with phrase queries,  
> Boolean queries, etc.
> 
> 
> You can get more information about complex-lsa and realtime-search 
> performance from here:
> http://solr-ra.tgels.org/wiki/en/Complex-lsa-demo
> 
> You can download Solr 4.10 with RankingAlgorithm 1.5.4 from here:
> http://solr-ra.tgels.org
> 
> Please download and give the new version a try.
> 
> Regards,
> 
> Nagendra Nagarajayya
> http://solr-ra.tgels.org
> http://elasticsearch-ra.tgels.org
> http://rankingalgorithm.tgels.org
> 
> Note:
> 1. Apache Solr 4.10 with RankingAlgorithm 1.5.4 is an external project.
> 
> 
> 
> 


Re: [Announce] Apache Solr 4.10 with RankingAlgorithm 1.5.4 available now with complex-lsa algorithm (simulates human language acquisition and recognition)

Posted by Diego Fernandez <di...@redhat.com>.
Interesting.  Does anyone know how that compares to this http://www.searchbox.com/products/searchbox-plugins/solr-sense/?

Diego Fernandez - 爱国
Software Engineer
US GSS Supportability - Diagnostics


----- Original Message -----
> Hi!
> 
> I am very excited to announce the availability of Apache Solr 4.10 with
> RankingAlgorithm 1.5.4.
> 
> Solr 4.10.0 with RankingAlgorithm 1.5.4 includes support for complex-lsa.
> complex-lsa simulates human language acquisition and recognition (see demo
> <http://solr-ra.tgels.org/rankingsearchlsa.jsp> ) and can retrieve
> semantically related/hidden relationships between terms, sentences,
> paragraphs, chapters, books, images, etc. Three new similarities,
> TERM_SIMILARITY, DOCUMENT_SIMILARITY, TERM_DOCUMENT_SIMILARITY enable these
> with improved precision.  A query for “holy AND ghost” returns jesus/christ
> as the top results for the bible corpus with no effort to introduce this
> relationship (see demo <http://solr-ra.tgels.org/rankingsearchlsa.jsp> ).
> 
>  
> 
> This version adds support for  multiple linear algebra libraries.
> complex-lsa does a large amount of this calcs so speeding this up should
> speed up the retrieval etc. EJML is the fastest if you are using complex-lsa
> for a smaller set of documents, while MTJ is faster as your document
> collection becomes bigger. MTJ can also use BLAS/LAPACK, etc installed on
> your system to further improve performance with native execution. The
> performance is similar to a C/C++ application. It can also make use of GPUs
> or Intel's mkl library if you have access to it.
> 
> RankingAlgorithm 1.5.4 with complex-lsa supports the entire Lucene Query
> Syntax , ± and/or boolean/dismax/glob/regular
> expression/wildcard/fuzzy/prefix/suffix queries with boosting, etc. This
> version increases performance, with increased accuracy and relevance for
> Document similarity, fixes problems with phrase queries,  Boolean queries,
> etc.
> 
> 
> You can get more information about complex-lsa and realtime-search
> performance from here:
> http://solr-ra.tgels.org/wiki/en/Complex-lsa-demo
> 
> You can download Solr 4.10 with RankingAlgorithm 1.5.4 from here:
> http://solr-ra.tgels.org
> 
> Please download and give the new version a try.
> 
> Regards,
> 
> Nagendra Nagarajayya
> http://solr-ra.tgels.org
> http://elasticsearch-ra.tgels.org
> http://rankingalgorithm.tgels.org
> 
> Note:
> 1. Apache Solr 4.10 with RankingAlgorithm 1.5.4 is an external project.
> 
> 
> 
> 

Re: [Announce] Apache Solr 4.10 with RankingAlgorithm 1.5.4 available now with complex-lsa algorithm (simulates human language acquisition and recognition)

Posted by Diego Fernandez <di...@redhat.com>.
Interesting.  Does anyone know how that compares to this http://www.searchbox.com/products/searchbox-plugins/solr-sense/?

Diego Fernandez - 爱国
Software Engineer
US GSS Supportability - Diagnostics


----- Original Message -----
> Hi!
> 
> I am very excited to announce the availability of Apache Solr 4.10 with
> RankingAlgorithm 1.5.4.
> 
> Solr 4.10.0 with RankingAlgorithm 1.5.4 includes support for complex-lsa.
> complex-lsa simulates human language acquisition and recognition (see demo
> <http://solr-ra.tgels.org/rankingsearchlsa.jsp> ) and can retrieve
> semantically related/hidden relationships between terms, sentences,
> paragraphs, chapters, books, images, etc. Three new similarities,
> TERM_SIMILARITY, DOCUMENT_SIMILARITY, TERM_DOCUMENT_SIMILARITY enable these
> with improved precision.  A query for “holy AND ghost” returns jesus/christ
> as the top results for the bible corpus with no effort to introduce this
> relationship (see demo <http://solr-ra.tgels.org/rankingsearchlsa.jsp> ).
> 
>  
> 
> This version adds support for  multiple linear algebra libraries.
> complex-lsa does a large amount of this calcs so speeding this up should
> speed up the retrieval etc. EJML is the fastest if you are using complex-lsa
> for a smaller set of documents, while MTJ is faster as your document
> collection becomes bigger. MTJ can also use BLAS/LAPACK, etc installed on
> your system to further improve performance with native execution. The
> performance is similar to a C/C++ application. It can also make use of GPUs
> or Intel's mkl library if you have access to it.
> 
> RankingAlgorithm 1.5.4 with complex-lsa supports the entire Lucene Query
> Syntax , ± and/or boolean/dismax/glob/regular
> expression/wildcard/fuzzy/prefix/suffix queries with boosting, etc. This
> version increases performance, with increased accuracy and relevance for
> Document similarity, fixes problems with phrase queries,  Boolean queries,
> etc.
> 
> 
> You can get more information about complex-lsa and realtime-search
> performance from here:
> http://solr-ra.tgels.org/wiki/en/Complex-lsa-demo
> 
> You can download Solr 4.10 with RankingAlgorithm 1.5.4 from here:
> http://solr-ra.tgels.org
> 
> Please download and give the new version a try.
> 
> Regards,
> 
> Nagendra Nagarajayya
> http://solr-ra.tgels.org
> http://elasticsearch-ra.tgels.org
> http://rankingalgorithm.tgels.org
> 
> Note:
> 1. Apache Solr 4.10 with RankingAlgorithm 1.5.4 is an external project.
> 
> 
> 
>