You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by syedfa <fa...@gmail.com> on 2009/03/14 09:40:23 UTC

Lucene vs. LingPipe vs. GATE

Dear fellow Java/Lucene developers:

I have been working with lucene for the past year or so in developing search
applications, and just recently discovered another API for Java called
LingPipe.  I have never used LingPipe, and would like to know what is the
difference between the two, and if not, when should you use which tool? 
I've been to LingPipe's website, but it does not clarify how it
distinguishes itself from Lucene.  Is it also used for indexing and
searching documents like Lucene, or is it a tool that you would use
alongside Lucene to get better/different results?  What does it do, that
Lucene can't?  

I am also saying this because a new book just came called: Building Search
Applications: Lucene, LingPipe, and Gate

http://www.amazon.com/Building-Search-Applications-Lucene-LingPipe/dp/0615204252

I haven't been able to come up with much about GATE either.  Can anyone
explain more about LingPipe and Gate?

Thanks in advance.
-- 
View this message in context: http://www.nabble.com/Lucene-vs.-LingPipe-vs.-GATE-tp22510490p22510490.html
Sent from the Lucene - Java Users mailing list archive at Nabble.com.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


RE: Lucene vs. LingPipe vs. GATE

Posted by syedfa <fa...@gmail.com>.
Thanks very much, I really appreciated!

Fayyaz


Uwe Schindler wrote:
> 
> From what I can see on the JavaDocs of LingPipe, it is more for text
> analyzing not searching. You could for example use the tokenizer package
> to
> tokenize your text/query before indexing/searching with these tokenizers
> instead of Lucene's. This could be done using a wrapper that transforms a
> LingPipe Tokenizer
> (http://alias-i.com/lingpipe/docs/api/com/aliasi/tokenizer/package-summary.h
> tml) to a Lucene TokenStream or something like that.
> LingPipe also contains functions that help with analyzing which language a
> text is from or others. About using the Clustering algorithms with Lucene,
> I
> do not know.
> 
> I could think of using Lucene extended by some functions from LingPipe.
> From
> the amazon page, it seems, that this book is about that, it combines the
> three tools to create a web search engine.
> 
> Uwe
> 
> -----
> Uwe Schindler
> H.-H.-Meier-Allee 63, D-28213 Bremen
> http://www.thetaphi.de
> eMail: uwe@thetaphi.de
> 
>> -----Original Message-----
>> From: syedfa [mailto:fayyazuddin@gmail.com]
>> Sent: Saturday, March 14, 2009 9:40 AM
>> To: java-user@lucene.apache.org
>> Subject: Lucene vs. LingPipe vs. GATE
>> 
>> 
>> Dear fellow Java/Lucene developers:
>> 
>> I have been working with lucene for the past year or so in developing
>> search
>> applications, and just recently discovered another API for Java called
>> LingPipe.  I have never used LingPipe, and would like to know what is the
>> difference between the two, and if not, when should you use which tool?
>> I've been to LingPipe's website, but it does not clarify how it
>> distinguishes itself from Lucene.  Is it also used for indexing and
>> searching documents like Lucene, or is it a tool that you would use
>> alongside Lucene to get better/different results?  What does it do, that
>> Lucene can't?
>> 
>> I am also saying this because a new book just came called: Building
>> Search
>> Applications: Lucene, LingPipe, and Gate
>> 
>> http://www.amazon.com/Building-Search-Applications-Lucene-
>> LingPipe/dp/0615204252
>> 
>> I haven't been able to come up with much about GATE either.  Can anyone
>> explain more about LingPipe and Gate?
>> 
>> Thanks in advance.
>> --
>> View this message in context: http://www.nabble.com/Lucene-vs.-LingPipe-
>> vs.-GATE-tp22510490p22510490.html
>> Sent from the Lucene - Java Users mailing list archive at Nabble.com.
>> 
>> 
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
> 
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
> 
> 
> 

-- 
View this message in context: http://www.nabble.com/Lucene-vs.-LingPipe-vs.-GATE-tp22510490p22516235.html
Sent from the Lucene - Java Users mailing list archive at Nabble.com.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


RE: Lucene vs. LingPipe vs. GATE

Posted by Uwe Schindler <uw...@thetaphi.de>.
>From what I can see on the JavaDocs of LingPipe, it is more for text
analyzing not searching. You could for example use the tokenizer package to
tokenize your text/query before indexing/searching with these tokenizers
instead of Lucene's. This could be done using a wrapper that transforms a
LingPipe Tokenizer
(http://alias-i.com/lingpipe/docs/api/com/aliasi/tokenizer/package-summary.h
tml) to a Lucene TokenStream or something like that.
LingPipe also contains functions that help with analyzing which language a
text is from or others. About using the Clustering algorithms with Lucene, I
do not know.

I could think of using Lucene extended by some functions from LingPipe. From
the amazon page, it seems, that this book is about that, it combines the
three tools to create a web search engine.

Uwe

-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de

> -----Original Message-----
> From: syedfa [mailto:fayyazuddin@gmail.com]
> Sent: Saturday, March 14, 2009 9:40 AM
> To: java-user@lucene.apache.org
> Subject: Lucene vs. LingPipe vs. GATE
> 
> 
> Dear fellow Java/Lucene developers:
> 
> I have been working with lucene for the past year or so in developing
> search
> applications, and just recently discovered another API for Java called
> LingPipe.  I have never used LingPipe, and would like to know what is the
> difference between the two, and if not, when should you use which tool?
> I've been to LingPipe's website, but it does not clarify how it
> distinguishes itself from Lucene.  Is it also used for indexing and
> searching documents like Lucene, or is it a tool that you would use
> alongside Lucene to get better/different results?  What does it do, that
> Lucene can't?
> 
> I am also saying this because a new book just came called: Building Search
> Applications: Lucene, LingPipe, and Gate
> 
> http://www.amazon.com/Building-Search-Applications-Lucene-
> LingPipe/dp/0615204252
> 
> I haven't been able to come up with much about GATE either.  Can anyone
> explain more about LingPipe and Gate?
> 
> Thanks in advance.
> --
> View this message in context: http://www.nabble.com/Lucene-vs.-LingPipe-
> vs.-GATE-tp22510490p22510490.html
> Sent from the Lucene - Java Users mailing list archive at Nabble.com.
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org