You are viewing a plain text version of this content. The canonical link for it is here.
Posted to general@lucene.apache.org by 이지홍 <ho...@gmail.com> on 2009/01/04 08:54:58 UTC
SomeBody Help Me! To Find Out The Portuguese Analyzer
hi, all nice to meet you.
i need a 5 analyzer for lucene.
English
German language
French language
Portuguese
If you have That Analyzer.
plz send to : hongsgo@gmail.com
i need you help.
i can't find Portuguese Analyzer.. in Lucene sandbox..
and. what's the snowball analyzer..?
how to use this? when if i have analyzer..
select snowball analyzer or english analyzer?
thanks for read to my article
Re: SomeBody Help Me! To Find Out The Portuguese Analyzer
Posted by Grant Ingersoll <gs...@apache.org>.
On Jan 6, 2009, at 7:26 PM, 이지홍 wrote:
> thanks for your answers.
> i'm sorry. my english writing is not good.
> i was told you. the Lucene SandBox Analyzer.
> you can find out.
> following url :
> http://svn.apache.org/repos/asf/lucene/java/trunk/contrib/analyzers/src/java/org/apache/lucene/analysis/
> go there. you cand find out GermanAnalyzer and FranchAnalyzer.
>
> I will ask you repeat Time.
>
> Lucene SandBox Analyzer is What Diffrent From SnowBallAnalyzer?
I would suggest looking at the code. I haven't ever investigated them
at a low-level. If I had to guess, I bet they just have different
approaches to how stemming is done. Chances are neither is right or
wrong and there is no such thing as a perfect stemmer.
If I were you, I would setup a small program that takes in some number
of Strings from your documents in each of the languages and then runs
them through each Analyzer, printing out the the tokens. I have a
_SAMPLE_ of this in my Lucene Boot Camp training code: http://www.lucenebootcamp.com/LuceneBootCamp/training/src/test/java/com/lucenebootcamp/training/basic/AnalyzerTest.java
>
>
> I don't know That.
>
> Which One Is Best?
Best for what? It's going to depend.
>
>
> you can sure that snowball analyzer is covered english language?
Yes.
Analyzer analyzer = new SnowballAnalyzer("English");
>
>
> Plz Teach me.
>
Please have a look through more of the documentation and try some
things out.
A simple:
Analyzer analyzer = new //FILL IN YOUR ANALYZER HERE
TokenStream stream = analyzer.tokenStream("foo", new
StringReader("Test String Goes here"));
Token token = new Token();
while ((token = tokenStream.next(token)) != null) {
System.out.println("Token: " + token);
}
will go a long way in your understanding of how these Analyzers work.
I am doing Lucene Boot Camp at ApacheCon in Amsterdam, Netherlands in
March. If you can't make that, I suggest you buy the most excellent
"Lucene In Action" by Erik, Otis and Mike M. (http://www.manning.com/hatcher3
). Otherwise, there are plenty of tutorials and articles on using
Lucene at http://wiki.apache.org/lucene-java/Resources and on the Wiki
itself: http://wiki.apache.org/lucene-java/ which will cover how to
use an analyzer.
You might also check out Solr's Admin UI, which has a built in way of
outputting tokens to the screen given some user input in a text box.
See the Solr project for more on that.
Good Luck,
Grant
Re: SomeBody Help Me! To Find Out The Portuguese Analyzer
Posted by 이지홍 <ho...@gmail.com>.
thanks for your answers.
i'm sorry. my english writing is not good.
i was told you. the Lucene SandBox Analyzer.
you can find out.
following url :
http://svn.apache.org/repos/asf/lucene/java/trunk/contrib/analyzers/src/java/org/apache/lucene/analysis/
go there. you cand find out GermanAnalyzer and FranchAnalyzer.
I will ask you repeat Time.
Lucene SandBox Analyzer is What Diffrent From SnowBallAnalyzer?
I don't know That.
Which One Is Best?
you can sure that snowball analyzer is covered english language?
Plz Teach me.
2009년 1월 6일 (화) 오후 10:36, Grant Ingersoll <gs...@apache.org>님의 말:
> I'm not sure what you mean by the Lucene SandBox. Do you mean the contrib
> area?
>
> I think the big difference between the analyzers is how they implement
> stemming, but I would suggest opening up the source and having a look.
>
> Yes, the Snowball Analyzer covers those three languages, as well as many
> others. See the link to the Snowball project for more info on how Snowball
> works.
>
> On Jan 6, 2009, at 2:32 AM, 이지홍 wrote:
>
>> thank you very much.
>> but, i have a question.
>> i was found OtherAnalyzer in Lucene SandBox.
>> what's those?
>> GermanAnalyzer Or FranchAnalyzer In LuceneSandBox.
>> What's Different?
>> SnowBall Analyzer is Covered That?(DE,FR,PT)
>>
>>
>> 2009/1/6 Grant Ingersoll <gs...@apache.org>:
>>>
>>> Hi,
>>>
>>> The SnowballAnalyzer should support all of those languages. See
>>> contrib/snowball and also http://snowball.tartarus.org/
>>>
>>> See the examples in the demo for how to use an Analyzer. You might also
>>> find it useful to look at Solr, which integrates all of these into a
>>> ready
>>> to go system.
>>>
>>>
>>> On Jan 4, 2009, at 2:54 AM, 이지홍 wrote:
>>>
>>>> hi, all nice to meet you.
>>>> i need a 5 analyzer for lucene.
>>>> English
>>>> German language
>>>> French language
>>>> Portuguese
>>>>
>>>> If you have That Analyzer.
>>>> plz send to : hongsgo@gmail.com
>>>>
>>>> i need you help.
>>>>
>>>> i can't find Portuguese Analyzer.. in Lucene sandbox..
>>>>
>>>> and. what's the snowball analyzer..?
>>>> how to use this? when if i have analyzer..
>>>>
>>>> select snowball analyzer or english analyzer?
>>>>
>>>> thanks for read to my article
>>>
>>> --------------------------
>>> Grant Ingersoll
>>>
>>> Lucene Helpful Hints:
>>> http://wiki.apache.org/lucene-java/BasicsOfPerformance
>>> http://wiki.apache.org/lucene-java/LuceneFAQ
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>
> --------------------------
> Grant Ingersoll
>
> Lucene Helpful Hints:
> http://wiki.apache.org/lucene-java/BasicsOfPerformance
> http://wiki.apache.org/lucene-java/LuceneFAQ
>
>
>
>
>
>
>
>
>
>
>
Re: SomeBody Help Me! To Find Out The Portuguese Analyzer
Posted by Grant Ingersoll <gs...@apache.org>.
I'm not sure what you mean by the Lucene SandBox. Do you mean the
contrib area?
I think the big difference between the analyzers is how they implement
stemming, but I would suggest opening up the source and having a look.
Yes, the Snowball Analyzer covers those three languages, as well as
many others. See the link to the Snowball project for more info on
how Snowball works.
On Jan 6, 2009, at 2:32 AM, 이지홍 wrote:
> thank you very much.
> but, i have a question.
> i was found OtherAnalyzer in Lucene SandBox.
> what's those?
> GermanAnalyzer Or FranchAnalyzer In LuceneSandBox.
> What's Different?
> SnowBall Analyzer is Covered That?(DE,FR,PT)
>
>
> 2009/1/6 Grant Ingersoll <gs...@apache.org>:
>> Hi,
>>
>> The SnowballAnalyzer should support all of those languages. See
>> contrib/snowball and also http://snowball.tartarus.org/
>>
>> See the examples in the demo for how to use an Analyzer. You might
>> also
>> find it useful to look at Solr, which integrates all of these into
>> a ready
>> to go system.
>>
>>
>> On Jan 4, 2009, at 2:54 AM, 이지홍 wrote:
>>
>>> hi, all nice to meet you.
>>> i need a 5 analyzer for lucene.
>>> English
>>> German language
>>> French language
>>> Portuguese
>>>
>>> If you have That Analyzer.
>>> plz send to : hongsgo@gmail.com
>>>
>>> i need you help.
>>>
>>> i can't find Portuguese Analyzer.. in Lucene sandbox..
>>>
>>> and. what's the snowball analyzer..?
>>> how to use this? when if i have analyzer..
>>>
>>> select snowball analyzer or english analyzer?
>>>
>>> thanks for read to my article
>>
>> --------------------------
>> Grant Ingersoll
>>
>> Lucene Helpful Hints:
>> http://wiki.apache.org/lucene-java/BasicsOfPerformance
>> http://wiki.apache.org/lucene-java/LuceneFAQ
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
--------------------------
Grant Ingersoll
Lucene Helpful Hints:
http://wiki.apache.org/lucene-java/BasicsOfPerformance
http://wiki.apache.org/lucene-java/LuceneFAQ
Re: SomeBody Help Me! To Find Out The Portuguese Analyzer
Posted by 이지홍 <ho...@gmail.com>.
thank you very much.
but, i have a question.
i was found OtherAnalyzer in Lucene SandBox.
what's those?
GermanAnalyzer Or FranchAnalyzer In LuceneSandBox.
What's Different?
SnowBall Analyzer is Covered That?(DE,FR,PT)
2009/1/6 Grant Ingersoll <gs...@apache.org>:
> Hi,
>
> The SnowballAnalyzer should support all of those languages. See
> contrib/snowball and also http://snowball.tartarus.org/
>
> See the examples in the demo for how to use an Analyzer. You might also
> find it useful to look at Solr, which integrates all of these into a ready
> to go system.
>
>
> On Jan 4, 2009, at 2:54 AM, 이지홍 wrote:
>
>> hi, all nice to meet you.
>> i need a 5 analyzer for lucene.
>> English
>> German language
>> French language
>> Portuguese
>>
>> If you have That Analyzer.
>> plz send to : hongsgo@gmail.com
>>
>> i need you help.
>>
>> i can't find Portuguese Analyzer.. in Lucene sandbox..
>>
>> and. what's the snowball analyzer..?
>> how to use this? when if i have analyzer..
>>
>> select snowball analyzer or english analyzer?
>>
>> thanks for read to my article
>
> --------------------------
> Grant Ingersoll
>
> Lucene Helpful Hints:
> http://wiki.apache.org/lucene-java/BasicsOfPerformance
> http://wiki.apache.org/lucene-java/LuceneFAQ
>
>
>
>
>
>
>
>
>
>
>
Re: SomeBody Help Me! To Find Out The Portuguese Analyzer
Posted by Grant Ingersoll <gs...@apache.org>.
Hi,
The SnowballAnalyzer should support all of those languages. See
contrib/snowball and also http://snowball.tartarus.org/
See the examples in the demo for how to use an Analyzer. You might
also find it useful to look at Solr, which integrates all of these
into a ready to go system.
On Jan 4, 2009, at 2:54 AM, 이지홍 wrote:
> hi, all nice to meet you.
> i need a 5 analyzer for lucene.
> English
> German language
> French language
> Portuguese
>
> If you have That Analyzer.
> plz send to : hongsgo@gmail.com
>
> i need you help.
>
> i can't find Portuguese Analyzer.. in Lucene sandbox..
>
> and. what's the snowball analyzer..?
> how to use this? when if i have analyzer..
>
> select snowball analyzer or english analyzer?
>
> thanks for read to my article
--------------------------
Grant Ingersoll
Lucene Helpful Hints:
http://wiki.apache.org/lucene-java/BasicsOfPerformance
http://wiki.apache.org/lucene-java/LuceneFAQ