You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by Darren Hoffman <da...@jnamics.com> on 2013/09/06 21:41:37 UTC
Smart Chinese Analyzer Performance
I am using the SmartChineseAnalyzer in v3.6 but accessing or instantiating
it for the first time takes 10 to 15 seconds before it does anything. I do
not see this huge delay with StandardAnalyzer.
Is it loading a cache? Is there someway to speed it up?
I am currently using Lucene 3.6 and am trying to upgrade to 4.4 but IntelliJ
does not currently support SPI services.
Does 4.4 offer substantial performance improvements that I should take the
time to upgrade and work around the IntelliJ shortfall?
Thanks,
Darren
Re: 答复: Smart Chinese Analyzer Performance
Posted by Darren Hoffman <da...@jnamics.com>.
Thanks for the advice!
On 9/6/13 3:08 PM, "Oliver Xu (Aigine Co)" <ol...@aigine.com> wrote:
>You may want to try IKAnalyzer which what I have used for years. Never
>see a
>delay with this analyzer as you mentioned.
>
>Oliver
>
>-----邮件原件-----
>发件人: java-user-return-56896-oliver.xu=aigine.com@lucene.apache.org
>[mailto:java-user-return-56896-oliver.xu=aigine.com@lucene.apache.org] 代表
>Erick Erickson
>发送时间: 2013年9月6日 21:07
>收件人: java-user
>主题: Re: Smart Chinese Analyzer Performance
>
>Well, various people have measured between a 50% and 70+% reduction in
>memory used for identical data, so I'd say so. The CHANGES.txt is where
>I'd
>look to see if anything mentioned is worth your time.
>
>Not to mention SolrCloud...
>
>Erick
>
>
>On Fri, Sep 6, 2013 at 3:41 PM, Darren Hoffman <da...@jnamics.com> wrote:
>
>> I am using the SmartChineseAnalyzer in v3.6 but accessing or
>>instantiating
>> it for the first time takes 10 to 15 seconds before it does anything. I
>>do
>> not see this huge delay with StandardAnalyzer.
>>
>> Is it loading a cache? Is there someway to speed it up?
>>
>> I am currently using Lucene 3.6 and am trying to upgrade to 4.4 but
>> IntelliJ
>> does not currently support SPI services.
>>
>> Does 4.4 offer substantial performance improvements that I should take
>>the
>> time to upgrade and work around the IntelliJ shortfall?
>>
>> Thanks,
>> Darren
>>
>>
>>
>
>
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>For additional commands, e-mail: java-user-help@lucene.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
答复: Smart Chinese Analyzer Performance
Posted by "Oliver Xu (Aigine Co)" <ol...@aigine.com>.
You may want to try IKAnalyzer which what I have used for years. Never see a
delay with this analyzer as you mentioned.
Oliver
-----邮件原件-----
发件人: java-user-return-56896-oliver.xu=aigine.com@lucene.apache.org
[mailto:java-user-return-56896-oliver.xu=aigine.com@lucene.apache.org] 代表
Erick Erickson
发送时间: 2013年9月6日 21:07
收件人: java-user
主题: Re: Smart Chinese Analyzer Performance
Well, various people have measured between a 50% and 70+% reduction in
memory used for identical data, so I'd say so. The CHANGES.txt is where I'd
look to see if anything mentioned is worth your time.
Not to mention SolrCloud...
Erick
On Fri, Sep 6, 2013 at 3:41 PM, Darren Hoffman <da...@jnamics.com> wrote:
> I am using the SmartChineseAnalyzer in v3.6 but accessing or instantiating
> it for the first time takes 10 to 15 seconds before it does anything. I do
> not see this huge delay with StandardAnalyzer.
>
> Is it loading a cache? Is there someway to speed it up?
>
> I am currently using Lucene 3.6 and am trying to upgrade to 4.4 but
> IntelliJ
> does not currently support SPI services.
>
> Does 4.4 offer substantial performance improvements that I should take the
> time to upgrade and work around the IntelliJ shortfall?
>
> Thanks,
> Darren
>
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: Smart Chinese Analyzer Performance
Posted by Darren Hoffman <da...@jnamics.com>.
Thanks for the feedback. I'll keep pressing on then.
BTW, I'm not using solr; I am building an Android app.
On 9/6/13 1:06 PM, "Erick Erickson" <er...@gmail.com> wrote:
>Well, various people have measured between a 50% and 70+% reduction in
>memory used for identical data, so I'd say so. The CHANGES.txt is where
>I'd
>look to see if anything mentioned is worth your time.
>
>Not to mention SolrCloud...
>
>Erick
>
>
>On Fri, Sep 6, 2013 at 3:41 PM, Darren Hoffman <da...@jnamics.com> wrote:
>
>> I am using the SmartChineseAnalyzer in v3.6 but accessing or
>>instantiating
>> it for the first time takes 10 to 15 seconds before it does anything. I
>>do
>> not see this huge delay with StandardAnalyzer.
>>
>> Is it loading a cache? Is there someway to speed it up?
>>
>> I am currently using Lucene 3.6 and am trying to upgrade to 4.4 but
>> IntelliJ
>> does not currently support SPI services.
>>
>> Does 4.4 offer substantial performance improvements that I should take
>>the
>> time to upgrade and work around the IntelliJ shortfall?
>>
>> Thanks,
>> Darren
>>
>>
>>
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: Smart Chinese Analyzer Performance
Posted by Erick Erickson <er...@gmail.com>.
Well, various people have measured between a 50% and 70+% reduction in
memory used for identical data, so I'd say so. The CHANGES.txt is where I'd
look to see if anything mentioned is worth your time.
Not to mention SolrCloud...
Erick
On Fri, Sep 6, 2013 at 3:41 PM, Darren Hoffman <da...@jnamics.com> wrote:
> I am using the SmartChineseAnalyzer in v3.6 but accessing or instantiating
> it for the first time takes 10 to 15 seconds before it does anything. I do
> not see this huge delay with StandardAnalyzer.
>
> Is it loading a cache? Is there someway to speed it up?
>
> I am currently using Lucene 3.6 and am trying to upgrade to 4.4 but
> IntelliJ
> does not currently support SPI services.
>
> Does 4.4 offer substantial performance improvements that I should take the
> time to upgrade and work around the IntelliJ shortfall?
>
> Thanks,
> Darren
>
>
>