You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Yonik Seeley (JIRA)" <ji...@apache.org> on 2005/09/21 23:41:27 UTC
[jira] Created: (LUCENE-437) SnowballFilter loses token position offset
SnowballFilter loses token position offset
------------------------------------------
Key: LUCENE-437
URL: http://issues.apache.org/jira/browse/LUCENE-437
Project: Lucene - Java
Type: Bug
Components: Analysis
Versions: CVS Nightly - Specify date in submission
Reporter: Yonik Seeley
SnowballFilter doesn't set the token position increment (and thus it defaults to 1).
This also affetcs SnowballAnalyzer since it uses SnowballFilter.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Resolved: (LUCENE-437) SnowballFilter loses token position offset
Posted by "Erik Hatcher (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/LUCENE-437?page=all ]
Erik Hatcher resolved LUCENE-437:
---------------------------------
Fix Version: unspecified
Resolution: Fixed
Yonik - thanks for the patch! It has been applied.
> SnowballFilter loses token position offset
> ------------------------------------------
>
> Key: LUCENE-437
> URL: http://issues.apache.org/jira/browse/LUCENE-437
> Project: Lucene - Java
> Type: Bug
> Components: Analysis
> Versions: CVS Nightly - Specify date in submission
> Reporter: Yonik Seeley
> Assignee: Erik Hatcher
> Fix For: unspecified
> Attachments: yonik_snowballfix.txt
>
> SnowballFilter doesn't set the token position increment (and thus it defaults to 1).
> This also affetcs SnowballAnalyzer since it uses SnowballFilter.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
Fwd: [jira] Updated: (LUCENE-437) SnowballFilter loses token position offset
Posted by Erik Hatcher <er...@ehatchersolutions.com>.
Begin forwarded message:
> From: "Yonik Seeley (JIRA)" <ji...@apache.org>
> Date: September 21, 2005 5:45:27 PM EDT
> To: java-dev@lucene.apache.org
> Subject: [jira] Updated: (LUCENE-437) SnowballFilter loses token
> position offset
> Reply-To: java-dev@lucene.apache.org
>
>
> [ http://issues.apache.org/jira/browse/LUCENE-437?page=all ]
>
> Yonik Seeley updated LUCENE-437:
> --------------------------------
>
> Attachment: yonik_snowballfix.txt
>
> "svn diff" for the testcase and patch.
>
> Q: for future patches, should the diffs be in one file or multiple
> files?
One patch file per issue is ideal.
Erik
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Updated: (LUCENE-437) SnowballFilter loses token position offset
Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/LUCENE-437?page=all ]
Yonik Seeley updated LUCENE-437:
--------------------------------
Attachment: yonik_snowballfix.txt
"svn diff" for the testcase and patch.
Q: for future patches, should the diffs be in one file or multiple files?
> SnowballFilter loses token position offset
> ------------------------------------------
>
> Key: LUCENE-437
> URL: http://issues.apache.org/jira/browse/LUCENE-437
> Project: Lucene - Java
> Type: Bug
> Components: Analysis
> Versions: CVS Nightly - Specify date in submission
> Reporter: Yonik Seeley
> Attachments: yonik_snowballfix.txt
>
> SnowballFilter doesn't set the token position increment (and thus it defaults to 1).
> This also affetcs SnowballAnalyzer since it uses SnowballFilter.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Closed: (LUCENE-437) SnowballFilter loses token position offset
Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/LUCENE-437?page=all ]
Yonik Seeley closed LUCENE-437:
-------------------------------
> SnowballFilter loses token position offset
> ------------------------------------------
>
> Key: LUCENE-437
> URL: http://issues.apache.org/jira/browse/LUCENE-437
> Project: Lucene - Java
> Type: Bug
> Components: Analysis
> Versions: unspecified
> Reporter: Yonik Seeley
> Assignee: Erik Hatcher
> Fix For: 1.9
> Attachments: yonik_snowballfix.txt
>
> SnowballFilter doesn't set the token position increment (and thus it defaults to 1).
> This also affetcs SnowballAnalyzer since it uses SnowballFilter.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Updated: (LUCENE-437) SnowballFilter loses token position offset
Posted by "Erik Hatcher (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/LUCENE-437?page=all ]
Erik Hatcher updated LUCENE-437:
--------------------------------
Fix Version: 1.9
(was: unspecified)
Version: unspecified
(was: CVS Nightly - Specify date in submission)
> SnowballFilter loses token position offset
> ------------------------------------------
>
> Key: LUCENE-437
> URL: http://issues.apache.org/jira/browse/LUCENE-437
> Project: Lucene - Java
> Type: Bug
> Components: Analysis
> Versions: unspecified
> Reporter: Yonik Seeley
> Assignee: Erik Hatcher
> Fix For: 1.9
> Attachments: yonik_snowballfix.txt
>
> SnowballFilter doesn't set the token position increment (and thus it defaults to 1).
> This also affetcs SnowballAnalyzer since it uses SnowballFilter.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
Re: Can any one help
Posted by Daniel Naber <lu...@danielnaber.de>.
On Thursday 22 September 2005 15:20, santosh wrote:
(TooManyClauses)
> We are passing this String " booleanQuery.toString() =
> +contents:java* +contents:oracle* " to searcher
see
http://wiki.apache.org/jakarta-lucene/LuceneFAQ#head-06fafb5d19e786a50fb3dfb8821a6af9f37aa831
--
http://www.danielnaber.de
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: Can any one help
Posted by santosh <sa...@siti.com>.
Hi Erik,
Thanks for support
We are passing this String " booleanQuery.toString() = +contents:java*
+contents:oracle* " to searcher
and i also observed that internally it is creating queries which are adding
to the BooleanQuery and Clause sixe is increasing.
Any suggetsion
-Santhosh
----- Original Message -----
From: "Erik Hatcher" <er...@ehatchersolutions.com>
To: <ja...@lucene.apache.org>
Sent: Thursday, September 22, 2005 6:32 PM
Subject: Re: Can any one help
What is the offending .toString() of your query? You're building a
big boolean query somehow - via wildcards? range? fuzzy? The
queries you mention below would not cause that error.
Also, please follow-up to java-user list, not java-dev.
Erik
On Sep 22, 2005, at 1:55 AM, santosh wrote:
> Hi,
>
>
>
> Below is the problem I am facing when I am trying to get the index
> file
> from my production box to local. I got this Exception:
>
> org.apache.lucene.search.BooleanQuery$TooManyClauses
>
> at org.apache.lucene.search.BooleanQuery.add
> (BooleanQuery.java:78)
>
>
>
> This index file contains nearly 30,000 documents. This exception is
> triggered in few cases, when search words are eg : java ,
> eg .java oracle,
> eg : java oracle sql
>
>
>
> This issue is not seen in my production box. For resolving the
> issue in
> local setup some modifications to code are done like, increasing
> the clause
> count, after this its working fine.
>
>
>
> Before getting Hits from the Boolean query I am checking the clause
> count it
> is not more than 20 Even I am not using the RangeQuery.
>
>
>
> My question is that am I going in the right direction or is there
> any other
> settings which I need to take care so that I will not face such
> difficulty
> as my production data keeps increasing to good volumes.
>
>
>
> Pls. Suggest …
>
>
>
> Thanks
>
>
>
> Santhosh Kumar Pabba
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-dev-help@lucene.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
Re: Can any one help
Posted by Erik Hatcher <er...@ehatchersolutions.com>.
What is the offending .toString() of your query? You're building a
big boolean query somehow - via wildcards? range? fuzzy? The
queries you mention below would not cause that error.
Also, please follow-up to java-user list, not java-dev.
Erik
On Sep 22, 2005, at 1:55 AM, santosh wrote:
> Hi,
>
>
>
> Below is the problem I am facing when I am trying to get the index
> file
> from my production box to local. I got this Exception:
>
> org.apache.lucene.search.BooleanQuery$TooManyClauses
>
> at org.apache.lucene.search.BooleanQuery.add
> (BooleanQuery.java:78)
>
>
>
> This index file contains nearly 30,000 documents. This exception is
> triggered in few cases, when search words are eg : java ,
> eg .java oracle,
> eg : java oracle sql
>
>
>
> This issue is not seen in my production box. For resolving the
> issue in
> local setup some modifications to code are done like, increasing
> the clause
> count, after this its working fine.
>
>
>
> Before getting Hits from the Boolean query I am checking the clause
> count it
> is not more than 20 Even I am not using the RangeQuery.
>
>
>
> My question is that am I going in the right direction or is there
> any other
> settings which I need to take care so that I will not face such
> difficulty
> as my production data keeps increasing to good volumes.
>
>
>
> Pls. Suggest …
>
>
>
> Thanks
>
>
>
> Santhosh Kumar Pabba
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-dev-help@lucene.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
Can any one help
Posted by santosh <sa...@siti.com>.
Hi,
Below is the problem I am facing when I am trying to get the index file
from my production box to local. I got this Exception:
org.apache.lucene.search.BooleanQuery$TooManyClauses
at org.apache.lucene.search.BooleanQuery.add(BooleanQuery.java:78)
This index file contains nearly 30,000 documents. This exception is
triggered in few cases, when search words are eg : java , eg .java oracle,
eg : java oracle sql
This issue is not seen in my production box. For resolving the issue in
local setup some modifications to code are done like, increasing the clause
count, after this its working fine.
Before getting Hits from the Boolean query I am checking the clause count it
is not more than 20 Even I am not using the RangeQuery.
My question is that am I going in the right direction or is there any other
settings which I need to take care so that I will not face such difficulty
as my production data keeps increasing to good volumes.
Pls. Suggest …
Thanks
Santhosh Kumar Pabba
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Assigned: (LUCENE-437) SnowballFilter loses token position offset
Posted by "Erik Hatcher (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/LUCENE-437?page=all ]
Erik Hatcher reassigned LUCENE-437:
-----------------------------------
Assign To: Erik Hatcher
> SnowballFilter loses token position offset
> ------------------------------------------
>
> Key: LUCENE-437
> URL: http://issues.apache.org/jira/browse/LUCENE-437
> Project: Lucene - Java
> Type: Bug
> Components: Analysis
> Versions: CVS Nightly - Specify date in submission
> Reporter: Yonik Seeley
> Assignee: Erik Hatcher
> Attachments: yonik_snowballfix.txt
>
> SnowballFilter doesn't set the token position increment (and thus it defaults to 1).
> This also affetcs SnowballAnalyzer since it uses SnowballFilter.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org