You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Amin Mohammed-Coleman (JIRA)" <ji...@apache.org> on 2009/03/12 12:46:50 UTC
[jira] Created: (LUCENE-1559) Highlighting not working in some
instances even though indexsearcher returns result.
Highlighting not working in some instances even though indexsearcher returns result.
------------------------------------------------------------------------------------
Key: LUCENE-1559
URL: https://issues.apache.org/jira/browse/LUCENE-1559
Project: Lucene - Java
Issue Type: Bug
Affects Versions: 2.4
Environment: Mac OS 1.5
Eclipse 3.4
Reporter: Amin Mohammed-Coleman
In some instances highlighting does not return a result. However when you use a different term for teh same document you get results.
Please see attach testcase and template file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Commented: (LUCENE-1559) Highlighting not working in some
instances even though indexsearcher returns result.
Posted by "Mark Harwood (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12681466#action_12681466 ]
Mark Harwood commented on LUCENE-1559:
--------------------------------------
I ran a quick test and I dont think I could see "document" in the Token.termText() of any tokens in the TokenStream you provide to the Highlighter.
It's late and I need to be elsewhere but if you have time to pursue this check the above statement is true.
If so, check the body text retrieved from Document.get("body") in the search results is the same as the String you store at index time (just in case the act of storing/retrieving has altered the text somehow).
Will look into this more later
> Highlighting not working in some instances even though indexsearcher returns result.
> ------------------------------------------------------------------------------------
>
> Key: LUCENE-1559
> URL: https://issues.apache.org/jira/browse/LUCENE-1559
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 2.4
> Environment: Mac OS 1.5
> Eclipse 3.4
> Reporter: Amin Mohammed-Coleman
> Attachments: AJiA CH 02.doc, fileToSearch.txt, HighLightingSummaryTest(2).java, HighLightingSummaryTest.java, HighLightingSummaryTestV3.java
>
>
> In some instances highlighting does not return a result. However when you use a different term for teh same document you get results.
> Please see attach testcase and template file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Commented: (LUCENE-1559) Highlighting not working in some
instances even though indexsearcher returns result.
Posted by "Mark Harwood (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12681323#action_12681323 ]
Mark Harwood commented on LUCENE-1559:
--------------------------------------
Your code still imports POI and is now importing a .DOC file without parsing, producing garbage.
You'll need to supply an example Junit which illustrates this problem with plain text before we can look at it.
You should be able to turn the .Doc into text at your end using POI and then supply the file.
Are you sure there isn't a problem with POI failing to parse the file correctly?
> Highlighting not working in some instances even though indexsearcher returns result.
> ------------------------------------------------------------------------------------
>
> Key: LUCENE-1559
> URL: https://issues.apache.org/jira/browse/LUCENE-1559
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 2.4
> Environment: Mac OS 1.5
> Eclipse 3.4
> Reporter: Amin Mohammed-Coleman
> Attachments: AJiA CH 02.doc, HighLightingSummaryTest(2).java, HighLightingSummaryTest.java
>
>
> In some instances highlighting does not return a result. However when you use a different term for teh same document you get results.
> Please see attach testcase and template file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Commented: (LUCENE-1559) Highlighting not working in some
instances even though indexsearcher returns result.
Posted by "Mark Harwood (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12681507#action_12681507 ]
Mark Harwood commented on LUCENE-1559:
--------------------------------------
Ah. Try set this....
highlighter.setMaxDocCharsToAnalyze(Integer.MAX_VALUE);
> Highlighting not working in some instances even though indexsearcher returns result.
> ------------------------------------------------------------------------------------
>
> Key: LUCENE-1559
> URL: https://issues.apache.org/jira/browse/LUCENE-1559
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 2.4
> Environment: Mac OS 1.5
> Eclipse 3.4
> Reporter: Amin Mohammed-Coleman
> Attachments: AJiA CH 02.doc, fileToSearch.txt, HighLightingSummaryTest(2).java, HighLightingSummaryTest.java, HighLightingSummaryTestV3.java
>
>
> In some instances highlighting does not return a result. However when you use a different term for teh same document you get results.
> Please see attach testcase and template file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Updated: (LUCENE-1559) Highlighting not working in some
instances even though indexsearcher returns result.
Posted by "Amin Mohammed-Coleman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amin Mohammed-Coleman updated LUCENE-1559:
------------------------------------------
Attachment: HighLightingSummaryTest(2).java
Updated test case with no external dependencies
> Highlighting not working in some instances even though indexsearcher returns result.
> ------------------------------------------------------------------------------------
>
> Key: LUCENE-1559
> URL: https://issues.apache.org/jira/browse/LUCENE-1559
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 2.4
> Environment: Mac OS 1.5
> Eclipse 3.4
> Reporter: Amin Mohammed-Coleman
> Attachments: AJiA CH 02.doc, HighLightingSummaryTest(2).java, HighLightingSummaryTest.java
>
>
> In some instances highlighting does not return a result. However when you use a different term for teh same document you get results.
> Please see attach testcase and template file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Commented: (LUCENE-1559) Highlighting not working in some
instances even though indexsearcher returns result.
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12681347#action_12681347 ]
Uwe Schindler commented on LUCENE-1559:
---------------------------------------
The problems with POI often come from the fact, that POI does not filter the outputted characters and sometimes even generates non Unicode conform char values (>0xd000). E.g. you sometimes have non-breaking-spaces instead of normal spaces or other things. Depending on the Lucene Analyzer you use, there may be problems. E.g., TIKA uses a filter that maps all incorrect characters coming from POI according to aloowed chars in XML (because it generates XHTML from the docs that can be indexed using TikaAnalyzer).
I think, your problem is invalid plain text content coming from POI.
> Highlighting not working in some instances even though indexsearcher returns result.
> ------------------------------------------------------------------------------------
>
> Key: LUCENE-1559
> URL: https://issues.apache.org/jira/browse/LUCENE-1559
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 2.4
> Environment: Mac OS 1.5
> Eclipse 3.4
> Reporter: Amin Mohammed-Coleman
> Attachments: AJiA CH 02.doc, HighLightingSummaryTest(2).java, HighLightingSummaryTest.java
>
>
> In some instances highlighting does not return a result. However when you use a different term for teh same document you get results.
> Please see attach testcase and template file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Commented: (LUCENE-1559) Highlighting not working in some
instances even though indexsearcher returns result.
Posted by "Amin Mohammed-Coleman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12681310#action_12681310 ]
Amin Mohammed-Coleman commented on LUCENE-1559:
-----------------------------------------------
This problem occurs when using this exact document and other document which is pdf. I'm not sure the test will be valid if i just use a normal test file. The version of POI am currently using is :
3.1-Final
poi-scratchpad-3.1-final
I can try to extract the test with no other libraries but I;'m not sure if it will work.
> Highlighting not working in some instances even though indexsearcher returns result.
> ------------------------------------------------------------------------------------
>
> Key: LUCENE-1559
> URL: https://issues.apache.org/jira/browse/LUCENE-1559
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 2.4
> Environment: Mac OS 1.5
> Eclipse 3.4
> Reporter: Amin Mohammed-Coleman
> Attachments: AJiA CH 02.doc, HighLightingSummaryTest.java
>
>
> In some instances highlighting does not return a result. However when you use a different term for teh same document you get results.
> Please see attach testcase and template file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Commented: (LUCENE-1559) Highlighting not working in some
instances even though indexsearcher returns result.
Posted by "Mark Harwood (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12681344#action_12681344 ]
Mark Harwood commented on LUCENE-1559:
--------------------------------------
>>Sorry...I don't know what I should do at this stage
Give us a Junit example of your problem code when working with plain text (Not PDF, word or .doc) that clearly demonstrates where Lucene fails to index/search or highlight this text correctly.
> Highlighting not working in some instances even though indexsearcher returns result.
> ------------------------------------------------------------------------------------
>
> Key: LUCENE-1559
> URL: https://issues.apache.org/jira/browse/LUCENE-1559
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 2.4
> Environment: Mac OS 1.5
> Eclipse 3.4
> Reporter: Amin Mohammed-Coleman
> Attachments: AJiA CH 02.doc, HighLightingSummaryTest(2).java, HighLightingSummaryTest.java
>
>
> In some instances highlighting does not return a result. However when you use a different term for teh same document you get results.
> Please see attach testcase and template file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Issue Comment Edited: (LUCENE-1559) Highlighting not working
in some instances even though indexsearcher returns result.
Posted by "Amin Mohammed-Coleman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12681315#action_12681315 ]
Amin Mohammed-Coleman edited comment on LUCENE-1559 at 3/12/09 6:43 AM:
------------------------------------------------------------------------
Updated test case with no external dependencies
HighLightingSummaryTest(2).java
was (Author: amin):
Updated test case with no external dependencies
> Highlighting not working in some instances even though indexsearcher returns result.
> ------------------------------------------------------------------------------------
>
> Key: LUCENE-1559
> URL: https://issues.apache.org/jira/browse/LUCENE-1559
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 2.4
> Environment: Mac OS 1.5
> Eclipse 3.4
> Reporter: Amin Mohammed-Coleman
> Attachments: AJiA CH 02.doc, HighLightingSummaryTest(2).java, HighLightingSummaryTest.java
>
>
> In some instances highlighting does not return a result. However when you use a different term for teh same document you get results.
> Please see attach testcase and template file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Updated: (LUCENE-1559) Highlighting not working in some
instances even though indexsearcher returns result.
Posted by "Amin Mohammed-Coleman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amin Mohammed-Coleman updated LUCENE-1559:
------------------------------------------
Attachment: HighLightingSummaryTestV3.java
fileToSearch.txt
Updated test case with no external dependencies except for lucene and junit.
> Highlighting not working in some instances even though indexsearcher returns result.
> ------------------------------------------------------------------------------------
>
> Key: LUCENE-1559
> URL: https://issues.apache.org/jira/browse/LUCENE-1559
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 2.4
> Environment: Mac OS 1.5
> Eclipse 3.4
> Reporter: Amin Mohammed-Coleman
> Attachments: AJiA CH 02.doc, fileToSearch.txt, HighLightingSummaryTest(2).java, HighLightingSummaryTest.java, HighLightingSummaryTestV3.java
>
>
> In some instances highlighting does not return a result. However when you use a different term for teh same document you get results.
> Please see attach testcase and template file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Commented: (LUCENE-1559) Highlighting not working in some
instances even though indexsearcher returns result.
Posted by "Mark Harwood (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12681336#action_12681336 ]
Mark Harwood commented on LUCENE-1559:
--------------------------------------
Can I close this then as it appears to be an issue with your parser, not Lucene?
> Highlighting not working in some instances even though indexsearcher returns result.
> ------------------------------------------------------------------------------------
>
> Key: LUCENE-1559
> URL: https://issues.apache.org/jira/browse/LUCENE-1559
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 2.4
> Environment: Mac OS 1.5
> Eclipse 3.4
> Reporter: Amin Mohammed-Coleman
> Attachments: AJiA CH 02.doc, HighLightingSummaryTest(2).java, HighLightingSummaryTest.java
>
>
> In some instances highlighting does not return a result. However when you use a different term for teh same document you get results.
> Please see attach testcase and template file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Commented: (LUCENE-1559) Highlighting not working in some
instances even though indexsearcher returns result.
Posted by "Amin Mohammed-Coleman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12681329#action_12681329 ]
Amin Mohammed-Coleman commented on LUCENE-1559:
-----------------------------------------------
I don't think there is an error with POI parsing the document as summary is generated when I use the term "aspectj". I will modify the code to use an rtf file and see if this problem still occurs.
> Highlighting not working in some instances even though indexsearcher returns result.
> ------------------------------------------------------------------------------------
>
> Key: LUCENE-1559
> URL: https://issues.apache.org/jira/browse/LUCENE-1559
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 2.4
> Environment: Mac OS 1.5
> Eclipse 3.4
> Reporter: Amin Mohammed-Coleman
> Attachments: AJiA CH 02.doc, HighLightingSummaryTest(2).java, HighLightingSummaryTest.java
>
>
> In some instances highlighting does not return a result. However when you use a different term for teh same document you get results.
> Please see attach testcase and template file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Commented: (LUCENE-1559) Highlighting not working in some
instances even though indexsearcher returns result.
Posted by "Amin Mohammed-Coleman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12681339#action_12681339 ]
Amin Mohammed-Coleman commented on LUCENE-1559:
-----------------------------------------------
Yep. I'm still confused and I don't understand how Lucene indexes the term "document" and I can perform the search. The content of the file is stored in the document compressed (I'm not reparsing the file for highlighting). The document must be in the Lucene document otherwise I would not be able to find the document from the search.
Sorry...I don't know what I should do at this stage (as I mentioned earlier it's also happening to a certain pdf document (unless something is being chooped off during compression).
> Highlighting not working in some instances even though indexsearcher returns result.
> ------------------------------------------------------------------------------------
>
> Key: LUCENE-1559
> URL: https://issues.apache.org/jira/browse/LUCENE-1559
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 2.4
> Environment: Mac OS 1.5
> Eclipse 3.4
> Reporter: Amin Mohammed-Coleman
> Attachments: AJiA CH 02.doc, HighLightingSummaryTest(2).java, HighLightingSummaryTest.java
>
>
> In some instances highlighting does not return a result. However when you use a different term for teh same document you get results.
> Please see attach testcase and template file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Issue Comment Edited: (LUCENE-1559) Highlighting not working
in some instances even though indexsearcher returns result.
Posted by "Amin Mohammed-Coleman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12681329#action_12681329 ]
Amin Mohammed-Coleman edited comment on LUCENE-1559 at 3/12/09 7:34 AM:
------------------------------------------------------------------------
Ok. So it looks like there is an issue when POI extracts the text.
I don't understand this to be honest. When indexing obviously I am indexing the word "document" and when I perform the search with the term "document" I get the correct result.
It seems strange that I cannot have the term "document" in the file. This also happens for a pdf file which makes it even more confusing.
was (Author: amin):
I don't think there is an error with POI parsing the document as summary is generated when I use the term "aspectj". I will modify the code to use an rtf file and see if this problem still occurs.
> Highlighting not working in some instances even though indexsearcher returns result.
> ------------------------------------------------------------------------------------
>
> Key: LUCENE-1559
> URL: https://issues.apache.org/jira/browse/LUCENE-1559
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 2.4
> Environment: Mac OS 1.5
> Eclipse 3.4
> Reporter: Amin Mohammed-Coleman
> Attachments: AJiA CH 02.doc, HighLightingSummaryTest(2).java, HighLightingSummaryTest.java
>
>
> In some instances highlighting does not return a result. However when you use a different term for teh same document you get results.
> Please see attach testcase and template file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Commented: (LUCENE-1559) Highlighting not working in some
instances even though indexsearcher returns result.
Posted by "Amin Mohammed-Coleman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12681351#action_12681351 ]
Amin Mohammed-Coleman commented on LUCENE-1559:
-----------------------------------------------
Seems to make sense. I am using the StandardAnaylzer when indexing. I can understand that there maybe an issue with POI, my only concern is how come Lucene managed to index the term "document" in the first place? The term "document" is in the content of the word document. If there was a problem as you mentioned then I would expect that the "document" would not be indexed.
I am toying with the idea of using TIKA, however I can't find an example from which I could work from. I know the new Lucene In Action book uses TIKA, does anyone have some sample code that I could look at?
I presume I should bring this up in the lucene mailing rather than adding to the JIRA.
Cheers
> Highlighting not working in some instances even though indexsearcher returns result.
> ------------------------------------------------------------------------------------
>
> Key: LUCENE-1559
> URL: https://issues.apache.org/jira/browse/LUCENE-1559
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 2.4
> Environment: Mac OS 1.5
> Eclipse 3.4
> Reporter: Amin Mohammed-Coleman
> Attachments: AJiA CH 02.doc, HighLightingSummaryTest(2).java, HighLightingSummaryTest.java
>
>
> In some instances highlighting does not return a result. However when you use a different term for teh same document you get results.
> Please see attach testcase and template file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Issue Comment Edited: (LUCENE-1559) Highlighting not working
in some instances even though indexsearcher returns result.
Posted by "Amin Mohammed-Coleman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12681468#action_12681468 ]
Amin Mohammed-Coleman edited comment on LUCENE-1559 at 3/12/09 1:22 PM:
------------------------------------------------------------------------
Hi Mark
Thanks for looking into this, your help is much appreciated. I compared the body of the file (value to be indexed) against the doc.get("body") and they are both the same.
assertEquals(bodyToBeStored, bodyText);
Also
tokenText = text.substring(startOffset, endOffset); line 240 of Highlighter doesn't return "document" all i get is "documentation"
Cheers
was (Author: amin):
Hi Mark
Thanks for looking into this, your help is much appreciated. I compared the body of the file (value to be indexed) against the doc.get("body") and they are both the same.
assertEquals(bodyToBeStored, bodyText);
Cheers
> Highlighting not working in some instances even though indexsearcher returns result.
> ------------------------------------------------------------------------------------
>
> Key: LUCENE-1559
> URL: https://issues.apache.org/jira/browse/LUCENE-1559
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 2.4
> Environment: Mac OS 1.5
> Eclipse 3.4
> Reporter: Amin Mohammed-Coleman
> Attachments: AJiA CH 02.doc, fileToSearch.txt, HighLightingSummaryTest(2).java, HighLightingSummaryTest.java, HighLightingSummaryTestV3.java
>
>
> In some instances highlighting does not return a result. However when you use a different term for teh same document you get results.
> Please see attach testcase and template file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Closed: (LUCENE-1559) Highlighting not working in some
instances even though indexsearcher returns result.
Posted by "Mark Harwood (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mark Harwood closed LUCENE-1559.
--------------------------------
Resolution: Invalid
Working as designed with feature designed to prevent too-costly analysis
> Highlighting not working in some instances even though indexsearcher returns result.
> ------------------------------------------------------------------------------------
>
> Key: LUCENE-1559
> URL: https://issues.apache.org/jira/browse/LUCENE-1559
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 2.4
> Environment: Mac OS 1.5
> Eclipse 3.4
> Reporter: Amin Mohammed-Coleman
> Attachments: AJiA CH 02.doc, fileToSearch.txt, HighLightingSummaryTest(2).java, HighLightingSummaryTest.java, HighLightingSummaryTestV3.java
>
>
> In some instances highlighting does not return a result. However when you use a different term for teh same document you get results.
> Please see attach testcase and template file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Commented: (LUCENE-1559) Highlighting not working in some
instances even though indexsearcher returns result.
Posted by "Amin Mohammed-Coleman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12681468#action_12681468 ]
Amin Mohammed-Coleman commented on LUCENE-1559:
-----------------------------------------------
Hi Mark
Thanks for looking into this, your help is much appreciated. I compared the body of the file (value to be indexed) against the doc.get("body") and they are both the same.
assertEquals(bodyToBeStored, bodyText);
Cheers
> Highlighting not working in some instances even though indexsearcher returns result.
> ------------------------------------------------------------------------------------
>
> Key: LUCENE-1559
> URL: https://issues.apache.org/jira/browse/LUCENE-1559
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 2.4
> Environment: Mac OS 1.5
> Eclipse 3.4
> Reporter: Amin Mohammed-Coleman
> Attachments: AJiA CH 02.doc, fileToSearch.txt, HighLightingSummaryTest(2).java, HighLightingSummaryTest.java, HighLightingSummaryTestV3.java
>
>
> In some instances highlighting does not return a result. However when you use a different term for teh same document you get results.
> Please see attach testcase and template file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Commented: (LUCENE-1559) Highlighting not working in some
instances even though indexsearcher returns result.
Posted by "Amin Mohammed-Coleman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12681514#action_12681514 ]
Amin Mohammed-Coleman commented on LUCENE-1559:
-----------------------------------------------
That did the trick. Thanks.
> Highlighting not working in some instances even though indexsearcher returns result.
> ------------------------------------------------------------------------------------
>
> Key: LUCENE-1559
> URL: https://issues.apache.org/jira/browse/LUCENE-1559
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 2.4
> Environment: Mac OS 1.5
> Eclipse 3.4
> Reporter: Amin Mohammed-Coleman
> Attachments: AJiA CH 02.doc, fileToSearch.txt, HighLightingSummaryTest(2).java, HighLightingSummaryTest.java, HighLightingSummaryTestV3.java
>
>
> In some instances highlighting does not return a result. However when you use a different term for teh same document you get results.
> Please see attach testcase and template file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Updated: (LUCENE-1559) Highlighting not working in some
instances even though indexsearcher returns result.
Posted by "Amin Mohammed-Coleman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amin Mohammed-Coleman updated LUCENE-1559:
------------------------------------------
Attachment: HighLightingSummaryTest.java
AJiA CH 02.doc
> Highlighting not working in some instances even though indexsearcher returns result.
> ------------------------------------------------------------------------------------
>
> Key: LUCENE-1559
> URL: https://issues.apache.org/jira/browse/LUCENE-1559
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 2.4
> Environment: Mac OS 1.5
> Eclipse 3.4
> Reporter: Amin Mohammed-Coleman
> Attachments: AJiA CH 02.doc, HighLightingSummaryTest.java
>
>
> In some instances highlighting does not return a result. However when you use a different term for teh same document you get results.
> Please see attach testcase and template file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Commented: (LUCENE-1559) Highlighting not working in some
instances even though indexsearcher returns result.
Posted by "Mark Harwood (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12681287#action_12681287 ]
Mark Harwood commented on LUCENE-1559:
--------------------------------------
Sorry to be picky but can you submit a self-contained test with no external dependencies other than Lucene+Highlighter+JUnit
I don't want POI versions to be a factor here.
Cheers
Mark
> Highlighting not working in some instances even though indexsearcher returns result.
> ------------------------------------------------------------------------------------
>
> Key: LUCENE-1559
> URL: https://issues.apache.org/jira/browse/LUCENE-1559
> Project: Lucene - Java
> Issue Type: Bug
> Affects Versions: 2.4
> Environment: Mac OS 1.5
> Eclipse 3.4
> Reporter: Amin Mohammed-Coleman
> Attachments: AJiA CH 02.doc, HighLightingSummaryTest.java
>
>
> In some instances highlighting does not return a result. However when you use a different term for teh same document you get results.
> Please see attach testcase and template file.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org