You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Mike Hugo (Created) (JIRA)" <ji...@apache.org> on 2012/01/24 21:54:40 UTC
[jira] [Created] (LUCENE-3721) HTMLStripCharFilterFactory behavior
is different in Solr4 than it was in Solr 3.x
HTMLStripCharFilterFactory behavior is different in Solr4 than it was in Solr 3.x
---------------------------------------------------------------------------------
Key: LUCENE-3721
URL: https://issues.apache.org/jira/browse/LUCENE-3721
Project: Lucene - Java
Issue Type: Bug
Reporter: Mike Hugo
Attachments: htmlstripfilter_test.patch
In Solr3, using the attached configuration, HTML entities like trademark and registered were being stripped (and NOT indexed) using the HTMLStripCharFilterFactory. In Solr4 it looks like those values are still making it through to the index and are then appearing in faceted results (we'd like them not to)
see http://lucene.472066.n3.nabble.com/HTMLStripCharFilterFactory-not-working-in-Solr4-td3685599.html for background
possibly related to this https://issues.apache.org/jira/browse/LUCENE-3690
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3721) HTMLStripCharFilterFactory
behavior is different in Solr4 than it was in Solr 3.x
Posted by "Mike Hugo (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13192521#comment-13192521 ]
Mike Hugo commented on LUCENE-3721:
-----------------------------------
Robert, does the attached test case work for you? If not, do you know how I can get it running the way it used to?
> HTMLStripCharFilterFactory behavior is different in Solr4 than it was in Solr 3.x
> ---------------------------------------------------------------------------------
>
> Key: LUCENE-3721
> URL: https://issues.apache.org/jira/browse/LUCENE-3721
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Mike Hugo
> Attachments: htmlstripfilter_test.patch
>
>
> In Solr3, using the attached configuration, HTML entities like trademark and registered were being stripped (and NOT indexed) using the HTMLStripCharFilterFactory. In Solr4 it looks like those values are still making it through to the index and are then appearing in faceted results (we'd like them not to)
> see http://lucene.472066.n3.nabble.com/HTMLStripCharFilterFactory-not-working-in-Solr4-td3685599.html for background
> possibly related to this https://issues.apache.org/jira/browse/LUCENE-3690
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (LUCENE-3721) CharFilters not being invoked in
Solr
Posted by "Hoss Man (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hoss Man updated LUCENE-3721:
-----------------------------
Description:
On Solr trunk, *all* CharFilters have been non-functional since LUCENE-3396 was committed in r1175297 on 25 Sept 2011, until Yonik's fix today in r1235810; Solr 3.x was not affected - CharFilters have been working there all along.
was:
In Solr3, using the attached configuration, HTML entities like trademark and registered were being stripped (and NOT indexed) using the HTMLStripCharFilterFactory. In Solr4 it looks like those values are still making it through to the index and are then appearing in faceted results (we'd like them not to)
see http://lucene.472066.n3.nabble.com/HTMLStripCharFilterFactory-not-working-in-Solr4-td3685599.html for background
possibly related to this https://issues.apache.org/jira/browse/LUCENE-3690
Assignee: Yonik Seeley
Summary: CharFilters not being invoked in Solr (was: HTMLStripCharFilterFactory behavior is different in Solr4 than it was in Solr 3.x)
updated summary and description
> CharFilters not being invoked in Solr
> -------------------------------------
>
> Key: LUCENE-3721
> URL: https://issues.apache.org/jira/browse/LUCENE-3721
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Mike Hugo
> Assignee: Yonik Seeley
> Fix For: 4.0
>
> Attachments: htmlstripfilter_test.patch
>
>
> On Solr trunk, *all* CharFilters have been non-functional since LUCENE-3396 was committed in r1175297 on 25 Sept 2011, until Yonik's fix today in r1235810; Solr 3.x was not affected - CharFilters have been working there all along.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3721) HTMLStripCharFilterFactory
behavior is different in Solr4 than it was in Solr 3.x
Posted by "Mike Hugo (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13192522#comment-13192522 ]
Mike Hugo commented on LUCENE-3721:
-----------------------------------
Also - I'm happy to change the title if this isn't related to HTMLStripCharFilterFactory, I'm just seeing that the behavior we saw in Solr3.x is different (with the same configuration) in Solr4 - just trying to track down how we get it to work the way it used to! Thanks for the help!
> HTMLStripCharFilterFactory behavior is different in Solr4 than it was in Solr 3.x
> ---------------------------------------------------------------------------------
>
> Key: LUCENE-3721
> URL: https://issues.apache.org/jira/browse/LUCENE-3721
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Mike Hugo
> Attachments: htmlstripfilter_test.patch
>
>
> In Solr3, using the attached configuration, HTML entities like trademark and registered were being stripped (and NOT indexed) using the HTMLStripCharFilterFactory. In Solr4 it looks like those values are still making it through to the index and are then appearing in faceted results (we'd like them not to)
> see http://lucene.472066.n3.nabble.com/HTMLStripCharFilterFactory-not-working-in-Solr4-td3685599.html for background
> possibly related to this https://issues.apache.org/jira/browse/LUCENE-3690
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3721) HTMLStripCharFilterFactory
behavior is different in Solr4 than it was in Solr 3.x
Posted by "Yonik Seeley (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13193105#comment-13193105 ]
Yonik Seeley commented on LUCENE-3721:
--------------------------------------
OK, so it looks like all CharFilters were broken in Solr by LUCENE-3396 (since last Sept!).
I just checked in a fix and added a test.
Thanks for bringing this to our attention Mike!
> HTMLStripCharFilterFactory behavior is different in Solr4 than it was in Solr 3.x
> ---------------------------------------------------------------------------------
>
> Key: LUCENE-3721
> URL: https://issues.apache.org/jira/browse/LUCENE-3721
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Mike Hugo
> Attachments: htmlstripfilter_test.patch
>
>
> In Solr3, using the attached configuration, HTML entities like trademark and registered were being stripped (and NOT indexed) using the HTMLStripCharFilterFactory. In Solr4 it looks like those values are still making it through to the index and are then appearing in faceted results (we'd like them not to)
> see http://lucene.472066.n3.nabble.com/HTMLStripCharFilterFactory-not-working-in-Solr4-td3685599.html for background
> possibly related to this https://issues.apache.org/jira/browse/LUCENE-3690
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3721) HTMLStripCharFilterFactory
behavior is different in Solr4 than it was in Solr 3.x
Posted by "Steven Rowe (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13193117#comment-13193117 ]
Steven Rowe commented on LUCENE-3721:
-------------------------------------
I committed {{BasicFunctionalityTest.testHTMLStrip()}} to branch_3x - it succeeds for me with no changes required.
> HTMLStripCharFilterFactory behavior is different in Solr4 than it was in Solr 3.x
> ---------------------------------------------------------------------------------
>
> Key: LUCENE-3721
> URL: https://issues.apache.org/jira/browse/LUCENE-3721
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Mike Hugo
> Fix For: 4.0
>
> Attachments: htmlstripfilter_test.patch
>
>
> In Solr3, using the attached configuration, HTML entities like trademark and registered were being stripped (and NOT indexed) using the HTMLStripCharFilterFactory. In Solr4 it looks like those values are still making it through to the index and are then appearing in faceted results (we'd like them not to)
> see http://lucene.472066.n3.nabble.com/HTMLStripCharFilterFactory-not-working-in-Solr4-td3685599.html for background
> possibly related to this https://issues.apache.org/jira/browse/LUCENE-3690
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Resolved] (LUCENE-3721) HTMLStripCharFilterFactory behavior
is different in Solr4 than it was in Solr 3.x
Posted by "Robert Muir (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Muir resolved LUCENE-3721.
---------------------------------
Resolution: Not A Problem
According to the mailing thread, this has nothing to do with htmlstripcharfilter.
> HTMLStripCharFilterFactory behavior is different in Solr4 than it was in Solr 3.x
> ---------------------------------------------------------------------------------
>
> Key: LUCENE-3721
> URL: https://issues.apache.org/jira/browse/LUCENE-3721
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Mike Hugo
> Attachments: htmlstripfilter_test.patch
>
>
> In Solr3, using the attached configuration, HTML entities like trademark and registered were being stripped (and NOT indexed) using the HTMLStripCharFilterFactory. In Solr4 it looks like those values are still making it through to the index and are then appearing in faceted results (we'd like them not to)
> see http://lucene.472066.n3.nabble.com/HTMLStripCharFilterFactory-not-working-in-Solr4-td3685599.html for background
> possibly related to this https://issues.apache.org/jira/browse/LUCENE-3690
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Reopened] (LUCENE-3721) HTMLStripCharFilterFactory behavior
is different in Solr4 than it was in Solr 3.x
Posted by "Yonik Seeley (Reopened) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yonik Seeley reopened LUCENE-3721:
----------------------------------
> HTMLStripCharFilterFactory behavior is different in Solr4 than it was in Solr 3.x
> ---------------------------------------------------------------------------------
>
> Key: LUCENE-3721
> URL: https://issues.apache.org/jira/browse/LUCENE-3721
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Mike Hugo
> Fix For: 4.0
>
> Attachments: htmlstripfilter_test.patch
>
>
> In Solr3, using the attached configuration, HTML entities like trademark and registered were being stripped (and NOT indexed) using the HTMLStripCharFilterFactory. In Solr4 it looks like those values are still making it through to the index and are then appearing in faceted results (we'd like them not to)
> see http://lucene.472066.n3.nabble.com/HTMLStripCharFilterFactory-not-working-in-Solr4-td3685599.html for background
> possibly related to this https://issues.apache.org/jira/browse/LUCENE-3690
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Resolved] (LUCENE-3721) HTMLStripCharFilterFactory behavior
is different in Solr4 than it was in Solr 3.x
Posted by "Yonik Seeley (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yonik Seeley resolved LUCENE-3721.
----------------------------------
Resolution: Fixed
Fix Version/s: 4.0
> HTMLStripCharFilterFactory behavior is different in Solr4 than it was in Solr 3.x
> ---------------------------------------------------------------------------------
>
> Key: LUCENE-3721
> URL: https://issues.apache.org/jira/browse/LUCENE-3721
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Mike Hugo
> Fix For: 4.0
>
> Attachments: htmlstripfilter_test.patch
>
>
> In Solr3, using the attached configuration, HTML entities like trademark and registered were being stripped (and NOT indexed) using the HTMLStripCharFilterFactory. In Solr4 it looks like those values are still making it through to the index and are then appearing in faceted results (we'd like them not to)
> see http://lucene.472066.n3.nabble.com/HTMLStripCharFilterFactory-not-working-in-Solr4-td3685599.html for background
> possibly related to this https://issues.apache.org/jira/browse/LUCENE-3690
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3721) HTMLStripCharFilterFactory
behavior is different in Solr4 than it was in Solr 3.x
Posted by "Steven Rowe (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13193109#comment-13193109 ]
Steven Rowe commented on LUCENE-3721:
-------------------------------------
bq. I just checked in a fix and added a test.
Mike's test succeeds for me with the fix.
Thanks Yonik.
> HTMLStripCharFilterFactory behavior is different in Solr4 than it was in Solr 3.x
> ---------------------------------------------------------------------------------
>
> Key: LUCENE-3721
> URL: https://issues.apache.org/jira/browse/LUCENE-3721
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Mike Hugo
> Fix For: 4.0
>
> Attachments: htmlstripfilter_test.patch
>
>
> In Solr3, using the attached configuration, HTML entities like trademark and registered were being stripped (and NOT indexed) using the HTMLStripCharFilterFactory. In Solr4 it looks like those values are still making it through to the index and are then appearing in faceted results (we'd like them not to)
> see http://lucene.472066.n3.nabble.com/HTMLStripCharFilterFactory-not-working-in-Solr4-td3685599.html for background
> possibly related to this https://issues.apache.org/jira/browse/LUCENE-3690
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (LUCENE-3721) HTMLStripCharFilterFactory behavior
is different in Solr4 than it was in Solr 3.x
Posted by "Mike Hugo (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mike Hugo updated LUCENE-3721:
------------------------------
Attachment: htmlstripfilter_test.patch
> HTMLStripCharFilterFactory behavior is different in Solr4 than it was in Solr 3.x
> ---------------------------------------------------------------------------------
>
> Key: LUCENE-3721
> URL: https://issues.apache.org/jira/browse/LUCENE-3721
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Mike Hugo
> Attachments: htmlstripfilter_test.patch
>
>
> In Solr3, using the attached configuration, HTML entities like trademark and registered were being stripped (and NOT indexed) using the HTMLStripCharFilterFactory. In Solr4 it looks like those values are still making it through to the index and are then appearing in faceted results (we'd like them not to)
> see http://lucene.472066.n3.nabble.com/HTMLStripCharFilterFactory-not-working-in-Solr4-td3685599.html for background
> possibly related to this https://issues.apache.org/jira/browse/LUCENE-3690
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org