[jira] Commented: (SOLR-1536) Support for TokenFilters that may modify input documents

["Mike Perham (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SOLR-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832493#action_12832493 ] 

Mike Perham commented on SOLR-1536:
-----------------------------------

This would be hugely useful for us in implementing a profanity detector.  We'd like to scan the 'content' field for profane tokens and mark a boolean 'safe' field with the results.

> Support for TokenFilters that may modify input documents
> --------------------------------------------------------
>
>                 Key: SOLR-1536
>                 URL: https://issues.apache.org/jira/browse/SOLR-1536
>             Project: Solr
>          Issue Type: New Feature
>          Components: Schema and Analysis
>    Affects Versions: 1.5
>            Reporter: Andrzej Bialecki 
>         Attachments: altering.patch
>
>
> In some scenarios it's useful to be able to create or modify fields in the input document based on analysis of other fields of this document. This need arises e.g. when indexing multilingual documents, or when doing NLP processing such as NER. However, currently this is not possible to do.
> This issue provides an implementation of this functionality that consists of the following parts:
> * DocumentAlteringFilterFactory - abstract superclass that indicates that TokenFilter-s created from this factory may modify fields in a SolrInputDocument.
> * TypeAsFieldFilterFactory - example implementation that illustrates this concept, with a JUnit test.
> * DocumentBuilder modifications to support this functionality.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.