[GitHub] [lucene-solr] magibney commented on issue #772: Payload-stored position length intervals

[GitBox <gi...@apache.org>]

magibney commented on issue #772: Payload-stored position length intervals
URL: https://github.com/apache/lucene-solr/pull/772#issuecomment-510162543
 
 
   Would you want to consider reordering tokens in PositionLengthTokenFilter, so that query implementations can expect a reliable ordering of tokens from the index? I think this would affect the order of terms recorded in the index only for "prefix phrases", as might be generated with a synonym such as "toaster"=="toaster oven"; but if we're recording position length in the index, it's good to have a defined ordering that reflects this new structural information.
   Reordering would be similar to that done by FlattenGraphFilter; for reference, an example that reorders for position length (and records position length to Payloads) can be found [here](https://github.com/magibney/lucene-solr/blob/LUCENE-7398/master/lucene/core/src/java/org/apache/lucene/analysis/core/PositionLengthOrderTokenFilter.java).

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org