[GitHub] [pinot] jackluo923 opened a new issue, #10863: Text-index does not support multi-token substring search where first and last tokens are partial

["jackluo923 (via GitHub)" <gi...@apache.org>]

jackluo923 opened a new issue, #10863:
URL: https://github.com/apache/pinot/issues/10863

   We've seen many cases where a user wants to search for a substring in a field with a text index. If all of the tokens in the query are complete words, we can directly use a phrase search:
   `SELECT * FROM table WHERE text_match("col", '"substring match query"')`
   However, if the first or last token is a partial word (e.g., `"string match que"`), the query will not return any results.
   To work around the limitation, we can use this a query like this:
   `SELECT * FROM table WHERE text_match("col", '".*string" AND match AND "que*"') AND "col" LIKE "%string match que%"`
   But this is very slow and computationally expensive due to the LIKE which is necessary for validating the order of the tokens.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org

[GitHub] [pinot] chenboat commented on issue #10863: Text-index does not support multi-token substring search where first and last tokens are partial

["chenboat (via GitHub)" <gi...@apache.org>]

chenboat commented on issue #10863:
URL: https://github.com/apache/pinot/issues/10863#issuecomment-1581246120

   This stackoverflow question suggests ElasticSearch (built on top of Lucene) supports similar substring search feature. https://stackoverflow.com/questions/44791075/in-elasticsearch-how-do-i-search-for-an-arbitrary-substring


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org