[I] [Feature] Add Tokenizer Support for All Index Types [skywalking]

["hanahmily (via GitHub)" <gi...@apache.org>]

hanahmily opened a new issue, #13331:
URL: https://github.com/apache/skywalking/issues/13331

   ### Search before asking
   
   - [x] I had searched in the [issues](https://github.com/apache/skywalking/issues?q=is%3Aissue) and found no similar feature requirement.
   
   
   ### Description
   
   Integrate tokenization capabilities into all index types (core and secondary) to enable full-text search and advanced filtering of tracing data.
   
   Key Features:
   - **Tokenization for Indexed Data**: Support tokenizing indexed fields (e.g., `operationName`, tags) using configurable tokenizers (e.g., keyword, simple, standard). This allows breaking down text into tokens for efficient searching.
   - **Query Tokenization**: Modify the query engine to tokenize search conditions (e.g., "operationName: GET /api/users") into `IN` operations against the tokenized index. This enables matching against any token in the field.
   
   
   ### Use case
   
   _No response_
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a pull request to implement this on your own?
   
   - [ ] Yes I am willing to submit a pull request on my own!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Feature] Add Tokenizer Support for All Index Types [skywalking]

["wu-sheng (via GitHub)" <gi...@apache.org>]

wu-sheng commented on issue #13331:
URL: https://github.com/apache/skywalking/issues/13331#issuecomment-2986196629

   Endpoint-tokenizer is supported through measure(endpoint_traffic) 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Feature] Add Tokenizer Support for All Index Types [skywalking]

["hanahmily (via GitHub)" <gi...@apache.org>]

hanahmily closed issue #13331: [Feature] Add Tokenizer Support for All Index Types
URL: https://github.com/apache/skywalking/issues/13331


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org