[GitHub] [pinot] Jackie-Jiang commented on pull request #10046: bytes dictionaries don't work with variable length byte[]s

[GitBox <gi...@apache.org>]

Jackie-Jiang commented on PR #10046:
URL: https://github.com/apache/pinot/pull/10046#issuecomment-1370367631

   Bytes dictionary is designed for fixed length bytes values only (e.g. serialized HLL) because there is no common padding character can be used. For var length bytes values, user should configure it with var-length dictionary.
   I think during segment creation, pinot gather the value length, and automatically use var-length dictionary for bytes columns when it detects values with different lengths.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org