[GitHub] [pinot] Jackie-Jiang commented on issue #8750: Disable Dictionaries for High Cardinality MV Fields

[GitBox <gi...@apache.org>]

Jackie-Jiang commented on issue #8750:
URL: https://github.com/apache/pinot/issues/8750#issuecomment-1328330848

   For this column, the length of the values are quite skewed (from 20 to 512). The default string dictionary stores values with fixed length (shorter values are padded to be the same length), so the size of the dictionary is 8 (header) + 512 * 776088 = 397357064. Instead, we can store it using var-length dictionary, which has a 4 bytes overhead per entry, but avoid padding the values.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org