[GitHub] Jackie-Jiang opened a new pull request #3725: Replace partition ranges with partitions

[GitBox <gi...@apache.org>]

Jackie-Jiang opened a new pull request #3725: Replace partition ranges with partitions
URL: https://github.com/apache/incubator-pinot/pull/3725
 
 
   Currently for partition based routing and pruning, we store a list
   of ranges (IntRange), but does not support any operations on ranges.
   Instead, storing a list of partitions (int) should be enough to
   serve all use cases.
   
   New behavior:
   - For json format ColumnPartitionMetadata, replace "partitionRanges"
     with "partitions" key.
     E.g. "partitionRanges":"[0 0],[1 1]" -> "partitions":[0,1]
   - For partition in segment metadata, replace strings with integers
     E.g. partitionValues = [0 0],[1 1] -> oartitionValues = 0,1
   
   Backward-compatibility:
   - Add custom deserializer for ColumnPartitionMetadata to handle both
     new and legacy json format
   - Add ColumnPartitionMetadata.extractPartitions() to handle both new
     and legacy config format
   - Add ColumnPartitionMetadataTest

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@pinot.apache.org
For additional commands, e-mail: dev-help@pinot.apache.org