You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "abhioncbr (via GitHub)" <gi...@apache.org> on 2023/12/04 19:33:53 UTC
Re: [PR] Changes for migration to commons-configuration2 [pinot]
abhioncbr commented on code in PR #11985:
URL: https://github.com/apache/pinot/pull/11985#discussion_r1414394951
##########
pinot-spi/src/main/java/org/apache/pinot/spi/env/CommonsConfigurationUtils.java:
##########
@@ -317,19 +242,57 @@ public static String recoverSpecialCharacterInPropertyValue(String value) {
return value.replace("\0\0", ",");
}
+ /**
Review Comment:
Moved the function [getStringListFromSegmentProperties](https://github.com/apache/pinot/blob/master/pinot-segment-local/src/main/java/org/apache/pinot/segment/local/segment/index/loader/LoaderUtils.java#L70C30-L70C64) to here, since commons-configuration2 saves list-based data individually, for exampel
```bash
segment.dimension.column.names = bytesDimSV1
segment.dimension.column.names = generationNumber
segment.dimension.column.names = intDimMV1
segment.dimension.column.names = intDimMV2
segment.dimension.column.names = longDimSV1
segment.dimension.column.names = longDimSV2
segment.dimension.column.names = mapDim1__KEYS
segment.dimension.column.names = mapDim1__VALUES
segment.dimension.column.names = mapDim2json
segment.dimension.column.names = stringDimMV1
segment.dimension.column.names = stringDimMV2
segment.dimension.column.names = stringDimSV1
segment.dimension.column.names = stringDimSV2
segment.dimension.column.names = textDim1
segment.metric.column.names = doubleMetric1
segment.metric.column.names = floatMetric1
segment.metric.column.names = intMetric1
segment.metric.column.names = longMetric1
```
to make this migration compatible, enhanced the function to split the values in-case if it has comma `,`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org