You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "clarahong (via GitHub)" <gi...@apache.org> on 2024/12/13 23:19:59 UTC
[I] Table Index Config settings not preserved when migrating to fieldConfigList [pinot]
clarahong opened a new issue, #14660:
URL: https://github.com/apache/pinot/issues/14660
When setting table index configs, Pinot documentation recommends deprecating usage of single-column index configurations in favor of the Field Config List.
However, when attempting to migrate an existing table from the deprecated format, these settings are not respected. For example, using an old table config, dictionary indexes are disabled:
```
{
...
"tableIndexConfig": {
"noDictionaryColumns": [
"col1",
“range1”,
],
...
"optimizeDictionaryForMetrics": true,
"optimizeDictionary": false,
"noDictionarySizeRatioThreshold": 0.85
},
}
```
Updating to a new definition:
```
{
...
"fieldConfigList": [
{
"name": "range1",
"indexes": {
"dictionary": {
"disabled": true
},
"range": {}
}
},
{
"name": "col1",
"indexes": {
"dictionary": {
"disabled": true
},
"json": {
"maxLevels": 1,
"excludeArray": true,
"disableCrossArrayUnnest": true
}
}
}
]
}
```
Making the table config change and triggering a table reload creates new dictionary indexes even though they are specified as disabled. Adding the property "encodingType": "RAW" also does not resolve this issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Table Index Config settings not preserved when migrating to fieldConfigList [pinot]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #14660:
URL: https://github.com/apache/pinot/issues/14660#issuecomment-4627181982
This issue has been closed because it has been inactive for 180 days. If you believe this issue is still relevant, please feel free to reopen it or create a new issue. Thank you!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Table Index Config settings not preserved when migrating to fieldConfigList [pinot]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #14660:
URL: https://github.com/apache/pinot/issues/14660#issuecomment-4384248594
This issue has been automatically marked as stale because it has not had any activity in the last 150 days. It will be closed in 30 days if no further activity occurs. If this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Table Index Config settings not preserved when migrating to fieldConfigList [pinot]
Posted by "clarahong (via GitHub)" <gi...@apache.org>.
clarahong commented on issue #14660:
URL: https://github.com/apache/pinot/issues/14660#issuecomment-2546272199
Thanks for addressing. We'll test out the changes on the next release with 1.3.0 and report back with any issues.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Table Index Config settings not preserved when migrating to fieldConfigList [pinot]
Posted by "Jackie-Jiang (via GitHub)" <gi...@apache.org>.
Jackie-Jiang commented on issue #14660:
URL: https://github.com/apache/pinot/issues/14660#issuecomment-2543383374
Thanks for reporting the issue. I believe this is a bug and should be fixed with #14258. Can you try with the latest master?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Table Index Config settings not preserved when migrating to fieldConfigList [pinot]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #14660: Table Index Config settings not preserved when migrating to fieldConfigList
URL: https://github.com/apache/pinot/issues/14660
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org