You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2022/09/27 23:03:14 UTC
[GitHub] [pinot] chenboat opened a new issue, #9476: Limit the depth of Json index
chenboat opened a new issue, #9476:
URL: https://github.com/apache/pinot/issues/9476
Today Pinot's json index does not limit the depth of Json path it tries to index. For large json data sets, it can result in high memory usage and OOM errors. In many cases, users are happy if they can search up to 2-3 levels of json data. Limiting the depth of json index can help reduce memory usage and meet user demand.
The propose is to add an additional config `maxDepth` to the existing json-index in Pinot to limit the depth of indexed json path. Beyond the maxDepth, json data will not be indexed.
cc @icefury71 @Jackie-Jiang
https://docs.pinot.apache.org/basics/indexing/json-index
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] Jackie-Jiang closed issue #9476: Limit the depth of Json index
Posted by GitBox <gi...@apache.org>.
Jackie-Jiang closed issue #9476: Limit the depth of Json index
URL: https://github.com/apache/pinot/issues/9476
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org