[GitHub] [pinot] mneedham opened a new issue, #10506: Updating JSON index config

["mneedham (via GitHub)" <gi...@apache.org>]

mneedham opened a new issue, #10506:
URL: https://github.com/apache/pinot/issues/10506

   Let’s say I create a segment with the JSON index with default params and I decide afterwards that I want to exclude some fields. 
   
   At the moment there isn't a way to reload the segment because that code path checks if a JSON index exists on that column (which it does) and then skips over it.
   
   (https://github.com/apache/pinot/blob/master/pinot-segment-local/src/main/java/org/apache/pinot/segment/local/segment/index/loader/invertedindex/JsonIndexHandler.java#L89)
   
   I am able to replace the JSON index if I first completely remove it from the table config, reload segments, then add it back to the table config, and reload all segments.
   
   But it would be cool if we could do that in one step rather than two.
   
   cc @Jackie-Jiang 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org

[GitHub] [pinot] Jackie-Jiang commented on issue #10506: Updating JSON index config

["Jackie-Jiang (via GitHub)" <gi...@apache.org>]

Jackie-Jiang commented on issue #10506:
URL: https://github.com/apache/pinot/issues/10506#issuecomment-1490729975

   This is similar to #8700. To support it, we'll need to store the config used to create the segment into the segment metadata, then when loading the segment, we can compare the config within the segment with the table config, and see if we need to re-generate the index.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org