[GitHub] [pinot] KKcorps commented on pull request #9804: Add a new server directory to store metadata

[GitBox <gi...@apache.org>]

KKcorps commented on PR #9804:
URL: https://github.com/apache/pinot/pull/9804#issuecomment-1324957363

   > Is this specific to the upsert metadata for now? It is confusing because initially I expect the segment metadata will be stored in this new dir.
   > Do you see a scenario where we don't want the `metadataDir` under the `dateDir`?
   
   Yes, so basically metadataDir specifically can be loaded onto a faster disk system while dataDir can be mounted to a slow disk.
   This will allow us to minimize cost while also providing necessary performance for upsert lookups
   Kishore also doesn't want that users should be able to configure metadata directory from tableConfig and instead it should be a cluster level config.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org