[GitHub] [incubator-pinot] siddharthteotia edited a comment on pull request #6710: Add a positional data section to data table and measure data table serialization cost on server

[GitBox <gi...@apache.org>]

siddharthteotia edited a comment on pull request #6710:
URL: https://github.com/apache/incubator-pinot/pull/6710#issuecomment-804592233


   With the addition of new data structure in this PR, there are essentially two places in DataTable where the key-value / name-value style structure is located.
   
   - First is the existing DataTable metadata which is also a series of key-value pairs where key is string and value is some statistic/metric. This is towards the beginning of the byte stream
   - Second is the structure introduced in this PR which is written as a footer.
   
   Since we are anyway bumping up the version, how about we move the existing metadata of key-value pairs to the end of file to keep consistency in the format. So, all the metadata stuff (aka key-value pairs or new positional stuff) can be a file footer. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org