[GitHub] fx19880617 commented on issue #3420: Deep Storage Support for Realtime

[GitBox <gi...@apache.org>]

fx19880617 commented on issue #3420: Deep Storage Support for Realtime
URL: https://github.com/apache/incubator-pinot/issues/3420#issuecomment-437806568
 
 
   > > -Then, we commit the segment metadata. In the first pass, we will still need to download the segment from deep storage or send the entire segment with .tar.gz in order to to get the segment metadata.
   > 
   > Why do we need to download the segment again to get segment metadata info? Which kind of info we can get from a download? Can we get them the query parameters of segCommitEnd request?
   
   I think this is the first phase which we follow the same steps as offline segment push to download segment from remote storage in controller and load segment metadata from it.
   
   Eventually we should be able to get rid of controller downloading segments and only push segment metadata.
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@pinot.apache.org
For additional commands, e-mail: dev-help@pinot.apache.org