[GitHub] [pinot] deemoliu commented on issue #10494: Partial Upsert Tables Read a Lot of MMAP'ed Data

["deemoliu (via GitHub)" <gi...@apache.org>]

deemoliu commented on issue #10494:
URL: https://github.com/apache/pinot/issues/10494#issuecomment-1527815550

   I can take a look at partial upsert handler and provide a potential optimization.
   We might ignore and avoid accessing null values during 'merging' to reduce disk I/O.
   
   @Jackie-Jiang Do you think this will be helpful?
   
   @ankitsultana  I think this issue can happen when there are too many columns in a high throughput kafka topic. 
    do we have metrics on disk IO metric for this table? 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org