[GitHub] [druid] paul-rogers commented on issue #13208: Coordinator crashes trying to compact a datasource ingested through MSQ with PARTITIONED BY ALL

[GitBox <gi...@apache.org>]

paul-rogers commented on issue #13208:
URL: https://github.com/apache/druid/issues/13208#issuecomment-1276425778

   @cryptoe, are we doing the probabilistic analysis to limit memory footprint when we we have a large number of segments? if so, we can start by looking at the total count of segments. If the segment is smaller than some number, I'd assume we can use a deterministic analysis. That is, if there is one segment, we don't need to sample: the one segment will fit in memory just fine.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org