You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2019/08/15 20:30:44 UTC

[GitHub] [incubator-druid] jihoonson commented on issue #8257: Add support for parallel native indexing with shuffle for perfect rollup

jihoonson commented on issue #8257: Add support for parallel native indexing with shuffle for perfect rollup
URL: https://github.com/apache/incubator-druid/pull/8257#issuecomment-521786344
 
 
   Thank you for the review.
   
   > currently, user needs to set `totalNumMergeTasks` which by default is set to a static value of 10. as a follow up, it would be great to change the default value dynamically based on size of data, number of partitions, number of segment intervals etc ... so that default behavior just works for most cases.
   
   Yes, the number of merge tasks can be automatically computed in the future. `PartitionStat` was added to collect some statistics which could be useful for such computation. I think it would be pretty cool if we support it, but not sure when I can work on it yet. Will try to do it before 0.17.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org