[GitHub] jihoonson edited a comment on issue #5492: Native parallel batch indexing without shuffle

[GitBox <gi...@apache.org>]

jihoonson edited a comment on issue #5492: Native parallel batch indexing without shuffle
URL: https://github.com/apache/incubator-druid/pull/5492#issuecomment-410923528
 
 
   @josephglanville in perfect roll-up, all rows which have the timestamp falling in the same interval should be in the same segment. If input data is already partitioned by timestamp, I think your idea would be nice. However, generally, we can't guarantee that data is already partitioned by their timestamp, and thus the shuffle phase is inevitable. 
   
   @drcrallen thanks for the review! I'm going to resolve conflicts and merge this PR shortly.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org