[GitHub] [incubator-druid] jihoonson opened a new pull request #7547: Minor compaction

[GitBox <gi...@apache.org>]

jihoonson opened a new pull request #7547: Minor compaction
URL: https://github.com/apache/incubator-druid/pull/7547
 
 
   Fixes https://github.com/apache/incubator-druid/issues/7491. This PR is still WIP, but I think it includes all important changes. Remaining TODOs are mostly about adding more unit tests. I've been testing this PR in our in-house cluster for several days and it looks fine.
   
   This PR is slightly different from the proposal in #7491. I'll update the proposal shortly.
   
   This PR is marked as `Incompatible` because it introduces a new shardSpec. It's not possible to roll back after this PR. For rolling update while kafka/kinesis indexing service is running, any kind of overwriting tasks (including compaction task and index task) should be stopped first. Otherwise, kafka/kinesis index tasks might fail when they list segments with the new shardSpec generated by overwriting tasks. 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org