[GitHub] [incubator-druid] jihoonson commented on issue #7949: KIS: potential data overriding when taskDuration is set

[GitBox <gi...@apache.org>]

jihoonson commented on issue #7949: KIS: potential data overriding when taskDuration is set
URL: https://github.com/apache/incubator-druid/issues/7949#issuecomment-505122398
 
 
   Hi @litao91, did you see any data loss because of the described problem? I'm asking because this shouldn't happen. What should happen in KIS is,
   
   1) First generation of Kafka tasks generates segments of interval of 12:00-13:00, of version v1.
   2) Next generation tasks starts and creates new segments, also of interval of 12:00-13:00. At this point, they would lock those segments with the version _v2_.
   4) However, those segments themselves will have the version _**v1**_, not v2, since they shouldn't override existing segments.
   4) Once the new segments are published, both existing and new segments end up being available in historicals.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org