[GitHub] [druid] misterbykl commented on issue #8605: Failed to publish segments because of [java.lang.RuntimeException: Aborting transaction!].

[GitBox <gi...@apache.org>]

misterbykl commented on issue #8605:
URL: https://github.com/apache/druid/issues/8605#issuecomment-775092862


   @jihoonson @jon-wei 
   
   we are experiencing the same issue with version 0.20.0. 
   
   > Is the data eventually reingested by a later task?
   
   Yes, but it fails again. Tries 5 times and occasionally fails. Sometimes, on the 4th try, it succeeds.("segmentGranularity":"HOUR")
   
   > BTW, even if you saw this error, the new task will consume the same data from Kafka and create the same set of segments. So as long as your Kafka retention is long enough, you should be able to ingest all data.
   
   Our retention time for related topic is 1 hour. What would be the ideal retention in this case?
   
   > That kind of situation should not happen too often, how often did you observe that kind of task failure?
   
   It happens almost every hour during peak time. No task fails during night time.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org