[GitHub] [druid] madan522 opened a new issue #11629: Why middlemanager termination does not commit the date

[GitBox <gi...@apache.org>]

madan522 opened a new issue #11629:
URL: https://github.com/apache/druid/issues/11629


   I have S3 storage and druid setting that all tasks commits data to S3 once in an hour. 
   For some reason, if middlemanager restarts, I get all tasks in FAILED state and data not commited to s3. 
   Is there a way that make sure that data is commited to s3 if middlemanagers wants to terminate?
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org

[GitHub] [druid] spinus commented on issue #11629: Why middlemanager termination does not commit the data

[GitBox <gi...@apache.org>]

spinus commented on issue #11629:
URL: https://github.com/apache/druid/issues/11629#issuecomment-1083056698


   @madan522 does it ends up in data loss or middlemanager persist data in temporary storage and you can restart tasks later?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org