[GitHub] tweise commented on issue #6567: [FLINK-10074] Allowable number of checkpoint failures

[GitBox <gi...@apache.org>]

tweise commented on issue #6567: [FLINK-10074] Allowable number of checkpoint failures
URL: https://github.com/apache/flink/pull/6567#issuecomment-421971822
 
 
   @yanghua @tillrohrmann I think a user would normally expect this count to apply globally, but please also consider the case of an intermittent failure (like S3 rate limit or storage backend unavailable for other reason). In a large job that would cause potentially many subtasks to fail in parallel. While this could be addressed by setting a corresponding very high threshold, it would in turn mean a problem that is isolated to a single task would not hit the threshold until much much later, leaving the job in flipflop status instead of failing. 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services