You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@tez.apache.org by GitBox <gi...@apache.org> on 2020/05/18 13:23:10 UTC

[GitHub] [tez] pgaref opened a new pull request #68: TEZ-4183: Failed event AM propagation logic for Tez Unordered fetcher

pgaref opened a new pull request #68:
URL: https://github.com/apache/tez/pull/68


   New event propagation  logic for Tez unordered fetcher.
   Inform AM:
          *    - Immediately if maxTimeToWaitForReportMillis is 0
          *    - When time exceeded SHUFFLE_BATCH_WAIT ms (batch events)
          *    - When more than THRESHOLD readErrors occurred for a particular task_attempt
          *    maxFetchFailuresBeforeReporting (5) (batch events)
   Extending InputReadErrorEvent and HostFetchResult to track diskRead errors
   ReporterCallable thread now sends events to AM either when there is a signal or time exceeded SHUFFLE_BATCH_WAIT


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org