You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "László Bodor (Jira)" <ji...@apache.org> on 2020/04/17 13:45:00 UTC
[jira] [Updated] (TEZ-4147) Reduce NN calls in
RecoveryService::handleRecoveryEvent
[ https://issues.apache.org/jira/browse/TEZ-4147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
László Bodor updated TEZ-4147:
------------------------------
Attachment: TEZ-4147.01.patch
> Reduce NN calls in RecoveryService::handleRecoveryEvent
> -------------------------------------------------------
>
> Key: TEZ-4147
> URL: https://issues.apache.org/jira/browse/TEZ-4147
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Rajesh Balamohan
> Assignee: László Bodor
> Priority: Trivial
> Attachments: TEZ-4147.01.patch
>
>
> [https://github.com/apache/tez/blob/master/tez-dag/src/main/java/org/apache/tez/dag/history/recovery/RecoveryService.java#L459]
> [https://github.com/apache/tez/blob/master/tez-dag/src/main/java/org/apache/tez/dag/history/recovery/RecoveryService.java#L467]
> {{create(overwrite=false)}} already checks for file exists and throws relevant exception. It should be possible to reduce {{recoveryDirFS.exists(dagFilePath)}} check to help in concurrent job runs (e.g 50-100 AM trying to run very short jobs).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)