You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Janos Makai (Jira)" <ji...@apache.org> on 2022/11/30 14:48:00 UTC
[jira] [Created] (OOZIE-3678) Reduce the number of NameNode access when starting the Yarn job
Janos Makai created OOZIE-3678:
----------------------------------
Summary: Reduce the number of NameNode access when starting the Yarn job
Key: OOZIE-3678
URL: https://issues.apache.org/jira/browse/OOZIE-3678
Project: Oozie
Issue Type: Improvement
Affects Versions: 5.2.1
Reporter: Janos Makai
Assignee: Janos Makai
Before Oozie starts the Yarn application it assembles the class path which's elements' paths are resolved with
{code:java}
remoteFS.resolvePath(p){code}
which can cause slowness and high NameNode load.
The intention is to make this path resolution configurable (ability to turn it on/off) via an Oozie configuration thus customers can turn it off when they experience job start slowness. Default value should result the new behaviour is active.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)