[jira] [Created] (TEZ-1160) Allow users to set non-tez configs on client side

["Ramya Sunil (JIRA)" <ji...@apache.org>]

Ramya Sunil created TEZ-1160:
--------------------------------

             Summary: Allow users to set non-tez configs on client side
                 Key: TEZ-1160
                 URL: https://issues.apache.org/jira/browse/TEZ-1160
             Project: Apache Tez
          Issue Type: Improvement
            Reporter: Ramya Sunil


We ran into an issue while testing ATS with tez. We wanted to validate if tez AM can write to ATS but we could not do this without updating configs on the entire cluster.

Here is the exact scenario:

1. 10node cluster running with ats=disabled in yarn-site.xml
2. Set ATS=enabled on one host in the cluster and start ATS daemon before test execution
3. Submit a tez job with ats=enabled on cli/tez-site.xml to verify that tezAM writes to ATS.
4. Shutdown ATS.

Step #3 will fail because tezAM reads configs deployed on the cluster i.e RM/NMs and in the configs deployed on the cluster ats=disabled, meaning tezAM does not write to ATS though the client side/tez-site.xml has set ats=enabled.

As a workaround, we need to update the entire cluster with ats=enabled and restart services so that tezAM can write to ATS. It will be nice to have a feature in tez where users can set a non-tez config in tez-site.xml and that config is honored cluster wide for tez AM/tasks.



--
This message was sent by Atlassian JIRA
(v6.2#6252)