You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tez.apache.org by "Rohini Palaniswamy (JIRA)" <ji...@apache.org> on 2015/12/16 21:44:46 UTC

[jira] [Created] (TEZ-3008) AM java.io.tmpdir should be set to $PWD/tmp

Rohini Palaniswamy created TEZ-3008:
---------------------------------------

             Summary: AM java.io.tmpdir should be set to $PWD/tmp
                 Key: TEZ-3008
                 URL: https://issues.apache.org/jira/browse/TEZ-3008
             Project: Apache Tez
          Issue Type: Improvement
            Reporter: Rohini Palaniswamy


For tasks it is already done by TezRuntimeChildJVM

{code}
Path childTmpDir = new Path(Environment.PWD.$(),
        YarnConfiguration.DEFAULT_CONTAINER_TEMP_DIR);
    vargs.add("-Djava.io.tmpdir=" + childTmpDir);
{code}

Need to do this in AM as well. Mapreduce has uber mode which usually causes more problem (MAPREDUCE-6576), when user code writes to  java.io.tmpdir as it defaults to /tmp in AM and fills up disk space on cluster nodes. Even though there is no uber mode with Tez AM that can cause problem, there is still the chance that the output committer code of users which run in AM can write something to java.io.tmpdir.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)