You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tez.apache.org by "Rohini Palaniswamy (JIRA)" <ji...@apache.org> on 2015/12/16 21:44:46 UTC
[jira] [Created] (TEZ-3008) AM java.io.tmpdir should be set to
$PWD/tmp
Rohini Palaniswamy created TEZ-3008:
---------------------------------------
Summary: AM java.io.tmpdir should be set to $PWD/tmp
Key: TEZ-3008
URL: https://issues.apache.org/jira/browse/TEZ-3008
Project: Apache Tez
Issue Type: Improvement
Reporter: Rohini Palaniswamy
For tasks it is already done by TezRuntimeChildJVM
{code}
Path childTmpDir = new Path(Environment.PWD.$(),
YarnConfiguration.DEFAULT_CONTAINER_TEMP_DIR);
vargs.add("-Djava.io.tmpdir=" + childTmpDir);
{code}
Need to do this in AM as well. Mapreduce has uber mode which usually causes more problem (MAPREDUCE-6576), when user code writes to java.io.tmpdir as it defaults to /tmp in AM and fills up disk space on cluster nodes. Even though there is no uber mode with Tez AM that can cause problem, there is still the chance that the output committer code of users which run in AM can write something to java.io.tmpdir.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)