You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Aggarwal-Raghav (via GitHub)" <gi...@apache.org> on 2026/03/07 11:05:40 UTC
Re: [PR] TEZ-4682: [Cloud] Tez AM docker image [tez]
Aggarwal-Raghav commented on PR #456:
URL: https://github.com/apache/tez/pull/456#issuecomment-4016261977
In YARN the AM was started using these opts in my env.
```
echo "Launching container"
exec /bin/bash -c "$JAVA_HOME/bin/java -Xmx819m -Djava.io.tmpdir=$PWD/tmp -server -Djava.net.preferIPv4Stack=true -Xlog:gc*=info,class+load=info::time,uptime,level,tags -XX:+UseNUMA --add-opens=java.base/java.net=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.base/java.util.concurrent.atomic=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.lang.invoke=ALL-UNNAMED --add-opens=java.base/java.lang.reflect=ALL-UNNAMED --add-opens=java.base/java.math=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/java.text=ALL-UNNAMED --add-opens=java.base/java.time=ALL-UNNAMED --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED --add-opens=java.base/jdk.internal.reflect=ALL-UNNAMED --add-opens=java.sql/java.sql=ALL-UNNAMED --add-opens=java.base/sun.nio.ch=ALL-UNNAMED --add-o
pens=java.base/sun.nio.cs=ALL-UNNAMED --add-opens=java.base/java.util.regex=ALL-UNNAMED --add-opens=java.base/java.security=ALL-UNNAMED --add-opens=java.base/sun.security.provider=ALL-UNNAMED --add-opens java.base/java.lang=ALL-UNNAMED -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=/Users/raghav/Desktop/setup/hadoop/logs/userlogs/application_1772650638101_0002/container_1772650638101_0002_01_000001 -Dtez.root.logger=INFO,CLA -Dsun.nio.ch.bugLevel='' org.apache.tez.dag.app.DAGAppMaster --session 1>/Users/raghav/Desktop/setup/hadoop/logs/userlogs/application_1772650638101_0002/container_1772650638101_0002_01_000001/stdout 2>/Users/raghav/Desktop/setup/hadoop/logs/userlogs/application_1772650638101_0002/container_1772650638101_0002_01_000001/stderr "
```
Based on this I have update the java opts to use `TezLog4jConfigurator` and `tez-container-log4j.properties`.
NOTE:
1. `yarn.app.container.log.dir` was added as it is used in `tez-container-log4j.properties`.
2. `tez-container-log4j.properties` exists in tez-dag.jar so no need for explicit log4j2 file. Filed TEZ-4690 for moving to log4j2 in long run.
3. Added console appender in `tez-container-log4j.properties` to simulate same behaviour of logs on console as it was with hadoop tarballl.
4. Added gc parameters but they are creating noise in logs. Hence commented it out. On need basis developer can uncomment and re-build image
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@tez.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org