You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Konstantin Knauf (Jira)" <ji...@apache.org> on 2021/07/29 07:38:14 UTC
[jira] [Updated] (FLINK-11324) Custom Log4j properties for each
flink job
[ https://issues.apache.org/jira/browse/FLINK-11324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Konstantin Knauf updated FLINK-11324:
-------------------------------------
Labels: (was: auto-closed)
Priority: Not a Priority (was: Minor)
> Custom Log4j properties for each flink job
> ------------------------------------------
>
> Key: FLINK-11324
> URL: https://issues.apache.org/jira/browse/FLINK-11324
> Project: Flink
> Issue Type: Improvement
> Components: Legacy Components / Flink on Tez
> Affects Versions: 1.6.2
> Reporter: Ankit Sharma
> Priority: Not a Priority
>
> It would be a good idea if we can have a custom log4j files/location for each job we run via flink.
> Currently there is no option for that in flink command.
> I tried providing log4j properties by using below command but it didn't worked for me:
> flink run /usr/lib/flink/examples/batch/WordCount.jar -Dlog4j.configuration=~/log4j_ABC.properties
> So, i checked the source code of flink and found that the path of log4j proerpties are hard-coded in flink command script, so did few twik to make it work. It worked for me but i am really not sure about what other components it might affect.
> Below are the steps/changes done:
> 1. Add below code in $FLINK_HOME/bin/flink file just after the config.sh being called, this code will add a new environment variable FLINK_LOG_SETTING in which we will be setting the log4j-cli.properties absolute path:
> if [ -z "$FLINK_LOG_SETTING" ]; then FLINK_LOG_SETTING=$FLINK_CONF_DIR; fi
> 2. In log_setting variable mentioned in flink, change the -Dlog4j.configuration as below:
> log_setting=(-Dlog.file="$log" -Dlog4j.configuration=file:"$FLINK_LOG_SETTING"/log4j-cli.properties -Dlogback.configurationFile=file:"$FLINK_CONF_DIR"/logback.xml)
> 3. save the changes.
> 4. Now before executing any flink job in cli, export the FLINK_LOG_SETTING to any custom path where you have log4j-cli.properties present for the respective job.
> $ export FLINK_LOG_SETTING=/home/hadoop/test
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)