You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Satish Subhashrao Saley (JIRA)" <ji...@apache.org> on 2017/06/12 22:07:00 UTC
[jira] [Created] (HADOOP-14522) Unable to see logs for Job end
notification
Satish Subhashrao Saley created HADOOP-14522:
------------------------------------------------
Summary: Unable to see logs for Job end notification
Key: HADOOP-14522
URL: https://issues.apache.org/jira/browse/HADOOP-14522
Project: Hadoop Common
Issue Type: Bug
Reporter: Satish Subhashrao Saley
Hi, I have set {{mapreduce.job.end-notification.url}} and I am able to get the notification correctly. But I am unable to see log lines from class org.apache.hadoop.mapreduce.v2.app.MRAppMaster regarding job end notification. When I was trying out different notification urls (before stabilizing my app), I didn't have any way to look at the logs and wasted a lot of time figuring out actual issue. It would be good if these logs are also included in syslog for container.
[relevant code|https://github.com/apache/hadoop/blob/branch-2.8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java#L641-L650]
{code}
notifyIsLastAMRetry(isLastAMRetry);
// Stop all services
// This will also send the final report to the ResourceManager
LOG.info("Calling stop for all the services"); <---- Able to see this.
MRAppMaster.this.stop();
if (isLastAMRetry) {
// Send job-end notification when it is safe to report termination to
// users and it is the last AM retry
if (getConfig().get(MRJobConfig.MR_JOB_END_NOTIFICATION_URL) != null) {
try {
LOG.info("Job end notification started for jobID : "
+ job.getReport().getJobId()); <--- unable to see this
JobEndNotifier notifier = new JobEndNotifier();
notifier.setConf(getConfig());
JobReport report = job.getReport();
{code}
Is it because we are shutting down all services including JobHistoryEventHandler in {{MRAppMaster.this.stop();}} ?
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org