You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Satish Subhashrao Saley (JIRA)" <ji...@apache.org> on 2016/07/06 23:17:11 UTC
[jira] [Resolved] (OOZIE-2561) Child job url in case of child job
failure
[ https://issues.apache.org/jira/browse/OOZIE-2561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Satish Subhashrao Saley resolved OOZIE-2561.
--------------------------------------------
Resolution: Duplicate
> Child job url in case of child job failure
> ------------------------------------------
>
> Key: OOZIE-2561
> URL: https://issues.apache.org/jira/browse/OOZIE-2561
> Project: Oozie
> Issue Type: Bug
> Reporter: Satish Subhashrao Saley
> Assignee: Satish Subhashrao Saley
>
> Currently we are putting child job ids in output.properties in
> {code}
> protected static void writeExternalChildIDs(String logFile, Pattern[] patterns, String name) {
> // Harvesting and recording Hadoop Job IDs
> // See JavaActionExecutor#readExternalChildIDs for how they are read
> try {
> Properties jobIds = getHadoopJobIds(logFile, patterns);
> File file = new File(System.getProperty(LauncherMapper.ACTION_PREFIX
> + LauncherMapper.ACTION_DATA_OUTPUT_PROPS));
> OutputStream os = new FileOutputStream(file);
> try {
> jobIds.store(os, "");
> }
> finally {
> os.close();
> }
> System.out.println(" Hadoop Job IDs executed by " + name + ": " + jobIds.getProperty(HADOOP_JOBS));
> System.out.println();
> }
> catch (Exception e) {
> System.out.println("WARN: Error getting Hadoop Job IDs executed by " + name);
> e.printStackTrace(System.out);
> }
> }
> {code}
> We read from this file only in case of success of Launcher Main
> {code}
> In JavaActionExecutor:
> if (LauncherMapperHelper.isMainSuccessful(runningJob)) {
> if (getCaptureOutput(action) && LauncherMapperHelper.hasOutputData(actionData)) {
> context.setExecutionData(SUCCEEDED, PropertiesUtils.stringToProperties(actionData
> .get(LauncherMapper.ACTION_DATA_OUTPUT_PROPS)));
> LOG.info(XLog.STD, "action produced output");
> }
> {code}
> We should write child job its to oozie.action.externalChildIDs. We need changes in following
> - HiveMain
> - Hive2Main
> - DistcpMain
> - SparkMain
> - SqoopMain
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)