You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by "Suhas Vasu (JIRA)" <ji...@apache.org> on 2014/01/02 08:38:50 UTC
[jira] [Commented] (FALCON-241) The job logs are not copied during
Post-Processing step in Replication workflows
[ https://issues.apache.org/jira/browse/FALCON-241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13860068#comment-13860068 ]
Suhas Vasu commented on FALCON-241:
-----------------------------------
I think the reason for this is:
we call the function copyTTlogs(fs, path, jobInfo.getActions().get(2))
If you see the function copyTTlogs, we call getExternalId on the 3rd variable.
With latest oozie the order of the actions has changed as it lists the nodes as well, which was not the case in earlier versions of Oozie.
> The job logs are not copied during Post-Processing step in Replication workflows
> --------------------------------------------------------------------------------
>
> Key: FALCON-241
> URL: https://issues.apache.org/jira/browse/FALCON-241
> Project: Falcon
> Issue Type: Bug
> Reporter: Suhas Vasu
> Assignee: Suhas Vasu
>
> The post processing step in Replication workflows is failing with Exception:
> 2013-12-30 11:23:08,889 ERROR - Exception in log mover: (LogMover:117)
> java.lang.IllegalArgumentException: JobId string : - is not properly formed
> at org.apache.hadoop.mapreduce.JobID.forName(JobID.java:149)
> at org.apache.hadoop.mapred.JobID.forName(JobID.java:78)
> at org.apache.falcon.logging.LogMover.getTTlogURL(LogMover.java:203)
> at org.apache.falcon.logging.LogMover.copyTTlogs(LogMover.java:137)
> at org.apache.falcon.logging.LogMover.run(LogMover.java:98)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.falcon.logging.LogMover.main(LogMover.java:72)
> at org.apache.falcon.workflow.FalconPostProcessing.invokeLogProducer(FalconPostProcessing.java:172)
> at org.apache.falcon.workflow.FalconPostProcessing.run(FalconPostProcessing.java:101)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.falcon.workflow.FalconPostProcessing.main(FalconPostProcessing.java:88)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:491)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:391)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
> at org.apache.hadoop.mapred.Child$4.run(Child.java:266)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
> at org.apache.hadoop.mapred.Child.main(Child.java:260)
> The job id is not retrieved the right way which is causing this exception, as a result of which the job logs are not copied for Replication workflows
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)