You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by "Shwetha G S (JIRA)" <ji...@apache.org> on 2014/08/21 12:43:11 UTC
[jira] [Comment Edited] (FALCON-623) HCat replication fails on
table-export
[ https://issues.apache.org/jira/browse/FALCON-623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105263#comment-14105263 ]
Shwetha G S edited comment on FALCON-623 at 8/21/14 10:42 AM:
--------------------------------------------------------------
Actually, I don't think it will work(we verified as well with these configs). Here is the code in oozie that sets the JobConf:
{code}
public JobConf createBaseHadoopConf(Context context, Element actionXml) {
Namespace ns = actionXml.getNamespace();
String jobTracker = actionXml.getChild("job-tracker", ns).getTextTrim();
String nameNode = actionXml.getChild("name-node", ns).getTextTrim();
JobConf conf = Services.get().get(HadoopAccessorService.class).createJobConf(jobTracker);
conf.set(HADOOP_USER, context.getProtoActionConf().get(WorkflowAppService.HADOOP_USER));
conf.set(HADOOP_JOB_TRACKER, jobTracker);
conf.set(HADOOP_JOB_TRACKER_2, jobTracker);
conf.set(HADOOP_YARN_RM, jobTracker);
conf.set(HADOOP_NAME_NODE, nameNode);
conf.set("mapreduce.fileoutputcommitter.marksuccessfuljobs", "true");
return conf;
}
{code}
{{Services.get().get(HadoopAccessorService.class).createJobConf(jobTracker)}} loads the correct conf(nn and jt endpoints) using oozie-site. But later, nn and jt endpoints are overridden with the endpoints mentioned in the export action which is for source cluster. This conf is used by JobClient to load the libraries (the jar path doesn't contain the endpoint, just the path. old hadoop even cdh4 has : as the lib separator in the conf. Hence the jar path contains just the path without host).
Not sure if its anything to do with recent changes in oozie. We are using oozie trunk(1-2 months old). Which version of oozie are you using? Did you test end to end with these changes in oozie-site?
was (Author: shwethags):
Actually, I don't think it will work(we verified as well with these configs). Here is the code in oozie that sets the JobConf:
{code}
public JobConf createBaseHadoopConf(Context context, Element actionXml) {
Namespace ns = actionXml.getNamespace();
String jobTracker = actionXml.getChild("job-tracker", ns).getTextTrim();
String nameNode = actionXml.getChild("name-node", ns).getTextTrim();
JobConf conf = Services.get().get(HadoopAccessorService.class).createJobConf(jobTracker);
conf.set(HADOOP_USER, context.getProtoActionConf().get(WorkflowAppService.HADOOP_USER));
conf.set(HADOOP_JOB_TRACKER, jobTracker);
conf.set(HADOOP_JOB_TRACKER_2, jobTracker);
conf.set(HADOOP_YARN_RM, jobTracker);
conf.set(HADOOP_NAME_NODE, nameNode);
conf.set("mapreduce.fileoutputcommitter.marksuccessfuljobs", "true");
return conf;
}
{code}
{{Services.get().get(HadoopAccessorService.class).createJobConf(jobTracker)}} loads the correct conf(nn and jt endpoints) using oozie-site. But later, nn and jt endpoints are overridden with the endpoints mentioned in the export action which is for source cluster. This conf is used by JobClient to load the libraries (the jar path doesn't contain the endpoint, just the path).
Not sure if its anything to do with recent changes in oozie. We are using oozie trunk(1-2 months old). Which version of oozie are you using? Did you test end to end with these changes in oozie-site?
> HCat replication fails on table-export
> --------------------------------------
>
> Key: FALCON-623
> URL: https://issues.apache.org/jira/browse/FALCON-623
> Project: Falcon
> Issue Type: Bug
> Components: replication
> Environment: QA
> Reporter: Karishma Gulati
>
> On scheduling a one-source, one-target HCat Replication job, table export fails, with error message:
> {code}
> JA008: File does not exist: /projects/ivory/staging/falcon/workflows/feed/raaw-logs16-73741e09/1373320570ef25b7d7c1ee474f1f0428_1408529998170/lib/falcon-client-0.6-incubating-SNAPSHOT.jar
> {code}
> Oozie track trace:
> {code}
> 2014-08-20 11:13:01,477 ERROR pool-2-thread-9 UserGroupInformation - SERVER[ip-192-168-138-139] PriviledgedActionException as:karishma (auth:PROXY) via oozie (auth:SIMPLE) cause:java.io.FileNotFoundException: File does not exist: /projects/ivory/staging/falcon/workflows/feed/raaw-logs16-105f5895/bfed9c56081276857ce86136475fc7da_1408530730861/lib/falcon-client-0.6-incubating-SNAPSHOT.jar
> 2014-08-20 11:13:01,585 WARN pool-2-thread-9 ActionStartXCommand - SERVER[ip-192-168-138-139] USER[karishma] GROUP[-] TOKEN[] APP[FALCON_FEED_REPLICATION_raaw-logs16-105f5895] JOB[0000078-140813072435213-oozie-oozi-W] ACTION[0000078-140813072435213-oozie-oozi-W@table-export] Error starting action [table-export]. ErrorType [ERROR], ErrorCode [JA008], Message [JA008: File does not exist: /projects/ivory/staging/falcon/workflows/feed/raaw-logs16-105f5895/bfed9c56081276857ce86136475fc7da_1408530730861/lib/falcon-client-0.6-incubating-SNAPSHOT.jar]
> org.apache.oozie.action.ActionExecutorException: JA008: File does not exist: /projects/ivory/staging/falcon/workflows/feed/raaw-logs16-105f5895/bfed9c56081276857ce86136475fc7da_1408530730861/lib/falcon-client-0.6-incubating-SNAPSHOT.jar
> at org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:412)
> at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:396)
> at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:930)
> at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1085)
> at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:228)
> at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:63)
> at org.apache.oozie.command.XCommand.call(XCommand.java:283)
> at org.apache.oozie.command.XCommand.call(XCommand.java:352)
> at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:395)
> at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:73)
> at org.apache.oozie.command.XCommand.call(XCommand.java:283)
> at org.apache.oozie.command.XCommand.call(XCommand.java:352)
> at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:273)
> at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:60)
> at org.apache.oozie.command.XCommand.call(XCommand.java:283)
> at org.apache.oozie.command.XCommand.call(XCommand.java:352)
> at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:241)
> at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:55)
> at org.apache.oozie.command.XCommand.call(XCommand.java:283)
> at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:174)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:701)
> Caused by: java.io.FileNotFoundException: File does not exist: /projects/ivory/staging/falcon/workflows/feed/raaw-logs16-105f5895/bfed9c56081276857ce86136475fc7da_1408530730861/lib/falcon-client-0.6-incubating-SNAPSHOT.jar
> at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:824)
> at org.apache.hadoop.filecache.DistributedCache.getFileStatus(DistributedCache.java:185)
> at org.apache.hadoop.filecache.TrackerDistributedCacheManager.determineTimestamps(TrackerDistributedCacheManager.java:821)
> at org.apache.hadoop.filecache.TrackerDistributedCacheManager.determineTimestampsAndCacheVisibilities(TrackerDistributedCacheManager.java:778)
> at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:852)
> at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:743)
> at org.apache.hadoop.mapred.JobClient.access$400(JobClient.java:174)
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:960)
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:945)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:416)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:945)
> at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:919)
> at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:915)
> ... 20 more
> {code}
> I set up falcon in distributed mode, using different clusters for source and target.
--
This message was sent by Atlassian JIRA
(v6.2#6252)