You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by "Venkatesh Seetharam (JIRA)" <ji...@apache.org> on 2014/10/10 02:34:33 UTC
[jira] [Commented] (FALCON-787) FalconCLI - Submit recipe failed
[ https://issues.apache.org/jira/browse/FALCON-787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166059#comment-14166059 ]
Venkatesh Seetharam commented on FALCON-787:
--------------------------------------------
Unit tests fail:
{noformat}
Running org.apache.falcon.oozie.process.OozieProcessWorkflowBuilderTest
Tests run: 17, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 10.99 sec <<< FAILURE! - in org.apache.falcon.oozie.process.OozieProcessWorkflowBuilderTest
testBundle(org.apache.falcon.oozie.process.OozieProcessWorkflowBuilderTest) Time elapsed: 0.082 sec <<< FAILURE!
org.apache.falcon.FalconException: java.io.FileNotFoundException: File /Users/seetharam/Hortonworks/dev/apache-workspace/falcon/incubator-falcon/oozie/webapp/target/tmp-hadoop-seetharam/jail-fs/testCluster/user/guest/workflowlib does not exist
at org.apache.hadoop.fs.RawLocalFileSystem.listStatus(RawLocalFileSystem.java:371)
at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1483)
at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1523)
at org.apache.hadoop.fs.ChecksumFileSystem.listStatus(ChecksumFileSystem.java:568)
at org.apache.falcon.hadoop.JailedFileSystem.listStatus(JailedFileSystem.java:112)
at org.apache.falcon.update.UpdateHelper.checksumAndCopy(UpdateHelper.java:170)
at org.apache.falcon.oozie.process.ProcessBundleBuilder.copyUserWorkflow(ProcessBundleBuilder.java:130)
at org.apache.falcon.oozie.process.ProcessBundleBuilder.buildCoords(ProcessBundleBuilder.java:110)
at org.apache.falcon.oozie.OozieBundleBuilder.build(OozieBundleBuilder.java:67)
at org.apache.falcon.oozie.process.OozieProcessWorkflowBuilderTest.initializeProcessMapper(OozieProcessWorkflowBuilderTest.java:626)
at org.apache.falcon.oozie.process.OozieProcessWorkflowBuilderTest.testBundle(OozieProcessWorkflowBuilderTest.java:209)
testBundle1(org.apache.falcon.oozie.process.OozieProcessWorkflowBuilderTest) Time elapsed: 0.044 sec <<< FAILURE!
org.apache.falcon.FalconException: java.io.FileNotFoundException: File /Users/seetharam/Hortonworks/dev/apache-workspace/falcon/incubator-falcon/oozie/webapp/target/tmp-hadoop-seetharam/jail-fs/testCluster/user/guest/workflowlib does not exist
at org.apache.hadoop.fs.RawLocalFileSystem.listStatus(RawLocalFileSystem.java:371)
at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1483)
at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1523)
at org.apache.hadoop.fs.ChecksumFileSystem.listStatus(ChecksumFileSystem.java:568)
at org.apache.falcon.hadoop.JailedFileSystem.listStatus(JailedFileSystem.java:112)
at org.apache.falcon.update.UpdateHelper.checksumAndCopy(UpdateHelper.java:170)
at org.apache.falcon.oozie.process.ProcessBundleBuilder.copyUserWorkflow(ProcessBundleBuilder.java:130)
at org.apache.falcon.oozie.process.ProcessBundleBuilder.buildCoords(ProcessBundleBuilder.java:110)
at org.apache.falcon.oozie.OozieBundleBuilder.build(OozieBundleBuilder.java:67)
at org.apache.falcon.oozie.process.OozieProcessWorkflowBuilderTest.initializeProcessMapper(OozieProcessWorkflowBuilderTest.java:626)
at org.apache.falcon.oozie.process.OozieProcessWorkflowBuilderTest.testBundle1(OozieProcessWorkflowBuilderTest.java:222)
{noformat}
> FalconCLI - Submit recipe failed
> ---------------------------------
>
> Key: FALCON-787
> URL: https://issues.apache.org/jira/browse/FALCON-787
> Project: Falcon
> Issue Type: Bug
> Components: client
> Affects Versions: 0.6
> Reporter: Balu Vellanki
> Assignee: Sowmya Ramesh
> Fix For: 0.6
>
> Attachments: FALCON-787-v1.patch, FALCON-787.patch
>
>
> Attempted submitting falcon hdfs-replication recipe without setting falcon.recipe.path in client.properties. Expected falcon to look under falcon.home directory for recipe
> {code}
> [hrt_qa@falcon-balu-6-3 falcon]$ ./bin/falcon recipe -name hdfs-replication
> Stacktrace:
> org.apache.falcon.client.FalconCLIException: Recipe template file does not exist : null/hdfs-replication-template.xml
> at org.apache.falcon.client.FalconClient.submitRecipe(FalconClient.java:1049)
> at org.apache.falcon.cli.FalconCLI.recipeCommand(FalconCLI.java:1003)
> at org.apache.falcon.cli.FalconCLI.run(FalconCLI.java:203)
> at org.apache.falcon.cli.FalconCLI.main(FalconCLI.java:144)
> {code}
> In this case falcon.home is not set. A better behavior would be to ensure user sets falcon.recipe.path before using recipe cli.
> Error 2 : After setting falcon.recipe.path in client.properties and restarting falcon, I saw this error.
> {code}
> [hrt_qa@falcon-balu-6-3 falcon]$ ./bin/falcon recipe -name hdfs-replication
> Stacktrace:
> org.apache.falcon.client.FalconCLIException: Recipe workflow file does not exist : /recipes/hdfs-replication/hdfs-replication-workflow.xml
> Submitted process entity: /tmp/falcon-recipe-14121951222843863920744826423593.xml
> at org.apache.falcon.client.FalconClient.submitRecipe(FalconClient.java:1090)
> at org.apache.falcon.cli.FalconCLI.recipeCommand(FalconCLI.java:1003)
> at org.apache.falcon.cli.FalconCLI.run(FalconCLI.java:203)
> at org.apache.falcon.cli.FalconCLI.main(FalconCLI.java:144)
> Caused by: java.lang.Exception: Recipe workflow file does not exist : /recipes/hdfs-replication/hdfs-replication-workflow.xml
> at org.apache.falcon.recipe.RecipeTool.validateArtifacts(RecipeTool.java:139)
> at org.apache.falcon.recipe.RecipeTool.run(RecipeTool.java:74)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.falcon.recipe.RecipeTool.main(RecipeTool.java:60)
> {code}
> The doc FalconCLI.twiki should be updated to say “recipename-workflow.xml” should be present in the falcon.recipe.path dir.
> Once I manually fixed above error and tried to resubmit recipe, it fails with the following error.
> {code}
> [hrt_qa@falcon-balu-6-3 falcon]$ ./bin/falcon recipe -name hdfs-replication
> recipeWfPathName: falcon/recipes/hdfs-replication/hdfs-replication-workflow.xml
> Completed disaster recovery
> Stacktrace:
> org.apache.falcon.client.FalconCLIException: Bad Request;dryRun failed on cluster primaryCluster
> Submitted process entity: /tmp/falcon-recipe-1412196250999979012201450070295.xml
> at org.apache.falcon.client.FalconClient.submitRecipe(FalconClient.java:1090)
> at org.apache.falcon.cli.FalconCLI.recipeCommand(FalconCLI.java:1003)
> at org.apache.falcon.cli.FalconCLI.run(FalconCLI.java:203)
> at org.apache.falcon.cli.FalconCLI.main(FalconCLI.java:144)
> Caused by: java.io.FileNotFoundException: File hdfs://172.18.145.72:8020/user/falcon/falcon/recipes/hdfs-replication/hdfs-replication-workflow.xml does not exist.
> at org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:697)
> at org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSystem.java:105)
> at org.apache.hadoop.hdfs.DistributedFileSystem$15.doCall(DistributedFileSystem.java:755)
> at org.apache.hadoop.hdfs.DistributedFileSystem$15.doCall(DistributedFileSystem.java:751)
> at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:751)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)