You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Virag Kothari (JIRA)" <ji...@apache.org> on 2012/12/22 02:53:13 UTC

[jira] [Commented] (OOZIE-1144) OOZIE-1137 breaks the sharelib

    [ https://issues.apache.org/jira/browse/OOZIE-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13538639#comment-13538639 ] 

Virag Kothari commented on OOZIE-1144:
--------------------------------------

+1..Good catch, Robert. OOZIE-1137 was being tested at Y! and I should have put a comment there to not get it committed. Sorry about that.
Also, at some point in future Oozie should have a test framework setup for federation.


                
> OOZIE-1137 breaks the sharelib
> ------------------------------
>
>                 Key: OOZIE-1144
>                 URL: https://issues.apache.org/jira/browse/OOZIE-1144
>             Project: Oozie
>          Issue Type: Bug
>          Components: core
>    Affects Versions: trunk
>            Reporter: Robert Kanter
>            Assignee: Robert Kanter
>            Priority: Blocker
>             Fix For: trunk
>
>         Attachments: OOZIE-1144.patch, OOZIE-1144.patch
>
>
> OOZIE-1137 changes the {{javaActionExecutor#addShareLib}} method to use the {{actionLibPath}} instead of the {{appPath}} for getting the {{FileSystem}} to acces the sharelib JARs.  However, the {{actionLibPath}} is by default simply {{/user/${user.name\}/share/lib}} (taken from the {{oozie.service.WorkflowAppService.system.libpath}} property), so when Oozie tries to get the {{FileSystem}} for loading sharelib JARs, the action will fail with a error message like this:
> {code}
> 2012-12-21 15:53:00,379  WARN ActionStartXCommand:542 - USER[rkanter] GROUP[-] TOKEN[] APP[pig-wf] JOB[0000000-121221155218043-oozie-rkan-W] ACTION[0000000-121221155218043-oozie-rkan-W@pig-node] Error starting action [pig-node]. ErrorType [FAILED], ErrorCode [E0904], Message [E0904: Scheme [null] not supported in uri [/user/rkanter/share/lib/pig]]
> org.apache.oozie.action.ActionExecutorException: E0904: Scheme [null] not supported in uri [/user/rkanter/share/lib/pig]
> 	at org.apache.oozie.action.hadoop.JavaActionExecutor.addShareLib(JavaActionExecutor.java:411)
> 	at org.apache.oozie.action.hadoop.JavaActionExecutor.addActionShareLib(JavaActionExecutor.java:509)
> 	at org.apache.oozie.action.hadoop.JavaActionExecutor.addAllShareLibs(JavaActionExecutor.java:492)
> 	at org.apache.oozie.action.hadoop.JavaActionExecutor.setLibFilesArchives(JavaActionExecutor.java:485)
> 	at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:661)
> 	at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:902)
> 	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:211)
> 	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:59)
> 	at org.apache.oozie.command.XCommand.call(XCommand.java:277)
> 	at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:326)
> 	at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:255)
> 	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> 	at java.lang.Thread.run(Thread.java:680)
> {code}
> As is, the only way to fix this is to specify a "complete" path for the sharelib property; e.g. {{hdfs://localhost:8020/user/${user.name\}/share/lib}}.  We should fix this so that's not necessary.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira