You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@oozie.apache.org by "Roman Shaposhnik (JIRA)" <ji...@apache.org> on 2011/09/10 05:25:09 UTC

[jira] [Created] (OOZIE-536) OOZIE-119: relative path in coord dataset include should throw exception if given

OOZIE-119: relative path in coord dataset include should throw exception if given
---------------------------------------------------------------------------------

                 Key: OOZIE-536
                 URL: https://issues.apache.org/jira/browse/OOZIE-536
             Project: Oozie
          Issue Type: Bug
            Reporter: Angelo K. Huang
            Assignee: Angelo K. Huang


the <include> in datasets definition should use full path, e.g., hdfs://NN/.... when a
relative path is applied, the error is confusing that it referrs to the job definition rather than dataset, and tries
to get the file relative to user home dir rather than coord app path.

coordinator.xml:
<datasets>
<include>${include_ds_files1}</include>

where include_ds_files1=datasets1.xml.

in 3.0.1
$ oozie job -run -config job.properties 
Error: E1001 : E1001: Could not read the coordinator job definition, File does not exist: /user/strat_ci/datasets1.xml


yoozie-3.0.2.1307495311.N55771
$ oozie job -run -config job.properties 
Error: E1001 : E1001: Could not read the coordinator job definition, File does not exist:
/user/strat_ci/datasets1.xml/coordinator.xml


java.io.FileNotFoundException: File does not exist: /user/strat_ci/datasets1.xml/coordinator.xml
        at org.apache.hadoop.hdfs.DFSClient$DFSInputStream.openInfo(DFSClient.java:1583)
        at org.apache.hadoop.hdfs.DFSClient$DFSInputStream.<init>(DFSClient.java:1574)
        at org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:423)
        at org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:187)
        at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:400)
        at org.apache.oozie.command.coord.CoordSubmitXCommand.readDefinition(CoordSubmitXCommand.java:880)
        at org.apache.oozie.command.coord.CoordSubmitXCommand.includeOneDSFile(CoordSubmitXCommand.java:807)
        at org.apache.oozie.command.coord.CoordSubmitXCommand.includeDataSets(CoordSubmitXCommand.java:775)
        at org.apache.oozie.command.coord.CoordSubmitXCommand.basicResolveAndIncludeDS(CoordSubmitXCommand.java:398)
        at org.apache.oozie.command.coord.CoordSubmitXCommand.submit(CoordSubmitXCommand.java:209)
        at org.apache.oozie.command.SubmitTransitionXCommand.execute(SubmitTransitionXCommand.java:78)
        at org.apache.oozie.command.SubmitTransitionXCommand.execute(SubmitTransitionXCommand.java:26)
        at org.apache.oozie.command.XCommand.call(XCommand.java:257)
        at org.apache.oozie.CoordinatorEngine.submitJob(CoordinatorEngine.java:311)
        at org.apache.oozie.servlet.V1JobsServlet.submitCoordinatorJob(V1JobsServlet.java:197)
        at org.apache.oozie.servlet.V1JobsServlet.submitJob(V1JobsServlet.java:77)
        at org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:92)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
        at org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at com.yahoo.oozie.filter.OozieAuthFilter.doFilter(OozieAuthFilter.java:40)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at
org.apache.hadoop.http.authentication.web.AuthenticationProcessingFilter.doFilter(AuthenticationProcessingFilter.java:75)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at yjava.cookie.CookieDataFilter.doFilter(CookieDataFilter.java:371)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at yjava.remote.ip.RemoteIPFilter.doFilter(RemoteIPFilter.java:154)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at yjava.security.yiv.servlet.InputValidationFilter.doFilter(InputValidationFilter.java:193)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
        at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
        at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
        at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
        at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
        at yjava.tomcat.valves.YahooConnectionValve.invoke(YahooConnectionValve.java:165)
        at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
        at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
        at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
        at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
        at java.lang.Thread.run(Thread.java:662)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira