You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by "Pallavi Rao (JIRA)" <ji...@apache.org> on 2015/08/20 08:41:46 UTC
[jira] [Commented] (FALCON-1412) Process waits indefinitely and
finally timedout even though missing dependencies are met
[ https://issues.apache.org/jira/browse/FALCON-1412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704388#comment-14704388 ]
Pallavi Rao commented on FALCON-1412:
-------------------------------------
The root cause of the issue is that Falcon ELExpressions uses commons-lang3 which is not available in the class path of Apache Oozie (HDP will probably have it).
To address this, we’ll have to change the assembly of Falcon a bit to add commons-lang3 under ooze/libext. That way, users can copy all jars under oozie/libext to <oozie-install-dir>/libext
> Process waits indefinitely and finally timedout even though missing dependencies are met
> ----------------------------------------------------------------------------------------
>
> Key: FALCON-1412
> URL: https://issues.apache.org/jira/browse/FALCON-1412
> Project: Falcon
> Issue Type: Bug
> Components: prism
> Affects Versions: 0.7
> Environment: QA
> Reporter: Pragya Mittal
> Assignee: Pallavi Rao
>
> While scheduling a process it gets scheduled but instance keeps on waiting (although there are no missing dependency) and finally times out.
> Process -definition is :
> {code}
> <?xml version="1.0" encoding="UTF-8"?><process xmlns="uri:falcon:process:0.1" name="A2e5a4c86-eb1bf7ae">
> <clusters>
> <cluster name="A2e5a4c86-19a2cd05">
> <validity start="2015-01-02T01:00Z" end="2015-01-02T01:04Z"/>
> </cluster>
> </clusters>
> <parallel>1</parallel>
> <order>FIFO</order>
> <frequency>minutes(5)</frequency>
> <timezone>UTC</timezone>
> <inputs>
> <input name="inputData" feed="A2e5a4c86-a870a6f8" start="now(0,-20)" end="now(0,0)"/>
> </inputs>
> <outputs>
> <output name="outputData" feed="A2e5a4c86-fcf4ee44" instance="now(0,0)"/>
> </outputs>
> <properties>
> <property name="inputPath" value="/tmp/falcon-regression/ProcessInstanceRerunTest/rerun"/>
> <property name="outputPath" value="/tmp/falcon-regression/ProcessInstanceRerunTest/rerun/output"/>
> </properties>
> <workflow path="/tmp/falcon-regression/ProcessInstanceRerunTest/aggregator"/>
> <retry policy="periodic" delay="minutes(3)" attempts="3"/>
> <ACL owner="pragya" group="dataqa" permission="*"/>
> </process>
> {code}
> Oozie stack trace :
> {code}
> 2015-08-19 14:29:54,187 ERROR pool-6-thread-1 CoordActionInputCheckXCommand - SERVER[ip-192-168-138-200] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000005-150819132616710-oozie-oozi-C] ACTION[0000005-150819132616710-oozie-oozi-C@1] XException,
> org.apache.oozie.command.CommandException: E1021: Coord Action Input Check Error: Unable to evaluate :${dataIn('inputData', 'null')}:
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:279)
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:71)
> at org.apache.oozie.command.XCommand.call(XCommand.java:286)
> at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.Exception: Unable to evaluate :${dataIn('inputData', 'null')}:
> at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:723)
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveTagContents(CoordActionInputCheckXCommand.java:398)
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.materializeDataProperties(CoordActionInputCheckXCommand.java:379)
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveCoordConfiguration(CoordActionInputCheckXCommand.java:288)
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:230)
> ... 6 more
> Caused by: javax.servlet.jsp.el.ELException: An error occurred while evaluating function "dataIn"
> at org.apache.commons.el.Logger.logError(Logger.java:484)
> at org.apache.commons.el.Logger.logError(Logger.java:545)
> at org.apache.commons.el.FunctionInvocation.evaluate(FunctionInvocation.java:174)
> at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:263)
> at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:190)
> at org.apache.oozie.util.ELEvaluator.evaluate(ELEvaluator.java:204)
> at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:714)
> ... 10 more
> 2015-08-19 14:29:54,194 WARN pool-6-thread-1 CallableQueueService$CallableWrapper - SERVER[ip-192-168-138-200] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000005-150819132616710-oozie-oozi-C] ACTION[0000005-150819132616710-oozie-oozi-C@1] exception callable [coord_action_input], E1021: Coord Action Input Check Error: Unable to evaluate :${dataIn('inputData', 'null')}:
> org.apache.oozie.command.CommandException: E1021: Coord Action Input Check Error: Unable to evaluate :${dataIn('inputData', 'null')}:
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:279)
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:71)
> at org.apache.oozie.command.XCommand.call(XCommand.java:286)
> at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.Exception: Unable to evaluate :${dataIn('inputData', 'null')}:
> at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:723)
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveTagContents(CoordActionInputCheckXCommand.java:398)
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.materializeDataProperties(CoordActionInputCheckXCommand.java:379)
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveCoordConfiguration(CoordActionInputCheckXCommand.java:288)
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:230)
> ... 6 more
> Caused by: javax.servlet.jsp.el.ELException: An error occurred while evaluating function "dataIn"
> at org.apache.commons.el.Logger.logError(Logger.java:484)
> at org.apache.commons.el.Logger.logError(Logger.java:545)
> at org.apache.commons.el.FunctionInvocation.evaluate(FunctionInvocation.java:174)
> at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:263)
> at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:190)
> at org.apache.oozie.util.ELEvaluator.evaluate(ELEvaluator.java:204)
> at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:714)
> ... 10 more
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)