You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by "Pragya Mittal (JIRA)" <ji...@apache.org> on 2015/08/19 16:33:45 UTC
[jira] [Updated] (FALCON-1412) Process waits indefinitely and
finally timedout even though missing dependencies are met
[ https://issues.apache.org/jira/browse/FALCON-1412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Pragya Mittal updated FALCON-1412:
----------------------------------
Description:
While scheduling a process it gets scheduled but instance keeps on waiting (although there are no missing dependency) and finally times out.
Process -definition is :
{code}
<?xml version="1.0" encoding="UTF-8"?><process xmlns="uri:falcon:process:0.1" name="A2e5a4c86-eb1bf7ae">
<clusters>
<cluster name="A2e5a4c86-19a2cd05">
<validity start="2015-01-02T01:00Z" end="2015-01-02T01:04Z"/>
</cluster>
</clusters>
<parallel>1</parallel>
<order>FIFO</order>
<frequency>minutes(5)</frequency>
<timezone>UTC</timezone>
<inputs>
<input name="inputData" feed="A2e5a4c86-a870a6f8" start="now(0,-20)" end="now(0,0)"/>
</inputs>
<outputs>
<output name="outputData" feed="A2e5a4c86-fcf4ee44" instance="now(0,0)"/>
</outputs>
<properties>
<property name="inputPath" value="/tmp/falcon-regression/ProcessInstanceRerunTest/rerun"/>
<property name="outputPath" value="/tmp/falcon-regression/ProcessInstanceRerunTest/rerun/output"/>
</properties>
<workflow path="/tmp/falcon-regression/ProcessInstanceRerunTest/aggregator"/>
<retry policy="periodic" delay="minutes(3)" attempts="3"/>
<ACL owner="pragya" group="dataqa" permission="*"/>
</process>
{code}
Oozie stack trace :
{code}
2015-08-19 14:29:54,187 ERROR pool-6-thread-1 CoordActionInputCheckXCommand - SERVER[ip-192-168-138-200] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000005-150819132616710-oozie-oozi-C] ACTION[0000005-150819132616710-oozie-oozi-C@1] XException,
org.apache.oozie.command.CommandException: E1021: Coord Action Input Check Error: Unable to evaluate :${dataIn('inputData', 'null')}:
at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:279)
at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:71)
at org.apache.oozie.command.XCommand.call(XCommand.java:286)
at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.Exception: Unable to evaluate :${dataIn('inputData', 'null')}:
at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:723)
at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveTagContents(CoordActionInputCheckXCommand.java:398)
at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.materializeDataProperties(CoordActionInputCheckXCommand.java:379)
at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveCoordConfiguration(CoordActionInputCheckXCommand.java:288)
at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:230)
... 6 more
Caused by: javax.servlet.jsp.el.ELException: An error occurred while evaluating function "dataIn"
at org.apache.commons.el.Logger.logError(Logger.java:484)
at org.apache.commons.el.Logger.logError(Logger.java:545)
at org.apache.commons.el.FunctionInvocation.evaluate(FunctionInvocation.java:174)
at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:263)
at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:190)
at org.apache.oozie.util.ELEvaluator.evaluate(ELEvaluator.java:204)
at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:714)
... 10 more
2015-08-19 14:29:54,194 WARN pool-6-thread-1 CallableQueueService$CallableWrapper - SERVER[ip-192-168-138-200] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000005-150819132616710-oozie-oozi-C] ACTION[0000005-150819132616710-oozie-oozi-C@1] exception callable [coord_action_input], E1021: Coord Action Input Check Error: Unable to evaluate :${dataIn('inputData', 'null')}:
org.apache.oozie.command.CommandException: E1021: Coord Action Input Check Error: Unable to evaluate :${dataIn('inputData', 'null')}:
at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:279)
at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:71)
at org.apache.oozie.command.XCommand.call(XCommand.java:286)
at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.Exception: Unable to evaluate :${dataIn('inputData', 'null')}:
at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:723)
at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveTagContents(CoordActionInputCheckXCommand.java:398)
at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.materializeDataProperties(CoordActionInputCheckXCommand.java:379)
at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveCoordConfiguration(CoordActionInputCheckXCommand.java:288)
at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:230)
... 6 more
Caused by: javax.servlet.jsp.el.ELException: An error occurred while evaluating function "dataIn"
at org.apache.commons.el.Logger.logError(Logger.java:484)
at org.apache.commons.el.Logger.logError(Logger.java:545)
at org.apache.commons.el.FunctionInvocation.evaluate(FunctionInvocation.java:174)
at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:263)
at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:190)
at org.apache.oozie.util.ELEvaluator.evaluate(ELEvaluator.java:204)
at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:714)
... 10 more
{code}
> Process waits indefinitely and finally timedout even though missing dependencies are met
> ----------------------------------------------------------------------------------------
>
> Key: FALCON-1412
> URL: https://issues.apache.org/jira/browse/FALCON-1412
> Project: Falcon
> Issue Type: Bug
> Components: prism
> Affects Versions: 0.7
> Environment: QA
> Reporter: Pragya Mittal
>
> While scheduling a process it gets scheduled but instance keeps on waiting (although there are no missing dependency) and finally times out.
> Process -definition is :
> {code}
> <?xml version="1.0" encoding="UTF-8"?><process xmlns="uri:falcon:process:0.1" name="A2e5a4c86-eb1bf7ae">
> <clusters>
> <cluster name="A2e5a4c86-19a2cd05">
> <validity start="2015-01-02T01:00Z" end="2015-01-02T01:04Z"/>
> </cluster>
> </clusters>
> <parallel>1</parallel>
> <order>FIFO</order>
> <frequency>minutes(5)</frequency>
> <timezone>UTC</timezone>
> <inputs>
> <input name="inputData" feed="A2e5a4c86-a870a6f8" start="now(0,-20)" end="now(0,0)"/>
> </inputs>
> <outputs>
> <output name="outputData" feed="A2e5a4c86-fcf4ee44" instance="now(0,0)"/>
> </outputs>
> <properties>
> <property name="inputPath" value="/tmp/falcon-regression/ProcessInstanceRerunTest/rerun"/>
> <property name="outputPath" value="/tmp/falcon-regression/ProcessInstanceRerunTest/rerun/output"/>
> </properties>
> <workflow path="/tmp/falcon-regression/ProcessInstanceRerunTest/aggregator"/>
> <retry policy="periodic" delay="minutes(3)" attempts="3"/>
> <ACL owner="pragya" group="dataqa" permission="*"/>
> </process>
> {code}
> Oozie stack trace :
> {code}
> 2015-08-19 14:29:54,187 ERROR pool-6-thread-1 CoordActionInputCheckXCommand - SERVER[ip-192-168-138-200] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000005-150819132616710-oozie-oozi-C] ACTION[0000005-150819132616710-oozie-oozi-C@1] XException,
> org.apache.oozie.command.CommandException: E1021: Coord Action Input Check Error: Unable to evaluate :${dataIn('inputData', 'null')}:
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:279)
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:71)
> at org.apache.oozie.command.XCommand.call(XCommand.java:286)
> at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.Exception: Unable to evaluate :${dataIn('inputData', 'null')}:
> at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:723)
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveTagContents(CoordActionInputCheckXCommand.java:398)
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.materializeDataProperties(CoordActionInputCheckXCommand.java:379)
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveCoordConfiguration(CoordActionInputCheckXCommand.java:288)
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:230)
> ... 6 more
> Caused by: javax.servlet.jsp.el.ELException: An error occurred while evaluating function "dataIn"
> at org.apache.commons.el.Logger.logError(Logger.java:484)
> at org.apache.commons.el.Logger.logError(Logger.java:545)
> at org.apache.commons.el.FunctionInvocation.evaluate(FunctionInvocation.java:174)
> at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:263)
> at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:190)
> at org.apache.oozie.util.ELEvaluator.evaluate(ELEvaluator.java:204)
> at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:714)
> ... 10 more
> 2015-08-19 14:29:54,194 WARN pool-6-thread-1 CallableQueueService$CallableWrapper - SERVER[ip-192-168-138-200] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000005-150819132616710-oozie-oozi-C] ACTION[0000005-150819132616710-oozie-oozi-C@1] exception callable [coord_action_input], E1021: Coord Action Input Check Error: Unable to evaluate :${dataIn('inputData', 'null')}:
> org.apache.oozie.command.CommandException: E1021: Coord Action Input Check Error: Unable to evaluate :${dataIn('inputData', 'null')}:
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:279)
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:71)
> at org.apache.oozie.command.XCommand.call(XCommand.java:286)
> at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.Exception: Unable to evaluate :${dataIn('inputData', 'null')}:
> at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:723)
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveTagContents(CoordActionInputCheckXCommand.java:398)
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.materializeDataProperties(CoordActionInputCheckXCommand.java:379)
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveCoordConfiguration(CoordActionInputCheckXCommand.java:288)
> at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:230)
> ... 6 more
> Caused by: javax.servlet.jsp.el.ELException: An error occurred while evaluating function "dataIn"
> at org.apache.commons.el.Logger.logError(Logger.java:484)
> at org.apache.commons.el.Logger.logError(Logger.java:545)
> at org.apache.commons.el.FunctionInvocation.evaluate(FunctionInvocation.java:174)
> at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:263)
> at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:190)
> at org.apache.oozie.util.ELEvaluator.evaluate(ELEvaluator.java:204)
> at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:714)
> ... 10 more
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)