You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by "Pragya Mittal (JIRA)" <ji...@apache.org> on 2016/02/08 13:40:39 UTC
[jira] [Commented] (FALCON-1811) Status API does not honour start
option
[ https://issues.apache.org/jira/browse/FALCON-1811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15136894#comment-15136894 ]
Pragya Mittal commented on FALCON-1811:
---------------------------------------
I think you meant process definition.
I am attaching more examples with a new process definition. Hope that helps you.
Process :
{noformat}
<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<process name="processMerlinOozie" xmlns="uri:falcon:process:0.1">
<clusters>
<cluster name="A952710a-23a4500a">
<validity start="2016-02-08T11:27Z" end="2016-02-08T16:27Z"/>
</cluster>
<cluster name="A952710a-1cee6ea2">
<validity start="2016-02-08T11:27Z" end="2016-02-08T16:27Z"/>
</cluster>
</clusters>
<parallel>2</parallel>
<order>FIFO</order>
<frequency>minutes(1)</frequency>
<timezone>UTC</timezone>
<properties>
<property name="queueName" value="default"/>
<property name="fileTime" value="${formatTime(dateOffset(instanceTime(), 1, 'DAY'), 'yyyy-MMM-dd')}"/>
<property name="user" value="${user()}"/>
</properties>
<workflow path="/tmp/falcon-regression/ProcessMultipleClustersTest/aggregator"/>
<retry policy="periodic" delay="minutes(3)" attempts="3"/>
<ACL owner="pragya" group="dataqa" permission="*"/>
</process>
{noformat}
Status command with numResults :
{noformat}
dataqa@lda01:~$ falcon instance -type process -status -name processMerlinOozie -colo ua1 -start 2016-02-08T12:00Z -numResults 5
Consolidated Status: SUCCEEDED
Instances:
Instance Cluster SourceCluster Status Start End Details Log
-----------------------------------------------------------------------------------------------
2016-02-08T12:34Z A952710a-23a4500a - READY - - - -
2016-02-08T12:33Z A952710a-23a4500a - READY - - - -
2016-02-08T12:32Z A952710a-23a4500a - READY - - - -
2016-02-08T12:31Z A952710a-23a4500a - READY - - - -
2016-02-08T12:30Z A952710a-23a4500a - READY - - - -
{noformat}
Status command without numResults :
(It takes the default numResults)
{noformat}
dataqa@lda01:~$ falcon instance -type process -status -name processMerlinOozie -colo ua1 -start 2016-02-08T12:00Z
Consolidated Status: SUCCEEDED
Instances:
Instance Cluster SourceCluster Status Start End Details Log
-----------------------------------------------------------------------------------------------
2016-02-08T12:34Z A952710a-23a4500a - READY - - - -
2016-02-08T12:33Z A952710a-23a4500a - READY - - - -
2016-02-08T12:32Z A952710a-23a4500a - READY - - - -
2016-02-08T12:31Z A952710a-23a4500a - READY - - - -
2016-02-08T12:30Z A952710a-23a4500a - READY - - - -
2016-02-08T12:29Z A952710a-23a4500a - READY - - - -
2016-02-08T12:28Z A952710a-23a4500a - READY - - - -
2016-02-08T12:27Z A952710a-23a4500a - READY - - - -
2016-02-08T12:26Z A952710a-23a4500a - READY - - - -
2016-02-08T12:25Z A952710a-23a4500a - READY - - - -
{noformat}
Status command with start and end option :
{noformat}
dataqa@lda01:~$ falcon instance -type process -status -name processMerlinOozie -colo ua1 -start 2016-02-08T12:00Z -end 2016-02-08T12:02Z
Consolidated Status: SUCCEEDED
Instances:
Instance Cluster SourceCluster Status Start End Details Log
-----------------------------------------------------------------------------------------------
2016-02-08T12:01Z A952710a-23a4500a - SUCCEEDED 2016-02-08T12:33Z 2016-02-08T12:34Z - http://lda01:11000/oozie?job=0003365-160206182257819-oozie-oozi-W
actions:
hdfscommands OK -
aggregator SUCCEEDED http://lda01:8088/proxy/application_1453705227650_19082/
java-node SUCCEEDED http://lda01:8088/proxy/application_1453705227650_19085/
2016-02-08T12:00Z A952710a-23a4500a - SUCCEEDED 2016-02-08T12:33Z 2016-02-08T12:33Z - http://lda01:11000/oozie?job=0003363-160206182257819-oozie-oozi-W
actions:
hdfscommands OK -
aggregator SUCCEEDED http://lda01:8088/proxy/application_1453705227650_19078/
java-node SUCCEEDED http://lda01:8088/proxy/application_1453705227650_19081/
Additional Information:
Response: ua1/STATUS
Request Id: ua1/729814761@qtp-1816147548-43 - 7e62713c-8781-476d-baa4-3822bb0fda2d
{noformat}
> Status API does not honour start option
> ---------------------------------------
>
> Key: FALCON-1811
> URL: https://issues.apache.org/jira/browse/FALCON-1811
> Project: Falcon
> Issue Type: Bug
> Components: client
> Affects Versions: trunk, 0.9
> Reporter: Pragya Mittal
> Assignee: Praveen Adlakha
>
> The result of status API is :
> {noformat}
> dataqa@lda01:~$ fipstatus processMerlinOozie -colo ua2 -numResults 2 -start 2016-02-02T12:59Z
> Consolidated Status: SUCCEEDED
> Instances:
> Instance Cluster SourceCluster Status Start End Details Log
> -----------------------------------------------------------------------------------------------
> 2016-02-02T13:08Z ProcessMultipleClustersTest-corp-3a97a54e - RUNNING 2016-02-02T13:08Z - -http://8RPCG32.corp.inmobi.com:11000/oozie?job=0001277-160202121302340-oozie-oozi-W
> actions:
> hdfscommands OK -
> aggregator SUCCEEDED http://8RPCG32.corp.inmobi.com:8088/proxy/application_1454048976510_7718/
> java-node SUCCEEDED http://8RPCG32.corp.inmobi.com:8088/proxy/application_1454048976510_7722/
> succeeded-post-processing RUNNING http://8RPCG32.corp.inmobi.com:8088/proxy/application_1454048976510_7726/
> 2016-02-02T13:07Z ProcessMultipleClustersTest-corp-3a97a54e - SUCCEEDED 2016-02-02T13:07Z 2016-02-02T13:07Z - http://8RPCG32.corp.inmobi.com:11000/oozie?job=0001274-160202121302340-oozie-oozi-W
> actions:
> hdfscommands OK -
> aggregator SUCCEEDED http://8RPCG32.corp.inmobi.com:8088/proxy/application_1454048976510_7709/
> java-node SUCCEEDED http://8RPCG32.corp.inmobi.com:8088/proxy/application_1454048976510_7713/
> Additional Information:
> Response: ua2/STATUS
> Request Id: ua2/1073468757@qtp-311239812-13 - 31efc585-41ae-48a3-9e53-515e71fe4243
> {noformat}
> Instead it should display two instances :
> 2016-02-02T12:59Z
> 2016-02-02T13:00Z
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)