You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by "Murali Ramasami (JIRA)" <ji...@apache.org> on 2016/08/31 07:02:21 UTC
[jira] [Created] (FALCON-2134) Fix
testProcessInstanceKillKillNotRunning test case
Murali Ramasami created FALCON-2134:
---------------------------------------
Summary: Fix testProcessInstanceKillKillNotRunning test case
Key: FALCON-2134
URL: https://issues.apache.org/jira/browse/FALCON-2134
Project: Falcon
Issue Type: Bug
Components: merlin
Affects Versions: trunk
Reporter: Murali Ramasami
Assignee: Murali Ramasami
Fix For: trunk
testProcessInstanceKillKillNotRunning failed since waiting instance got killed.
Test Case Description:
{noformat}
* Schedule process. Provide data for all instances except the last ,thus making it non-materialized (waiting).
* Try to -kill last 3 instances.
* Check that only running instances were affected.
{noformat}
Test case Failure log:
In the log , we can see "0000882-160722063010010-oozie-oozi-C@6" is in waiting but when the kill issued for last 3 running instances[ in this case 2 running and 1 waiting] , all the 3 instances are got killed [ including the instances in waiting state] .
{noformat}
2016-07-22 10:18:10,030 INFO - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Try 20 of 50 (InstanceUtil:644)
2016-07-22 10:18:10,051 INFO - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Coordinator Action 0000882-160722063010010-oozie-oozi-C@1 status is RUNNING on oozie http://nat-r6-anms-falcon-2-5.openstacklocal:11000/oozie/ (InstanceUtil:654)
2016-07-22 10:18:10,051 INFO - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Coordinator Action 0000882-160722063010010-oozie-oozi-C@2 status is RUNNING on oozie http://nat-r6-anms-falcon-2-5.openstacklocal:11000/oozie/ (InstanceUtil:654)
2016-07-22 10:18:10,051 INFO - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Coordinator Action 0000882-160722063010010-oozie-oozi-C@3 status is RUNNING on oozie http://nat-r6-anms-falcon-2-5.openstacklocal:11000/oozie/ (InstanceUtil:654)
2016-07-22 10:18:10,051 INFO - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Coordinator Action 0000882-160722063010010-oozie-oozi-C@4 status is RUNNING on oozie http://nat-r6-anms-falcon-2-5.openstacklocal:11000/oozie/ (InstanceUtil:654)
2016-07-22 10:18:10,051 INFO - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Coordinator Action 0000882-160722063010010-oozie-oozi-C@5 status is RUNNING on oozie http://nat-r6-anms-falcon-2-5.openstacklocal:11000/oozie/ (InstanceUtil:654)
2016-07-22 10:18:10,051 INFO - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Coordinator Action 0000882-160722063010010-oozie-oozi-C@6 status is WAITING on oozie http://nat-r6-anms-falcon-2-5.openstacklocal:11000/oozie/ (InstanceUtil:654)
2016-07-22 10:18:10,051 INFO - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Request Url: http://nat-r6-anms-falcon-2-4.openstacklocal:15000/api/instance/kill/process/A73856b63-3afc1e07/?start=2010-01-02T00%3A14Z&end=2010-01-02T00%3A26Z&colo=*&user.name=hrt_qa (BaseRequest:175)
2016-07-22 10:18:10,051 INFO - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Request Method: POST (BaseRequest:176)
2016-07-22 10:18:10,051 INFO - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Request Header: Name=Cookie Value=hadoop.auth="u=hrt_qa&p=hrt_qa@EXAMPLE.COM&t=kerberos&e=1469206397045&s=vmgc7OiuViE0So52XM+c/04XuOo=" (BaseRequest:179)
2016-07-22 10:18:10,658 INFO - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Response Status: HTTP/1.1 200 OK (BaseRequest:207)
2016-07-22 10:18:10,658 INFO - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Response Header: Name=Content-Type Value=application/json (BaseRequest:209)
2016-07-22 10:18:10,658 INFO - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Response Header: Name=Transfer-Encoding Value=chunked (BaseRequest:209)
2016-07-22 10:18:10,658 INFO - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Response Header: Name=Server Value=Jetty(6.1.26.hwx) (BaseRequest:209)
2016-07-22 10:18:10,659 INFO - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ The web service response is:
{
"status": "SUCCEEDED",
"message": "default/KILL\n",
"requestId": "default/1217343444@qtp-1597328335-86 - e730514a-f313-45fe-af87-69ca2bf5e92c\n",
"instances": [
{
"instance": "2010-01-02T00:25Z",
"status": "KILLED",
"cluster": "A73856b63-223dd32f",
"runId": 0,
"details": "hdfs://nat-r6-anms-falcon-2-7.openstacklocal:8020/tmp/falcon-regression/ProcessInstanceKillsTest/input/2010/01/02/00/25#hdfs://nat-r6-anms-falcon-2-7.openstacklocal:8020/tmp/falcon-regression/ProcessInstanceKillsTest/input/2010/01/02/00/20#hdfs://nat-r6-anms-falcon-2-7.openstacklocal:8020/tmp/falcon-regression/ProcessInstanceKillsTest/input/2010/01/02/00/15#hdfs://nat-r6-anms-falcon-2-7.openstacklocal:8020/tmp/falcon-regression/ProcessInstanceKillsTest/input/2010/01/02/00/10#hdfs://nat-r6-anms-falcon-2-7.openstacklocal:8020/tmp/falcon-regression/ProcessInstanceKillsTest/input/2010/01/02/00/05"
},
{
"instance": "2010-01-02T00:20Z",
"status": "KILLED",
"logFile": "http://nat-r6-anms-falcon-2-5.openstacklocal:11000/oozie/?job\u003d0000882-160722063010010-oozie-oozi-C@5",
"cluster": "A73856b63-223dd32f",
"startTime": "2016-07-22T10:18:07Z",
"runId": 0,
"details": ""
},
{
"instance": "2010-01-02T00:15Z",
"status": "KILLED",
"logFile": "http://nat-r6-anms-falcon-2-5.openstacklocal:11000/oozie/?job\u003d0000882-160722063010010-oozie-oozi-C@4",
"cluster": "A73856b63-223dd32f",
"startTime": "2016-07-22T10:18:07Z",
"runId": 0,
"details": ""
}
]
} (InstanceUtil:94)
2016-07-22 10:18:10,659 INFO - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ statusCode: 200 (InstanceUtil:136)
2016-07-22 10:18:10,659 INFO - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ message: default/KILL
(InstanceUtil:137)
2016-07-22 10:18:10,661 INFO - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ APIResult.Status: SUCCEEDED (InstanceUtil:138)
2016-07-22 10:18:10,661 INFO - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ instances: [{instance:2010-01-02T00:25Z, status:KILLED, cluster:A73856b63-223dd32f}
, {instance:2010-01-02T00:20Z, status:KILLED, log:http://nat-r6-anms-falcon-2-5.openstacklocal:11000/oozie/?job=0000882-160722063010010-oozie-oozi-C@5, cluster:A73856b63-223dd32f}
, {instance:2010-01-02T00:15Z, status:KILLED, log:http://nat-r6-anms-falcon-2-5.openstacklocal:11000/oozie/?job=0000882-160722063010010-oozie-oozi-C@4, cluster:A73856b63-223dd32f}
] (InstanceUtil:271)
2016-07-22 10:18:10,661 INFO - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ status: KILLED, instance: 2010-01-02T00:25Z (InstanceUtil:277)
2016-07-22 10:18:10,661 INFO - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ status: KILLED, instance: 2010-01-02T00:20Z (InstanceUtil:277)
2016-07-22 10:18:10,661 INFO - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ status: KILLED, instance: 2010-01-02T00:15Z (InstanceUtil:277)
2016-07-22 10:18:10,661 INFO - [pool-34-thread-1:testProcessInstanceKillKillNotRunning] ~ Testing going to end for: org.apache.falcon.regression.ProcessInstanceKillsTest.testProcessInstanceKillKillNotRunning([]) ----- Status: FAILED (TestngListener:79)
2016-07-22 10:18:10,661 INFO - [pool-34-thread-1:] ~ ---------------------------------------------------------------------------------------------------- (TestngListener:83)
2016-07-22 10:18:10,662 INFO - [pool-34-thread-1:] ~ java.lang.AssertionError: Waiting Instances expected [1] but found [0]
at org.testng.Assert.fail(Assert.java:94)
at org.testng.Assert.failNotEquals(Assert.java:494)
at org.testng.Assert.assertEquals(Assert.java:123)
at org.testng.Assert.assertEquals(Assert.java:370)
at org.apache.falcon.regression.core.util.InstanceUtil.validateResponse(InstanceUtil.java:284)
at org.apache.falcon.regression.ProcessInstanceKillsTest.testProcessInstanceKillKillNotRunning(ProcessInstanceKillsTest.java:167)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:84)
at org.testng.internal.Invoker.invokeMethod(Invoker.java:714)
at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:901)
at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1231)
at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:127)
at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:111)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
(TestngListener:116)
{noformat}
From the doc it says,
https://oozie.apache.org/docs/4.2.0/DG_CommandLineTool.html#Killing_a_Workflow_Coordinator_or_Bundle_Job
Given a date range to kill instances of coord, Oozie kills all instances that are in non-terminal state.
{noformat}
Killing a Coordinator Action or Multiple Actions
Example:
$oozie job -kill <coord_Job_id> [-action 1, 3-4, 7-40] [-date 2009-01-01T01:00Z::2009-05-31T23:59Z, 2009-11-10T01:00Z, 2009-12-31T22:00Z]
The kill option here for a range of coordinator actions kills a non-terminal (=RUNNING=, WAITING , READY , SUSPENDED ) coordinator action when coordinator job is not in FAILED or KILLED state.
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)