You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@stratos.apache.org by Rajkumar Rajaratnam <ra...@wso2.com> on 2015/11/22 08:09:01 UTC
Why some test cases are excluded from integration tests?
Devs,
The following test cases is annotated with "failed" group. As "failed"
group is excluded in testng.xml, these test cases won't be executed in
integration tests.
GroupTerminationBehaviorTestCase
IaaSProviderTestCase
PartitionOneAfterAnotherClusterTestCase
Any reason to do this?
Thanks,
Raj.
--
Rajkumar Rajaratnam
Committer & PMC Member, Apache Stratos
Software Engineer, WSO2
Mobile : +94777568639
Blog : rajkumarr.com
Re: Why some test cases are excluded from integration tests?
Posted by Reka Thirunavukkarasu <re...@wso2.com>.
Hi Raj,
If it failed at the first place, then there might be some issue as this
test used to work first time as i can remember..:)
Thanks,
Reka
On Sun, Nov 22, 2015 at 10:01 PM, Rajkumar Rajaratnam <ra...@wso2.com>
wrote:
> Hey Akila,
>
> Will verify with Sajith about IaaSProviderTestCase.
>
> Luckily, GroupTerminationBehaviorTestCase is failing at the first time :).
>
> Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 214.032
> sec <<< FAILURE! - in TestSuite
> testTerminationBehavior(org.apache.stratos.integration.tests.application.GroupTerminationBehaviorTestCase)
> Time elapsed: 168.728 sec <<< FAILURE!
> java.lang.AssertionError: Cluster status did not change to active:
> [cluster-id]
> group-termination-behavior-test.c3-1x0-group-termination-behavior-test.c3-group-termination-behavior-test.domain
> at org.testng.AssertJUnit.fail(AssertJUnit.java:59)
> at org.testng.AssertJUnit.assertTrue(AssertJUnit.java:24)
> at
> org.apache.stratos.integration.common.TopologyHandler.assertClusterActivation(TopologyHandler.java:305)
> at
> org.apache.stratos.integration.tests.application.GroupTerminationBehaviorTestCase.testTerminationBehavior(GroupTerminationBehaviorTestCase.java:190)
>
> Thanks.
>
> On Sun, Nov 22, 2015 at 9:43 PM, Akila Ravihansa Perera <
> ravihansa@wso2.com> wrote:
>
>> Hi Raj,
>>
>> IaaSProviderTestCase has been added 2 days ago. I'm not sure why it was
>> marked as disabled. Perhaps the test case was not complete? Better check
>> that before enabling.
>>
>> Also GroupTerminationBehaviorTestCase and PartitionOneAfterAnotherClusterTestCase
>> started failing intermittently. So don't assume that they work just because
>> it passes at the first time :)
>>
>> Thanks.
>>
>> On Sun, Nov 22, 2015 at 9:38 PM, Rajkumar Rajaratnam <ra...@wso2.com>
>> wrote:
>>
>>> Thanks Akila. I have tested IaaSProviderTestCase and it passed, so I
>>> enabled and pushed the changes to 4.1.x. I will check why
>>> GroupTerminationBehaviorTestCase & PartitionOneAfterAnotherClusterTestCase
>>> are failing.
>>>
>>> Thanks,
>>> Raj.
>>>
>>> On Sun, Nov 22, 2015 at 1:57 PM, Akila Ravihansa Perera <
>>> ravihansa@wso2.com> wrote:
>>>
>>>> Hi Raj,
>>>>
>>>> These test cases were excluded because they were failing due to bugs
>>>> (either in test case or Stratos components) and we didn't have enough time
>>>> to fix those. I think we created JIRAs to track these and fix in a later
>>>> release.
>>>>
>>>> Thanks.
>>>>
>>>> On Sun, Nov 22, 2015 at 12:39 PM, Rajkumar Rajaratnam <
>>>> rajkumarr@wso2.com> wrote:
>>>>
>>>>> Devs,
>>>>>
>>>>> The following test cases is annotated with "failed" group. As "failed"
>>>>> group is excluded in testng.xml, these test cases won't be executed in
>>>>> integration tests.
>>>>>
>>>>> GroupTerminationBehaviorTestCase
>>>>> IaaSProviderTestCase
>>>>> PartitionOneAfterAnotherClusterTestCase
>>>>>
>>>>> Any reason to do this?
>>>>>
>>>>> Thanks,
>>>>> Raj.
>>>>>
>>>>> --
>>>>> Rajkumar Rajaratnam
>>>>> Committer & PMC Member, Apache Stratos
>>>>> Software Engineer, WSO2
>>>>>
>>>>> Mobile : +94777568639
>>>>> Blog : rajkumarr.com
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Akila Ravihansa Perera
>>>> WSO2 Inc.; http://wso2.com/
>>>>
>>>> Blog: http://ravihansa3000.blogspot.com
>>>>
>>>
>>>
>>>
>>> --
>>> Rajkumar Rajaratnam
>>> Committer & PMC Member, Apache Stratos
>>> Software Engineer, WSO2
>>>
>>> Mobile : +94777568639
>>> Blog : rajkumarr.com
>>>
>>
>>
>>
>> --
>> Akila Ravihansa Perera
>> WSO2 Inc.; http://wso2.com/
>>
>> Blog: http://ravihansa3000.blogspot.com
>>
>
>
>
> --
> Rajkumar Rajaratnam
> Committer & PMC Member, Apache Stratos
> Software Engineer, WSO2
>
> Mobile : +94777568639
> Blog : rajkumarr.com
>
--
Reka Thirunavukkarasu
Senior Software Engineer,
WSO2, Inc.:http://wso2.com,
Mobile: +94776442007
Re: Why some test cases are excluded from integration tests?
Posted by Sajith Kariyawasam <sa...@wso2.com>.
On Sun, Nov 22, 2015 at 10:01 PM, Rajkumar Rajaratnam <ra...@wso2.com>
wrote:
> Hey Akila,
>
> Will verify with Sajith about IaaSProviderTestCase.
>
>
Sorry guys, it was a mistake and not meant as a "failed" test case. Thanks
for fixing it! :)
Btw, found that the new test case added IaasProviderAttributeTest need to
be renamed to IaasProviderAttributeTestCase, adhering to our naming
convention.
Luckily, GroupTerminationBehaviorTestCase is failing at the first time :).
>
> Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 214.032
> sec <<< FAILURE! - in TestSuite
> testTerminationBehavior(org.apache.stratos.integration.tests.application.GroupTerminationBehaviorTestCase)
> Time elapsed: 168.728 sec <<< FAILURE!
> java.lang.AssertionError: Cluster status did not change to active:
> [cluster-id]
> group-termination-behavior-test.c3-1x0-group-termination-behavior-test.c3-group-termination-behavior-test.domain
> at org.testng.AssertJUnit.fail(AssertJUnit.java:59)
> at org.testng.AssertJUnit.assertTrue(AssertJUnit.java:24)
> at
> org.apache.stratos.integration.common.TopologyHandler.assertClusterActivation(TopologyHandler.java:305)
> at
> org.apache.stratos.integration.tests.application.GroupTerminationBehaviorTestCase.testTerminationBehavior(GroupTerminationBehaviorTestCase.java:190)
>
> Thanks.
>
> On Sun, Nov 22, 2015 at 9:43 PM, Akila Ravihansa Perera <
> ravihansa@wso2.com> wrote:
>
>> Hi Raj,
>>
>> IaaSProviderTestCase has been added 2 days ago. I'm not sure why it was
>> marked as disabled. Perhaps the test case was not complete? Better check
>> that before enabling.
>>
>> Also GroupTerminationBehaviorTestCase and PartitionOneAfterAnotherClusterTestCase
>> started failing intermittently. So don't assume that they work just because
>> it passes at the first time :)
>>
>> Thanks.
>>
>> On Sun, Nov 22, 2015 at 9:38 PM, Rajkumar Rajaratnam <ra...@wso2.com>
>> wrote:
>>
>>> Thanks Akila. I have tested IaaSProviderTestCase and it passed, so I
>>> enabled and pushed the changes to 4.1.x. I will check why
>>> GroupTerminationBehaviorTestCase & PartitionOneAfterAnotherClusterTestCase
>>> are failing.
>>>
>>> Thanks,
>>> Raj.
>>>
>>> On Sun, Nov 22, 2015 at 1:57 PM, Akila Ravihansa Perera <
>>> ravihansa@wso2.com> wrote:
>>>
>>>> Hi Raj,
>>>>
>>>> These test cases were excluded because they were failing due to bugs
>>>> (either in test case or Stratos components) and we didn't have enough time
>>>> to fix those. I think we created JIRAs to track these and fix in a later
>>>> release.
>>>>
>>>> Thanks.
>>>>
>>>> On Sun, Nov 22, 2015 at 12:39 PM, Rajkumar Rajaratnam <
>>>> rajkumarr@wso2.com> wrote:
>>>>
>>>>> Devs,
>>>>>
>>>>> The following test cases is annotated with "failed" group. As "failed"
>>>>> group is excluded in testng.xml, these test cases won't be executed in
>>>>> integration tests.
>>>>>
>>>>> GroupTerminationBehaviorTestCase
>>>>> IaaSProviderTestCase
>>>>> PartitionOneAfterAnotherClusterTestCase
>>>>>
>>>>> Any reason to do this?
>>>>>
>>>>> Thanks,
>>>>> Raj.
>>>>>
>>>>> --
>>>>> Rajkumar Rajaratnam
>>>>> Committer & PMC Member, Apache Stratos
>>>>> Software Engineer, WSO2
>>>>>
>>>>> Mobile : +94777568639
>>>>> Blog : rajkumarr.com
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Akila Ravihansa Perera
>>>> WSO2 Inc.; http://wso2.com/
>>>>
>>>> Blog: http://ravihansa3000.blogspot.com
>>>>
>>>
>>>
>>>
>>> --
>>> Rajkumar Rajaratnam
>>> Committer & PMC Member, Apache Stratos
>>> Software Engineer, WSO2
>>>
>>> Mobile : +94777568639
>>> Blog : rajkumarr.com
>>>
>>
>>
>>
>> --
>> Akila Ravihansa Perera
>> WSO2 Inc.; http://wso2.com/
>>
>> Blog: http://ravihansa3000.blogspot.com
>>
>
>
>
> --
> Rajkumar Rajaratnam
> Committer & PMC Member, Apache Stratos
> Software Engineer, WSO2
>
> Mobile : +94777568639
> Blog : rajkumarr.com
>
--
Sajith Kariyawasam
*Committer and PMC member, Apache Stratos, *
*WSO2 Inc.; http://wso2.com <http://wso2.com>*
*Mobile: 0772269575*
Re: Why some test cases are excluded from integration tests?
Posted by Rajkumar Rajaratnam <ra...@wso2.com>.
Hey Akila,
Will verify with Sajith about IaaSProviderTestCase.
Luckily, GroupTerminationBehaviorTestCase is failing at the first time :).
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 214.032 sec
<<< FAILURE! - in TestSuite
testTerminationBehavior(org.apache.stratos.integration.tests.application.GroupTerminationBehaviorTestCase)
Time elapsed: 168.728 sec <<< FAILURE!
java.lang.AssertionError: Cluster status did not change to active:
[cluster-id]
group-termination-behavior-test.c3-1x0-group-termination-behavior-test.c3-group-termination-behavior-test.domain
at org.testng.AssertJUnit.fail(AssertJUnit.java:59)
at org.testng.AssertJUnit.assertTrue(AssertJUnit.java:24)
at
org.apache.stratos.integration.common.TopologyHandler.assertClusterActivation(TopologyHandler.java:305)
at
org.apache.stratos.integration.tests.application.GroupTerminationBehaviorTestCase.testTerminationBehavior(GroupTerminationBehaviorTestCase.java:190)
Thanks.
On Sun, Nov 22, 2015 at 9:43 PM, Akila Ravihansa Perera <ra...@wso2.com>
wrote:
> Hi Raj,
>
> IaaSProviderTestCase has been added 2 days ago. I'm not sure why it was
> marked as disabled. Perhaps the test case was not complete? Better check
> that before enabling.
>
> Also GroupTerminationBehaviorTestCase and PartitionOneAfterAnotherClusterTestCase
> started failing intermittently. So don't assume that they work just because
> it passes at the first time :)
>
> Thanks.
>
> On Sun, Nov 22, 2015 at 9:38 PM, Rajkumar Rajaratnam <ra...@wso2.com>
> wrote:
>
>> Thanks Akila. I have tested IaaSProviderTestCase and it passed, so I
>> enabled and pushed the changes to 4.1.x. I will check why
>> GroupTerminationBehaviorTestCase & PartitionOneAfterAnotherClusterTestCase
>> are failing.
>>
>> Thanks,
>> Raj.
>>
>> On Sun, Nov 22, 2015 at 1:57 PM, Akila Ravihansa Perera <
>> ravihansa@wso2.com> wrote:
>>
>>> Hi Raj,
>>>
>>> These test cases were excluded because they were failing due to bugs
>>> (either in test case or Stratos components) and we didn't have enough time
>>> to fix those. I think we created JIRAs to track these and fix in a later
>>> release.
>>>
>>> Thanks.
>>>
>>> On Sun, Nov 22, 2015 at 12:39 PM, Rajkumar Rajaratnam <
>>> rajkumarr@wso2.com> wrote:
>>>
>>>> Devs,
>>>>
>>>> The following test cases is annotated with "failed" group. As "failed"
>>>> group is excluded in testng.xml, these test cases won't be executed in
>>>> integration tests.
>>>>
>>>> GroupTerminationBehaviorTestCase
>>>> IaaSProviderTestCase
>>>> PartitionOneAfterAnotherClusterTestCase
>>>>
>>>> Any reason to do this?
>>>>
>>>> Thanks,
>>>> Raj.
>>>>
>>>> --
>>>> Rajkumar Rajaratnam
>>>> Committer & PMC Member, Apache Stratos
>>>> Software Engineer, WSO2
>>>>
>>>> Mobile : +94777568639
>>>> Blog : rajkumarr.com
>>>>
>>>
>>>
>>>
>>> --
>>> Akila Ravihansa Perera
>>> WSO2 Inc.; http://wso2.com/
>>>
>>> Blog: http://ravihansa3000.blogspot.com
>>>
>>
>>
>>
>> --
>> Rajkumar Rajaratnam
>> Committer & PMC Member, Apache Stratos
>> Software Engineer, WSO2
>>
>> Mobile : +94777568639
>> Blog : rajkumarr.com
>>
>
>
>
> --
> Akila Ravihansa Perera
> WSO2 Inc.; http://wso2.com/
>
> Blog: http://ravihansa3000.blogspot.com
>
--
Rajkumar Rajaratnam
Committer & PMC Member, Apache Stratos
Software Engineer, WSO2
Mobile : +94777568639
Blog : rajkumarr.com
Re: Why some test cases are excluded from integration tests?
Posted by Akila Ravihansa Perera <ra...@wso2.com>.
Hi Raj,
IaaSProviderTestCase has been added 2 days ago. I'm not sure why it was
marked as disabled. Perhaps the test case was not complete? Better check
that before enabling.
Also GroupTerminationBehaviorTestCase and
PartitionOneAfterAnotherClusterTestCase
started failing intermittently. So don't assume that they work just because
it passes at the first time :)
Thanks.
On Sun, Nov 22, 2015 at 9:38 PM, Rajkumar Rajaratnam <ra...@wso2.com>
wrote:
> Thanks Akila. I have tested IaaSProviderTestCase and it passed, so I
> enabled and pushed the changes to 4.1.x. I will check why
> GroupTerminationBehaviorTestCase & PartitionOneAfterAnotherClusterTestCase
> are failing.
>
> Thanks,
> Raj.
>
> On Sun, Nov 22, 2015 at 1:57 PM, Akila Ravihansa Perera <
> ravihansa@wso2.com> wrote:
>
>> Hi Raj,
>>
>> These test cases were excluded because they were failing due to bugs
>> (either in test case or Stratos components) and we didn't have enough time
>> to fix those. I think we created JIRAs to track these and fix in a later
>> release.
>>
>> Thanks.
>>
>> On Sun, Nov 22, 2015 at 12:39 PM, Rajkumar Rajaratnam <rajkumarr@wso2.com
>> > wrote:
>>
>>> Devs,
>>>
>>> The following test cases is annotated with "failed" group. As "failed"
>>> group is excluded in testng.xml, these test cases won't be executed in
>>> integration tests.
>>>
>>> GroupTerminationBehaviorTestCase
>>> IaaSProviderTestCase
>>> PartitionOneAfterAnotherClusterTestCase
>>>
>>> Any reason to do this?
>>>
>>> Thanks,
>>> Raj.
>>>
>>> --
>>> Rajkumar Rajaratnam
>>> Committer & PMC Member, Apache Stratos
>>> Software Engineer, WSO2
>>>
>>> Mobile : +94777568639
>>> Blog : rajkumarr.com
>>>
>>
>>
>>
>> --
>> Akila Ravihansa Perera
>> WSO2 Inc.; http://wso2.com/
>>
>> Blog: http://ravihansa3000.blogspot.com
>>
>
>
>
> --
> Rajkumar Rajaratnam
> Committer & PMC Member, Apache Stratos
> Software Engineer, WSO2
>
> Mobile : +94777568639
> Blog : rajkumarr.com
>
--
Akila Ravihansa Perera
WSO2 Inc.; http://wso2.com/
Blog: http://ravihansa3000.blogspot.com
Re: Why some test cases are excluded from integration tests?
Posted by Rajkumar Rajaratnam <ra...@wso2.com>.
Thanks Akila. I have tested IaaSProviderTestCase and it passed, so I
enabled and pushed the changes to 4.1.x. I will check why
GroupTerminationBehaviorTestCase & PartitionOneAfterAnotherClusterTestCase
are failing.
Thanks,
Raj.
On Sun, Nov 22, 2015 at 1:57 PM, Akila Ravihansa Perera <ra...@wso2.com>
wrote:
> Hi Raj,
>
> These test cases were excluded because they were failing due to bugs
> (either in test case or Stratos components) and we didn't have enough time
> to fix those. I think we created JIRAs to track these and fix in a later
> release.
>
> Thanks.
>
> On Sun, Nov 22, 2015 at 12:39 PM, Rajkumar Rajaratnam <ra...@wso2.com>
> wrote:
>
>> Devs,
>>
>> The following test cases is annotated with "failed" group. As "failed"
>> group is excluded in testng.xml, these test cases won't be executed in
>> integration tests.
>>
>> GroupTerminationBehaviorTestCase
>> IaaSProviderTestCase
>> PartitionOneAfterAnotherClusterTestCase
>>
>> Any reason to do this?
>>
>> Thanks,
>> Raj.
>>
>> --
>> Rajkumar Rajaratnam
>> Committer & PMC Member, Apache Stratos
>> Software Engineer, WSO2
>>
>> Mobile : +94777568639
>> Blog : rajkumarr.com
>>
>
>
>
> --
> Akila Ravihansa Perera
> WSO2 Inc.; http://wso2.com/
>
> Blog: http://ravihansa3000.blogspot.com
>
--
Rajkumar Rajaratnam
Committer & PMC Member, Apache Stratos
Software Engineer, WSO2
Mobile : +94777568639
Blog : rajkumarr.com
Re: Why some test cases are excluded from integration tests?
Posted by Akila Ravihansa Perera <ra...@wso2.com>.
Hi Raj,
These test cases were excluded because they were failing due to bugs
(either in test case or Stratos components) and we didn't have enough time
to fix those. I think we created JIRAs to track these and fix in a later
release.
Thanks.
On Sun, Nov 22, 2015 at 12:39 PM, Rajkumar Rajaratnam <ra...@wso2.com>
wrote:
> Devs,
>
> The following test cases is annotated with "failed" group. As "failed"
> group is excluded in testng.xml, these test cases won't be executed in
> integration tests.
>
> GroupTerminationBehaviorTestCase
> IaaSProviderTestCase
> PartitionOneAfterAnotherClusterTestCase
>
> Any reason to do this?
>
> Thanks,
> Raj.
>
> --
> Rajkumar Rajaratnam
> Committer & PMC Member, Apache Stratos
> Software Engineer, WSO2
>
> Mobile : +94777568639
> Blog : rajkumarr.com
>
--
Akila Ravihansa Perera
WSO2 Inc.; http://wso2.com/
Blog: http://ravihansa3000.blogspot.com