You are viewing a plain text version of this content. The canonical link for it is here.
Posted to derby-dev@db.apache.org by "Sunitha Kambhampati (JIRA)" <de...@db.apache.org> on 2006/10/17 19:10:37 UTC

[jira] Created: (DERBY-1970) Add framework for performance tests in derby using Junit.

Add framework for performance tests in derby using Junit. 
----------------------------------------------------------

                 Key: DERBY-1970
                 URL: http://issues.apache.org/jira/browse/DERBY-1970
             Project: Derby
          Issue Type: Test
          Components: Test
    Affects Versions: 10.3.0.0
            Reporter: Sunitha Kambhampati


Add a framework for performance tests to be added in derby. 

Some goals are : 
-- use Junit, thus will serve double duty as both functional tests as well as performance tests.
-- builds upon the existing infrastructure available to run functional tests 
   *  for example, getting connections is handled in a single way allowing the performance tests to run with J2ME, DriverManager, DataSource, single leg of an XA transaction etc. 
-- be able to run using Junit directly. 
-- easy for developers to add these tests and run them. 

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (DERBY-1970) Add framework for performance tests in derby using Junit.

Posted by "Daniel John Debrunner (JIRA)" <ji...@apache.org>.
    [ http://issues.apache.org/jira/browse/DERBY-1970?page=comments#action_12445981 ] 
            
Daniel John Debrunner commented on DERBY-1970:
----------------------------------------------

Patches derby1970.p1.diff.txt  and derby1970.p2.stat.txt committed. Thanks Sunitha.
I made a minor change to the ValuesTest to ensure that an "unamed" suite did not exist.

> Add framework for performance tests in derby using Junit.
> ---------------------------------------------------------
>
>                 Key: DERBY-1970
>                 URL: http://issues.apache.org/jira/browse/DERBY-1970
>             Project: Derby
>          Issue Type: Test
>          Components: Test
>    Affects Versions: 10.3.0.0
>            Reporter: Sunitha Kambhampati
>         Assigned To: Sunitha Kambhampati
>         Attachments: derby1970.draft.1.diff.txt, derby1970.p1.diff.txt, derby1970.p2.diff.txt, derby1970.p2.stat.txt, Derby1970_Notes.html, Derby1970_Notes.html
>
>
> Add a framework for performance tests to be added in derby. 
> Some goals are : 
> -- use Junit, thus will serve double duty as both functional tests as well as performance tests.
> -- builds upon the existing infrastructure available to run functional tests 
>    *  for example, getting connections is handled in a single way allowing the performance tests to run with J2ME, DriverManager, DataSource, single leg of an XA transaction etc. 
> -- be able to run using Junit directly. 
> -- easy for developers to add these tests and run them. 

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (DERBY-1970) Add framework for performance tests in derby using Junit.

Posted by "Sunitha Kambhampati (JIRA)" <de...@db.apache.org>.
     [ http://issues.apache.org/jira/browse/DERBY-1970?page=all ]

Sunitha Kambhampati updated DERBY-1970:
---------------------------------------

      Assignee: Sunitha Kambhampati
    Derby Info: [Patch Available]

> Add framework for performance tests in derby using Junit.
> ---------------------------------------------------------
>
>                 Key: DERBY-1970
>                 URL: http://issues.apache.org/jira/browse/DERBY-1970
>             Project: Derby
>          Issue Type: Test
>          Components: Test
>    Affects Versions: 10.3.0.0
>            Reporter: Sunitha Kambhampati
>         Assigned To: Sunitha Kambhampati
>         Attachments: derby1970.draft.1.diff.txt, Derby1970_Notes.html, Derby1970_Notes.html
>
>
> Add a framework for performance tests to be added in derby. 
> Some goals are : 
> -- use Junit, thus will serve double duty as both functional tests as well as performance tests.
> -- builds upon the existing infrastructure available to run functional tests 
>    *  for example, getting connections is handled in a single way allowing the performance tests to run with J2ME, DriverManager, DataSource, single leg of an XA transaction etc. 
> -- be able to run using Junit directly. 
> -- easy for developers to add these tests and run them. 

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (DERBY-1970) Add framework for performance tests in derby using Junit.

Posted by "Sunitha Kambhampati (JIRA)" <de...@db.apache.org>.
     [ http://issues.apache.org/jira/browse/DERBY-1970?page=all ]

Sunitha Kambhampati updated DERBY-1970:
---------------------------------------

    Attachment: Derby1970_Notes.html
                derby1970.draft.1.diff.txt

Attaching a patch derby1970.draft.1.diff.txt and the notes.html for only  feedback.   It is a work in progress. 

I have added Derby1862 test as a performance test case and I have run this only using Junit directly. 

java -Dderby.system.home=$PWD junit.textui.TestRunner org.apache.derbyTesting.functionTests.tests.perf.JunitPerfDerby1862

Please see the Derby1970_Notes.html for more details.  I'll add more comments/ wiki on other ideas on how we can add to the JDBCPerfTestCase. 

Thanks. 

> Add framework for performance tests in derby using Junit.
> ---------------------------------------------------------
>
>                 Key: DERBY-1970
>                 URL: http://issues.apache.org/jira/browse/DERBY-1970
>             Project: Derby
>          Issue Type: Test
>          Components: Test
>    Affects Versions: 10.3.0.0
>            Reporter: Sunitha Kambhampati
>         Attachments: derby1970.draft.1.diff.txt, Derby1970_Notes.html
>
>
> Add a framework for performance tests to be added in derby. 
> Some goals are : 
> -- use Junit, thus will serve double duty as both functional tests as well as performance tests.
> -- builds upon the existing infrastructure available to run functional tests 
>    *  for example, getting connections is handled in a single way allowing the performance tests to run with J2ME, DriverManager, DataSource, single leg of an XA transaction etc. 
> -- be able to run using Junit directly. 
> -- easy for developers to add these tests and run them. 

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (DERBY-1970) Add framework for performance tests in derby using Junit.

Posted by "Sunitha Kambhampati (JIRA)" <ji...@apache.org>.
    [ http://issues.apache.org/jira/browse/DERBY-1970?page=comments#action_12446645 ] 
            
Sunitha Kambhampati commented on DERBY-1970:
--------------------------------------------

The initial framework patches are all committed, but I think there is more room for improvement, specially in the area of reporting. I was hoping to keep this issue open to attach any further patches for this.   

> Add framework for performance tests in derby using Junit.
> ---------------------------------------------------------
>
>                 Key: DERBY-1970
>                 URL: http://issues.apache.org/jira/browse/DERBY-1970
>             Project: Derby
>          Issue Type: Test
>          Components: Test
>    Affects Versions: 10.3.0.0
>            Reporter: Sunitha Kambhampati
>         Assigned To: Sunitha Kambhampati
>         Attachments: derby1970.draft.1.diff.txt, derby1970.p1.diff.txt, derby1970.p2.diff.txt, derby1970.p2.stat.txt, Derby1970_Notes.html, Derby1970_Notes.html
>
>
> Add a framework for performance tests to be added in derby. 
> Some goals are : 
> -- use Junit, thus will serve double duty as both functional tests as well as performance tests.
> -- builds upon the existing infrastructure available to run functional tests 
>    *  for example, getting connections is handled in a single way allowing the performance tests to run with J2ME, DriverManager, DataSource, single leg of an XA transaction etc. 
> -- be able to run using Junit directly. 
> -- easy for developers to add these tests and run them. 

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Resolved: (DERBY-1970) Add framework for performance tests in derby using Junit.

Posted by "Knut Anders Hatlen (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/DERBY-1970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Knut Anders Hatlen resolved DERBY-1970.
---------------------------------------

    Fix Version/s: 10.3.1.4
       Resolution: Fixed

I'm resolving this issue since all the patches have been committed and there has been no activity for more than three years. We can open new JIRA issues if further improvement is required.

> Add framework for performance tests in derby using Junit.
> ---------------------------------------------------------
>
>                 Key: DERBY-1970
>                 URL: https://issues.apache.org/jira/browse/DERBY-1970
>             Project: Derby
>          Issue Type: Improvement
>          Components: Test
>    Affects Versions: 10.3.1.4
>            Reporter: Sunitha Kambhampati
>            Assignee: Sunitha Kambhampati
>             Fix For: 10.3.1.4
>
>         Attachments: derby1970.draft.1.diff.txt, derby1970.p1.diff.txt, derby1970.p2.diff.txt, derby1970.p2.stat.txt, Derby1970_Notes.html, Derby1970_Notes.html
>
>
> Add a framework for performance tests to be added in derby. 
> Some goals are : 
> -- use Junit, thus will serve double duty as both functional tests as well as performance tests.
> -- builds upon the existing infrastructure available to run functional tests 
>    *  for example, getting connections is handled in a single way allowing the performance tests to run with J2ME, DriverManager, DataSource, single leg of an XA transaction etc. 
> -- be able to run using Junit directly. 
> -- easy for developers to add these tests and run them. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (DERBY-1970) Add framework for performance tests in derby using Junit.

Posted by "Andrew McIntyre (JIRA)" <ji...@apache.org>.
    [ http://issues.apache.org/jira/browse/DERBY-1970?page=comments#action_12446454 ] 
            
Andrew McIntyre commented on DERBY-1970:
----------------------------------------

Sunitha, is this issue now complete? Please resolve and close if so.

> Add framework for performance tests in derby using Junit.
> ---------------------------------------------------------
>
>                 Key: DERBY-1970
>                 URL: http://issues.apache.org/jira/browse/DERBY-1970
>             Project: Derby
>          Issue Type: Test
>          Components: Test
>    Affects Versions: 10.3.0.0
>            Reporter: Sunitha Kambhampati
>         Assigned To: Sunitha Kambhampati
>         Attachments: derby1970.draft.1.diff.txt, derby1970.p1.diff.txt, derby1970.p2.diff.txt, derby1970.p2.stat.txt, Derby1970_Notes.html, Derby1970_Notes.html
>
>
> Add a framework for performance tests to be added in derby. 
> Some goals are : 
> -- use Junit, thus will serve double duty as both functional tests as well as performance tests.
> -- builds upon the existing infrastructure available to run functional tests 
>    *  for example, getting connections is handled in a single way allowing the performance tests to run with J2ME, DriverManager, DataSource, single leg of an XA transaction etc. 
> -- be able to run using Junit directly. 
> -- easy for developers to add these tests and run them. 

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (DERBY-1970) Add framework for performance tests in derby using Junit.

Posted by "Sunitha Kambhampati (JIRA)" <de...@db.apache.org>.
    [ http://issues.apache.org/jira/browse/DERBY-1970?page=comments#action_12443641 ] 
            
Sunitha Kambhampati commented on DERBY-1970:
--------------------------------------------

Yes.  Thats correct. 

For JDBCPerfTestCase with R repeats and I iterations

This cycle is repeated R times
       {
            setUp run once
            fixture method is run I times (and timed)
            tearDown is run once
       } 

I'll update the javadoc for the JDBCPerfTestCase.   Thanks.

> Add framework for performance tests in derby using Junit.
> ---------------------------------------------------------
>
>                 Key: DERBY-1970
>                 URL: http://issues.apache.org/jira/browse/DERBY-1970
>             Project: Derby
>          Issue Type: Test
>          Components: Test
>    Affects Versions: 10.3.0.0
>            Reporter: Sunitha Kambhampati
>         Assigned To: Sunitha Kambhampati
>         Attachments: derby1970.draft.1.diff.txt, Derby1970_Notes.html, Derby1970_Notes.html
>
>
> Add a framework for performance tests to be added in derby. 
> Some goals are : 
> -- use Junit, thus will serve double duty as both functional tests as well as performance tests.
> -- builds upon the existing infrastructure available to run functional tests 
>    *  for example, getting connections is handled in a single way allowing the performance tests to run with J2ME, DriverManager, DataSource, single leg of an XA transaction etc. 
> -- be able to run using Junit directly. 
> -- easy for developers to add these tests and run them. 

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (DERBY-1970) Add framework for performance tests in derby using Junit.

Posted by "Dag H. Wanvik (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/DERBY-1970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dag H. Wanvik updated DERBY-1970:
---------------------------------

    Issue Type: Improvement  (was: Test)

> Add framework for performance tests in derby using Junit.
> ---------------------------------------------------------
>
>                 Key: DERBY-1970
>                 URL: https://issues.apache.org/jira/browse/DERBY-1970
>             Project: Derby
>          Issue Type: Improvement
>          Components: Test
>    Affects Versions: 10.3.1.4
>            Reporter: Sunitha Kambhampati
>            Assignee: Sunitha Kambhampati
>         Attachments: derby1970.draft.1.diff.txt, derby1970.p1.diff.txt, derby1970.p2.diff.txt, derby1970.p2.stat.txt, Derby1970_Notes.html, Derby1970_Notes.html
>
>
> Add a framework for performance tests to be added in derby. 
> Some goals are : 
> -- use Junit, thus will serve double duty as both functional tests as well as performance tests.
> -- builds upon the existing infrastructure available to run functional tests 
>    *  for example, getting connections is handled in a single way allowing the performance tests to run with J2ME, DriverManager, DataSource, single leg of an XA transaction etc. 
> -- be able to run using Junit directly. 
> -- easy for developers to add these tests and run them. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (DERBY-1970) Add framework for performance tests in derby using Junit.

Posted by "Sunitha Kambhampati (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/DERBY-1970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12468757 ] 

Sunitha Kambhampati commented on DERBY-1970:
--------------------------------------------

Adding link to the wiki page here.  Please feel free to edit... 
http://wiki.apache.org/db-derby/DerbyPerfTesting

> Add framework for performance tests in derby using Junit.
> ---------------------------------------------------------
>
>                 Key: DERBY-1970
>                 URL: https://issues.apache.org/jira/browse/DERBY-1970
>             Project: Derby
>          Issue Type: Test
>          Components: Test
>    Affects Versions: 10.3.0.0
>            Reporter: Sunitha Kambhampati
>         Assigned To: Sunitha Kambhampati
>         Attachments: derby1970.draft.1.diff.txt, derby1970.p1.diff.txt, derby1970.p2.diff.txt, derby1970.p2.stat.txt, Derby1970_Notes.html, Derby1970_Notes.html
>
>
> Add a framework for performance tests to be added in derby. 
> Some goals are : 
> -- use Junit, thus will serve double duty as both functional tests as well as performance tests.
> -- builds upon the existing infrastructure available to run functional tests 
>    *  for example, getting connections is handled in a single way allowing the performance tests to run with J2ME, DriverManager, DataSource, single leg of an XA transaction etc. 
> -- be able to run using Junit directly. 
> -- easy for developers to add these tests and run them. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (DERBY-1970) Add framework for performance tests in derby using Junit.

Posted by "Daniel John Debrunner (JIRA)" <de...@db.apache.org>.
    [ http://issues.apache.org/jira/browse/DERBY-1970?page=comments#action_12443639 ] 
            
Daniel John Debrunner commented on DERBY-1970:
----------------------------------------------

With the base performance class JDBCPerfTestCase it would be good to clarify how the test is run in terms of number of executions of the setUp, fixture and  tearDown methods.

For a standard JUnit test then the each method is run once.

For JDBCPerfTestCase  with R repeats and I iterations then is this the case?

This cycle is repeated R times
       {
            setUp run once
            fixture method is run I times (and timed)
            tearDown is run once
       }


       
       

> Add framework for performance tests in derby using Junit.
> ---------------------------------------------------------
>
>                 Key: DERBY-1970
>                 URL: http://issues.apache.org/jira/browse/DERBY-1970
>             Project: Derby
>          Issue Type: Test
>          Components: Test
>    Affects Versions: 10.3.0.0
>            Reporter: Sunitha Kambhampati
>         Assigned To: Sunitha Kambhampati
>         Attachments: derby1970.draft.1.diff.txt, Derby1970_Notes.html, Derby1970_Notes.html
>
>
> Add a framework for performance tests to be added in derby. 
> Some goals are : 
> -- use Junit, thus will serve double duty as both functional tests as well as performance tests.
> -- builds upon the existing infrastructure available to run functional tests 
>    *  for example, getting connections is handled in a single way allowing the performance tests to run with J2ME, DriverManager, DataSource, single leg of an XA transaction etc. 
> -- be able to run using Junit directly. 
> -- easy for developers to add these tests and run them. 

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (DERBY-1970) Add framework for performance tests in derby using Junit.

Posted by "Sunitha Kambhampati (JIRA)" <de...@db.apache.org>.
     [ http://issues.apache.org/jira/browse/DERBY-1970?page=all ]

Sunitha Kambhampati updated DERBY-1970:
---------------------------------------

    Attachment: Derby1970_Notes.html

> Add framework for performance tests in derby using Junit.
> ---------------------------------------------------------
>
>                 Key: DERBY-1970
>                 URL: http://issues.apache.org/jira/browse/DERBY-1970
>             Project: Derby
>          Issue Type: Test
>          Components: Test
>    Affects Versions: 10.3.0.0
>            Reporter: Sunitha Kambhampati
>         Attachments: derby1970.draft.1.diff.txt, Derby1970_Notes.html, Derby1970_Notes.html
>
>
> Add a framework for performance tests to be added in derby. 
> Some goals are : 
> -- use Junit, thus will serve double duty as both functional tests as well as performance tests.
> -- builds upon the existing infrastructure available to run functional tests 
>    *  for example, getting connections is handled in a single way allowing the performance tests to run with J2ME, DriverManager, DataSource, single leg of an XA transaction etc. 
> -- be able to run using Junit directly. 
> -- easy for developers to add these tests and run them. 

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (DERBY-1970) Add framework for performance tests in derby using Junit.

Posted by "Daniel John Debrunner (JIRA)" <ji...@apache.org>.
     [ http://issues.apache.org/jira/browse/DERBY-1970?page=all ]

Daniel John Debrunner updated DERBY-1970:
-----------------------------------------

    Derby Info:   (was: [Patch Available])

> Add framework for performance tests in derby using Junit.
> ---------------------------------------------------------
>
>                 Key: DERBY-1970
>                 URL: http://issues.apache.org/jira/browse/DERBY-1970
>             Project: Derby
>          Issue Type: Test
>          Components: Test
>    Affects Versions: 10.3.0.0
>            Reporter: Sunitha Kambhampati
>         Assigned To: Sunitha Kambhampati
>         Attachments: derby1970.draft.1.diff.txt, derby1970.p1.diff.txt, derby1970.p2.diff.txt, derby1970.p2.stat.txt, Derby1970_Notes.html, Derby1970_Notes.html
>
>
> Add a framework for performance tests to be added in derby. 
> Some goals are : 
> -- use Junit, thus will serve double duty as both functional tests as well as performance tests.
> -- builds upon the existing infrastructure available to run functional tests 
>    *  for example, getting connections is handled in a single way allowing the performance tests to run with J2ME, DriverManager, DataSource, single leg of an XA transaction etc. 
> -- be able to run using Junit directly. 
> -- easy for developers to add these tests and run them. 

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira