You are viewing a plain text version of this content. The canonical link for it is here.
Posted to derby-dev@db.apache.org by "Mamta A. Satoor (Created) (JIRA)" <ji...@apache.org> on 2011/10/04 23:28:35 UTC
[jira] [Created] (DERBY-5445) Enhance existing concurrency test to
stress sequence generators to also stress identity columns
Enhance existing concurrency test to stress sequence generators to also stress identity columns
-----------------------------------------------------------------------------------------------
Key: DERBY-5445
URL: https://issues.apache.org/jira/browse/DERBY-5445
Project: Derby
Issue Type: Task
Components: Test
Affects Versions: 10.8.2.2, 10.9.0.0
Reporter: Mamta A. Satoor
DERBY-4565 added a concurrency test for sequence generators to test the possible race condition for allocating a new range of pre-allocated numbers for the sequence. I have been looking at enhancing that test to provide similar test for identity columns. I plan to add another command line parameter to the test which will run the concurrency test to stress identity column generator.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (DERBY-5445) Enhance existing concurrency test
to stress sequence generators to also stress identity columns
Posted by "Mamta A. Satoor (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/DERBY-5445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13121414#comment-13121414 ]
Mamta A. Satoor commented on DERBY-5445:
----------------------------------------
For some reason, my commit 1179374 for this jira has not yet been assoicated here. The commit had added means to stress test identity columns under concurrent thread. The commit comments are as follows
DERBY--5445 (Enhance existing concurrency test to stress sequence generators to also stress identity columns)
DERBY-4565 added a concurrency test to stress sequence generation. I am making simple modifications to that test to add identity column stress testing. Based on a command line parameter, the test will either do sequence generation testing or identity column testing. If no parameter is specified, it will default to doing sequene generation testing.
The test already takes number of parameters. One of those parameters is load options parameter. Load option parameter is indicated by -load_opts on command line and it is followed by a comma separated list of sub-parameters. An eg of load option parameter is as follows
-load_opts debugging=1,numberOfGenerators=5,tablesPerGenerator=10,insertsPerTransaction=100
I am adding another pair to the comma separated sub-parameters,namely identityTest=aNumber. If identityTest is 1, then the test will do identity column stress testing. For any other value for identityTest, the test will do sequence generation testing. If the user doesn't specify identityTest in load options, the test will perform sequence generation testing.
eg of asking the test to do identity column testing
java org.apache.derbyTesting.perf.clients.Runner -driver org.apache.derby.jdbc.EmbeddedDriver -init -load seq_gen -load_opts debugging=1,numberOfGenerators=5,tablesPerGenerator=10,insertsPerTransaction=100,identityTest=1 -gen b2b -threads 10
Two possible way of asking the test to do sequence generation testing(identityTest set to a value other than 1 or identityTest is not specified)
java org.apache.derbyTesting.perf.clients.Runner -driver org.apache.derby.jdbc.EmbeddedDriver -init -load seq_gen -load_opts debugging=1,numberOfGenerators=5,tablesPerGenerator=10,insertsPerTransaction=100,identityTest=2 -gen b2b -threads 10
OR
java org.apache.derbyTesting.perf.clients.Runner -driver org.apache.derby.jdbc.EmbeddedDriver -init -load seq_gen -load_opts debugging=1,numberOfGenerators=5,tablesPerGenerator=10,insertsPerTransaction=100 -gen b2b -threads 10
When I run the test for identity columns, I can consistently see it running into derby lock time out with nested sequencec contention error while trying to get current identity value and advancing(this is what we want to achieve from the test ie that it is able to stress the functionality enough to run into contention while trying to get next range for identity columns.) Additionally, there are some lock time out errors raised by store while trying to update system catalog(this is expected too because of multiple threads simulataneously trying to do inserts into a table with identity column). I also in my codeline reverted to changes before DERBY-5426 (DERBY-4526 is Improve the error raised by too much contention on a sequence/identity.) was fixed and saw sequence contention errors (without the lock time out error encapsulation).
> Enhance existing concurrency test to stress sequence generators to also stress identity columns
> -----------------------------------------------------------------------------------------------
>
> Key: DERBY-5445
> URL: https://issues.apache.org/jira/browse/DERBY-5445
> Project: Derby
> Issue Type: Task
> Components: Test
> Affects Versions: 10.8.2.2, 10.9.0.0
> Reporter: Mamta A. Satoor
> Assignee: Mamta A. Satoor
>
> DERBY-4565 added a concurrency test for sequence generators to test the possible race condition for allocating a new range of pre-allocated numbers for the sequence. I have been looking at enhancing that test to provide similar test for identity columns. I plan to add another command line parameter to the test which will run the concurrency test to stress identity column generator.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (DERBY-5445) Enhance existing concurrency test to
stress sequence generators to also stress identity columns
Posted by "Mamta A. Satoor (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/DERBY-5445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mamta A. Satoor reassigned DERBY-5445:
--------------------------------------
Assignee: Mamta A. Satoor
> Enhance existing concurrency test to stress sequence generators to also stress identity columns
> -----------------------------------------------------------------------------------------------
>
> Key: DERBY-5445
> URL: https://issues.apache.org/jira/browse/DERBY-5445
> Project: Derby
> Issue Type: Task
> Components: Test
> Affects Versions: 10.8.2.2, 10.9.0.0
> Reporter: Mamta A. Satoor
> Assignee: Mamta A. Satoor
>
> DERBY-4565 added a concurrency test for sequence generators to test the possible race condition for allocating a new range of pre-allocated numbers for the sequence. I have been looking at enhancing that test to provide similar test for identity columns. I plan to add another command line parameter to the test which will run the concurrency test to stress identity column generator.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (DERBY-5445) Enhance existing concurrency test to
stress sequence generators to also stress identity columns
Posted by "Knut Anders Hatlen (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/DERBY-5445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Knut Anders Hatlen updated DERBY-5445:
--------------------------------------
Attachment: fix-init-msg.diff
The original "initializing database..." message was changed by this issue to "initializing database for identity column testing..." or "initializing database for sequence generator testing..."
Although the new messages are more accurate when testing identity columns or sequence generators, they are wrong when running the other tests that don't use identity columns or sequence generators.
The attached patch changes the message back to the original.
Committed revision 1185056.
> Enhance existing concurrency test to stress sequence generators to also stress identity columns
> -----------------------------------------------------------------------------------------------
>
> Key: DERBY-5445
> URL: https://issues.apache.org/jira/browse/DERBY-5445
> Project: Derby
> Issue Type: Task
> Components: Test
> Affects Versions: 10.8.2.2, 10.9.0.0
> Reporter: Mamta A. Satoor
> Assignee: Mamta A. Satoor
> Fix For: 10.8.2.2, 10.9.0.0
>
> Attachments: fix-init-msg.diff
>
>
> DERBY-4565 added a concurrency test for sequence generators to test the possible race condition for allocating a new range of pre-allocated numbers for the sequence. I have been looking at enhancing that test to provide similar test for identity columns. I plan to add another command line parameter to the test which will run the concurrency test to stress identity column generator.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (DERBY-5445) Enhance existing concurrency test
to stress sequence generators to also stress identity columns
Posted by "Mamta A. Satoor (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/DERBY-5445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125889#comment-13125889 ]
Mamta A. Satoor commented on DERBY-5445:
----------------------------------------
Knut, thanks for noticing that extra hyphen. I have editted the svn comment to fix it.
> Enhance existing concurrency test to stress sequence generators to also stress identity columns
> -----------------------------------------------------------------------------------------------
>
> Key: DERBY-5445
> URL: https://issues.apache.org/jira/browse/DERBY-5445
> Project: Derby
> Issue Type: Task
> Components: Test
> Affects Versions: 10.8.2.2, 10.9.0.0
> Reporter: Mamta A. Satoor
> Assignee: Mamta A. Satoor
> Fix For: 10.8.2.2, 10.9.0.0
>
>
> DERBY-4565 added a concurrency test for sequence generators to test the possible race condition for allocating a new range of pre-allocated numbers for the sequence. I have been looking at enhancing that test to provide similar test for identity columns. I plan to add another command line parameter to the test which will run the concurrency test to stress identity column generator.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (DERBY-5445) Enhance existing concurrency test to
stress sequence generators to also stress identity columns
Posted by "Mamta A. Satoor (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/DERBY-5445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mamta A. Satoor resolved DERBY-5445.
------------------------------------
Resolution: Fixed
> Enhance existing concurrency test to stress sequence generators to also stress identity columns
> -----------------------------------------------------------------------------------------------
>
> Key: DERBY-5445
> URL: https://issues.apache.org/jira/browse/DERBY-5445
> Project: Derby
> Issue Type: Task
> Components: Test
> Affects Versions: 10.8.2.2, 10.9.1.0
> Reporter: Mamta A. Satoor
> Assignee: Mamta A. Satoor
> Fix For: 10.9.1.0, 10.8.2.2
>
> Attachments: fix-init-msg.diff
>
>
> DERBY-4565 added a concurrency test for sequence generators to test the possible race condition for allocating a new range of pre-allocated numbers for the sequence. I have been looking at enhancing that test to provide similar test for identity columns. I plan to add another command line parameter to the test which will run the concurrency test to stress identity column generator.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (DERBY-5445) Enhance existing concurrency test
to stress sequence generators to also stress identity columns
Posted by "Knut Anders Hatlen (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/DERBY-5445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125719#comment-13125719 ]
Knut Anders Hatlen commented on DERBY-5445:
-------------------------------------------
> For some reason, my commit 1179374 for this jira has not yet been
> assoicated here. The commit had added means to stress test identity
> columns under concurrent thread. The commit comments are as follows
>
> DERBY--5445 (...)
Probably the extra hyphen is why it didn't get associated with the issue.
> Enhance existing concurrency test to stress sequence generators to also stress identity columns
> -----------------------------------------------------------------------------------------------
>
> Key: DERBY-5445
> URL: https://issues.apache.org/jira/browse/DERBY-5445
> Project: Derby
> Issue Type: Task
> Components: Test
> Affects Versions: 10.8.2.2, 10.9.0.0
> Reporter: Mamta A. Satoor
> Assignee: Mamta A. Satoor
> Fix For: 10.8.2.2, 10.9.0.0
>
>
> DERBY-4565 added a concurrency test for sequence generators to test the possible race condition for allocating a new range of pre-allocated numbers for the sequence. I have been looking at enhancing that test to provide similar test for identity columns. I plan to add another command line parameter to the test which will run the concurrency test to stress identity column generator.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (DERBY-5445) Enhance existing concurrency test to
stress sequence generators to also stress identity columns
Posted by "Mamta A. Satoor (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/DERBY-5445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mamta A. Satoor updated DERBY-5445:
-----------------------------------
Fix Version/s: 10.9.0.0
10.8.2.2
> Enhance existing concurrency test to stress sequence generators to also stress identity columns
> -----------------------------------------------------------------------------------------------
>
> Key: DERBY-5445
> URL: https://issues.apache.org/jira/browse/DERBY-5445
> Project: Derby
> Issue Type: Task
> Components: Test
> Affects Versions: 10.8.2.2, 10.9.0.0
> Reporter: Mamta A. Satoor
> Assignee: Mamta A. Satoor
> Fix For: 10.8.2.2, 10.9.0.0
>
>
> DERBY-4565 added a concurrency test for sequence generators to test the possible race condition for allocating a new range of pre-allocated numbers for the sequence. I have been looking at enhancing that test to provide similar test for identity columns. I plan to add another command line parameter to the test which will run the concurrency test to stress identity column generator.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (DERBY-5445) Enhance existing concurrency test
to stress sequence generators to also stress identity columns
Posted by "Mamta A. Satoor (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/DERBY-5445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13121422#comment-13121422 ]
Mamta A. Satoor commented on DERBY-5445:
----------------------------------------
I was wondering how often does java org.apache.derbyTesting.perf.clients.Runner get run? Don't think it is part of junit suite. Does it get run as part of a new release process?
> Enhance existing concurrency test to stress sequence generators to also stress identity columns
> -----------------------------------------------------------------------------------------------
>
> Key: DERBY-5445
> URL: https://issues.apache.org/jira/browse/DERBY-5445
> Project: Derby
> Issue Type: Task
> Components: Test
> Affects Versions: 10.8.2.2, 10.9.0.0
> Reporter: Mamta A. Satoor
> Assignee: Mamta A. Satoor
>
> DERBY-4565 added a concurrency test for sequence generators to test the possible race condition for allocating a new range of pre-allocated numbers for the sequence. I have been looking at enhancing that test to provide similar test for identity columns. I plan to add another command line parameter to the test which will run the concurrency test to stress identity column generator.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (DERBY-5445) Enhance existing concurrency test
to stress sequence generators to also stress identity columns
Posted by "Myrna van Lunteren (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/DERBY-5445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13213102#comment-13213102 ]
Myrna van Lunteren commented on DERBY-5445:
-------------------------------------------
Is there more expected on this issue?
> Enhance existing concurrency test to stress sequence generators to also stress identity columns
> -----------------------------------------------------------------------------------------------
>
> Key: DERBY-5445
> URL: https://issues.apache.org/jira/browse/DERBY-5445
> Project: Derby
> Issue Type: Task
> Components: Test
> Affects Versions: 10.8.2.2, 10.9.0.0
> Reporter: Mamta A. Satoor
> Assignee: Mamta A. Satoor
> Fix For: 10.8.2.2, 10.9.0.0
>
> Attachments: fix-init-msg.diff
>
>
> DERBY-4565 added a concurrency test for sequence generators to test the possible race condition for allocating a new range of pre-allocated numbers for the sequence. I have been looking at enhancing that test to provide similar test for identity columns. I plan to add another command line parameter to the test which will run the concurrency test to stress identity column generator.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (DERBY-5445) Enhance existing concurrency test
to stress sequence generators to also stress identity columns
Posted by "Kristian Waagan (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/DERBY-5445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13121447#comment-13121447 ]
Kristian Waagan commented on DERBY-5445:
----------------------------------------
Every day?
See http://home.online.no/~olmsan/derby/perf/ , accessible from http://dbtg.foundry.sun.com/derby/test/ .
Since the results don't make sense without comparing them over time (on the same hardware, os, JVM, etc), I don't think they're well suited for running as part of suite.All. Note also that the results can be rather unstable, so to draw conclusions one has to look at the numbers for a longer period of time.
I don't know if there are any other performance test comparing performance over time for Derby.
> Enhance existing concurrency test to stress sequence generators to also stress identity columns
> -----------------------------------------------------------------------------------------------
>
> Key: DERBY-5445
> URL: https://issues.apache.org/jira/browse/DERBY-5445
> Project: Derby
> Issue Type: Task
> Components: Test
> Affects Versions: 10.8.2.2, 10.9.0.0
> Reporter: Mamta A. Satoor
> Assignee: Mamta A. Satoor
>
> DERBY-4565 added a concurrency test for sequence generators to test the possible race condition for allocating a new range of pre-allocated numbers for the sequence. I have been looking at enhancing that test to provide similar test for identity columns. I plan to add another command line parameter to the test which will run the concurrency test to stress identity column generator.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira