You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Robert Muir (JIRA)" <ji...@apache.org> on 2012/09/16 22:09:07 UTC
[jira] [Created] (LUCENE-4397)
TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes
very very slow
Robert Muir created LUCENE-4397:
-----------------------------------
Summary: TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes very very slow
Key: LUCENE-4397
URL: https://issues.apache.org/jira/browse/LUCENE-4397
Project: Lucene - Core
Issue Type: Bug
Components: general/test
Reporter: Robert Muir
e.g. ant test -Dtestcase=TestIndexWriterWithThreads -Dtests.seed=C9BE919B1BE0DAC7
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (LUCENE-4397)
TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes
very very slow
Posted by "Dawid Weiss (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dawid Weiss updated LUCENE-4397:
--------------------------------
Attachment: LUCENE-4397.patch
It's weird, the variance on this test is indeed very high. I think it may have something to do with the fact that it spins many threads (that do i/o) so if you're running on a multicore and there are other parallel jvms running tests you're putting a load on the hardware. If ran in isolation things get much faster (for me).
I've replaced some of the random() calls with the non-asserting random; I see some difference but not that much.
> TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes very very slow
> ---------------------------------------------------------------------------------------
>
> Key: LUCENE-4397
> URL: https://issues.apache.org/jira/browse/LUCENE-4397
> Project: Lucene - Core
> Issue Type: Bug
> Components: general/test
> Reporter: Robert Muir
> Attachments: LUCENE-4397.patch
>
>
> e.g. ant test -Dtestcase=TestIndexWriterWithThreads -Dtests.seed=C9BE919B1BE0DAC7
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (LUCENE-4397)
TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes
very very slow
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Muir updated LUCENE-4397:
--------------------------------
Attachment: LUCENE-4397.patch
updated patch: I'd rather just use newDirectory actually.
This means the test will be occasionally slow on windows, but I think thats ok. I dont want to start the path of losing test coverage because of certain os brokenness.
> TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes very very slow
> ---------------------------------------------------------------------------------------
>
> Key: LUCENE-4397
> URL: https://issues.apache.org/jira/browse/LUCENE-4397
> Project: Lucene - Core
> Issue Type: Bug
> Components: general/test
> Reporter: Robert Muir
> Attachments: LUCENE-4397.patch, LUCENE-4397.patch, LUCENE-4397.patch
>
>
> e.g. ant test -Dtestcase=TestIndexWriterWithThreads -Dtests.seed=C9BE919B1BE0DAC7
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-4397)
TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes
very very slow
Posted by "Dawid Weiss (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13458453#comment-13458453 ]
Dawid Weiss commented on LUCENE-4397:
-------------------------------------
Did you run all these with the same seed?
> TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes very very slow
> ---------------------------------------------------------------------------------------
>
> Key: LUCENE-4397
> URL: https://issues.apache.org/jira/browse/LUCENE-4397
> Project: Lucene - Core
> Issue Type: Bug
> Components: general/test
> Reporter: Robert Muir
>
> e.g. ant test -Dtestcase=TestIndexWriterWithThreads -Dtests.seed=C9BE919B1BE0DAC7
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-4397)
TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes
very very slow
Posted by "Jack Krupansky (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13458225#comment-13458225 ]
Jack Krupansky commented on LUCENE-4397:
----------------------------------------
My latest test for branch_4x finished this test in 2771.02 seconds on Windows. No errors were reported. CPU was relatively idle whenever I checked (25%). In Eclipse it took 316 seconds (while ant test was still running the rest of the tests.)
On trunk, TestIndexWriterWithThreads took 90 seconds.
> TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes very very slow
> ---------------------------------------------------------------------------------------
>
> Key: LUCENE-4397
> URL: https://issues.apache.org/jira/browse/LUCENE-4397
> Project: Lucene - Core
> Issue Type: Bug
> Components: general/test
> Reporter: Robert Muir
>
> e.g. ant test -Dtestcase=TestIndexWriterWithThreads -Dtests.seed=C9BE919B1BE0DAC7
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Resolved] (LUCENE-4397)
TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes
very very slow
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Muir resolved LUCENE-4397.
---------------------------------
Resolution: Fixed
> TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes very very slow
> ---------------------------------------------------------------------------------------
>
> Key: LUCENE-4397
> URL: https://issues.apache.org/jira/browse/LUCENE-4397
> Project: Lucene - Core
> Issue Type: Bug
> Components: general/test
> Reporter: Robert Muir
> Attachments: LUCENE-4397.patch, LUCENE-4397.patch, LUCENE-4397.patch
>
>
> e.g. ant test -Dtestcase=TestIndexWriterWithThreads -Dtests.seed=C9BE919B1BE0DAC7
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (LUCENE-4397)
TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes
very very slow
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Muir updated LUCENE-4397:
--------------------------------
Attachment: LUCENE-4397.patch
here's a patch: there are two things,
* the test is too slow in general (too many iterations)
* the test is super-slow on windows because of syncd i/o: i wired it to use mmapdirectory.
> TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes very very slow
> ---------------------------------------------------------------------------------------
>
> Key: LUCENE-4397
> URL: https://issues.apache.org/jira/browse/LUCENE-4397
> Project: Lucene - Core
> Issue Type: Bug
> Components: general/test
> Reporter: Robert Muir
> Attachments: LUCENE-4397.patch, LUCENE-4397.patch
>
>
> e.g. ant test -Dtestcase=TestIndexWriterWithThreads -Dtests.seed=C9BE919B1BE0DAC7
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org