You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Robert Muir (JIRA)" <ji...@apache.org> on 2012/09/16 22:09:07 UTC

[jira] [Created] (LUCENE-4397) TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes very very slow

Robert Muir created LUCENE-4397:
-----------------------------------

             Summary: TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes very very slow
                 Key: LUCENE-4397
                 URL: https://issues.apache.org/jira/browse/LUCENE-4397
             Project: Lucene - Core
          Issue Type: Bug
          Components: general/test
            Reporter: Robert Muir


e.g. ant test -Dtestcase=TestIndexWriterWithThreads -Dtests.seed=C9BE919B1BE0DAC7

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Updated] (LUCENE-4397) TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes very very slow

Posted by "Dawid Weiss (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dawid Weiss updated LUCENE-4397:
--------------------------------

    Attachment: LUCENE-4397.patch

It's weird, the variance on this test is indeed very high. I think it may have something to do with the fact that it spins many threads (that do i/o) so if you're running on a multicore and there are other parallel jvms running tests you're putting a load on the hardware. If ran in isolation things get much faster (for me).

I've replaced some of the random() calls with the non-asserting random; I see some difference but not that much.
                
> TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes very very slow
> ---------------------------------------------------------------------------------------
>
>                 Key: LUCENE-4397
>                 URL: https://issues.apache.org/jira/browse/LUCENE-4397
>             Project: Lucene - Core
>          Issue Type: Bug
>          Components: general/test
>            Reporter: Robert Muir
>         Attachments: LUCENE-4397.patch
>
>
> e.g. ant test -Dtestcase=TestIndexWriterWithThreads -Dtests.seed=C9BE919B1BE0DAC7

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Updated] (LUCENE-4397) TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes very very slow

Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Muir updated LUCENE-4397:
--------------------------------

    Attachment: LUCENE-4397.patch

updated patch: I'd rather just use newDirectory actually. 

This means the test will be occasionally slow on windows, but I think thats ok. I dont want to start the path of losing test coverage because of certain os brokenness.
                
> TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes very very slow
> ---------------------------------------------------------------------------------------
>
>                 Key: LUCENE-4397
>                 URL: https://issues.apache.org/jira/browse/LUCENE-4397
>             Project: Lucene - Core
>          Issue Type: Bug
>          Components: general/test
>            Reporter: Robert Muir
>         Attachments: LUCENE-4397.patch, LUCENE-4397.patch, LUCENE-4397.patch
>
>
> e.g. ant test -Dtestcase=TestIndexWriterWithThreads -Dtests.seed=C9BE919B1BE0DAC7

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (LUCENE-4397) TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes very very slow

Posted by "Dawid Weiss (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13458453#comment-13458453 ] 

Dawid Weiss commented on LUCENE-4397:
-------------------------------------

Did you run all these with the same seed?
                
> TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes very very slow
> ---------------------------------------------------------------------------------------
>
>                 Key: LUCENE-4397
>                 URL: https://issues.apache.org/jira/browse/LUCENE-4397
>             Project: Lucene - Core
>          Issue Type: Bug
>          Components: general/test
>            Reporter: Robert Muir
>
> e.g. ant test -Dtestcase=TestIndexWriterWithThreads -Dtests.seed=C9BE919B1BE0DAC7

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (LUCENE-4397) TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes very very slow

Posted by "Jack Krupansky (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13458225#comment-13458225 ] 

Jack Krupansky commented on LUCENE-4397:
----------------------------------------

My latest test for branch_4x finished this test in 2771.02 seconds on Windows. No errors were reported. CPU was relatively idle whenever I checked (25%). In Eclipse it took 316 seconds (while ant test was still running the rest of the tests.)

On trunk, TestIndexWriterWithThreads took 90 seconds.


                
> TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes very very slow
> ---------------------------------------------------------------------------------------
>
>                 Key: LUCENE-4397
>                 URL: https://issues.apache.org/jira/browse/LUCENE-4397
>             Project: Lucene - Core
>          Issue Type: Bug
>          Components: general/test
>            Reporter: Robert Muir
>
> e.g. ant test -Dtestcase=TestIndexWriterWithThreads -Dtests.seed=C9BE919B1BE0DAC7

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Resolved] (LUCENE-4397) TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes very very slow

Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Muir resolved LUCENE-4397.
---------------------------------

    Resolution: Fixed
    
> TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes very very slow
> ---------------------------------------------------------------------------------------
>
>                 Key: LUCENE-4397
>                 URL: https://issues.apache.org/jira/browse/LUCENE-4397
>             Project: Lucene - Core
>          Issue Type: Bug
>          Components: general/test
>            Reporter: Robert Muir
>         Attachments: LUCENE-4397.patch, LUCENE-4397.patch, LUCENE-4397.patch
>
>
> e.g. ant test -Dtestcase=TestIndexWriterWithThreads -Dtests.seed=C9BE919B1BE0DAC7

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Updated] (LUCENE-4397) TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes very very slow

Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Muir updated LUCENE-4397:
--------------------------------

    Attachment: LUCENE-4397.patch

here's a patch: there are two things,
* the test is too slow in general (too many iterations)
* the test is super-slow on windows because of syncd i/o: i wired it to use mmapdirectory.
                
> TestIndexWriterWithThreads.testRollbackAndCommitWithThreads is sometimes very very slow
> ---------------------------------------------------------------------------------------
>
>                 Key: LUCENE-4397
>                 URL: https://issues.apache.org/jira/browse/LUCENE-4397
>             Project: Lucene - Core
>          Issue Type: Bug
>          Components: general/test
>            Reporter: Robert Muir
>         Attachments: LUCENE-4397.patch, LUCENE-4397.patch
>
>
> e.g. ant test -Dtestcase=TestIndexWriterWithThreads -Dtests.seed=C9BE919B1BE0DAC7

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org