You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Michael McCandless (JIRA)" <ji...@apache.org> on 2010/10/30 16:08:20 UTC
[jira] Created: (LUCENE-2730) intermittent deadlock in
TestAtomicUpdate,TestIndexWriterExceptions
intermittent deadlock in TestAtomicUpdate,TestIndexWriterExceptions
-------------------------------------------------------------------
Key: LUCENE-2730
URL: https://issues.apache.org/jira/browse/LUCENE-2730
Project: Lucene - Java
Issue Type: Bug
Components: Index
Affects Versions: 3.0.2, 2.9.3
Reporter: Michael McCandless
Assignee: Michael McCandless
Fix For: 2.9.4, 3.0.3
While backporting issues for 2.9.x/3.0.x release I hit deadlocks in these two tests, under both test-core and test-tag.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (LUCENE-2730) intermittent deadlock in
TestAtomicUpdate,TestIndexWriterExceptions
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12926603#action_12926603 ]
Uwe Schindler commented on LUCENE-2730:
---------------------------------------
For me it now passes :-)
In my opinion we should remove the stupid synchronized in TermsHash completely (also trunk and 3.x, I removed at least the compact()-sync). This class needs no sync.
> intermittent deadlock in TestAtomicUpdate,TestIndexWriterExceptions
> -------------------------------------------------------------------
>
> Key: LUCENE-2730
> URL: https://issues.apache.org/jira/browse/LUCENE-2730
> Project: Lucene - Java
> Issue Type: Bug
> Components: Index
> Affects Versions: 2.9.3, 3.0.2
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.4, 3.0.3
>
> Attachments: LUCENE-2730.patch
>
>
> While backporting issues for 2.9.x/3.0.x release I hit deadlocks in these two tests, under both test-core and test-tag.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (LUCENE-2730) intermittent deadlock in
TestAtomicUpdate,TestIndexWriterExceptions
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12926605#action_12926605 ]
Uwe Schindler commented on LUCENE-2730:
---------------------------------------
Hangs in this and other tests can also come from increet test MT programming. Just think about Michael Busch's talk @ LuceneRev. The test uses some fields in the thread that are not volatile or synchronized on. The test is fixed in trunk/3.x during our total test overhaul. There are about 10 tests using the same wrong thread inner class.
If we want to fix that we must also fix backwards... happy tag creating again *g*
> intermittent deadlock in TestAtomicUpdate,TestIndexWriterExceptions
> -------------------------------------------------------------------
>
> Key: LUCENE-2730
> URL: https://issues.apache.org/jira/browse/LUCENE-2730
> Project: Lucene - Java
> Issue Type: Bug
> Components: Index
> Affects Versions: 2.9.3, 3.0.2
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.4, 3.0.3
>
> Attachments: LUCENE-2730.patch
>
>
> While backporting issues for 2.9.x/3.0.x release I hit deadlocks in these two tests, under both test-core and test-tag.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (LUCENE-2730) intermittent deadlock in
TestAtomicUpdate,TestIndexWriterExceptions
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12926589#action_12926589 ]
Uwe Schindler commented on LUCENE-2730:
---------------------------------------
Windows 7 1.5.0_22 64 hangy very often in test-tag (every 2 times)
> intermittent deadlock in TestAtomicUpdate,TestIndexWriterExceptions
> -------------------------------------------------------------------
>
> Key: LUCENE-2730
> URL: https://issues.apache.org/jira/browse/LUCENE-2730
> Project: Lucene - Java
> Issue Type: Bug
> Components: Index
> Affects Versions: 2.9.3, 3.0.2
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.4, 3.0.3
>
> Attachments: LUCENE-2730.patch
>
>
> While backporting issues for 2.9.x/3.0.x release I hit deadlocks in these two tests, under both test-core and test-tag.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Issue Comment Edited: (LUCENE-2730) intermittent deadlock in
TestAtomicUpdate,TestIndexWriterExceptions
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12926605#action_12926605 ]
Uwe Schindler edited comment on LUCENE-2730 at 10/30/10 12:38 PM:
------------------------------------------------------------------
Hangs in this and other tests can also come from incorrect test MT programming. Just think about Michael Busch's talk @ LuceneRev. The test uses some fields in the thread that are not volatile or synchronized on. The test is fixed in trunk/3.x during our total test overhaul. There are about 10 tests using the same wrong thread inner class.
If we want to fix that we must also fix backwards... happy tag creating again *g*
was (Author: thetaphi):
Hangs in this and other tests can also come from increet test MT programming. Just think about Michael Busch's talk @ LuceneRev. The test uses some fields in the thread that are not volatile or synchronized on. The test is fixed in trunk/3.x during our total test overhaul. There are about 10 tests using the same wrong thread inner class.
If we want to fix that we must also fix backwards... happy tag creating again *g*
> intermittent deadlock in TestAtomicUpdate,TestIndexWriterExceptions
> -------------------------------------------------------------------
>
> Key: LUCENE-2730
> URL: https://issues.apache.org/jira/browse/LUCENE-2730
> Project: Lucene - Java
> Issue Type: Bug
> Components: Index
> Affects Versions: 2.9.3, 3.0.2
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.4, 3.0.3
>
> Attachments: LUCENE-2730.patch
>
>
> While backporting issues for 2.9.x/3.0.x release I hit deadlocks in these two tests, under both test-core and test-tag.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (LUCENE-2730) intermittent deadlock in
TestAtomicUpdate,TestIndexWriterExceptions
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12926588#action_12926588 ]
Robert Muir commented on LUCENE-2730:
-------------------------------------
hmm ok, because I'm able to easily reproduce the TestIndexWriterExceptions with 3.0.2,
but i haven't had any luck with TestAtomicUpdate (seems like a different problem)
pretty sure TestAtomicUpdate doesn't hang often even in 3.0.x for me now, i'll try on linux
too just in case.
> intermittent deadlock in TestAtomicUpdate,TestIndexWriterExceptions
> -------------------------------------------------------------------
>
> Key: LUCENE-2730
> URL: https://issues.apache.org/jira/browse/LUCENE-2730
> Project: Lucene - Java
> Issue Type: Bug
> Components: Index
> Affects Versions: 2.9.3, 3.0.2
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.4, 3.0.3
>
> Attachments: LUCENE-2730.patch
>
>
> While backporting issues for 2.9.x/3.0.x release I hit deadlocks in these two tests, under both test-core and test-tag.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (LUCENE-2730) intermittent deadlock in
TestAtomicUpdate,TestIndexWriterExceptions
Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12926704#action_12926704 ]
Michael McCandless commented on LUCENE-2730:
--------------------------------------------
bq. In my opinion we should remove the stupid synchronized in TermsHash completely (also trunk and 3.x, I removed at least the compact()-sync). This class needs no sync.
We have to be somewhat careful w/ this.
Eg in 2.9.x/3.0.x some of the sync is needed because IW calls freeRAM "freely", ie, while other threads are indexing. IW still calls freeRAM in 3.x/4.0, but it's a no-op there since we don't recycle RAM as aggressively anymore. So likely we could remove sync from TermsHash on 3.x/trunk, but let's do that another day...
> intermittent deadlock in TestAtomicUpdate,TestIndexWriterExceptions
> -------------------------------------------------------------------
>
> Key: LUCENE-2730
> URL: https://issues.apache.org/jira/browse/LUCENE-2730
> Project: Lucene - Java
> Issue Type: Bug
> Components: Index
> Affects Versions: 2.9.3, 3.0.2
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.4, 3.0.3
>
> Attachments: LUCENE-2730.patch
>
>
> While backporting issues for 2.9.x/3.0.x release I hit deadlocks in these two tests, under both test-core and test-tag.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (LUCENE-2730) intermittent deadlock in
TestAtomicUpdate,TestIndexWriterExceptions
Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12926702#action_12926702 ]
Michael McCandless commented on LUCENE-2730:
--------------------------------------------
OK I'll commit... we can reopen if the hangs happen again!
> intermittent deadlock in TestAtomicUpdate,TestIndexWriterExceptions
> -------------------------------------------------------------------
>
> Key: LUCENE-2730
> URL: https://issues.apache.org/jira/browse/LUCENE-2730
> Project: Lucene - Java
> Issue Type: Bug
> Components: Index
> Affects Versions: 2.9.3, 3.0.2
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.4, 3.0.3
>
> Attachments: LUCENE-2730.patch
>
>
> While backporting issues for 2.9.x/3.0.x release I hit deadlocks in these two tests, under both test-core and test-tag.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (LUCENE-2730) intermittent deadlock in
TestAtomicUpdate,TestIndexWriterExceptions
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12926598#action_12926598 ]
Uwe Schindler commented on LUCENE-2730:
---------------------------------------
I have seen the synchronized also in TermsHash in 3.x... Do we need to remove it there, too?
> intermittent deadlock in TestAtomicUpdate,TestIndexWriterExceptions
> -------------------------------------------------------------------
>
> Key: LUCENE-2730
> URL: https://issues.apache.org/jira/browse/LUCENE-2730
> Project: Lucene - Java
> Issue Type: Bug
> Components: Index
> Affects Versions: 2.9.3, 3.0.2
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.4, 3.0.3
>
> Attachments: LUCENE-2730.patch
>
>
> While backporting issues for 2.9.x/3.0.x release I hit deadlocks in these two tests, under both test-core and test-tag.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Resolved: (LUCENE-2730) intermittent deadlock in
TestAtomicUpdate,TestIndexWriterExceptions
Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Michael McCandless resolved LUCENE-2730.
----------------------------------------
Resolution: Fixed
Fix Version/s: 4.0
3.1
> intermittent deadlock in TestAtomicUpdate,TestIndexWriterExceptions
> -------------------------------------------------------------------
>
> Key: LUCENE-2730
> URL: https://issues.apache.org/jira/browse/LUCENE-2730
> Project: Lucene - Java
> Issue Type: Bug
> Components: Index
> Affects Versions: 2.9.3, 3.0.2
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.4, 3.0.3, 3.1, 4.0
>
> Attachments: LUCENE-2730.patch
>
>
> While backporting issues for 2.9.x/3.0.x release I hit deadlocks in these two tests, under both test-core and test-tag.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (LUCENE-2730) intermittent deadlock in
TestAtomicUpdate,TestIndexWriterExceptions
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12926696#action_12926696 ]
Robert Muir commented on LUCENE-2730:
-------------------------------------
I made my own test runner, and ran this test for hours, but i couldnt reproduce the hang.
There is a general problem on windows: if we run a test and it hangs there is no way to get the SIGQUIT stacktrace.
if you use control-break, it only gives you the stacktrace of the 'ant' jvm itself... somehow I would like to fix this later.
but don't let me stand in the way here... perhaps i made some mistake/didn't ant clean, something silly! sorry!
> intermittent deadlock in TestAtomicUpdate,TestIndexWriterExceptions
> -------------------------------------------------------------------
>
> Key: LUCENE-2730
> URL: https://issues.apache.org/jira/browse/LUCENE-2730
> Project: Lucene - Java
> Issue Type: Bug
> Components: Index
> Affects Versions: 2.9.3, 3.0.2
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.4, 3.0.3
>
> Attachments: LUCENE-2730.patch
>
>
> While backporting issues for 2.9.x/3.0.x release I hit deadlocks in these two tests, under both test-core and test-tag.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (LUCENE-2730) intermittent deadlock in
TestAtomicUpdate,TestIndexWriterExceptions
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12926602#action_12926602 ]
Robert Muir commented on LUCENE-2730:
-------------------------------------
I ran with the patch here on 2.9.x, and still encountered the hang in TestAtomicUpdate...
> intermittent deadlock in TestAtomicUpdate,TestIndexWriterExceptions
> -------------------------------------------------------------------
>
> Key: LUCENE-2730
> URL: https://issues.apache.org/jira/browse/LUCENE-2730
> Project: Lucene - Java
> Issue Type: Bug
> Components: Index
> Affects Versions: 2.9.3, 3.0.2
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.4, 3.0.3
>
> Attachments: LUCENE-2730.patch
>
>
> While backporting issues for 2.9.x/3.0.x release I hit deadlocks in these two tests, under both test-core and test-tag.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (LUCENE-2730) intermittent deadlock in
TestAtomicUpdate,TestIndexWriterExceptions
Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12926600#action_12926600 ]
Michael McCandless commented on LUCENE-2730:
--------------------------------------------
bq. I have seen the synchronized also in TermsHash in 3.x... Do we need to remove it there, too?
I will also remove from 3.x & trunk, but, this does not lead to deadlock because we've simplified how IW re-uses RAM, so this particular deadlock case can't occur.
Still we should remove it, so I will...
> intermittent deadlock in TestAtomicUpdate,TestIndexWriterExceptions
> -------------------------------------------------------------------
>
> Key: LUCENE-2730
> URL: https://issues.apache.org/jira/browse/LUCENE-2730
> Project: Lucene - Java
> Issue Type: Bug
> Components: Index
> Affects Versions: 2.9.3, 3.0.2
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.4, 3.0.3
>
> Attachments: LUCENE-2730.patch
>
>
> While backporting issues for 2.9.x/3.0.x release I hit deadlocks in these two tests, under both test-core and test-tag.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (LUCENE-2730) intermittent deadlock in
TestAtomicUpdate,TestIndexWriterExceptions
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12926590#action_12926590 ]
Robert Muir commented on LUCENE-2730:
-------------------------------------
Right, mine hangs very often, but on TestIndexWriterExceptions, not TestAtomicUpdate.
its the TestAtomicUpdate hang that is hard to reproduce for me
> intermittent deadlock in TestAtomicUpdate,TestIndexWriterExceptions
> -------------------------------------------------------------------
>
> Key: LUCENE-2730
> URL: https://issues.apache.org/jira/browse/LUCENE-2730
> Project: Lucene - Java
> Issue Type: Bug
> Components: Index
> Affects Versions: 2.9.3, 3.0.2
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.4, 3.0.3
>
> Attachments: LUCENE-2730.patch
>
>
> While backporting issues for 2.9.x/3.0.x release I hit deadlocks in these two tests, under both test-core and test-tag.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (LUCENE-2730) intermittent deadlock in
TestAtomicUpdate,TestIndexWriterExceptions
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12926594#action_12926594 ]
Uwe Schindler commented on LUCENE-2730:
---------------------------------------
TestAtomicUpdate is the one that hangs for me in test-tag every 2 times. Don't know why, maybe the JVM or processor speed?
> intermittent deadlock in TestAtomicUpdate,TestIndexWriterExceptions
> -------------------------------------------------------------------
>
> Key: LUCENE-2730
> URL: https://issues.apache.org/jira/browse/LUCENE-2730
> Project: Lucene - Java
> Issue Type: Bug
> Components: Index
> Affects Versions: 2.9.3, 3.0.2
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.4, 3.0.3
>
> Attachments: LUCENE-2730.patch
>
>
> While backporting issues for 2.9.x/3.0.x release I hit deadlocks in these two tests, under both test-core and test-tag.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (LUCENE-2730) intermittent deadlock in
TestAtomicUpdate,TestIndexWriterExceptions
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12926584#action_12926584 ]
Uwe Schindler commented on LUCENE-2730:
---------------------------------------
It's there since the very beginning of 2.9/3.0. I had the hangs also in some test runs when releaseing 3.0.0! I mendioned that, but we said "its a test failure, lets ignore it).
> intermittent deadlock in TestAtomicUpdate,TestIndexWriterExceptions
> -------------------------------------------------------------------
>
> Key: LUCENE-2730
> URL: https://issues.apache.org/jira/browse/LUCENE-2730
> Project: Lucene - Java
> Issue Type: Bug
> Components: Index
> Affects Versions: 2.9.3, 3.0.2
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.4, 3.0.3
>
> Attachments: LUCENE-2730.patch
>
>
> While backporting issues for 2.9.x/3.0.x release I hit deadlocks in these two tests, under both test-core and test-tag.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (LUCENE-2730) intermittent deadlock in
TestAtomicUpdate,TestIndexWriterExceptions
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12926597#action_12926597 ]
Robert Muir commented on LUCENE-2730:
-------------------------------------
bq. TestAtomicUpdate is the one that hangs for me in test-tag every 2 times. Don't know why, maybe the JVM or processor speed?
No, its because it does not hang in 3.0.x, only 2.9.x, they are not the same bugfix level :)
> intermittent deadlock in TestAtomicUpdate,TestIndexWriterExceptions
> -------------------------------------------------------------------
>
> Key: LUCENE-2730
> URL: https://issues.apache.org/jira/browse/LUCENE-2730
> Project: Lucene - Java
> Issue Type: Bug
> Components: Index
> Affects Versions: 2.9.3, 3.0.2
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.4, 3.0.3
>
> Attachments: LUCENE-2730.patch
>
>
> While backporting issues for 2.9.x/3.0.x release I hit deadlocks in these two tests, under both test-core and test-tag.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (LUCENE-2730) intermittent deadlock in
TestAtomicUpdate,TestIndexWriterExceptions
Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12926596#action_12926596 ]
Michael McCandless commented on LUCENE-2730:
--------------------------------------------
OK so the TestAtomicUpdate hang only affects 2.9.x, since we removed autoCommit in 3.0.x.
> intermittent deadlock in TestAtomicUpdate,TestIndexWriterExceptions
> -------------------------------------------------------------------
>
> Key: LUCENE-2730
> URL: https://issues.apache.org/jira/browse/LUCENE-2730
> Project: Lucene - Java
> Issue Type: Bug
> Components: Index
> Affects Versions: 2.9.3, 3.0.2
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.4, 3.0.3
>
> Attachments: LUCENE-2730.patch
>
>
> While backporting issues for 2.9.x/3.0.x release I hit deadlocks in these two tests, under both test-core and test-tag.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (LUCENE-2730) intermittent deadlock in
TestAtomicUpdate,TestIndexWriterExceptions
Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12926595#action_12926595 ]
Michael McCandless commented on LUCENE-2730:
--------------------------------------------
Uwe can you test the patch and see if that fixes your TestAtomicUpdate hang?
> intermittent deadlock in TestAtomicUpdate,TestIndexWriterExceptions
> -------------------------------------------------------------------
>
> Key: LUCENE-2730
> URL: https://issues.apache.org/jira/browse/LUCENE-2730
> Project: Lucene - Java
> Issue Type: Bug
> Components: Index
> Affects Versions: 2.9.3, 3.0.2
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.4, 3.0.3
>
> Attachments: LUCENE-2730.patch
>
>
> While backporting issues for 2.9.x/3.0.x release I hit deadlocks in these two tests, under both test-core and test-tag.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (LUCENE-2730) intermittent deadlock in
TestAtomicUpdate,TestIndexWriterExceptions
Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12926585#action_12926585 ]
Uwe Schindler commented on LUCENE-2730:
---------------------------------------
It happens also in backwards tests (much more often!)
> intermittent deadlock in TestAtomicUpdate,TestIndexWriterExceptions
> -------------------------------------------------------------------
>
> Key: LUCENE-2730
> URL: https://issues.apache.org/jira/browse/LUCENE-2730
> Project: Lucene - Java
> Issue Type: Bug
> Components: Index
> Affects Versions: 2.9.3, 3.0.2
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.4, 3.0.3
>
> Attachments: LUCENE-2730.patch
>
>
> While backporting issues for 2.9.x/3.0.x release I hit deadlocks in these two tests, under both test-core and test-tag.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (LUCENE-2730) intermittent deadlock in
TestAtomicUpdate,TestIndexWriterExceptions
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12926606#action_12926606 ]
Robert Muir commented on LUCENE-2730:
-------------------------------------
well, it still doesnt fix the problem for me, so i dont think we should go changing things yet, until we find the real cause of the hang.
> intermittent deadlock in TestAtomicUpdate,TestIndexWriterExceptions
> -------------------------------------------------------------------
>
> Key: LUCENE-2730
> URL: https://issues.apache.org/jira/browse/LUCENE-2730
> Project: Lucene - Java
> Issue Type: Bug
> Components: Index
> Affects Versions: 2.9.3, 3.0.2
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.4, 3.0.3
>
> Attachments: LUCENE-2730.patch
>
>
> While backporting issues for 2.9.x/3.0.x release I hit deadlocks in these two tests, under both test-core and test-tag.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Updated: (LUCENE-2730) intermittent deadlock in
TestAtomicUpdate,TestIndexWriterExceptions
Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Michael McCandless updated LUCENE-2730:
---------------------------------------
Attachment: LUCENE-2730.patch
Attached patch.
The deadlock in TestIndexWriterExceptions was due to locks being acquired in the wrong order; to fix this I've removed synchronized from TestHash.abort. DocumentsWriter idles all other threads before calling abort so we don't need to sync. I'll also remove this from trunk and 3.x.
TestAtomicUpdate's deadlock only happens when autoCommit=true, when one thread has called commit and the flush by that commit tries to spawn new merges, which enters CMS who then hits the max merge thread count and waits for merge threads to finish while another merge thread is attempting an autoCommit. I don't think we need to make any changes to 3.x/trunk for this (autoCommit is gone).
> intermittent deadlock in TestAtomicUpdate,TestIndexWriterExceptions
> -------------------------------------------------------------------
>
> Key: LUCENE-2730
> URL: https://issues.apache.org/jira/browse/LUCENE-2730
> Project: Lucene - Java
> Issue Type: Bug
> Components: Index
> Affects Versions: 2.9.3, 3.0.2
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.4, 3.0.3
>
> Attachments: LUCENE-2730.patch
>
>
> While backporting issues for 2.9.x/3.0.x release I hit deadlocks in these two tests, under both test-core and test-tag.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] Commented: (LUCENE-2730) intermittent deadlock in
TestAtomicUpdate,TestIndexWriterExceptions
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12926579#action_12926579 ]
Robert Muir commented on LUCENE-2730:
-------------------------------------
I've experienced this before too (even a few months ago).
I'll try to find what rev this was introduced.
> intermittent deadlock in TestAtomicUpdate,TestIndexWriterExceptions
> -------------------------------------------------------------------
>
> Key: LUCENE-2730
> URL: https://issues.apache.org/jira/browse/LUCENE-2730
> Project: Lucene - Java
> Issue Type: Bug
> Components: Index
> Affects Versions: 2.9.3, 3.0.2
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Fix For: 2.9.4, 3.0.3
>
>
> While backporting issues for 2.9.x/3.0.x release I hit deadlocks in these two tests, under both test-core and test-tag.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org