You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucenenet.apache.org by "Christopher Currens (Created) (JIRA)" <ji...@apache.org> on 2012/04/13 20:46:17 UTC
[jira] [Created] (LUCENENET-484) Some possibly major tests
intermittently fail
Some possibly major tests intermittently fail
----------------------------------------------
Key: LUCENENET-484
URL: https://issues.apache.org/jira/browse/LUCENENET-484
Project: Lucene.Net
Issue Type: Bug
Components: Lucene.Net Core, Lucene.Net Test
Affects Versions: Lucene.Net 3.0.3
Reporter: Christopher Currens
Fix For: Lucene.Net 3.0.3
These tests will fail intermittently in Debug or Release mode, in the core test suite:
# Lucene.Net.Index:
#- TestConcurrentMergeScheduler.TestFlushExceptions
# Lucene.Net.Store:
#- TestLockFactory.TestStressLocks
# Lucene.Net.Search:
#- TestSort.TestParallelMultiSort
# Lucene.Net.Util:
#- TestFieldCacheSanityChecker.TestInsanity1
#- TestFieldCacheSanityChecker.TestInsanity2
#- (It's possible all of the insanity tests fail at one point or another)
# Lucene.Net.Support
#- TestWeakHashTableMultiThreadAccess.Test
TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
RE: [jira] [Commented] (LUCENENET-484) Some possibly major tests
intermittently fail
Posted by "Vanlerberghe, Luc" <Lu...@bvdinfo.com>.
You're welcome.
By the way, the TestInsanity1 test could be forced to fail on every run by inserting a GC.Collect() call just before the CheckInsanity call.
I didn't patch the TestCase itself since it's ported from java code...
Luc
-----Original Message-----
From: Christopher Currens (JIRA) [mailto:jira@apache.org]
Sent: donderdag 31 mei 2012 18:14
To: lucene-net-dev@lucene.apache.org
Subject: [jira] [Commented] (LUCENENET-484) Some possibly major tests intermittently fail
[ https://issues.apache.org/jira/browse/LUCENENET-484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13286699#comment-13286699 ]
Christopher Currens commented on LUCENENET-484:
-----------------------------------------------
Thanks Luc. This is great stuff. I'll run the patch on my local box and double check everything. Your help with this is appreciated by all of us!
> Some possibly major tests intermittently fail
> ----------------------------------------------
>
> Key: LUCENENET-484
> URL: https://issues.apache.org/jira/browse/LUCENENET-484
> Project: Lucene.Net
> Issue Type: Bug
> Components: Lucene.Net Core, Lucene.Net Test
> Affects Versions: Lucene.Net 3.0.3
> Reporter: Christopher Currens
> Fix For: Lucene.Net 3.0.3
>
> Attachments: Lucenenet-484-WeakDictionary.patch,
> Lucenenet-484-WeakDictionaryTests.patch
>
>
> These tests will fail intermittently in Debug or Release mode, in the core test suite:
> # -Lucene.Net.Index:-
> #- -TestConcurrentMergeScheduler.TestFlushExceptions-
> # Lucene.Net.Store:
> #- TestLockFactory.TestStressLocks
> # Lucene.Net.Search:
> #- TestSort.TestParallelMultiSort
> # Lucene.Net.Util:
> #- TestFieldCacheSanityChecker.TestInsanity1
> #- TestFieldCacheSanityChecker.TestInsanity2
> #- (It's possible all of the insanity tests fail at one point or
> another) # Lucene.Net.Support
> #- TestWeakHashTableMultiThreadAccess.Test
> TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (LUCENENET-484) Some possibly major tests
intermittently fail
Posted by "Itamar Syn-Hershko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13264399#comment-13264399 ]
Itamar Syn-Hershko commented on LUCENENET-484:
----------------------------------------------
That's probably a matter of things not being cleaned up properly in some tests? (didn't actually look at the tests, just the immediate thing that comes to mind)
> Some possibly major tests intermittently fail
> ----------------------------------------------
>
> Key: LUCENENET-484
> URL: https://issues.apache.org/jira/browse/LUCENENET-484
> Project: Lucene.Net
> Issue Type: Bug
> Components: Lucene.Net Core, Lucene.Net Test
> Affects Versions: Lucene.Net 3.0.3
> Reporter: Christopher Currens
> Fix For: Lucene.Net 3.0.3
>
>
> These tests will fail intermittently in Debug or Release mode, in the core test suite:
> # -Lucene.Net.Index:-
> #- -TestConcurrentMergeScheduler.TestFlushExceptions-
> # Lucene.Net.Store:
> #- TestLockFactory.TestStressLocks
> # Lucene.Net.Search:
> #- TestSort.TestParallelMultiSort
> # Lucene.Net.Util:
> #- TestFieldCacheSanityChecker.TestInsanity1
> #- TestFieldCacheSanityChecker.TestInsanity2
> #- (It's possible all of the insanity tests fail at one point or another)
> # Lucene.Net.Support
> #- TestWeakHashTableMultiThreadAccess.Test
> TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (LUCENENET-484) Some possibly major tests
intermittently fail
Posted by "Christopher Currens (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christopher Currens updated LUCENENET-484:
------------------------------------------
Description:
These tests will fail intermittently in Debug or Release mode, in the core test suite:
# Lucene.Net.Index:
#- TestConcurrentMergeScheduler.TestFlushExceptions -- *FIXED*
# Lucene.Net.Store:
#- TestLockFactory.TestStressLocks -- *FIXED*
# Lucene.Net.Search:
#- TestSort.TestParallelMultiSort -- *FIXED*
# Lucene.Net.Util:
#- TestFieldCacheSanityChecker.TestInsanity1 -- *FIXED*
#- TestFieldCacheSanityChecker.TestInsanity2 -- *FIXED*
# Lucene.Net.Support
#- TestWeakHashTableMultiThreadAccess.Test -- *FIXED*
TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
was:
These tests will fail intermittently in Debug or Release mode, in the core test suite:
# -Lucene.Net.Index:-
#- -TestConcurrentMergeScheduler.TestFlushExceptions-
# Lucene.Net.Store:
#- TestLockFactory.TestStressLocks
# Lucene.Net.Search:
#- TestSort.TestParallelMultiSort
# -Lucene.Net.Util:-
#- -TestFieldCacheSanityChecker.TestInsanity1-
#- -TestFieldCacheSanityChecker.TestInsanity2-
#- -(It's possible all of the insanity tests fail at one point or another)-
# -Lucene.Net.Support-
#- -TestWeakHashTableMultiThreadAccess.Test-
TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
> Some possibly major tests intermittently fail
> ----------------------------------------------
>
> Key: LUCENENET-484
> URL: https://issues.apache.org/jira/browse/LUCENENET-484
> Project: Lucene.Net
> Issue Type: Bug
> Components: Lucene.Net Core, Lucene.Net Test
> Affects Versions: Lucene.Net 3.0.3
> Environment: All
> Reporter: Christopher Currens
> Fix For: Lucene.Net 3.0.3
>
> Attachments: Lucenenet-484-FieldCacheImpl.patch, Lucenenet-484-NativeFSLockFactory.patch, Lucenenet-484-WeakDictionary.patch, Lucenenet-484-WeakDictionaryTests.patch
>
>
> These tests will fail intermittently in Debug or Release mode, in the core test suite:
> # Lucene.Net.Index:
> #- TestConcurrentMergeScheduler.TestFlushExceptions -- *FIXED*
> # Lucene.Net.Store:
> #- TestLockFactory.TestStressLocks -- *FIXED*
> # Lucene.Net.Search:
> #- TestSort.TestParallelMultiSort -- *FIXED*
> # Lucene.Net.Util:
> #- TestFieldCacheSanityChecker.TestInsanity1 -- *FIXED*
> #- TestFieldCacheSanityChecker.TestInsanity2 -- *FIXED*
> # Lucene.Net.Support
> #- TestWeakHashTableMultiThreadAccess.Test -- *FIXED*
> TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (LUCENENET-484) Some possibly major tests
intermittently fail
Posted by "Prescott Nasser (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13285755#comment-13285755 ]
Prescott Nasser commented on LUCENENET-484:
-------------------------------------------
Has anyone had any luck with any more of these tests? I can still only reproduce TestInsanity1 - Win7 x64, vs2010
> Some possibly major tests intermittently fail
> ----------------------------------------------
>
> Key: LUCENENET-484
> URL: https://issues.apache.org/jira/browse/LUCENENET-484
> Project: Lucene.Net
> Issue Type: Bug
> Components: Lucene.Net Core, Lucene.Net Test
> Affects Versions: Lucene.Net 3.0.3
> Reporter: Christopher Currens
> Fix For: Lucene.Net 3.0.3
>
>
> These tests will fail intermittently in Debug or Release mode, in the core test suite:
> # -Lucene.Net.Index:-
> #- -TestConcurrentMergeScheduler.TestFlushExceptions-
> # Lucene.Net.Store:
> #- TestLockFactory.TestStressLocks
> # Lucene.Net.Search:
> #- TestSort.TestParallelMultiSort
> # Lucene.Net.Util:
> #- TestFieldCacheSanityChecker.TestInsanity1
> #- TestFieldCacheSanityChecker.TestInsanity2
> #- (It's possible all of the insanity tests fail at one point or another)
> # Lucene.Net.Support
> #- TestWeakHashTableMultiThreadAccess.Test
> TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (LUCENENET-484) Some possibly major tests
intermittently fail
Posted by "Luc Vanlerberghe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397377#comment-13397377 ]
Luc Vanlerberghe commented on LUCENENET-484:
--------------------------------------------
TestSort.TestParallelMultiSort crashes sometimes because of a race condition in FieldCacheImpl.GetCacheEntries.
It's only called in DEBUG during tests while calling FieldCacheSanityChecker.CheckSanity.
In TestSort.TestParallelMultiSort this can happen on multiple threads simultaneously.
I checked the java version and it has the same problem in version 3.0.3 but was corrected later in rev. 912330:
"uschindler 21/02/2010 12:16:42 LUCENE-2273: Fixed bug in FieldCacheImpl.getCacheEntries() that used WeakHashMap incorrectly and lead to ConcurrentModificationException"
The patch also correct FieldCachImpl.PurgeAllCaches() and .Purge(IndexReader r)
The first is also only called in test, but the second one is called in the DoClose() methods on several Reader implementations and could cause trouble if left unpatched (though near to impossible to write a test for, IMHO)
I'll post the translated patch in a minute
> Some possibly major tests intermittently fail
> ----------------------------------------------
>
> Key: LUCENENET-484
> URL: https://issues.apache.org/jira/browse/LUCENENET-484
> Project: Lucene.Net
> Issue Type: Bug
> Components: Lucene.Net Core, Lucene.Net Test
> Affects Versions: Lucene.Net 3.0.3
> Environment: All
> Reporter: Christopher Currens
> Fix For: Lucene.Net 3.0.3
>
> Attachments: Lucenenet-484-NativeFSLockFactory.patch, Lucenenet-484-WeakDictionary.patch, Lucenenet-484-WeakDictionaryTests.patch
>
>
> These tests will fail intermittently in Debug or Release mode, in the core test suite:
> # -Lucene.Net.Index:-
> #- -TestConcurrentMergeScheduler.TestFlushExceptions-
> # Lucene.Net.Store:
> #- TestLockFactory.TestStressLocks
> # Lucene.Net.Search:
> #- TestSort.TestParallelMultiSort
> # -Lucene.Net.Util:-
> #- -TestFieldCacheSanityChecker.TestInsanity1-
> #- -TestFieldCacheSanityChecker.TestInsanity2-
> #- -(It's possible all of the insanity tests fail at one point or another)-
> # -Lucene.Net.Support-
> #- -TestWeakHashTableMultiThreadAccess.Test-
> TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (LUCENENET-484) Some possibly major tests
intermittently fail
Posted by "Luc Vanlerberghe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Luc Vanlerberghe updated LUCENENET-484:
---------------------------------------
Attachment: Lucenenet-484-WeakDictionaryTests.patch
This patch removes WeakHashtable and uses its tests for WeakDictionary instead (I actually renamed the test files and updated the tests so subversion would keep the history, but the .patch format apparently doesn't keep that info...)
> Some possibly major tests intermittently fail
> ----------------------------------------------
>
> Key: LUCENENET-484
> URL: https://issues.apache.org/jira/browse/LUCENENET-484
> Project: Lucene.Net
> Issue Type: Bug
> Components: Lucene.Net Core, Lucene.Net Test
> Affects Versions: Lucene.Net 3.0.3
> Reporter: Christopher Currens
> Fix For: Lucene.Net 3.0.3
>
> Attachments: Lucenenet-484-WeakDictionary.patch, Lucenenet-484-WeakDictionaryTests.patch
>
>
> These tests will fail intermittently in Debug or Release mode, in the core test suite:
> # -Lucene.Net.Index:-
> #- -TestConcurrentMergeScheduler.TestFlushExceptions-
> # Lucene.Net.Store:
> #- TestLockFactory.TestStressLocks
> # Lucene.Net.Search:
> #- TestSort.TestParallelMultiSort
> # Lucene.Net.Util:
> #- TestFieldCacheSanityChecker.TestInsanity1
> #- TestFieldCacheSanityChecker.TestInsanity2
> #- (It's possible all of the insanity tests fail at one point or another)
> # Lucene.Net.Support
> #- TestWeakHashTableMultiThreadAccess.Test
> TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (LUCENENET-484) Some possibly major tests
intermittently fail
Posted by "Luc Vanlerberghe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Luc Vanlerberghe updated LUCENENET-484:
---------------------------------------
Attachment: Lucenenet-484-WeakDictionary.patch
Corrects both Clean() and WeakKey<T>.Equals
> Some possibly major tests intermittently fail
> ----------------------------------------------
>
> Key: LUCENENET-484
> URL: https://issues.apache.org/jira/browse/LUCENENET-484
> Project: Lucene.Net
> Issue Type: Bug
> Components: Lucene.Net Core, Lucene.Net Test
> Affects Versions: Lucene.Net 3.0.3
> Reporter: Christopher Currens
> Fix For: Lucene.Net 3.0.3
>
> Attachments: Lucenenet-484-WeakDictionary.patch
>
>
> These tests will fail intermittently in Debug or Release mode, in the core test suite:
> # -Lucene.Net.Index:-
> #- -TestConcurrentMergeScheduler.TestFlushExceptions-
> # Lucene.Net.Store:
> #- TestLockFactory.TestStressLocks
> # Lucene.Net.Search:
> #- TestSort.TestParallelMultiSort
> # Lucene.Net.Util:
> #- TestFieldCacheSanityChecker.TestInsanity1
> #- TestFieldCacheSanityChecker.TestInsanity2
> #- (It's possible all of the insanity tests fail at one point or another)
> # Lucene.Net.Support
> #- TestWeakHashTableMultiThreadAccess.Test
> TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (LUCENENET-484) Some possibly major tests
intermittently fail
Posted by "Christopher Currens (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christopher Currens resolved LUCENENET-484.
-------------------------------------------
Resolution: Fixed
Thanks for your help with all of these Luc. Thanks to your hard work, this issue is finally closed, and for the first time in a long time, the whole test suite should consistently pass!
> Some possibly major tests intermittently fail
> ----------------------------------------------
>
> Key: LUCENENET-484
> URL: https://issues.apache.org/jira/browse/LUCENENET-484
> Project: Lucene.Net
> Issue Type: Bug
> Components: Lucene.Net Core, Lucene.Net Test
> Affects Versions: Lucene.Net 3.0.3
> Environment: All
> Reporter: Christopher Currens
> Fix For: Lucene.Net 3.0.3
>
> Attachments: Lucenenet-484-FieldCacheImpl.patch, Lucenenet-484-NativeFSLockFactory.patch, Lucenenet-484-WeakDictionary.patch, Lucenenet-484-WeakDictionaryTests.patch
>
>
> These tests will fail intermittently in Debug or Release mode, in the core test suite:
> # Lucene.Net.Index:
> #- TestConcurrentMergeScheduler.TestFlushExceptions -- *FIXED*
> # Lucene.Net.Store:
> #- TestLockFactory.TestStressLocks -- *FIXED*
> # Lucene.Net.Search:
> #- TestSort.TestParallelMultiSort -- *FIXED*
> # Lucene.Net.Util:
> #- TestFieldCacheSanityChecker.TestInsanity1 -- *FIXED*
> #- TestFieldCacheSanityChecker.TestInsanity2 -- *FIXED*
> # Lucene.Net.Support
> #- TestWeakHashTableMultiThreadAccess.Test -- *FIXED*
> TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (LUCENENET-484) Some possibly major tests
intermittently fail
Posted by "Christopher Currens (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christopher Currens updated LUCENENET-484:
------------------------------------------
Description:
These tests will fail intermittently in Debug or Release mode, in the core test suite:
# -Lucene.Net.Index:-
#- -TestConcurrentMergeScheduler.TestFlushExceptions-
# Lucene.Net.Store:
#- TestLockFactory.TestStressLocks
# Lucene.Net.Search:
#- TestSort.TestParallelMultiSort
# Lucene.Net.Util:
#- TestFieldCacheSanityChecker.TestInsanity1
#- TestFieldCacheSanityChecker.TestInsanity2
#- (It's possible all of the insanity tests fail at one point or another)
# Lucene.Net.Support
#- TestWeakHashTableMultiThreadAccess.Test
TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
was:
These tests will fail intermittently in Debug or Release mode, in the core test suite:
# Lucene.Net.Index:
#- TestConcurrentMergeScheduler.TestFlushExceptions
# Lucene.Net.Store:
#- TestLockFactory.TestStressLocks
# Lucene.Net.Search:
#- TestSort.TestParallelMultiSort
# Lucene.Net.Util:
#- TestFieldCacheSanityChecker.TestInsanity1
#- TestFieldCacheSanityChecker.TestInsanity2
#- (It's possible all of the insanity tests fail at one point or another)
# Lucene.Net.Support
#- TestWeakHashTableMultiThreadAccess.Test
TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
So, I figured out the issue with the ConcurrentMergeScheduler, it was simply a port issue for the actual Test. I had to add a workaround in {{FailOnlyOnFlush.Eval(Directory)}}, since java would compare stack frame with "main" (the thread running the test, it seems), and only execute the code if that was the case. That doesn't exactly work in .NET code, so instead, I inverted the check too look for the thread name not containing "Merge Thread". I can no longer reproduce it at all, where I could before every time.
> Some possibly major tests intermittently fail
> ----------------------------------------------
>
> Key: LUCENENET-484
> URL: https://issues.apache.org/jira/browse/LUCENENET-484
> Project: Lucene.Net
> Issue Type: Bug
> Components: Lucene.Net Core, Lucene.Net Test
> Affects Versions: Lucene.Net 3.0.3
> Reporter: Christopher Currens
> Fix For: Lucene.Net 3.0.3
>
>
> These tests will fail intermittently in Debug or Release mode, in the core test suite:
> # -Lucene.Net.Index:-
> #- -TestConcurrentMergeScheduler.TestFlushExceptions-
> # Lucene.Net.Store:
> #- TestLockFactory.TestStressLocks
> # Lucene.Net.Search:
> #- TestSort.TestParallelMultiSort
> # Lucene.Net.Util:
> #- TestFieldCacheSanityChecker.TestInsanity1
> #- TestFieldCacheSanityChecker.TestInsanity2
> #- (It's possible all of the insanity tests fail at one point or another)
> # Lucene.Net.Support
> #- TestWeakHashTableMultiThreadAccess.Test
> TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (LUCENENET-484) Some possibly major tests
intermittently fail
Posted by "Luc Vanlerberghe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Luc Vanlerberghe updated LUCENENET-484:
---------------------------------------
Attachment: Lucenenet-484-FieldCacheImpl.patch
Translated patch in rev. 912330 of java version:
uschindler 21/02/2010 12:16:42 LUCENE-2273: Fixed bug in FieldCacheImpl.getCacheEntries() that used WeakHashMap incorrectly and lead to ConcurrentModificationException
Fixes interittent failures in TestSort.TestParallelMultiSort
> Some possibly major tests intermittently fail
> ----------------------------------------------
>
> Key: LUCENENET-484
> URL: https://issues.apache.org/jira/browse/LUCENENET-484
> Project: Lucene.Net
> Issue Type: Bug
> Components: Lucene.Net Core, Lucene.Net Test
> Affects Versions: Lucene.Net 3.0.3
> Environment: All
> Reporter: Christopher Currens
> Fix For: Lucene.Net 3.0.3
>
> Attachments: Lucenenet-484-FieldCacheImpl.patch, Lucenenet-484-NativeFSLockFactory.patch, Lucenenet-484-WeakDictionary.patch, Lucenenet-484-WeakDictionaryTests.patch
>
>
> These tests will fail intermittently in Debug or Release mode, in the core test suite:
> # -Lucene.Net.Index:-
> #- -TestConcurrentMergeScheduler.TestFlushExceptions-
> # Lucene.Net.Store:
> #- TestLockFactory.TestStressLocks
> # Lucene.Net.Search:
> #- TestSort.TestParallelMultiSort
> # -Lucene.Net.Util:-
> #- -TestFieldCacheSanityChecker.TestInsanity1-
> #- -TestFieldCacheSanityChecker.TestInsanity2-
> #- -(It's possible all of the insanity tests fail at one point or another)-
> # -Lucene.Net.Support-
> #- -TestWeakHashTableMultiThreadAccess.Test-
> TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (LUCENENET-484) Some possibly major tests
intermittently fail
Posted by "Luc Vanlerberghe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Luc Vanlerberghe updated LUCENENET-484:
---------------------------------------
Attachment: Lucenenet-484-NativeFSLockFactory.patch
Fixes the intermittent failures in
TestStressLocks and TestStressLocksNativeFSLockFactory
> Some possibly major tests intermittently fail
> ----------------------------------------------
>
> Key: LUCENENET-484
> URL: https://issues.apache.org/jira/browse/LUCENENET-484
> Project: Lucene.Net
> Issue Type: Bug
> Components: Lucene.Net Core, Lucene.Net Test
> Affects Versions: Lucene.Net 3.0.3
> Environment: All
> Reporter: Christopher Currens
> Fix For: Lucene.Net 3.0.3
>
> Attachments: Lucenenet-484-NativeFSLockFactory.patch, Lucenenet-484-WeakDictionary.patch, Lucenenet-484-WeakDictionaryTests.patch
>
>
> These tests will fail intermittently in Debug or Release mode, in the core test suite:
> # -Lucene.Net.Index:-
> #- -TestConcurrentMergeScheduler.TestFlushExceptions-
> # Lucene.Net.Store:
> #- TestLockFactory.TestStressLocks
> # Lucene.Net.Search:
> #- TestSort.TestParallelMultiSort
> # -Lucene.Net.Util:-
> #- -TestFieldCacheSanityChecker.TestInsanity1-
> #- -TestFieldCacheSanityChecker.TestInsanity2-
> #- -(It's possible all of the insanity tests fail at one point or another)-
> # -Lucene.Net.Support-
> #- -TestWeakHashTableMultiThreadAccess.Test-
> TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (LUCENENET-484) Some possibly major tests
intermittently fail
Posted by "Christopher Currens (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13253640#comment-13253640 ]
Christopher Currens commented on LUCENENET-484:
-----------------------------------------------
I should note, since they fail so intermittently, they can be reproduced more consistently if you wrap the test in a loop of 20+ iterations.
> Some possibly major tests intermittently fail
> ----------------------------------------------
>
> Key: LUCENENET-484
> URL: https://issues.apache.org/jira/browse/LUCENENET-484
> Project: Lucene.Net
> Issue Type: Bug
> Components: Lucene.Net Core, Lucene.Net Test
> Affects Versions: Lucene.Net 3.0.3
> Reporter: Christopher Currens
> Fix For: Lucene.Net 3.0.3
>
>
> These tests will fail intermittently in Debug or Release mode, in the core test suite:
> # Lucene.Net.Index:
> #- TestConcurrentMergeScheduler.TestFlushExceptions
> # Lucene.Net.Store:
> #- TestLockFactory.TestStressLocks
> # Lucene.Net.Search:
> #- TestSort.TestParallelMultiSort
> # Lucene.Net.Util:
> #- TestFieldCacheSanityChecker.TestInsanity1
> #- TestFieldCacheSanityChecker.TestInsanity2
> #- (It's possible all of the insanity tests fail at one point or another)
> # Lucene.Net.Support
> #- TestWeakHashTableMultiThreadAccess.Test
> TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (LUCENENET-484) Some possibly major tests
intermittently fail
Posted by "Luc Vanlerberghe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13286433#comment-13286433 ]
Luc Vanlerberghe commented on LUCENENET-484:
--------------------------------------------
The failures in the TestSanity test cases are due to a bug in Cleanup which is called whenever a GC is detected in CleanIfNeeded (which is itself called from several places)
Cleanup actually drops all cache entries that have live keys instead of the other way around!
I also corrected a race condition in WeakKey<T>.Equals (that will probably only happen under heavy load when you least
I'll post patches with the corrections and updated test cases in a minute...
> Some possibly major tests intermittently fail
> ----------------------------------------------
>
> Key: LUCENENET-484
> URL: https://issues.apache.org/jira/browse/LUCENENET-484
> Project: Lucene.Net
> Issue Type: Bug
> Components: Lucene.Net Core, Lucene.Net Test
> Affects Versions: Lucene.Net 3.0.3
> Reporter: Christopher Currens
> Fix For: Lucene.Net 3.0.3
>
>
> These tests will fail intermittently in Debug or Release mode, in the core test suite:
> # -Lucene.Net.Index:-
> #- -TestConcurrentMergeScheduler.TestFlushExceptions-
> # Lucene.Net.Store:
> #- TestLockFactory.TestStressLocks
> # Lucene.Net.Search:
> #- TestSort.TestParallelMultiSort
> # Lucene.Net.Util:
> #- TestFieldCacheSanityChecker.TestInsanity1
> #- TestFieldCacheSanityChecker.TestInsanity2
> #- (It's possible all of the insanity tests fail at one point or another)
> # Lucene.Net.Support
> #- TestWeakHashTableMultiThreadAccess.Test
> TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (LUCENENET-484) Some possibly major tests
intermittently fail
Posted by "Christopher Currens (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christopher Currens updated LUCENENET-484:
------------------------------------------
Description:
These tests will fail intermittently in Debug or Release mode, in the core test suite:
# -Lucene.Net.Index:-
#- -TestConcurrentMergeScheduler.TestFlushExceptions-
# Lucene.Net.Store:
#- TestLockFactory.TestStressLocks
# Lucene.Net.Search:
#- TestSort.TestParallelMultiSort
# -Lucene.Net.Util:-
#- -TestFieldCacheSanityChecker.TestInsanity1-
#- -TestFieldCacheSanityChecker.TestInsanity2-
#- -(It's possible all of the insanity tests fail at one point or another)-
# -Lucene.Net.Support-
#- -TestWeakHashTableMultiThreadAccess.Test-
TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
was:
These tests will fail intermittently in Debug or Release mode, in the core test suite:
# -Lucene.Net.Index:-
#- -TestConcurrentMergeScheduler.TestFlushExceptions-
# Lucene.Net.Store:
#- TestLockFactory.TestStressLocks
# Lucene.Net.Search:
#- TestSort.TestParallelMultiSort
# Lucene.Net.Util:
#- TestFieldCacheSanityChecker.TestInsanity1
#- TestFieldCacheSanityChecker.TestInsanity2
#- (It's possible all of the insanity tests fail at one point or another)
# Lucene.Net.Support
#- TestWeakHashTableMultiThreadAccess.Test
TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
Environment: All
Applied the patches. Getting closer to resolving this issue.
> Some possibly major tests intermittently fail
> ----------------------------------------------
>
> Key: LUCENENET-484
> URL: https://issues.apache.org/jira/browse/LUCENENET-484
> Project: Lucene.Net
> Issue Type: Bug
> Components: Lucene.Net Core, Lucene.Net Test
> Affects Versions: Lucene.Net 3.0.3
> Environment: All
> Reporter: Christopher Currens
> Fix For: Lucene.Net 3.0.3
>
> Attachments: Lucenenet-484-WeakDictionary.patch, Lucenenet-484-WeakDictionaryTests.patch
>
>
> These tests will fail intermittently in Debug or Release mode, in the core test suite:
> # -Lucene.Net.Index:-
> #- -TestConcurrentMergeScheduler.TestFlushExceptions-
> # Lucene.Net.Store:
> #- TestLockFactory.TestStressLocks
> # Lucene.Net.Search:
> #- TestSort.TestParallelMultiSort
> # -Lucene.Net.Util:-
> #- -TestFieldCacheSanityChecker.TestInsanity1-
> #- -TestFieldCacheSanityChecker.TestInsanity2-
> #- -(It's possible all of the insanity tests fail at one point or another)-
> # -Lucene.Net.Support-
> #- -TestWeakHashTableMultiThreadAccess.Test-
> TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (LUCENENET-484) Some possibly major tests
intermittently fail
Posted by "Christopher Currens (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13286699#comment-13286699 ]
Christopher Currens commented on LUCENENET-484:
-----------------------------------------------
Thanks Luc. This is great stuff. I'll run the patch on my local box and double check everything. Your help with this is appreciated by all of us!
> Some possibly major tests intermittently fail
> ----------------------------------------------
>
> Key: LUCENENET-484
> URL: https://issues.apache.org/jira/browse/LUCENENET-484
> Project: Lucene.Net
> Issue Type: Bug
> Components: Lucene.Net Core, Lucene.Net Test
> Affects Versions: Lucene.Net 3.0.3
> Reporter: Christopher Currens
> Fix For: Lucene.Net 3.0.3
>
> Attachments: Lucenenet-484-WeakDictionary.patch, Lucenenet-484-WeakDictionaryTests.patch
>
>
> These tests will fail intermittently in Debug or Release mode, in the core test suite:
> # -Lucene.Net.Index:-
> #- -TestConcurrentMergeScheduler.TestFlushExceptions-
> # Lucene.Net.Store:
> #- TestLockFactory.TestStressLocks
> # Lucene.Net.Search:
> #- TestSort.TestParallelMultiSort
> # Lucene.Net.Util:
> #- TestFieldCacheSanityChecker.TestInsanity1
> #- TestFieldCacheSanityChecker.TestInsanity2
> #- (It's possible all of the insanity tests fail at one point or another)
> # Lucene.Net.Support
> #- TestWeakHashTableMultiThreadAccess.Test
> TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (LUCENENET-484) Some possibly major tests
intermittently fail
Posted by "Luc Vanlerberghe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13395775#comment-13395775 ]
Luc Vanlerberghe commented on LUCENENET-484:
--------------------------------------------
TestStressLocks and TestStressLocksNativeFSLockFactory fail intermittently due to an UnauthorizedAccessException in NativeFSLockFactory.Obtain
In the code it is actually described that on Windows you can get intermittent "Access Denied" exceptions and the java version handles them properly.
*BUT*: in java, the "Access Denied" raises an IOException, whereas in .Net this raises an UnauthorizedAccessException
So the solution is to add an identical catch block for the UnauthorizedAccessException.
This will cause the lock obtain to simply fail and the calling methods to retry.
> Some possibly major tests intermittently fail
> ----------------------------------------------
>
> Key: LUCENENET-484
> URL: https://issues.apache.org/jira/browse/LUCENENET-484
> Project: Lucene.Net
> Issue Type: Bug
> Components: Lucene.Net Core, Lucene.Net Test
> Affects Versions: Lucene.Net 3.0.3
> Environment: All
> Reporter: Christopher Currens
> Fix For: Lucene.Net 3.0.3
>
> Attachments: Lucenenet-484-NativeFSLockFactory.patch, Lucenenet-484-WeakDictionary.patch, Lucenenet-484-WeakDictionaryTests.patch
>
>
> These tests will fail intermittently in Debug or Release mode, in the core test suite:
> # -Lucene.Net.Index:-
> #- -TestConcurrentMergeScheduler.TestFlushExceptions-
> # Lucene.Net.Store:
> #- TestLockFactory.TestStressLocks
> # Lucene.Net.Search:
> #- TestSort.TestParallelMultiSort
> # -Lucene.Net.Util:-
> #- -TestFieldCacheSanityChecker.TestInsanity1-
> #- -TestFieldCacheSanityChecker.TestInsanity2-
> #- -(It's possible all of the insanity tests fail at one point or another)-
> # -Lucene.Net.Support-
> #- -TestWeakHashTableMultiThreadAccess.Test-
> TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (LUCENENET-484) Some possibly major tests
intermittently fail
Posted by "Christopher Currens (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13264032#comment-13264032 ]
Christopher Currens commented on LUCENENET-484:
-----------------------------------------------
Some of the tests I can only produce if a) I run it in Release mode, AND b) I run the *entire* test suite, not just the single test.
> Some possibly major tests intermittently fail
> ----------------------------------------------
>
> Key: LUCENENET-484
> URL: https://issues.apache.org/jira/browse/LUCENENET-484
> Project: Lucene.Net
> Issue Type: Bug
> Components: Lucene.Net Core, Lucene.Net Test
> Affects Versions: Lucene.Net 3.0.3
> Reporter: Christopher Currens
> Fix For: Lucene.Net 3.0.3
>
>
> These tests will fail intermittently in Debug or Release mode, in the core test suite:
> # -Lucene.Net.Index:-
> #- -TestConcurrentMergeScheduler.TestFlushExceptions-
> # Lucene.Net.Store:
> #- TestLockFactory.TestStressLocks
> # Lucene.Net.Search:
> #- TestSort.TestParallelMultiSort
> # Lucene.Net.Util:
> #- TestFieldCacheSanityChecker.TestInsanity1
> #- TestFieldCacheSanityChecker.TestInsanity2
> #- (It's possible all of the insanity tests fail at one point or another)
> # Lucene.Net.Support
> #- TestWeakHashTableMultiThreadAccess.Test
> TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (LUCENENET-484) Some possibly major tests
intermittently fail
Posted by "Prescott Nasser (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENENET-484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13263979#comment-13263979 ]
Prescott Nasser commented on LUCENENET-484:
-------------------------------------------
I cannot reproduce any of the failures, except for TestInsanity1 - doesn't matter how much I loop it or rerun it. Are there any others who could test this aside from Chris and Myself to possibly provide more insight into the failures
> Some possibly major tests intermittently fail
> ----------------------------------------------
>
> Key: LUCENENET-484
> URL: https://issues.apache.org/jira/browse/LUCENENET-484
> Project: Lucene.Net
> Issue Type: Bug
> Components: Lucene.Net Core, Lucene.Net Test
> Affects Versions: Lucene.Net 3.0.3
> Reporter: Christopher Currens
> Fix For: Lucene.Net 3.0.3
>
>
> These tests will fail intermittently in Debug or Release mode, in the core test suite:
> # -Lucene.Net.Index:-
> #- -TestConcurrentMergeScheduler.TestFlushExceptions-
> # Lucene.Net.Store:
> #- TestLockFactory.TestStressLocks
> # Lucene.Net.Search:
> #- TestSort.TestParallelMultiSort
> # Lucene.Net.Util:
> #- TestFieldCacheSanityChecker.TestInsanity1
> #- TestFieldCacheSanityChecker.TestInsanity2
> #- (It's possible all of the insanity tests fail at one point or another)
> # Lucene.Net.Support
> #- TestWeakHashTableMultiThreadAccess.Test
> TestWeakHashTableMultiThreadAccess should be fine to remove along with the WeakHashTable in the Support namespace, since it's been replaced with WeakDictionary.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira