You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Erick Erickson <er...@gmail.com> on 2018/05/01 04:59:02 UTC

Weekly BadApple report:

In order to reduce some of the make-work, I collect failed tests Fri->Mon
so the BadApple'd tests on Thursday don't clutter things up.

BadApple candidates: I'll BadApple these on Thursday unless there are objections

   org.apache.solr.client.solrj.io.stream.MathExpressionTest.testGammaDistribution
   org.apache.solr.cloud.AddReplicaTest.test
   org.apache.solr.cloud.CreateRoutedAliasTest.testCollectionNamesMustBeAbsent
   org.apache.solr.cloud.CreateRoutedAliasTest.testTimezoneAbsoluteDate
   org.apache.solr.cloud.CreateRoutedAliasTest.testV1
   org.apache.solr.cloud.CreateRoutedAliasTest.testV2
   org.apache.solr.cloud.DocValuesNotIndexedTest.testGroupingDVOnly
   org.apache.solr.cloud.LIRRollingUpdatesTest.testNewLeaderAndMixedReplicas
   org.apache.solr.cloud.LIRRollingUpdatesTest.testNewLeaderOldReplica
   org.apache.solr.cloud.LIRRollingUpdatesTest.testOldLeaderAndMixedReplicas
   org.apache.solr.cloud.LeaderElectionIntegrationTest.testSimpleSliceLeaderElection
   org.apache.solr.cloud.OverseerRolesTest.testOverseerRole
   org.apache.solr.cloud.SolrCloudExampleTest.testLoadDocsIntoGettingStartedCollection
   org.apache.solr.cloud.TestPullReplica.testKillLeader
   org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test
   org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testNodeLost
   org.apache.solr.cloud.autoscaling.NodeAddedTriggerTest.testRestoreState
   org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigAliasReplication
   org.apache.solr.schema.TestCloudSchemaless.test
   org.apache.solr.search.TestStressRecovery.testStressRecovery
   org.apache.solr.update.TestInPlaceUpdatesDistrib.test


I believe these are being worked on, so I will _not_ BadApple them
even though they fail.
What about the other autoscaling tests?

   org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMergeIntegration
   org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testSplitIntegration
   org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testTrigger


Number of AwaitsFix: 21 Number of BadApples: 90

*****************AwaitsFix Annotations:


************Lucene AwaitsFix
GeoPolygonTest.java
   testLUCENE8276_case3()
   //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8276")

GeoPolygonTest.java
   testLUCENE8280()
   //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8280")

GeoPolygonTest.java
   testLUCENE8281()
   //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8281")

RandomGeoPolygonTest.java
   testCompareBigPolygons()
   //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8281")

RandomGeoPolygonTest.java
   testCompareSmallPolygons()
   //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8281")

TestControlledRealTimeReopenThread.java
   testCRTReopen()
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737")

TestICUNormalizer2CharFilter.java
   testRandomStrings()
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595")

TestICUTokenizerCJK.java
   TestICUTokenizerCJK suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222")

TestMoreLikeThis.java
   testMultiFieldShouldReturnPerFieldBooleanQuery()
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161")

UIMABaseAnalyzerTest.java
   testRandomStrings()
   @Test @AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/LUCENE-3869")

UIMABaseAnalyzerTest.java
   testRandomStringsWithConfigurationParameters()
   @Test @AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/LUCENE-3869")

UIMATypeAwareAnalyzerTest.java
   testRandomStrings()
   @Test @AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/LUCENE-3869")


    ************Solr AwaitsFix
ReplaceNodeNoTargetTest.java
   ReplaceNodeNoTargetTest suite
   @LuceneTestCase.AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-11067")

TestCollapseQParserPlugin.java
   testStringCollapse()
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-11974")

TestImpersonationWithHadoopAuth.java
   testForwarding()
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893")

TestLTRReRankingPipeline.java
   testDifferentTopN()
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134")

TestMinMaxOnMultiValuedField.java
   testDoubleFieldCache()
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709")

TestMinMaxOnMultiValuedField.java
   testFloatFieldCache()
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709")

TestMinMaxOnMultiValuedField.java
   testIntFieldCache()
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709")

TestMinMaxOnMultiValuedField.java
   testLongFieldCache()
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709")



*****************BadApple Annotations:

************Lucene BadApple

    ************Solr BadApple
AddReplicaTest.java
   test()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 09-Apr-2018

AliasIntegrationTest.java
   testModifyPropertiesCAR()
   //@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

AliasIntegrationTest.java
   testModifyPropertiesV1()
   //@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 09-Apr-2018

AliasIntegrationTest.java
   testProperties()
   //@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

AutoAddReplicasIntegrationTest.java
   testSimple()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

AutoAddReplicasPlanActionTest.java
   testSimple()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

AutoScalingHandlerTest.java
   testReadApi()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

AutoscalingHistoryHandlerTest.java
   testHistory()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 09-Apr-2018

CdcrBootstrapTest.java
   testBootstrapWithContinousIndexingOnSourceCluster()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

CdcrReplicationDistributedZkTest.java
   CdcrReplicationDistributedZkTest suite
   @BadApple(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-12028,
https://issues.apache.org/jira/browse/SOLR-10107")

ChaosMonkeyNothingIsSafeTest.java
   test()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 09-Apr-2018

ChaosMonkeySafeLeaderTest.java
   test()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

ChaosMonkeySafeLeaderWithPullReplicasTest.java
   test()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

CollectionsAPIDistributedZkTest.java
   testCollectionsAPI()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

ComputePlanActionTest.java
   testSelectedCollections()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 09-Apr-2018

CreateRoutedAliasTest.java
   testCollectionNamesMustBeAbsent()
   //@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 09-Apr-2018

CreateRoutedAliasTest.java
   testTimezoneAbsoluteDate()
   //@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 09-Apr-2018

CreateRoutedAliasTest.java
   testV1()
   //@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 09-Apr-2018

CreateRoutedAliasTest.java
   testV2()
   //@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 09-Apr-2018

DeleteReplicaTest.java
   deleteReplicaOnIndexing()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 09-Apr-2018

DocValuesNotIndexedTest.java
   testGroupingDocAbsent()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

DocValuesNotIndexedTest.java
   testGroupingSorting()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 26-Mar-2018

ForceLeaderTest.java
   testReplicasInLIRNoLeader()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

ForceLeaderTest.java
   testReplicasInLowerTerms()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

HdfsBasicDistributedZk2Test.java
   HdfsBasicDistributedZk2Test suite
   @LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 26-Mar-2018

HdfsChaosMonkeyNothingIsSafeTest.java
   HdfsChaosMonkeyNothingIsSafeTest suite
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028,
https://issues.apache.org/jira/browse/SOLR-10191")

HdfsDirectoryTest.java
   testEOF()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

HdfsRecoveryZkTest.java
   HdfsRecoveryZkTest suite
   @LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

HdfsRestartWhileUpdatingTest.java
   HdfsRestartWhileUpdatingTest suite
   @LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
//2018-03-10

HdfsTlogReplayBufferedWhileIndexingTest.java
   HdfsTlogReplayBufferedWhileIndexingTest suite
   @LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

HttpPartitionTest.java
   test()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

LeaderFailoverAfterPartitionTest.java
   test()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

LegacyCloudClusterPropTest.java
   testCreateCollectionSwitchLegacyCloud()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

MathExpressionTest.java
   testDistributions()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

MathExpressionTest.java
   testMultiVariateNormalDistribution()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
//2018-03-10

MissingSegmentRecoveryTest.java
   testLeaderRecovery()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

MoveReplicaHDFSTest.java
   testNormalFailedMove()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

MoveReplicaHDFSTest.java
   testNormalMove()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
//2018-03-10

MoveReplicaTest.java
   testFailedMove()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 17-Mar-2018 This JIRA is fixed, but this test still fails

MultiThreadedOCPTest.java
   test()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

NodeLostTriggerTest.java
   testListenerAcceptance()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 16-Apr-2018

PeerSyncReplicationTest.java
   test()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

ReplaceNodeNoTargetTest.java
   test()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

ReplicationFactorTest.java
   ReplicationFactorTest suite
   @LuceneTestCase.BadApple(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-6944")

RestartWhileUpdatingTest.java
   test()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 26-Mar-2018

SSLMigrationTest.java
   test()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 17-Mar-2018

ScheduledMaintenanceTriggerTest.java
   testInactiveShardCleanup()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 17-Mar-2018

ScheduledTriggerIntegrationTest.java
   ScheduledTriggerIntegrationTest suite
   @LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 26-Mar-2018

ScheduledTriggerTest.java
   testTrigger()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 09-Apr-2018

ShardSplitTest.java
   test()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

ShardSplitTest.java
   testSplitAfterFailedSplit()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

ShardSplitTest.java
   testSplitWithChaosMonkey()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

SharedFSAutoReplicaFailoverTest.java
   test()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

TestAuthenticationFramework.java
   testBasics()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

TestCloudConsistency.java
   testOutOfSyncReplicasCannotBecomeLeader()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 26-Mar-2018

TestCloudConsistency.java
   testOutOfSyncReplicasCannotBecomeLeaderAfterRestart()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 26-Mar-2018

TestCloudRecovery.java
   leaderRecoverFromLogOnStartupTest()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 09-Apr-2018

TestCollectionStateWatchers.java
   testDeletionsTriggerWatches()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 09-Apr-2018

TestCollectionsAPIViaSolrCloudCluster.java
   testCollectionCreateSearchDelete()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

TestCollectionsAPIViaSolrCloudCluster.java
   testCollectionCreateWithoutCoresThenDelete()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 09-Apr-2018

TestDistributedSearch.java
   test()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 09-Apr-2018

TestDynamicLoading.java
   testDynamicLoading()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

TestGenericDistributedQueue.java
   TestGenericDistributedQueue suite
   @LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

TestLargeCluster.java
   TestLargeCluster suite
   @LuceneTestCase.BadApple(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-12075")

TestLargeCluster.java
   testSearchRate()
   @BadApple(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11714")

TestLeaderElectionZkExpiry.java
   testLeaderElectionWithZkExpiry()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 17-Mar-2018

TestLeaderInitiatedRecoveryThread.java
   testPublishDownState()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 09-Apr-2018

TestManagedResourceStorage.java
   TestManagedResourceStorage suite
   @LuceneTestCase.BadApple(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-6443")

TestPrepRecovery.java
   testLeaderNotResponding()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

TestPrepRecovery.java
   testLeaderUnloaded()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

TestPullReplica.java
   testAddDocs()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

TestPullReplica.java
   testKillLeader()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 26-Mar-2018

TestSegmentSorting.java
   testAtomicUpdateOfSegmentSortField()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 26-Mar-2018

TestSegmentSorting.java
   testSegmentTerminateEarly()
   @Test@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

TestStressCloudBlindAtomicUpdates.java
   test_dv()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

TestStressCloudBlindAtomicUpdates.java
   test_dv_stored()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

TestStressInPlaceUpdates.java
   stressTest()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 09-Apr-2018

TestTlogReplica.java
   testOnlyLeaderIndexes()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
//2018-03-10

TestTlogReplica.java
   testRecovery()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

TestTriggerIntegration.java
   testCooldown()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

TestTriggerIntegration.java
   testEventFromRestoredState()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
//2018-03-10

TestTriggerIntegration.java
   testEventQueue()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 16-Apr-2018

TestTriggerIntegration.java
   testListeners()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

TestTriggerIntegration.java
   testNodeAddedTriggerRestoreState()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 09-Apr-2018

TestTriggerIntegration.java
   testNodeLostTrigger()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 26-Mar-2018

TestTriggerIntegration.java
   testNodeLostTriggerRestoreState()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

TestTriggerIntegration.java
   testNodeMarkersRegistration()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

TestTriggerIntegration.java
   testSearchRate()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

TestV2Request.java
   testCloudSolrClient()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

TestV2Request.java
   testHttpSolrClient()
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: Weekly BadApple report:

Posted by Erick Erickson <er...@gmail.com>.
OK, won't BadApple any of the CreateRoutedAliasTest then.

On Tue, May 1, 2018 at 9:11 AM, David Smiley <da...@gmail.com> wrote:
> I'm actively working on the Alias ones.  Some have identified root causes
> relating to eventual-consistency timings.  Since I don't have a proper fix
> yet, in the interim I'm tempted to add a temporary Thread.sleep(200) at
> certain places in pertinent tests.
>
> On Tue, May 1, 2018 at 12:59 AM Erick Erickson <er...@gmail.com>
> wrote:
>>
>> In order to reduce some of the make-work, I collect failed tests Fri->Mon
>> so the BadApple'd tests on Thursday don't clutter things up.
>>
>> BadApple candidates: I'll BadApple these on Thursday unless there are
>> objections
>>
>>
>> org.apache.solr.client.solrj.io.stream.MathExpressionTest.testGammaDistribution
>>    org.apache.solr.cloud.AddReplicaTest.test
>>
>> org.apache.solr.cloud.CreateRoutedAliasTest.testCollectionNamesMustBeAbsent
>>    org.apache.solr.cloud.CreateRoutedAliasTest.testTimezoneAbsoluteDate
>>    org.apache.solr.cloud.CreateRoutedAliasTest.testV1
>>    org.apache.solr.cloud.CreateRoutedAliasTest.testV2
>>    org.apache.solr.cloud.DocValuesNotIndexedTest.testGroupingDVOnly
>>
>> org.apache.solr.cloud.LIRRollingUpdatesTest.testNewLeaderAndMixedReplicas
>>    org.apache.solr.cloud.LIRRollingUpdatesTest.testNewLeaderOldReplica
>>
>> org.apache.solr.cloud.LIRRollingUpdatesTest.testOldLeaderAndMixedReplicas
>>
>> org.apache.solr.cloud.LeaderElectionIntegrationTest.testSimpleSliceLeaderElection
>>    org.apache.solr.cloud.OverseerRolesTest.testOverseerRole
>>
>> org.apache.solr.cloud.SolrCloudExampleTest.testLoadDocsIntoGettingStartedCollection
>>    org.apache.solr.cloud.TestPullReplica.testKillLeader
>>    org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test
>>    org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testNodeLost
>>    org.apache.solr.cloud.autoscaling.NodeAddedTriggerTest.testRestoreState
>>
>> org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigAliasReplication
>>    org.apache.solr.schema.TestCloudSchemaless.test
>>    org.apache.solr.search.TestStressRecovery.testStressRecovery
>>    org.apache.solr.update.TestInPlaceUpdatesDistrib.test
>>
>>
>> I believe these are being worked on, so I will _not_ BadApple them
>> even though they fail.
>> What about the other autoscaling tests?
>>
>>
>> org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMergeIntegration
>>
>> org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testSplitIntegration
>>    org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testTrigger
>>
>>
>> Number of AwaitsFix: 21 Number of BadApples: 90
>>
>> *****************AwaitsFix Annotations:
>>
>>
>> ************Lucene AwaitsFix
>> GeoPolygonTest.java
>>    testLUCENE8276_case3()
>>
>> //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8276")
>>
>> GeoPolygonTest.java
>>    testLUCENE8280()
>>
>> //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8280")
>>
>> GeoPolygonTest.java
>>    testLUCENE8281()
>>
>> //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8281")
>>
>> RandomGeoPolygonTest.java
>>    testCompareBigPolygons()
>>
>> //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8281")
>>
>> RandomGeoPolygonTest.java
>>    testCompareSmallPolygons()
>>
>> //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8281")
>>
>> TestControlledRealTimeReopenThread.java
>>    testCRTReopen()
>>    @AwaitsFix(bugUrl =
>> "https://issues.apache.org/jira/browse/LUCENE-5737")
>>
>> TestICUNormalizer2CharFilter.java
>>    testRandomStrings()
>>    @AwaitsFix(bugUrl =
>> "https://issues.apache.org/jira/browse/LUCENE-5595")
>>
>> TestICUTokenizerCJK.java
>>    TestICUTokenizerCJK suite
>>    @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222")
>>
>> TestMoreLikeThis.java
>>    testMultiFieldShouldReturnPerFieldBooleanQuery()
>>    @AwaitsFix(bugUrl =
>> "https://issues.apache.org/jira/browse/LUCENE-7161")
>>
>> UIMABaseAnalyzerTest.java
>>    testRandomStrings()
>>    @Test @AwaitsFix(bugUrl =
>> "https://issues.apache.org/jira/browse/LUCENE-3869")
>>
>> UIMABaseAnalyzerTest.java
>>    testRandomStringsWithConfigurationParameters()
>>    @Test @AwaitsFix(bugUrl =
>> "https://issues.apache.org/jira/browse/LUCENE-3869")
>>
>> UIMATypeAwareAnalyzerTest.java
>>    testRandomStrings()
>>    @Test @AwaitsFix(bugUrl =
>> "https://issues.apache.org/jira/browse/LUCENE-3869")
>>
>>
>>     ************Solr AwaitsFix
>> ReplaceNodeNoTargetTest.java
>>    ReplaceNodeNoTargetTest suite
>>    @LuceneTestCase.AwaitsFix(bugUrl =
>> "https://issues.apache.org/jira/browse/SOLR-11067")
>>
>> TestCollapseQParserPlugin.java
>>    testStringCollapse()
>>    @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-11974")
>>
>> TestImpersonationWithHadoopAuth.java
>>    testForwarding()
>>    @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893")
>>
>> TestLTRReRankingPipeline.java
>>    testDifferentTopN()
>>    @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134")
>>
>> TestMinMaxOnMultiValuedField.java
>>    testDoubleFieldCache()
>>    @AwaitsFix(bugUrl =
>> "https://issues.apache.org/jira/browse/LUCENE-6709")
>>
>> TestMinMaxOnMultiValuedField.java
>>    testFloatFieldCache()
>>    @AwaitsFix(bugUrl =
>> "https://issues.apache.org/jira/browse/LUCENE-6709")
>>
>> TestMinMaxOnMultiValuedField.java
>>    testIntFieldCache()
>>    @AwaitsFix(bugUrl =
>> "https://issues.apache.org/jira/browse/LUCENE-6709")
>>
>> TestMinMaxOnMultiValuedField.java
>>    testLongFieldCache()
>>    @AwaitsFix(bugUrl =
>> "https://issues.apache.org/jira/browse/LUCENE-6709")
>>
>>
>>
>> *****************BadApple Annotations:
>>
>> ************Lucene BadApple
>>
>>     ************Solr BadApple
>> AddReplicaTest.java
>>    test()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 09-Apr-2018
>>
>> AliasIntegrationTest.java
>>    testModifyPropertiesCAR()
>>    //@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> AliasIntegrationTest.java
>>    testModifyPropertiesV1()
>>    //@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 09-Apr-2018
>>
>> AliasIntegrationTest.java
>>    testProperties()
>>    //@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> AutoAddReplicasIntegrationTest.java
>>    testSimple()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> AutoAddReplicasPlanActionTest.java
>>    testSimple()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> AutoScalingHandlerTest.java
>>    testReadApi()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> AutoscalingHistoryHandlerTest.java
>>    testHistory()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 09-Apr-2018
>>
>> CdcrBootstrapTest.java
>>    testBootstrapWithContinousIndexingOnSourceCluster()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> CdcrReplicationDistributedZkTest.java
>>    CdcrReplicationDistributedZkTest suite
>>    @BadApple(bugUrl =
>> "https://issues.apache.org/jira/browse/SOLR-12028,
>> https://issues.apache.org/jira/browse/SOLR-10107")
>>
>> ChaosMonkeyNothingIsSafeTest.java
>>    test()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 09-Apr-2018
>>
>> ChaosMonkeySafeLeaderTest.java
>>    test()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> ChaosMonkeySafeLeaderWithPullReplicasTest.java
>>    test()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> CollectionsAPIDistributedZkTest.java
>>    testCollectionsAPI()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> ComputePlanActionTest.java
>>    testSelectedCollections()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 09-Apr-2018
>>
>> CreateRoutedAliasTest.java
>>    testCollectionNamesMustBeAbsent()
>>    //@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 09-Apr-2018
>>
>> CreateRoutedAliasTest.java
>>    testTimezoneAbsoluteDate()
>>    //@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 09-Apr-2018
>>
>> CreateRoutedAliasTest.java
>>    testV1()
>>    //@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 09-Apr-2018
>>
>> CreateRoutedAliasTest.java
>>    testV2()
>>    //@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 09-Apr-2018
>>
>> DeleteReplicaTest.java
>>    deleteReplicaOnIndexing()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 09-Apr-2018
>>
>> DocValuesNotIndexedTest.java
>>    testGroupingDocAbsent()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> DocValuesNotIndexedTest.java
>>    testGroupingSorting()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 26-Mar-2018
>>
>> ForceLeaderTest.java
>>    testReplicasInLIRNoLeader()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> ForceLeaderTest.java
>>    testReplicasInLowerTerms()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> HdfsBasicDistributedZk2Test.java
>>    HdfsBasicDistributedZk2Test suite
>>
>> @LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 26-Mar-2018
>>
>> HdfsChaosMonkeyNothingIsSafeTest.java
>>    HdfsChaosMonkeyNothingIsSafeTest suite
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028,
>> https://issues.apache.org/jira/browse/SOLR-10191")
>>
>> HdfsDirectoryTest.java
>>    testEOF()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> HdfsRecoveryZkTest.java
>>    HdfsRecoveryZkTest suite
>>
>> @LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> HdfsRestartWhileUpdatingTest.java
>>    HdfsRestartWhileUpdatingTest suite
>>
>> @LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> //2018-03-10
>>
>> HdfsTlogReplayBufferedWhileIndexingTest.java
>>    HdfsTlogReplayBufferedWhileIndexingTest suite
>>
>> @LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> HttpPartitionTest.java
>>    test()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> LeaderFailoverAfterPartitionTest.java
>>    test()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> LegacyCloudClusterPropTest.java
>>    testCreateCollectionSwitchLegacyCloud()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> MathExpressionTest.java
>>    testDistributions()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> MathExpressionTest.java
>>    testMultiVariateNormalDistribution()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> //2018-03-10
>>
>> MissingSegmentRecoveryTest.java
>>    testLeaderRecovery()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> MoveReplicaHDFSTest.java
>>    testNormalFailedMove()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> MoveReplicaHDFSTest.java
>>    testNormalMove()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> //2018-03-10
>>
>> MoveReplicaTest.java
>>    testFailedMove()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 17-Mar-2018 This JIRA is fixed, but this test still fails
>>
>> MultiThreadedOCPTest.java
>>    test()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> NodeLostTriggerTest.java
>>    testListenerAcceptance()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 16-Apr-2018
>>
>> PeerSyncReplicationTest.java
>>    test()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> ReplaceNodeNoTargetTest.java
>>    test()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> ReplicationFactorTest.java
>>    ReplicationFactorTest suite
>>    @LuceneTestCase.BadApple(bugUrl =
>> "https://issues.apache.org/jira/browse/SOLR-6944")
>>
>> RestartWhileUpdatingTest.java
>>    test()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 26-Mar-2018
>>
>> SSLMigrationTest.java
>>    test()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 17-Mar-2018
>>
>> ScheduledMaintenanceTriggerTest.java
>>    testInactiveShardCleanup()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 17-Mar-2018
>>
>> ScheduledTriggerIntegrationTest.java
>>    ScheduledTriggerIntegrationTest suite
>>
>> @LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 26-Mar-2018
>>
>> ScheduledTriggerTest.java
>>    testTrigger()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 09-Apr-2018
>>
>> ShardSplitTest.java
>>    test()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> ShardSplitTest.java
>>    testSplitAfterFailedSplit()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> ShardSplitTest.java
>>    testSplitWithChaosMonkey()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> SharedFSAutoReplicaFailoverTest.java
>>    test()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> TestAuthenticationFramework.java
>>    testBasics()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> TestCloudConsistency.java
>>    testOutOfSyncReplicasCannotBecomeLeader()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 26-Mar-2018
>>
>> TestCloudConsistency.java
>>    testOutOfSyncReplicasCannotBecomeLeaderAfterRestart()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 26-Mar-2018
>>
>> TestCloudRecovery.java
>>    leaderRecoverFromLogOnStartupTest()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 09-Apr-2018
>>
>> TestCollectionStateWatchers.java
>>    testDeletionsTriggerWatches()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 09-Apr-2018
>>
>> TestCollectionsAPIViaSolrCloudCluster.java
>>    testCollectionCreateSearchDelete()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> TestCollectionsAPIViaSolrCloudCluster.java
>>    testCollectionCreateWithoutCoresThenDelete()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 09-Apr-2018
>>
>> TestDistributedSearch.java
>>    test()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 09-Apr-2018
>>
>> TestDynamicLoading.java
>>    testDynamicLoading()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> TestGenericDistributedQueue.java
>>    TestGenericDistributedQueue suite
>>
>> @LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> TestLargeCluster.java
>>    TestLargeCluster suite
>>    @LuceneTestCase.BadApple(bugUrl =
>> "https://issues.apache.org/jira/browse/SOLR-12075")
>>
>> TestLargeCluster.java
>>    testSearchRate()
>>    @BadApple(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11714")
>>
>> TestLeaderElectionZkExpiry.java
>>    testLeaderElectionWithZkExpiry()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 17-Mar-2018
>>
>> TestLeaderInitiatedRecoveryThread.java
>>    testPublishDownState()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 09-Apr-2018
>>
>> TestManagedResourceStorage.java
>>    TestManagedResourceStorage suite
>>    @LuceneTestCase.BadApple(bugUrl =
>> "https://issues.apache.org/jira/browse/SOLR-6443")
>>
>> TestPrepRecovery.java
>>    testLeaderNotResponding()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> TestPrepRecovery.java
>>    testLeaderUnloaded()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> TestPullReplica.java
>>    testAddDocs()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> TestPullReplica.java
>>    testKillLeader()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 26-Mar-2018
>>
>> TestSegmentSorting.java
>>    testAtomicUpdateOfSegmentSortField()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 26-Mar-2018
>>
>> TestSegmentSorting.java
>>    testSegmentTerminateEarly()
>>
>> @Test@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> TestStressCloudBlindAtomicUpdates.java
>>    test_dv()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> TestStressCloudBlindAtomicUpdates.java
>>    test_dv_stored()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> TestStressInPlaceUpdates.java
>>    stressTest()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 09-Apr-2018
>>
>> TestTlogReplica.java
>>    testOnlyLeaderIndexes()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> //2018-03-10
>>
>> TestTlogReplica.java
>>    testRecovery()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> TestTriggerIntegration.java
>>    testCooldown()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> TestTriggerIntegration.java
>>    testEventFromRestoredState()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> //2018-03-10
>>
>> TestTriggerIntegration.java
>>    testEventQueue()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 16-Apr-2018
>>
>> TestTriggerIntegration.java
>>    testListeners()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> TestTriggerIntegration.java
>>    testNodeAddedTriggerRestoreState()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 09-Apr-2018
>>
>> TestTriggerIntegration.java
>>    testNodeLostTrigger()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>> // 26-Mar-2018
>>
>> TestTriggerIntegration.java
>>    testNodeLostTriggerRestoreState()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> TestTriggerIntegration.java
>>    testNodeMarkersRegistration()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> TestTriggerIntegration.java
>>    testSearchRate()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> TestV2Request.java
>>    testCloudSolrClient()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> TestV2Request.java
>>    testHttpSolrClient()
>>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>>
> --
> Lucene/Solr Search Committer, Consultant, Developer, Author, Speaker
> LinkedIn: http://linkedin.com/in/davidwsmiley | Book:
> http://www.solrenterprisesearchserver.com

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: Weekly BadApple report:

Posted by David Smiley <da...@gmail.com>.
I'm actively working on the Alias ones.  Some have identified root causes
relating to eventual-consistency timings.  Since I don't have a proper fix
yet, in the interim I'm tempted to add a temporary Thread.sleep(200) at
certain places in pertinent tests.

On Tue, May 1, 2018 at 12:59 AM Erick Erickson <er...@gmail.com>
wrote:

> In order to reduce some of the make-work, I collect failed tests Fri->Mon
> so the BadApple'd tests on Thursday don't clutter things up.
>
> BadApple candidates: I'll BadApple these on Thursday unless there are
> objections
>
>
>  org.apache.solr.client.solrj.io.stream.MathExpressionTest.testGammaDistribution
>    org.apache.solr.cloud.AddReplicaTest.test
>
>  org.apache.solr.cloud.CreateRoutedAliasTest.testCollectionNamesMustBeAbsent
>    org.apache.solr.cloud.CreateRoutedAliasTest.testTimezoneAbsoluteDate
>    org.apache.solr.cloud.CreateRoutedAliasTest.testV1
>    org.apache.solr.cloud.CreateRoutedAliasTest.testV2
>    org.apache.solr.cloud.DocValuesNotIndexedTest.testGroupingDVOnly
>
>  org.apache.solr.cloud.LIRRollingUpdatesTest.testNewLeaderAndMixedReplicas
>    org.apache.solr.cloud.LIRRollingUpdatesTest.testNewLeaderOldReplica
>
>  org.apache.solr.cloud.LIRRollingUpdatesTest.testOldLeaderAndMixedReplicas
>
>  org.apache.solr.cloud.LeaderElectionIntegrationTest.testSimpleSliceLeaderElection
>    org.apache.solr.cloud.OverseerRolesTest.testOverseerRole
>
>  org.apache.solr.cloud.SolrCloudExampleTest.testLoadDocsIntoGettingStartedCollection
>    org.apache.solr.cloud.TestPullReplica.testKillLeader
>    org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test
>    org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testNodeLost
>    org.apache.solr.cloud.autoscaling.NodeAddedTriggerTest.testRestoreState
>
>  org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigAliasReplication
>    org.apache.solr.schema.TestCloudSchemaless.test
>    org.apache.solr.search.TestStressRecovery.testStressRecovery
>    org.apache.solr.update.TestInPlaceUpdatesDistrib.test
>
>
> I believe these are being worked on, so I will _not_ BadApple them
> even though they fail.
> What about the other autoscaling tests?
>
>
>  org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMergeIntegration
>
>  org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testSplitIntegration
>    org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testTrigger
>
>
> Number of AwaitsFix: 21 Number of BadApples: 90
>
> *****************AwaitsFix Annotations:
>
>
> ************Lucene AwaitsFix
> GeoPolygonTest.java
>    testLUCENE8276_case3()
>    //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8276
> ")
>
> GeoPolygonTest.java
>    testLUCENE8280()
>    //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8280
> ")
>
> GeoPolygonTest.java
>    testLUCENE8281()
>    //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8281
> ")
>
> RandomGeoPolygonTest.java
>    testCompareBigPolygons()
>    //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8281
> ")
>
> RandomGeoPolygonTest.java
>    testCompareSmallPolygons()
>    //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8281
> ")
>
> TestControlledRealTimeReopenThread.java
>    testCRTReopen()
>    @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737
> ")
>
> TestICUNormalizer2CharFilter.java
>    testRandomStrings()
>    @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595
> ")
>
> TestICUTokenizerCJK.java
>    TestICUTokenizerCJK suite
>    @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222")
>
> TestMoreLikeThis.java
>    testMultiFieldShouldReturnPerFieldBooleanQuery()
>    @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161
> ")
>
> UIMABaseAnalyzerTest.java
>    testRandomStrings()
>    @Test @AwaitsFix(bugUrl =
> "https://issues.apache.org/jira/browse/LUCENE-3869")
>
> UIMABaseAnalyzerTest.java
>    testRandomStringsWithConfigurationParameters()
>    @Test @AwaitsFix(bugUrl =
> "https://issues.apache.org/jira/browse/LUCENE-3869")
>
> UIMATypeAwareAnalyzerTest.java
>    testRandomStrings()
>    @Test @AwaitsFix(bugUrl =
> "https://issues.apache.org/jira/browse/LUCENE-3869")
>
>
>     ************Solr AwaitsFix
> ReplaceNodeNoTargetTest.java
>    ReplaceNodeNoTargetTest suite
>    @LuceneTestCase.AwaitsFix(bugUrl =
> "https://issues.apache.org/jira/browse/SOLR-11067")
>
> TestCollapseQParserPlugin.java
>    testStringCollapse()
>    @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-11974")
>
> TestImpersonationWithHadoopAuth.java
>    testForwarding()
>    @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893")
>
> TestLTRReRankingPipeline.java
>    testDifferentTopN()
>    @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134")
>
> TestMinMaxOnMultiValuedField.java
>    testDoubleFieldCache()
>    @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709
> ")
>
> TestMinMaxOnMultiValuedField.java
>    testFloatFieldCache()
>    @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709
> ")
>
> TestMinMaxOnMultiValuedField.java
>    testIntFieldCache()
>    @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709
> ")
>
> TestMinMaxOnMultiValuedField.java
>    testLongFieldCache()
>    @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709
> ")
>
>
>
> *****************BadApple Annotations:
>
> ************Lucene BadApple
>
>     ************Solr BadApple
> AddReplicaTest.java
>    test()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 09-Apr-2018
>
> AliasIntegrationTest.java
>    testModifyPropertiesCAR()
>    //@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> AliasIntegrationTest.java
>    testModifyPropertiesV1()
>    //@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 09-Apr-2018
>
> AliasIntegrationTest.java
>    testProperties()
>    //@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> AutoAddReplicasIntegrationTest.java
>    testSimple()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> AutoAddReplicasPlanActionTest.java
>    testSimple()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> AutoScalingHandlerTest.java
>    testReadApi()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> AutoscalingHistoryHandlerTest.java
>    testHistory()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 09-Apr-2018
>
> CdcrBootstrapTest.java
>    testBootstrapWithContinousIndexingOnSourceCluster()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> CdcrReplicationDistributedZkTest.java
>    CdcrReplicationDistributedZkTest suite
>    @BadApple(bugUrl =
> "https://issues.apache.org/jira/browse/SOLR-12028,
> https://issues.apache.org/jira/browse/SOLR-10107")
>
> ChaosMonkeyNothingIsSafeTest.java
>    test()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 09-Apr-2018
>
> ChaosMonkeySafeLeaderTest.java
>    test()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> ChaosMonkeySafeLeaderWithPullReplicasTest.java
>    test()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> CollectionsAPIDistributedZkTest.java
>    testCollectionsAPI()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> ComputePlanActionTest.java
>    testSelectedCollections()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 09-Apr-2018
>
> CreateRoutedAliasTest.java
>    testCollectionNamesMustBeAbsent()
>    //@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 09-Apr-2018
>
> CreateRoutedAliasTest.java
>    testTimezoneAbsoluteDate()
>    //@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 09-Apr-2018
>
> CreateRoutedAliasTest.java
>    testV1()
>    //@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 09-Apr-2018
>
> CreateRoutedAliasTest.java
>    testV2()
>    //@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 09-Apr-2018
>
> DeleteReplicaTest.java
>    deleteReplicaOnIndexing()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 09-Apr-2018
>
> DocValuesNotIndexedTest.java
>    testGroupingDocAbsent()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> DocValuesNotIndexedTest.java
>    testGroupingSorting()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 26-Mar-2018
>
> ForceLeaderTest.java
>    testReplicasInLIRNoLeader()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> ForceLeaderTest.java
>    testReplicasInLowerTerms()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> HdfsBasicDistributedZk2Test.java
>    HdfsBasicDistributedZk2Test suite
>    @LuceneTestCase.BadApple(bugUrl="
> https://issues.apache.org/jira/browse/SOLR-12028")
> // 26-Mar-2018
>
> HdfsChaosMonkeyNothingIsSafeTest.java
>    HdfsChaosMonkeyNothingIsSafeTest suite
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028,
> https://issues.apache.org/jira/browse/SOLR-10191")
>
> HdfsDirectoryTest.java
>    testEOF()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> HdfsRecoveryZkTest.java
>    HdfsRecoveryZkTest suite
>    @LuceneTestCase.BadApple(bugUrl="
> https://issues.apache.org/jira/browse/SOLR-12028")
>
> HdfsRestartWhileUpdatingTest.java
>    HdfsRestartWhileUpdatingTest suite
>    @LuceneTestCase.BadApple(bugUrl="
> https://issues.apache.org/jira/browse/SOLR-12028")
> //2018-03-10
>
> HdfsTlogReplayBufferedWhileIndexingTest.java
>    HdfsTlogReplayBufferedWhileIndexingTest suite
>    @LuceneTestCase.BadApple(bugUrl="
> https://issues.apache.org/jira/browse/SOLR-12028")
>
> HttpPartitionTest.java
>    test()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> LeaderFailoverAfterPartitionTest.java
>    test()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> LegacyCloudClusterPropTest.java
>    testCreateCollectionSwitchLegacyCloud()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> MathExpressionTest.java
>    testDistributions()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> MathExpressionTest.java
>    testMultiVariateNormalDistribution()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> //2018-03-10
>
> MissingSegmentRecoveryTest.java
>    testLeaderRecovery()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> MoveReplicaHDFSTest.java
>    testNormalFailedMove()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> MoveReplicaHDFSTest.java
>    testNormalMove()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> //2018-03-10
>
> MoveReplicaTest.java
>    testFailedMove()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 17-Mar-2018 This JIRA is fixed, but this test still fails
>
> MultiThreadedOCPTest.java
>    test()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> NodeLostTriggerTest.java
>    testListenerAcceptance()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 16-Apr-2018
>
> PeerSyncReplicationTest.java
>    test()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> ReplaceNodeNoTargetTest.java
>    test()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> ReplicationFactorTest.java
>    ReplicationFactorTest suite
>    @LuceneTestCase.BadApple(bugUrl =
> "https://issues.apache.org/jira/browse/SOLR-6944")
>
> RestartWhileUpdatingTest.java
>    test()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 26-Mar-2018
>
> SSLMigrationTest.java
>    test()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 17-Mar-2018
>
> ScheduledMaintenanceTriggerTest.java
>    testInactiveShardCleanup()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 17-Mar-2018
>
> ScheduledTriggerIntegrationTest.java
>    ScheduledTriggerIntegrationTest suite
>    @LuceneTestCase.BadApple(bugUrl="
> https://issues.apache.org/jira/browse/SOLR-12028")
> // 26-Mar-2018
>
> ScheduledTriggerTest.java
>    testTrigger()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 09-Apr-2018
>
> ShardSplitTest.java
>    test()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> ShardSplitTest.java
>    testSplitAfterFailedSplit()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> ShardSplitTest.java
>    testSplitWithChaosMonkey()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> SharedFSAutoReplicaFailoverTest.java
>    test()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> TestAuthenticationFramework.java
>    testBasics()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> TestCloudConsistency.java
>    testOutOfSyncReplicasCannotBecomeLeader()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 26-Mar-2018
>
> TestCloudConsistency.java
>    testOutOfSyncReplicasCannotBecomeLeaderAfterRestart()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 26-Mar-2018
>
> TestCloudRecovery.java
>    leaderRecoverFromLogOnStartupTest()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 09-Apr-2018
>
> TestCollectionStateWatchers.java
>    testDeletionsTriggerWatches()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 09-Apr-2018
>
> TestCollectionsAPIViaSolrCloudCluster.java
>    testCollectionCreateSearchDelete()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> TestCollectionsAPIViaSolrCloudCluster.java
>    testCollectionCreateWithoutCoresThenDelete()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 09-Apr-2018
>
> TestDistributedSearch.java
>    test()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 09-Apr-2018
>
> TestDynamicLoading.java
>    testDynamicLoading()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> TestGenericDistributedQueue.java
>    TestGenericDistributedQueue suite
>    @LuceneTestCase.BadApple(bugUrl="
> https://issues.apache.org/jira/browse/SOLR-12028")
>
> TestLargeCluster.java
>    TestLargeCluster suite
>    @LuceneTestCase.BadApple(bugUrl =
> "https://issues.apache.org/jira/browse/SOLR-12075")
>
> TestLargeCluster.java
>    testSearchRate()
>    @BadApple(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11714")
>
> TestLeaderElectionZkExpiry.java
>    testLeaderElectionWithZkExpiry()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 17-Mar-2018
>
> TestLeaderInitiatedRecoveryThread.java
>    testPublishDownState()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 09-Apr-2018
>
> TestManagedResourceStorage.java
>    TestManagedResourceStorage suite
>    @LuceneTestCase.BadApple(bugUrl =
> "https://issues.apache.org/jira/browse/SOLR-6443")
>
> TestPrepRecovery.java
>    testLeaderNotResponding()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> TestPrepRecovery.java
>    testLeaderUnloaded()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> TestPullReplica.java
>    testAddDocs()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> TestPullReplica.java
>    testKillLeader()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 26-Mar-2018
>
> TestSegmentSorting.java
>    testAtomicUpdateOfSegmentSortField()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 26-Mar-2018
>
> TestSegmentSorting.java
>    testSegmentTerminateEarly()
>    @Test@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028
> ")
>
> TestStressCloudBlindAtomicUpdates.java
>    test_dv()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> TestStressCloudBlindAtomicUpdates.java
>    test_dv_stored()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> TestStressInPlaceUpdates.java
>    stressTest()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 09-Apr-2018
>
> TestTlogReplica.java
>    testOnlyLeaderIndexes()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> //2018-03-10
>
> TestTlogReplica.java
>    testRecovery()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> TestTriggerIntegration.java
>    testCooldown()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> TestTriggerIntegration.java
>    testEventFromRestoredState()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> //2018-03-10
>
> TestTriggerIntegration.java
>    testEventQueue()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 16-Apr-2018
>
> TestTriggerIntegration.java
>    testListeners()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> TestTriggerIntegration.java
>    testNodeAddedTriggerRestoreState()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 09-Apr-2018
>
> TestTriggerIntegration.java
>    testNodeLostTrigger()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
> // 26-Mar-2018
>
> TestTriggerIntegration.java
>    testNodeLostTriggerRestoreState()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> TestTriggerIntegration.java
>    testNodeMarkersRegistration()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> TestTriggerIntegration.java
>    testSearchRate()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> TestV2Request.java
>    testCloudSolrClient()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> TestV2Request.java
>    testHttpSolrClient()
>    @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
> --
Lucene/Solr Search Committer, Consultant, Developer, Author, Speaker
LinkedIn: http://linkedin.com/in/davidwsmiley | Book:
http://www.solrenterprisesearchserver.com