BadApple report

[Erick Erickson <er...@gmail.com>]

Hoss’ rollups are particularly ugly, but given how much cleaner the reference impl has been lately (at least my mail filter is showing a large number of “all tests passed” rather than test failures) this may rectify itself next week. Unfortunately, there’s no good way to distinguish which failures in Hoss’ rollups are from the reference impl and which ones are from other builds...

Here’s the summary:
********Failures in Hoss' reports in every one of the last 4 rollups.

There were 343 unannotated tests that failed in Hoss' rollups. Ordered by the date I downloaded the rollup file, newest->oldest. See above for the dates the files were collected 
These tests were NOT BadApple'd or AwaitsFix'd

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   0.2     1867      8      CachingDirectoryFactoryTest.stressTest
     0123   1.7     1890     47      ClusterStateUpdateTest.testCoreRegistration
     0123 100.0      153    153      CollectionsAPIAsyncDistributedZkTest.classMethod
     0123   1.7     1894     47      CollectionsAPIAsyncDistributedZkTest.testAsyncIdRaceCondition
     0123   1.7     1869     45      CollectionsAPIAsyncDistributedZkTest.testSolrJAPICalls
     0123   1.7     1876     47      CollectionsAPIDistributedZkTest.testDeleteNonExistentCollection
     0123   1.7     1876     47      CollectionsAPIDistributedZkTest.testNoConfigSetExist
     0123 100.0       65     65      CustomHighlightComponentTest.classMethod
     0123   0.2     1842      4      CustomHighlightComponentTest.test
     0123 100.0      160    160      JsonRequestApiHeatmapFacetingTest.classMethod
     0123 100.0      160    160      JsonRequestApiTest.classMethod
     0123   0.6     1843      9      ManagedSchemaRoundRobinCloudTest.testAddFieldsRoundRobin
     0123   1.7     1876     39      MoveReplicaTest.test
     0123   1.6     1885     45      ShardSplitTest.testSplitShardWithRule
     0123   2.0     1420     25      TestCircuitBreaker.testResponseWithCBTiming
     0123   6.9     1335    105      TestContainerPlugin.testApi
     0123   1.4     1437     35      TestDistributedStatsComponentCardinality.test
     0123   1.7     1149     10      TestHdfsCloudBackupRestore.test
     0123   1.5     1343     11      TestLocalFSCloudBackupRestore.test
     0123   4.5     1388     29      TestPackages.testPluginLoading
     0123   2.9     1711     30      TestPullReplicaErrorHandling.testCantConnectToLeader
     0123  16.1     1711    311      TestPullReplicaErrorHandling.testCantConnectToPullReplica
     0123   2.7     1711     39      TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
     0123   2.1     1867     54      TestSchemalessBufferedUpdates.test
     0123 100.0      160    160      UsingSolrJRefGuideExamplesTest.classMethod
     0123 100.0      135    135      ZkConfigFilesTest.classMethod
********************************************

Failures over the last 4 weeks, but not every week. Ordered most-recent first:


Full report: