You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Erick Erickson <er...@gmail.com> on 2018/07/23 20:18:42 UTC
Weekly BadApple report
Full report attached
**Annotated tests/suites that didn't fail in the last 4 weeks.
**Annotations will be removed from the following tests because they
haven't failed in the last 4 rollups.
**Methods: 10
AddReplicaTest.test
HdfsChaosMonkeyNothingIsSafeTest
MaxSizeAutoCommitTest
PeerSyncReplicationTest.test
RecoveryZkTest.test
RollingRestartTest.test
SearchRateTriggerTest.testTrigger
TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
TestLargeCluster.testSearchRate
TestPullReplicaErrorHandling.throws
********Failures in Hoss' reports for the last 4 collected reports.
Will BadApple these
Failures in the last 4 reports..
Report Pct runs fails test
0123 2.3 1725 25 CloudSolrClientTest.preferLocalShardsTest
0123 3.4 1684 29 DistributedMLTComponentTest.test
0123 1.0 1643 14 FullSolrCloudDistribCmdsTest.test
0123 2.9 1307 13
HdfsAutoAddReplicasIntegrationTest.testSimple
0123 6.3 1634 94 MoveReplicaHDFSTest.testFailedMove
0123 5.0 1697 53
ScheduledTriggerIntegrationTest.testScheduledTrigger
0123 40.7 388 147 ShardSplitTest.test
0123 6.3 308 21 ShardSplitTest.testSplitMixedReplicaTypes
0123 7.3 1562 57 StreamDecoratorTest.testExecutorStream
0123 1.9 1561 15
StreamDecoratorTest.testParallelCommitStream
0123 6.3 132 8 StressHdfsTest(suite)
0123 0.3 1642 4
TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart
0123 6.7 128 12
TestGenericDistributedQueue.testDistributedQueue
0123 8.8 876 40 TestHdfsCloudBackupRestore.test
0123 2.0 1068 17 TestHdfsUpdateLog(suite)
0123 0.2 1687 4 TestIndexWriterOnVMError(suite)
0123 4.3 96 4 TestIndexWriterOnVMError.testCheckpoint
0123 9.0 1646 76 TestLocalFSCloudBackupRestore.test
0123 0.2 1691 15 TestLogWatcher.testLog4jWatcher
0123 0.2 1701 36 TestPullReplica.testKillLeader
0123 0.7 1662 23 TestSolrConfigHandlerCloud.test
0123 0.5 1648 9 TestTlogReplica(suite)
0123 11.0 364 36
TestTriggerIntegration.testNodeLostTriggerRestoreState
0123 0.3 1650 8 TimeRoutedAliasUpdateProcessorTest.test
Re: Weekly BadApple report
Posted by David Smiley <da...@gmail.com>.
Ah, @LogLevel -- fantastic
On Mon, Jul 23, 2018 at 8:28 PM Erick Erickson <er...@gmail.com>
wrote:
> David:
>
> I put it in my "do not BadApple" list. Beasting that test on my Mac
> Pro, 350 iterations or so and no failures FWIW.
>
> Erick
>
> On Mon, Jul 23, 2018 at 2:26 PM, Varun Thacker <va...@vthacker.in> wrote:
> > David TestLogLevelAnnotations might help you?
> >
> > On Mon, Jul 23, 2018 at 2:22 PM, David Smiley <da...@gmail.com>
> > wrote:
> >>
> >> Thanks for these reports Erick!
> >>
> >> Please don't BadApple TimeRoutedAliasUpdateProcessorTest. Failures seem
> >> rare. At least in the last week, only one of two I consider genuine.
> >>
> >> How can I configure expanded logging but only for one test suite?
> >>
> >> ~ David
> >>
> >> On Mon, Jul 23, 2018 at 4:19 PM Erick Erickson <erickerickson@gmail.com
> >
> >> wrote:
> >>>
> >>> Full report attached
> >>>
> >>> **Annotated tests/suites that didn't fail in the last 4 weeks.
> >>>
> >>> **Annotations will be removed from the following tests because they
> >>> haven't failed in the last 4 rollups.
> >>>
> >>> **Methods: 10
> >>> AddReplicaTest.test
> >>> HdfsChaosMonkeyNothingIsSafeTest
> >>> MaxSizeAutoCommitTest
> >>> PeerSyncReplicationTest.test
> >>> RecoveryZkTest.test
> >>> RollingRestartTest.test
> >>> SearchRateTriggerTest.testTrigger
> >>> TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
> >>> TestLargeCluster.testSearchRate
> >>> TestPullReplicaErrorHandling.throws
> >>>
> >>>
> >>> ********Failures in Hoss' reports for the last 4 collected reports.
> >>>
> >>> Will BadApple these
> >>>
> >>> Failures in the last 4 reports..
> >>> Report Pct runs fails test
> >>> 0123 2.3 1725 25
> >>> CloudSolrClientTest.preferLocalShardsTest
> >>> 0123 3.4 1684 29 DistributedMLTComponentTest.test
> >>> 0123 1.0 1643 14 FullSolrCloudDistribCmdsTest.test
> >>> 0123 2.9 1307 13
> >>> HdfsAutoAddReplicasIntegrationTest.testSimple
> >>> 0123 6.3 1634 94 MoveReplicaHDFSTest.testFailedMove
> >>> 0123 5.0 1697 53
> >>> ScheduledTriggerIntegrationTest.testScheduledTrigger
> >>> 0123 40.7 388 147 ShardSplitTest.test
> >>> 0123 6.3 308 21
> >>> ShardSplitTest.testSplitMixedReplicaTypes
> >>> 0123 7.3 1562 57
> >>> StreamDecoratorTest.testExecutorStream
> >>> 0123 1.9 1561 15
> >>> StreamDecoratorTest.testParallelCommitStream
> >>> 0123 6.3 132 8 StressHdfsTest(suite)
> >>> 0123 0.3 1642 4
> >>>
> TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart
> >>> 0123 6.7 128 12
> >>> TestGenericDistributedQueue.testDistributedQueue
> >>> 0123 8.8 876 40 TestHdfsCloudBackupRestore.test
> >>> 0123 2.0 1068 17 TestHdfsUpdateLog(suite)
> >>> 0123 0.2 1687 4 TestIndexWriterOnVMError(suite)
> >>> 0123 4.3 96 4
> >>> TestIndexWriterOnVMError.testCheckpoint
> >>> 0123 9.0 1646 76 TestLocalFSCloudBackupRestore.test
> >>> 0123 0.2 1691 15 TestLogWatcher.testLog4jWatcher
> >>> 0123 0.2 1701 36 TestPullReplica.testKillLeader
> >>> 0123 0.7 1662 23 TestSolrConfigHandlerCloud.test
> >>> 0123 0.5 1648 9 TestTlogReplica(suite)
> >>> 0123 11.0 364 36
> >>> TestTriggerIntegration.testNodeLostTriggerRestoreState
> >>> 0123 0.3 1650 8
> >>> TimeRoutedAliasUpdateProcessorTest.test
> >>>
> >>> ---------------------------------------------------------------------
> >>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> >>> For additional commands, e-mail: dev-help@lucene.apache.org
> >>
> >> --
> >> Lucene/Solr Search Committer, Consultant, Developer, Author, Speaker
> >> LinkedIn: http://linkedin.com/in/davidwsmiley | Book:
> >> http://www.solrenterprisesearchserver.com
> >
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
> --
Lucene/Solr Search Committer, Consultant, Developer, Author, Speaker
LinkedIn: http://linkedin.com/in/davidwsmiley | Book:
http://www.solrenterprisesearchserver.com
Re: Weekly BadApple report
Posted by Erick Erickson <er...@gmail.com>.
David:
I put it in my "do not BadApple" list. Beasting that test on my Mac
Pro, 350 iterations or so and no failures FWIW.
Erick
On Mon, Jul 23, 2018 at 2:26 PM, Varun Thacker <va...@vthacker.in> wrote:
> David TestLogLevelAnnotations might help you?
>
> On Mon, Jul 23, 2018 at 2:22 PM, David Smiley <da...@gmail.com>
> wrote:
>>
>> Thanks for these reports Erick!
>>
>> Please don't BadApple TimeRoutedAliasUpdateProcessorTest. Failures seem
>> rare. At least in the last week, only one of two I consider genuine.
>>
>> How can I configure expanded logging but only for one test suite?
>>
>> ~ David
>>
>> On Mon, Jul 23, 2018 at 4:19 PM Erick Erickson <er...@gmail.com>
>> wrote:
>>>
>>> Full report attached
>>>
>>> **Annotated tests/suites that didn't fail in the last 4 weeks.
>>>
>>> **Annotations will be removed from the following tests because they
>>> haven't failed in the last 4 rollups.
>>>
>>> **Methods: 10
>>> AddReplicaTest.test
>>> HdfsChaosMonkeyNothingIsSafeTest
>>> MaxSizeAutoCommitTest
>>> PeerSyncReplicationTest.test
>>> RecoveryZkTest.test
>>> RollingRestartTest.test
>>> SearchRateTriggerTest.testTrigger
>>> TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
>>> TestLargeCluster.testSearchRate
>>> TestPullReplicaErrorHandling.throws
>>>
>>>
>>> ********Failures in Hoss' reports for the last 4 collected reports.
>>>
>>> Will BadApple these
>>>
>>> Failures in the last 4 reports..
>>> Report Pct runs fails test
>>> 0123 2.3 1725 25
>>> CloudSolrClientTest.preferLocalShardsTest
>>> 0123 3.4 1684 29 DistributedMLTComponentTest.test
>>> 0123 1.0 1643 14 FullSolrCloudDistribCmdsTest.test
>>> 0123 2.9 1307 13
>>> HdfsAutoAddReplicasIntegrationTest.testSimple
>>> 0123 6.3 1634 94 MoveReplicaHDFSTest.testFailedMove
>>> 0123 5.0 1697 53
>>> ScheduledTriggerIntegrationTest.testScheduledTrigger
>>> 0123 40.7 388 147 ShardSplitTest.test
>>> 0123 6.3 308 21
>>> ShardSplitTest.testSplitMixedReplicaTypes
>>> 0123 7.3 1562 57
>>> StreamDecoratorTest.testExecutorStream
>>> 0123 1.9 1561 15
>>> StreamDecoratorTest.testParallelCommitStream
>>> 0123 6.3 132 8 StressHdfsTest(suite)
>>> 0123 0.3 1642 4
>>> TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart
>>> 0123 6.7 128 12
>>> TestGenericDistributedQueue.testDistributedQueue
>>> 0123 8.8 876 40 TestHdfsCloudBackupRestore.test
>>> 0123 2.0 1068 17 TestHdfsUpdateLog(suite)
>>> 0123 0.2 1687 4 TestIndexWriterOnVMError(suite)
>>> 0123 4.3 96 4
>>> TestIndexWriterOnVMError.testCheckpoint
>>> 0123 9.0 1646 76 TestLocalFSCloudBackupRestore.test
>>> 0123 0.2 1691 15 TestLogWatcher.testLog4jWatcher
>>> 0123 0.2 1701 36 TestPullReplica.testKillLeader
>>> 0123 0.7 1662 23 TestSolrConfigHandlerCloud.test
>>> 0123 0.5 1648 9 TestTlogReplica(suite)
>>> 0123 11.0 364 36
>>> TestTriggerIntegration.testNodeLostTriggerRestoreState
>>> 0123 0.3 1650 8
>>> TimeRoutedAliasUpdateProcessorTest.test
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: dev-help@lucene.apache.org
>>
>> --
>> Lucene/Solr Search Committer, Consultant, Developer, Author, Speaker
>> LinkedIn: http://linkedin.com/in/davidwsmiley | Book:
>> http://www.solrenterprisesearchserver.com
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
Re: Weekly BadApple report
Posted by Varun Thacker <va...@vthacker.in>.
David TestLogLevelAnnotations might help you?
On Mon, Jul 23, 2018 at 2:22 PM, David Smiley <da...@gmail.com>
wrote:
> Thanks for these reports Erick!
>
> Please don't BadApple TimeRoutedAliasUpdateProcessorTest. Failures seem
> rare. At least in the last week, only one of two I consider genuine.
>
> How can I configure expanded logging but only for one test suite?
>
> ~ David
>
> On Mon, Jul 23, 2018 at 4:19 PM Erick Erickson <er...@gmail.com>
> wrote:
>
>> Full report attached
>>
>> **Annotated tests/suites that didn't fail in the last 4 weeks.
>>
>> **Annotations will be removed from the following tests because they
>> haven't failed in the last 4 rollups.
>>
>> **Methods: 10
>> AddReplicaTest.test
>> HdfsChaosMonkeyNothingIsSafeTest
>> MaxSizeAutoCommitTest
>> PeerSyncReplicationTest.test
>> RecoveryZkTest.test
>> RollingRestartTest.test
>> SearchRateTriggerTest.testTrigger
>> TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
>> TestLargeCluster.testSearchRate
>> TestPullReplicaErrorHandling.throws
>>
>>
>> ********Failures in Hoss' reports for the last 4 collected reports.
>>
>> Will BadApple these
>>
>> Failures in the last 4 reports..
>> Report Pct runs fails test
>> 0123 2.3 1725 25 CloudSolrClientTest.
>> preferLocalShardsTest
>> 0123 3.4 1684 29 DistributedMLTComponentTest.test
>> 0123 1.0 1643 14 FullSolrCloudDistribCmdsTest.test
>> 0123 2.9 1307 13
>> HdfsAutoAddReplicasIntegrationTest.testSimple
>> 0123 6.3 1634 94 MoveReplicaHDFSTest.testFailedMove
>> 0123 5.0 1697 53
>> ScheduledTriggerIntegrationTest.testScheduledTrigger
>> 0123 40.7 388 147 ShardSplitTest.test
>> 0123 6.3 308 21 ShardSplitTest.
>> testSplitMixedReplicaTypes
>> 0123 7.3 1562 57 StreamDecoratorTest.
>> testExecutorStream
>> 0123 1.9 1561 15
>> StreamDecoratorTest.testParallelCommitStream
>> 0123 6.3 132 8 StressHdfsTest(suite)
>> 0123 0.3 1642 4
>> TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart
>> 0123 6.7 128 12
>> TestGenericDistributedQueue.testDistributedQueue
>> 0123 8.8 876 40 TestHdfsCloudBackupRestore.test
>> 0123 2.0 1068 17 TestHdfsUpdateLog(suite)
>> 0123 0.2 1687 4 TestIndexWriterOnVMError(suite)
>> 0123 4.3 96 4 TestIndexWriterOnVMError.
>> testCheckpoint
>> 0123 9.0 1646 76 TestLocalFSCloudBackupRestore.test
>> 0123 0.2 1691 15 TestLogWatcher.testLog4jWatcher
>> 0123 0.2 1701 36 TestPullReplica.testKillLeader
>> 0123 0.7 1662 23 TestSolrConfigHandlerCloud.test
>> 0123 0.5 1648 9 TestTlogReplica(suite)
>> 0123 11.0 364 36
>> TestTriggerIntegration.testNodeLostTriggerRestoreState
>> 0123 0.3 1650 8 TimeRoutedAliasUpdateProcessor
>> Test.test
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>
> --
> Lucene/Solr Search Committer, Consultant, Developer, Author, Speaker
> LinkedIn: http://linkedin.com/in/davidwsmiley | Book: http://www.
> solrenterprisesearchserver.com
>
Re: Weekly BadApple report
Posted by David Smiley <da...@gmail.com>.
Thanks for these reports Erick!
Please don't BadApple TimeRoutedAliasUpdateProcessorTest. Failures seem
rare. At least in the last week, only one of two I consider genuine.
How can I configure expanded logging but only for one test suite?
~ David
On Mon, Jul 23, 2018 at 4:19 PM Erick Erickson <er...@gmail.com>
wrote:
> Full report attached
>
> **Annotated tests/suites that didn't fail in the last 4 weeks.
>
> **Annotations will be removed from the following tests because they
> haven't failed in the last 4 rollups.
>
> **Methods: 10
> AddReplicaTest.test
> HdfsChaosMonkeyNothingIsSafeTest
> MaxSizeAutoCommitTest
> PeerSyncReplicationTest.test
> RecoveryZkTest.test
> RollingRestartTest.test
> SearchRateTriggerTest.testTrigger
> TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
> TestLargeCluster.testSearchRate
> TestPullReplicaErrorHandling.throws
>
>
> ********Failures in Hoss' reports for the last 4 collected reports.
>
> Will BadApple these
>
> Failures in the last 4 reports..
> Report Pct runs fails test
> 0123 2.3 1725 25
> CloudSolrClientTest.preferLocalShardsTest
> 0123 3.4 1684 29 DistributedMLTComponentTest.test
> 0123 1.0 1643 14 FullSolrCloudDistribCmdsTest.test
> 0123 2.9 1307 13
> HdfsAutoAddReplicasIntegrationTest.testSimple
> 0123 6.3 1634 94 MoveReplicaHDFSTest.testFailedMove
> 0123 5.0 1697 53
> ScheduledTriggerIntegrationTest.testScheduledTrigger
> 0123 40.7 388 147 ShardSplitTest.test
> 0123 6.3 308 21
> ShardSplitTest.testSplitMixedReplicaTypes
> 0123 7.3 1562 57 StreamDecoratorTest.testExecutorStream
> 0123 1.9 1561 15
> StreamDecoratorTest.testParallelCommitStream
> 0123 6.3 132 8 StressHdfsTest(suite)
> 0123 0.3 1642 4
> TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart
> 0123 6.7 128 12
> TestGenericDistributedQueue.testDistributedQueue
> 0123 8.8 876 40 TestHdfsCloudBackupRestore.test
> 0123 2.0 1068 17 TestHdfsUpdateLog(suite)
> 0123 0.2 1687 4 TestIndexWriterOnVMError(suite)
> 0123 4.3 96 4
> TestIndexWriterOnVMError.testCheckpoint
> 0123 9.0 1646 76 TestLocalFSCloudBackupRestore.test
> 0123 0.2 1691 15 TestLogWatcher.testLog4jWatcher
> 0123 0.2 1701 36 TestPullReplica.testKillLeader
> 0123 0.7 1662 23 TestSolrConfigHandlerCloud.test
> 0123 0.5 1648 9 TestTlogReplica(suite)
> 0123 11.0 364 36
> TestTriggerIntegration.testNodeLostTriggerRestoreState
> 0123 0.3 1650 8
> TimeRoutedAliasUpdateProcessorTest.test
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
--
Lucene/Solr Search Committer, Consultant, Developer, Author, Speaker
LinkedIn: http://linkedin.com/in/davidwsmiley | Book:
http://www.solrenterprisesearchserver.com