You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Erick Erickson <er...@gmail.com> on 2019/12/09 15:43:11 UTC
BadApples
I’ve attached the full report, but this has been a _really_ ragged week. Take a look here for the gory details of what’s failing currently: http://fucit.org/solr-jenkins-reports/failure-report.html
The tests that have failed over the last 4 consecutive weeks are:
Failures in the last 4 reports..
Report Pct runs fails test
0123 0.6 784 10 DimensionalRoutedAliasUpdateProcessorTest.testCatTime
0123 5.6 743 56 LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
0123 63.2 101 53 MoveReplicaHDFSTest.test
0123 6.7 85 5 ShardSplitTest.testSplitWithChaosMonkey
0123 2.4 714 9 SystemCollectionCompatTest.testBackCompat
0123 9.4 795 47 TestModelManagerPersistence.testFilePersistence
0123 9.4 797 49 TestModelManagerPersistence.testWrapperModelPersistence
0123 1.5 724 10 TestStressLiveNodes.testStress
************ Will BadApple all tests above this line except ones listed at the top**************
Do the attachments even make it through?
Re: BadApples
Posted by Erick Erickson <er...@gmail.com>.
I should have been clearer that I wasn’t complaining, just observing that the badapple report is too noisy to really be of much value. I fully understand that the noise is going away at a breakneck pace…..
> On Dec 9, 2019, at 11:15 AM, Kevin Risden <kr...@apache.org> wrote:
>
> Yes the "e-mail-2019-12-09.txt" attachment made it through.
>
> Many of the tests have failed due to the tightening of the security manager permissions for tests [1]. Most of the failures have been due to failing to null out static variables after a test run [2]. Others are real issues like TestSolrCLIRunExample [3] or the Hadoop related failures [4]. There are others that haven't been triaged yet.
>
> Rob has been putting in a lot of effort to try to get this under control as well. Getting the tests to run under the security manager is the first step to trying to enable it for real in Solr. Any help triaging the failures would be appreciated.
>
> If you are looking to triage some of the test failures, adding -Dargs="-Djava.security.debug=access,failure" can help find out why the security manager denied access. Some of the failures are different between OS as well where security manager allows the path on Linux but fails on Windows.
>
> [1] https://issues.apache.org/jira/browse/SOLR-13991
> [2] https://issues.apache.org/jira/browse/SOLR-14000
> [3] https://issues.apache.org/jira/browse/SOLR-14028
> [4] https://issues.apache.org/jira/browse/SOLR-14033
>
> Kevin Risden
>
>
> On Mon, Dec 9, 2019 at 10:43 AM Erick Erickson <er...@gmail.com> wrote:
> I’ve attached the full report, but this has been a _really_ ragged week. Take a look here for the gory details of what’s failing currently: http://fucit.org/solr-jenkins-reports/failure-report.html
>
>
> The tests that have failed over the last 4 consecutive weeks are:
>
> Failures in the last 4 reports..
> Report Pct runs fails test
> 0123 0.6 784 10 DimensionalRoutedAliasUpdateProcessorTest.testCatTime
> 0123 5.6 743 56 LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
> 0123 63.2 101 53 MoveReplicaHDFSTest.test
> 0123 6.7 85 5 ShardSplitTest.testSplitWithChaosMonkey
> 0123 2.4 714 9 SystemCollectionCompatTest.testBackCompat
> 0123 9.4 795 47 TestModelManagerPersistence.testFilePersistence
> 0123 9.4 797 49 TestModelManagerPersistence.testWrapperModelPersistence
> 0123 1.5 724 10 TestStressLiveNodes.testStress
> ************ Will BadApple all tests above this line except ones listed at the top**************
>
> Do the attachments even make it through?
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
Re: BadApples
Posted by Kevin Risden <kr...@apache.org>.
Yes the "e-mail-2019-12-09.txt" attachment made it through.
Many of the tests have failed due to the tightening of the security manager
permissions for tests [1]. Most of the failures have been due to failing to
null out static variables after a test run [2]. Others are real issues
like TestSolrCLIRunExample [3] or the Hadoop related failures [4]. There
are others that haven't been triaged yet.
Rob has been putting in a lot of effort to try to get this under control as
well. Getting the tests to run under the security manager is the first step
to trying to enable it for real in Solr. Any help triaging the failures
would be appreciated.
If you are looking to triage some of the test failures,
adding -Dargs="-Djava.security.debug=access,failure" can help find out why
the security manager denied access. Some of the failures are different
between OS as well where security manager allows the path on Linux but
fails on Windows.
[1] https://issues.apache.org/jira/browse/SOLR-13991
[2] https://issues.apache.org/jira/browse/SOLR-14000
[3] https://issues.apache.org/jira/browse/SOLR-14028
[4] https://issues.apache.org/jira/browse/SOLR-14033
Kevin Risden
On Mon, Dec 9, 2019 at 10:43 AM Erick Erickson <er...@gmail.com>
wrote:
> I’ve attached the full report, but this has been a _really_ ragged week.
> Take a look here for the gory details of what’s failing currently:
> http://fucit.org/solr-jenkins-reports/failure-report.html
>
>
> The tests that have failed over the last 4 consecutive weeks are:
>
> Failures in the last 4 reports..
> Report Pct runs fails test
> 0123 0.6 784 10
> DimensionalRoutedAliasUpdateProcessorTest.testCatTime
> 0123 5.6 743 56
> LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
> 0123 63.2 101 53 MoveReplicaHDFSTest.test
> 0123 6.7 85 5
> ShardSplitTest.testSplitWithChaosMonkey
> 0123 2.4 714 9
> SystemCollectionCompatTest.testBackCompat
> 0123 9.4 795 47
> TestModelManagerPersistence.testFilePersistence
> 0123 9.4 797 49
> TestModelManagerPersistence.testWrapperModelPersistence
> 0123 1.5 724 10 TestStressLiveNodes.testStress
> ************ Will BadApple all tests above this line except ones listed at
> the top**************
>
> Do the attachments even make it through?
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org