You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2017/09/18 07:44:34 UTC
[JENKINS] Lucene-Solr-master-Windows (32bit/jdk1.8.0_144) - Build #
6903 - Still Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Windows/6903/
Java: 32bit/jdk1.8.0_144 -client -XX:+UseG1GC
1 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.core.ConfigureRecoveryStrategyTest
Error Message:
Could not remove the following files (in the order of attempts): C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_6F4A16A3D2D384FB-001\init-core-data-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_6F4A16A3D2D384FB-001\init-core-data-001 C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_6F4A16A3D2D384FB-001\init-core-data-001\snapshot_metadata: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_6F4A16A3D2D384FB-001\init-core-data-001\snapshot_metadata C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_6F4A16A3D2D384FB-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_6F4A16A3D2D384FB-001
Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_6F4A16A3D2D384FB-001\init-core-data-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_6F4A16A3D2D384FB-001\init-core-data-001
C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_6F4A16A3D2D384FB-001\init-core-data-001\snapshot_metadata: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_6F4A16A3D2D384FB-001\init-core-data-001\snapshot_metadata
C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_6F4A16A3D2D384FB-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_6F4A16A3D2D384FB-001
at __randomizedtesting.SeedInfo.seed([6F4A16A3D2D384FB]:0)
at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12143 lines...]
[junit4] Suite: org.apache.solr.core.ConfigureRecoveryStrategyTest
[junit4] 2> 965654 INFO (SUITE-ConfigureRecoveryStrategyTest-seed#[6F4A16A3D2D384FB]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_6F4A16A3D2D384FB-001\init-core-data-001
[junit4] 2> 965656 INFO (SUITE-ConfigureRecoveryStrategyTest-seed#[6F4A16A3D2D384FB]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 965660 INFO (SUITE-ConfigureRecoveryStrategyTest-seed#[6F4A16A3D2D384FB]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 965661 INFO (SUITE-ConfigureRecoveryStrategyTest-seed#[6F4A16A3D2D384FB]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore
[junit4] 2> 965662 INFO (SUITE-ConfigureRecoveryStrategyTest-seed#[6F4A16A3D2D384FB]-worker) [ ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/C:/Users/jenkins/workspace/Lucene-Solr-master-Windows/solr/core/src/test-files/solr/collection1/lib, /C:/Users/jenkins/workspace/Lucene-Solr-master-Windows/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 965717 INFO (SUITE-ConfigureRecoveryStrategyTest-seed#[6F4A16A3D2D384FB]-worker) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 965739 INFO (SUITE-ConfigureRecoveryStrategyTest-seed#[6F4A16A3D2D384FB]-worker) [ ] o.a.s.s.IndexSchema [null] Schema name=test
[junit4] 2> 965890 INFO (SUITE-ConfigureRecoveryStrategyTest-seed#[6F4A16A3D2D384FB]-worker) [ ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 965996 INFO (SUITE-ConfigureRecoveryStrategyTest-seed#[6F4A16A3D2D384FB]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43515f
[junit4] 2> 966008 INFO (SUITE-ConfigureRecoveryStrategyTest-seed#[6F4A16A3D2D384FB]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43515f
[junit4] 2> 966008 INFO (SUITE-ConfigureRecoveryStrategyTest-seed#[6F4A16A3D2D384FB]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43515f
[junit4] 2> 966012 INFO (coreLoadExecutor-4382-thread-1) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/C:/Users/jenkins/workspace/Lucene-Solr-master-Windows/solr/core/src/test-files/solr/collection1/lib, /C:/Users/jenkins/workspace/Lucene-Solr-master-Windows/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 966081 INFO (coreLoadExecutor-4382-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 966096 INFO (coreLoadExecutor-4382-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 966214 INFO (coreLoadExecutor-4382-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 966234 INFO (coreLoadExecutor-4382-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1, trusted=true
[junit4] 2> 966234 INFO (coreLoadExecutor-4382-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@43515f
[junit4] 2> 966234 INFO (coreLoadExecutor-4382-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 966235 INFO (coreLoadExecutor-4382-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_6F4A16A3D2D384FB-001\init-core-data-001\]
[junit4] 2> 966244 INFO (coreLoadExecutor-4382-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=30.4208984375, floorSegmentMB=1.37890625, forceMergeDeletesPctAllowed=25.528084556549434, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.704228658620038
[junit4] 2> 966397 INFO (coreLoadExecutor-4382-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 966397 INFO (coreLoadExecutor-4382-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 966398 INFO (coreLoadExecutor-4382-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=20, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 966400 INFO (coreLoadExecutor-4382-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@e0f85e[collection1] main]
[junit4] 2> 966401 WARN (coreLoadExecutor-4382-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf; switching to use InMemory storage instead.
[junit4] 2> 966402 INFO (coreLoadExecutor-4382-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 966403 INFO (searcherExecutor-4383-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@e0f85e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 966405 INFO (SUITE-ConfigureRecoveryStrategyTest-seed#[6F4A16A3D2D384FB]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore end
[junit4] 2> 966409 INFO (TEST-ConfigureRecoveryStrategyTest.testBuilder-seed#[6F4A16A3D2D384FB]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testBuilder
[junit4] 2> 966409 INFO (TEST-ConfigureRecoveryStrategyTest.testBuilder-seed#[6F4A16A3D2D384FB]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testBuilder
[junit4] 2> 966413 INFO (TEST-ConfigureRecoveryStrategyTest.testAlmostAllMethodsAreFinal-seed#[6F4A16A3D2D384FB]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testAlmostAllMethodsAreFinal
[junit4] 2> 966414 INFO (TEST-ConfigureRecoveryStrategyTest.testAlmostAllMethodsAreFinal-seed#[6F4A16A3D2D384FB]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testAlmostAllMethodsAreFinal
[junit4] 2> 966414 INFO (SUITE-ConfigureRecoveryStrategyTest-seed#[6F4A16A3D2D384FB]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> 966414 INFO (SUITE-ConfigureRecoveryStrategyTest-seed#[6F4A16A3D2D384FB]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=11558384
[junit4] 2> 966414 INFO (SUITE-ConfigureRecoveryStrategyTest-seed#[6F4A16A3D2D384FB]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 966415 INFO (SUITE-ConfigureRecoveryStrategyTest-seed#[6F4A16A3D2D384FB]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@10dfe1c: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@18d3982
[junit4] 2> 966420 INFO (SUITE-ConfigureRecoveryStrategyTest-seed#[6F4A16A3D2D384FB]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 966421 INFO (SUITE-ConfigureRecoveryStrategyTest-seed#[6F4A16A3D2D384FB]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1824ffb: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1795e
[junit4] 2> 966427 INFO (SUITE-ConfigureRecoveryStrategyTest-seed#[6F4A16A3D2D384FB]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 966427 INFO (SUITE-ConfigureRecoveryStrategyTest-seed#[6F4A16A3D2D384FB]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@f27ded: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@14add92
[junit4] 2> 966428 INFO (SUITE-ConfigureRecoveryStrategyTest-seed#[6F4A16A3D2D384FB]-worker) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 966429 INFO (coreCloseExecutor-4387-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@13f95db
[junit4] 2> 966429 INFO (coreCloseExecutor-4387-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=20944347
[junit4] 2> 966429 INFO (coreCloseExecutor-4387-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4c55be: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@103826e
[junit4] 2> 966442 INFO (SUITE-ConfigureRecoveryStrategyTest-seed#[6F4A16A3D2D384FB]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1154, maxMBSortInHeap=7.265857469825143, sim=RandomSimilarity(queryNorm=true): {}, locale=cs, timezone=Australia/Lord_Howe
[junit4] 2> NOTE: Windows 10 10.0 x86/Oracle Corporation 1.8.0_144 (32-bit)/cpus=3,threads=1,free=390796496,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [TestMiniSolrCloudClusterSSL, TestDistributedMissingSort, LoggingHandlerTest, AnalyticsQueryTest, TestReplicationHandlerBackup, FileUtilsTest, TestWordDelimiterFilterFactory, PolyFieldTest, TestBM25SimilarityFactory, SpellingQueryConverterTest, TestManagedStopFilterFactory, TestTrieFacet, UUIDUpdateProcessorFallbackTest, HdfsRestartWhileUpdatingTest, ClassificationUpdateProcessorFactoryTest, SolrShardReporterTest, PKIAuthenticationIntegrationTest, BadIndexSchemaTest, TermsComponentTest, TestLegacyFieldCache, SolrCLIZkUtilsTest, TestDownShardTolerantSearch, TestPointFields, TestImpersonationWithHadoopAuth, SpellCheckCollatorWithCollapseTest, TestFieldCollectionResource, SampleTest, V2ApiIntegrationTest, MultiThreadedOCPTest, TestSimpleTrackingShardHandler, TestStressCloudBlindAtomicUpdates, BlockJoinFacetRandomTest, SharedFSAutoReplicaFailoverUtilsTest, TestSchemaNameResource, StressHdfsTest, TestInitParams, DistributedMLTComponentTest, TestLuceneMatchVersion, SolrIndexConfigTest, HdfsChaosMonkeyNothingIsSafeTest, SolrCmdDistributorTest, TestDistribIDF, TestTestInjection, DocumentBuilderTest, DirectSolrSpellCheckerTest, TestComponentsName, TestFreeTextSuggestions, TestPartialUpdateDeduplication, TestMaxTokenLenTokenizer, DistributedFacetPivotLargeTest, CloudMLTQParserTest, SolrGangliaReporterTest, TestFieldTypeCollectionResource, MBeansHandlerTest, BigEndianAscendingWordSerializerTest, HdfsLockFactoryTest, TestQueryWrapperFilter, TestBulkSchemaAPI, DocExpirationUpdateProcessorFactoryTest, PluginInfoTest, TestFastOutputStream, CdcrRequestHandlerTest, TestDeleteCollectionOnDownNodes, TestNestedDocsSort, TestJavabinTupleStreamParser, TermVectorComponentTest, TestRecoveryHdfs, UpdateParamsTest, LeaderElectionIntegrationTest, TestManagedSynonymGraphFilterFactory, OutOfBoxZkACLAndCredentialsProvidersTest, ConcurrentDeleteAndCreateCollectionTest, TestCloudDeleteByQuery, TestFieldCacheVsDocValues, ReplicaListTransformerTest, SpellPossibilityIteratorTest, SolrCoreCheckLockOnStartupTest, SearchHandlerTest, AddBlockUpdateTest, TestMacros, TestPullReplicaErrorHandling, TestDistributedGrouping, TestOrdValues, TestSchemalessBufferedUpdates, TestHdfsCloudBackupRestore, TestJoin, TestCrossCoreJoin, TestRealTimeGet, RestartWhileUpdatingTest, ParsingFieldUpdateProcessorsTest, DistributedTermsComponentTest, TestClassicSimilarityFactory, LeaderElectionContextKeyTest, ZkSolrClientTest, TestSolrQueryParser, TestSubQueryTransformerDistrib, TestStreamBody, FacetPivotSmallTest, SchemaVersionSpecificBehaviorTest, TestLegacyFieldReuse, SearchHandlerTest, OpenCloseCoreStressTest, TestSQLHandlerNonCloud, TestSimpleTextCodec, SolrCoreMetricManagerTest, TestCoreAdminApis, TestSolrQueryResponse, TestUnifiedSolrHighlighter, OverseerRolesTest, LukeRequestHandlerTest, HLLSerializationTest, ShardRoutingCustomTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, TestCloudSearcherWarming, TestPrepRecovery, CollectionsAPIAsyncDistributedZkTest, StatelessScriptUpdateProcessorFactoryTest, UninvertDocValuesMergePolicyTest, HdfsUnloadDistributedZkTest, TestNumericTerms64, SystemInfoHandlerTest, TestHashQParserPlugin, TestCollationField, TestUseDocValuesAsStored2, TestSubQueryTransformer, TestAddFieldRealTimeGet, TestConfigSetsAPIZkFailure, TestImplicitCoreProperties, HdfsCollectionsAPIDistributedZkTest, TestFieldCacheSort, TestEmbeddedSolrServerSchemaAPI, VersionInfoTest, AtomicUpdateProcessorFactoryTest, DistributedQueryElevationComponentTest, ImplicitSnitchTest, SOLR749Test, TestRemoteStreaming, TestSolrIndexConfig, PreAnalyzedFieldTest, TestQueryUtils, TestBadConfig, TestRandomFaceting, TestDynamicFieldCollectionResource, TestSha256AuthenticationProvider, DebugComponentTest, TestReload, IndexSchemaRuntimeFieldTest, TestScoreJoinQPScore, StatsReloadRaceTest, ReplaceNodeTest, TlogReplayBufferedWhileIndexingTest, TestExactStatsCache, DirectoryFactoryTest, TestSolr4Spatial, MoveReplicaHDFSUlogDirTest, TestFilteredDocIdSet, ConfigureRecoveryStrategyTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ConfigureRecoveryStrategyTest -Dtests.seed=6F4A16A3D2D384FB -Dtests.slow=true -Dtests.locale=cs -Dtests.timezone=Australia/Lord_Howe -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J1 | ConfigureRecoveryStrategyTest (suite) <<<
[junit4] > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
[junit4] > C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_6F4A16A3D2D384FB-001\init-core-data-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_6F4A16A3D2D384FB-001\init-core-data-001
[junit4] > C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_6F4A16A3D2D384FB-001\init-core-data-001\snapshot_metadata: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_6F4A16A3D2D384FB-001\init-core-data-001\snapshot_metadata
[junit4] > C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_6F4A16A3D2D384FB-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.core.ConfigureRecoveryStrategyTest_6F4A16A3D2D384FB-001
[junit4] > at __randomizedtesting.SeedInfo.seed([6F4A16A3D2D384FB]:0)
[junit4] > at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] Completed [302/732 (1!)] on J1 in 0.81s, 2 tests, 1 error <<< FAILURES!
[...truncated 43483 lines...]
[JENKINS-EA] Lucene-Solr-master-Windows (64bit/jdk-9-ea+181) -
Build # 6904 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Windows/6904/
Java: 64bit/jdk-9-ea+181 -XX:-UseCompressedOops -XX:+UseG1GC --illegal-access=deny
1 tests failed.
FAILED: org.apache.solr.update.TestInPlaceUpdatesDistrib.test
Error Message:
This doc was supposed to have been deleted, but was: SolrDocument{id=0, title_s=title0, id_i=0, inplace_updatable_float=1.0, _version_=1578891528619687936, inplace_updatable_int_with_default=666, inplace_updatable_float_with_default=42.0}
Stack Trace:
java.lang.AssertionError: This doc was supposed to have been deleted, but was: SolrDocument{id=0, title_s=title0, id_i=0, inplace_updatable_float=1.0, _version_=1578891528619687936, inplace_updatable_int_with_default=666, inplace_updatable_float_with_default=42.0}
at __randomizedtesting.SeedInfo.seed([1AA9A65B416E3B90:92FD9981EF925668]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.update.TestInPlaceUpdatesDistrib.reorderedDBQsSimpleTest(TestInPlaceUpdatesDistrib.java:247)
at org.apache.solr.update.TestInPlaceUpdatesDistrib.test(TestInPlaceUpdatesDistrib.java:151)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 13625 lines...]
[junit4] Suite: org.apache.solr.update.TestInPlaceUpdatesDistrib
[junit4] 2> 3075950 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[1AA9A65B416E3B90]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\init-core-data-001
[junit4] 2> 3075951 WARN (SUITE-TestInPlaceUpdatesDistrib-seed#[1AA9A65B416E3B90]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=102 numCloses=102
[junit4] 2> 3075951 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[1AA9A65B416E3B90]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 3075954 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[1AA9A65B416E3B90]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 3075954 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[1AA9A65B416E3B90]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 3075955 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[1AA9A65B416E3B90]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore
[junit4] 2> 3075955 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[1AA9A65B416E3B90]-worker) [ ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/C:/Users/jenkins/workspace/Lucene-Solr-master-Windows/solr/core/src/test-files/solr/collection1/lib, /C:/Users/jenkins/workspace/Lucene-Solr-master-Windows/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 3075972 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[1AA9A65B416E3B90]-worker) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 3075978 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[1AA9A65B416E3B90]-worker) [ ] o.a.s.s.IndexSchema [null] Schema name=inplace-updates
[junit4] 2> 3075980 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[1AA9A65B416E3B90]-worker) [ ] o.a.s.s.IndexSchema Loaded schema inplace-updates/1.6 with uniqueid field id
[junit4] 2> 3076009 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[1AA9A65B416E3B90]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0
[junit4] 2> 3076014 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[1AA9A65B416E3B90]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0
[junit4] 2> 3076014 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[1AA9A65B416E3B90]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0
[junit4] 2> 3076016 INFO (coreLoadExecutor-13029-thread-1) [ ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/C:/Users/jenkins/workspace/Lucene-Solr-master-Windows/solr/core/src/test-files/solr/collection1/lib, /C:/Users/jenkins/workspace/Lucene-Solr-master-Windows/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 3076031 INFO (coreLoadExecutor-13029-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 3076038 INFO (coreLoadExecutor-13029-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=inplace-updates
[junit4] 2> 3076040 INFO (coreLoadExecutor-13029-thread-1) [ ] o.a.s.s.IndexSchema Loaded schema inplace-updates/1.6 with uniqueid field id
[junit4] 2> 3076040 INFO (coreLoadExecutor-13029-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1, trusted=true
[junit4] 2> 3076041 INFO (coreLoadExecutor-13029-thread-1) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0
[junit4] 2> 3076041 INFO (coreLoadExecutor-13029-thread-1) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3076041 INFO (coreLoadExecutor-13029-thread-1) [ ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\init-core-data-001\]
[junit4] 2> 3076043 WARN (coreLoadExecutor-13029-thread-1) [ ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 3076094 INFO (coreLoadExecutor-13029-thread-1) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 3076095 INFO (coreLoadExecutor-13029-thread-1) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 3076110 INFO (coreLoadExecutor-13029-thread-1) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3076110 INFO (coreLoadExecutor-13029-thread-1) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3076111 INFO (coreLoadExecutor-13029-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@69af59e2[collection1] main]
[junit4] 2> 3076111 WARN (coreLoadExecutor-13029-thread-1) [ ] o.a.s.r.ManagedResourceStorage Cannot write to config directory C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf; switching to use InMemory storage instead.
[junit4] 2> 3076112 INFO (coreLoadExecutor-13029-thread-1) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 3076113 INFO (searcherExecutor-13030-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@69af59e2[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3076113 INFO (coreLoadExecutor-13029-thread-1) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1578891329186824192
[junit4] 2> 3076115 INFO (SUITE-TestInPlaceUpdatesDistrib-seed#[1AA9A65B416E3B90]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore end
[junit4] 2> 3076119 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 3076119 INFO (Thread-5535) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 3076119 INFO (Thread-5535) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 3076124 ERROR (Thread-5535) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 3076229 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.ZkTestServer start zk server on port:53812
[junit4] 2> 3076237 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e9594c6fc0000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 3076247 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 3076249 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf\schema-inplace-updates.xml to /configs/conf1/schema.xml
[junit4] 2> 3076251 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 3076254 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 3076256 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 3076258 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4] 2> 3076260 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 3076261 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 3076263 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 3076265 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 3076266 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 3076272 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
[junit4] 2> 3076611 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 3076612 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@54a75483{/,null,AVAILABLE}
[junit4] 2> 3076612 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@68c6f6b6{SSL,[ssl, http/1.1]}{127.0.0.1:53822}
[junit4] 2> 3076613 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.e.j.s.Server Started @3089514ms
[junit4] 2> 3076613 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solr.data.dir=C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\tempDir-001/control/data, hostPort=53822, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\control-001\cores}
[junit4] 2> 3076613 ERROR (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3076613 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 3076613 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3076613 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 3076613 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-09-18T15:21:49.542629Z
[junit4] 2> 3076620 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 3076620 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\control-001\solr.xml
[junit4] 2> 3076623 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 3076626 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53812/solr
[junit4] 2> 3076714 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3076714 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:53822_
[junit4] 2> 3076715 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.Overseer Overseer (id=98680708074831877-127.0.0.1:53822_-n_0000000000) starting
[junit4] 2> 3076721 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53822_
[junit4] 2> 3076722 INFO (zkCallback-6070-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3076787 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0
[junit4] 2> 3076810 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0
[junit4] 2> 3076810 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0
[junit4] 2> 3076812 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\control-001\cores
[junit4] 2> 3076836 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3076837 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:53812/solr ready
[junit4] 2> 3076851 INFO (qtp839211008-30956) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:53822_&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3076855 INFO (OverseerThreadFactory-13040-thread-1) [ ] o.a.s.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 3076963 INFO (qtp839211008-30953) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 3076964 INFO (qtp839211008-30953) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 3077070 INFO (zkCallback-6070-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 3077977 INFO (qtp839211008-30953) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 3077992 INFO (qtp839211008-30953) [ ] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=inplace-updates
[junit4] 2> 3077994 INFO (qtp839211008-30953) [ ] o.a.s.s.IndexSchema Loaded schema inplace-updates/1.6 with uniqueid field id
[junit4] 2> 3077994 INFO (qtp839211008-30953) [ ] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 3077995 INFO (qtp839211008-30953) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0
[junit4] 2> 3077995 INFO (qtp839211008-30953) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3077995 INFO (qtp839211008-30953) [ ] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\control-001\cores\control_collection_shard1_replica_n1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\control-001\cores\control_collection_shard1_replica_n1\data\]
[junit4] 2> 3077999 WARN (qtp839211008-30953) [ ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 3078065 INFO (qtp839211008-30953) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 3078065 INFO (qtp839211008-30953) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 3078090 INFO (qtp839211008-30953) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3078091 INFO (qtp839211008-30953) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3078092 INFO (qtp839211008-30953) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@519ee4f4[control_collection_shard1_replica_n1] main]
[junit4] 2> 3078094 INFO (qtp839211008-30953) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 3078094 INFO (qtp839211008-30953) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3078095 INFO (qtp839211008-30953) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 3078096 INFO (searcherExecutor-13043-thread-1) [ ] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@519ee4f4[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3078096 INFO (qtp839211008-30953) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1578891331266150400
[junit4] 2> 3078102 INFO (qtp839211008-30953) [ ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 3078102 INFO (qtp839211008-30953) [ ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 3078102 INFO (qtp839211008-30953) [ ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:53822/control_collection_shard1_replica_n1/
[junit4] 2> 3078102 INFO (qtp839211008-30953) [ ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 3078102 INFO (qtp839211008-30953) [ ] o.a.s.c.SyncStrategy https://127.0.0.1:53822/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 3078102 INFO (qtp839211008-30953) [ ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 3078107 INFO (qtp839211008-30953) [ ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:53822/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 3078233 INFO (zkCallback-6070-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 3078284 INFO (qtp839211008-30953) [ ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 3078285 INFO (qtp839211008-30953) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1321
[junit4] 2> 3078288 INFO (qtp839211008-30956) [ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 3078390 INFO (zkCallback-6070-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 3078855 INFO (OverseerCollectionConfigSetProcessor-98680708074831877-127.0.0.1:53822_-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 3079288 INFO (qtp839211008-30956) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:53822_&wt=javabin&version=2} status=0 QTime=2437
[junit4] 2> 3079289 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e9594c6fc0006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 3079295 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3079295 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:53812/solr ready
[junit4] 2> 3079295 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 3079297 INFO (qtp839211008-30964) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3079300 INFO (OverseerThreadFactory-13040-thread-2) [ ] o.a.s.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 3079301 WARN (OverseerThreadFactory-13040-thread-2) [ ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 3079507 INFO (qtp839211008-30964) [ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 3079507 INFO (qtp839211008-30964) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=209
[junit4] 2> 3079796 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\shard-1-001 of type TLOG
[junit4] 2> 3079797 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 3079798 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2ac87ca1{/,null,AVAILABLE}
[junit4] 2> 3079799 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@52bd6ad7{SSL,[ssl, http/1.1]}{127.0.0.1:53843}
[junit4] 2> 3079799 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.e.j.s.Server Started @3092700ms
[junit4] 2> 3079799 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\tempDir-001/jetty1, hostPort=53843, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\shard-1-001\cores, replicaType=TLOG}
[junit4] 2> 3079799 ERROR (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3079799 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 3079800 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3079800 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 3079800 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-09-18T15:21:52.729409500Z
[junit4] 2> 3079803 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 3079803 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\shard-1-001\solr.xml
[junit4] 2> 3079806 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 3079808 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53812/solr
[junit4] 2> 3079818 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3079820 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3079822 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53843_
[junit4] 2> 3079823 INFO (zkCallback-6077-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 3079823 INFO (zkCallback-6082-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 3079823 INFO (zkCallback-6070-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 3079871 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0
[junit4] 2> 3079878 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0
[junit4] 2> 3079879 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0
[junit4] 2> 3079880 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\shard-1-001\cores
[junit4] 2> 3079904 INFO (qtp839211008-30951) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:53843_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3079906 INFO (OverseerCollectionConfigSetProcessor-98680708074831877-127.0.0.1:53822_-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 3079907 INFO (OverseerThreadFactory-13040-thread-3) [ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:53843_ for creating new replica
[junit4] 2> 3079922 INFO (qtp1665186551-30999) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t21&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 3079922 INFO (qtp1665186551-30999) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 3080029 INFO (zkCallback-6082-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3080934 INFO (qtp1665186551-30999) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 3080941 INFO (qtp1665186551-30999) [ ] o.a.s.s.IndexSchema [collection1_shard1_replica_t21] Schema name=inplace-updates
[junit4] 2> 3080943 INFO (qtp1665186551-30999) [ ] o.a.s.s.IndexSchema Loaded schema inplace-updates/1.6 with uniqueid field id
[junit4] 2> 3080944 INFO (qtp1665186551-30999) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t21' using configuration from collection collection1, trusted=true
[junit4] 2> 3080944 INFO (qtp1665186551-30999) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t21' (registry 'solr.core.collection1.shard1.replica_t21') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0
[junit4] 2> 3080944 INFO (qtp1665186551-30999) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3080944 INFO (qtp1665186551-30999) [ ] o.a.s.c.SolrCore [[collection1_shard1_replica_t21] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\shard-1-001\cores\collection1_shard1_replica_t21], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\shard-1-001\cores\collection1_shard1_replica_t21\data\]
[junit4] 2> 3080948 WARN (qtp1665186551-30999) [ ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 3080995 INFO (qtp1665186551-30999) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 3080995 INFO (qtp1665186551-30999) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 3081013 INFO (qtp1665186551-30999) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3081013 INFO (qtp1665186551-30999) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3081015 INFO (qtp1665186551-30999) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@3fa9cddb[collection1_shard1_replica_t21] main]
[junit4] 2> 3081016 INFO (qtp1665186551-30999) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 3081016 INFO (qtp1665186551-30999) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3081016 INFO (qtp1665186551-30999) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 3081016 INFO (qtp1665186551-30999) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1578891334327992320
[junit4] 2> 3081019 INFO (searcherExecutor-13054-thread-1) [ ] o.a.s.c.SolrCore [collection1_shard1_replica_t21] Registered new searcher Searcher@3fa9cddb[collection1_shard1_replica_t21] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3081023 INFO (qtp1665186551-30999) [ ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 3081023 INFO (qtp1665186551-30999) [ ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 3081023 INFO (qtp1665186551-30999) [ ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:53843/collection1_shard1_replica_t21/
[junit4] 2> 3081023 INFO (qtp1665186551-30999) [ ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 3081023 INFO (qtp1665186551-30999) [ ] o.a.s.c.SyncStrategy https://127.0.0.1:53843/collection1_shard1_replica_t21/ has no replicas
[junit4] 2> 3081023 INFO (qtp1665186551-30999) [ ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 3081025 INFO (qtp1665186551-30999) [ ] o.a.s.c.ZkController collection1_shard1_replica_t21 stopping background replication from leader
[junit4] 2> 3081027 INFO (qtp1665186551-30999) [ ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:53843/collection1_shard1_replica_t21/ shard1
[junit4] 2> 3081132 INFO (zkCallback-6082-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3081182 INFO (qtp1665186551-30999) [ ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 3081183 INFO (qtp1665186551-30999) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t21&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1260
[junit4] 2> 3081185 INFO (qtp839211008-30951) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:53843_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=1280
[junit4] 2> 3081286 INFO (zkCallback-6082-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3081733 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\shard-2-001 of type TLOG
[junit4] 2> 3081735 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 3081736 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@54172c48{/,null,AVAILABLE}
[junit4] 2> 3081737 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@20b54c00{SSL,[ssl, http/1.1]}{127.0.0.1:53922}
[junit4] 2> 3081737 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.e.j.s.Server Started @3094638ms
[junit4] 2> 3081737 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\tempDir-001/jetty2, hostPort=53922, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\shard-2-001\cores, replicaType=TLOG}
[junit4] 2> 3081737 ERROR (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3081737 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 3081738 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3081738 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 3081738 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-09-18T15:21:54.667371600Z
[junit4] 2> 3081748 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e9594c6fc000b, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 3081749 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 3081749 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\shard-2-001\solr.xml
[junit4] 2> 3081753 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 3081756 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53812/solr
[junit4] 2> 3081771 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 3081773 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3081775 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53922_
[junit4] 2> 3081796 INFO (zkCallback-6082-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 3081796 INFO (zkCallback-6088-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 3081796 INFO (zkCallback-6077-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 3081796 INFO (zkCallback-6070-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 3081851 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0
[junit4] 2> 3081860 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0
[junit4] 2> 3081860 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0
[junit4] 2> 3081863 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\shard-2-001\cores
[junit4] 2> 3081906 INFO (qtp399623538-31030) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:53922_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3081908 INFO (OverseerCollectionConfigSetProcessor-98680708074831877-127.0.0.1:53822_-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 3081909 INFO (OverseerThreadFactory-13040-thread-4) [ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:53922_ for creating new replica
[junit4] 2> 3081912 INFO (qtp399623538-31038) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t23&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 3081912 INFO (qtp399623538-31038) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 3082019 INFO (zkCallback-6082-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 3082019 INFO (zkCallback-6088-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 3082933 INFO (qtp399623538-31038) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 3082949 INFO (qtp399623538-31038) [ ] o.a.s.s.IndexSchema [collection1_shard1_replica_t23] Schema name=inplace-updates
[junit4] 2> 3082952 INFO (qtp399623538-31038) [ ] o.a.s.s.IndexSchema Loaded schema inplace-updates/1.6 with uniqueid field id
[junit4] 2> 3082952 INFO (qtp399623538-31038) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t23' using configuration from collection collection1, trusted=true
[junit4] 2> 3082953 INFO (qtp399623538-31038) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t23' (registry 'solr.core.collection1.shard1.replica_t23') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0
[junit4] 2> 3082953 INFO (qtp399623538-31038) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3082954 INFO (qtp399623538-31038) [ ] o.a.s.c.SolrCore [[collection1_shard1_replica_t23] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\shard-2-001\cores\collection1_shard1_replica_t23], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\shard-2-001\cores\collection1_shard1_replica_t23\data\]
[junit4] 2> 3082960 WARN (qtp399623538-31038) [ ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 3083013 INFO (qtp399623538-31038) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 3083013 INFO (qtp399623538-31038) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 3083015 INFO (qtp399623538-31038) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3083015 INFO (qtp399623538-31038) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3083016 INFO (qtp399623538-31038) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@3b11567e[collection1_shard1_replica_t23] main]
[junit4] 2> 3083017 INFO (qtp399623538-31038) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 3083017 INFO (qtp399623538-31038) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3083017 INFO (qtp399623538-31038) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 3083018 INFO (qtp399623538-31038) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1578891336427241472
[junit4] 2> 3083018 INFO (searcherExecutor-13065-thread-1) [ ] o.a.s.c.SolrCore [collection1_shard1_replica_t23] Registered new searcher Searcher@3b11567e[collection1_shard1_replica_t23] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3083021 INFO (qtp399623538-31038) [ ] o.a.s.c.ZkController Core needs to recover:collection1_shard1_replica_t23
[junit4] 2> 3083021 INFO (updateExecutor-6085-thread-1) [ ] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 3083021 INFO (qtp399623538-31038) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t23&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1108
[junit4] 2> 3083022 INFO (recoveryExecutor-6086-thread-1) [ ] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 3083022 INFO (recoveryExecutor-6086-thread-1) [ ] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 3083022 INFO (recoveryExecutor-6086-thread-1) [ ] o.a.s.c.ZkController collection1_shard1_replica_t23 stopping background replication from leader
[junit4] 2> 3083022 INFO (recoveryExecutor-6086-thread-1) [ ] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard1_replica_t23]
[junit4] 2> 3083022 INFO (recoveryExecutor-6086-thread-1) [ ] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 3083022 INFO (recoveryExecutor-6086-thread-1) [ ] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard1_replica_t23] as recovering, leader is [https://127.0.0.1:53843/collection1_shard1_replica_t21/] and I am [https://127.0.0.1:53922/collection1_shard1_replica_t23/]
[junit4] 2> 3083024 INFO (qtp399623538-31030) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:53922_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=1118
[junit4] 2> 3083024 INFO (recoveryExecutor-6086-thread-1) [ ] o.a.s.c.RecoveryStrategy Sending prep recovery command to [https://127.0.0.1:53843]; [WaitForState: action=PREPRECOVERY&core=collection1_shard1_replica_t21&nodeName=127.0.0.1:53922_&coreNodeName=core_node24&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 3083050 INFO (qtp1665186551-31000) [ ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node24, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
[junit4] 2> 3083052 INFO (qtp1665186551-31000) [ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_t21, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:53922_, coreNodeName=core_node24, onlyIfActiveCheckResult=false, nodeProps: core_node24:{"core":"collection1_shard1_replica_t23","base_url":"https://127.0.0.1:53922","node_name":"127.0.0.1:53922_","state":"down","type":"TLOG"}
[junit4] 2> 3083127 INFO (zkCallback-6082-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 3083128 INFO (zkCallback-6088-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 3083338 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\shard-3-001 of type TLOG
[junit4] 2> 3083339 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 3083340 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@368b4dec{/,null,AVAILABLE}
[junit4] 2> 3083341 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7193789c{SSL,[ssl, http/1.1]}{127.0.0.1:53945}
[junit4] 2> 3083341 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.e.j.s.Server Started @3096242ms
[junit4] 2> 3083341 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\tempDir-001/jetty3, hostPort=53945, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\shard-3-001\cores, replicaType=TLOG}
[junit4] 2> 3083342 ERROR (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3083342 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 3083342 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3083342 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 3083342 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-09-18T15:21:56.271435600Z
[junit4] 2> 3083345 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 3083345 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\shard-3-001\solr.xml
[junit4] 2> 3083348 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 3083350 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53812/solr
[junit4] 2> 3083359 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 3083361 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3083363 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53945_
[junit4] 2> 3083364 INFO (zkCallback-6082-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 3083364 INFO (zkCallback-6088-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 3083364 INFO (zkCallback-6095-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 3083364 INFO (zkCallback-6077-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 3083364 INFO (zkCallback-6070-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 3083417 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0
[junit4] 2> 3083425 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0
[junit4] 2> 3083425 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0
[junit4] 2> 3083426 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\shard-3-001\cores
[junit4] 2> 3083461 INFO (qtp399623538-31037) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:53945_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3083464 INFO (OverseerCollectionConfigSetProcessor-98680708074831877-127.0.0.1:53822_-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 3083465 INFO (OverseerThreadFactory-13040-thread-5) [ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:53945_ for creating new replica
[junit4] 2> 3083478 INFO (qtp1055364106-31065) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t25&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 3083478 INFO (qtp1055364106-31065) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 3083585 INFO (zkCallback-6082-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 3083585 INFO (zkCallback-6095-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 3083585 INFO (zkCallback-6088-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 3084052 INFO (qtp1665186551-31000) [ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_t21, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:53922_, coreNodeName=core_node24, onlyIfActiveCheckResult=false, nodeProps: core_node24:{"core":"collection1_shard1_replica_t23","base_url":"https://127.0.0.1:53922","node_name":"127.0.0.1:53922_","state":"recovering","type":"TLOG"}
[junit4] 2> 3084052 INFO (qtp1665186551-31000) [ ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node24, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4] 2> 3084052 INFO (qtp1665186551-31000) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:53922_&onlyIfLeaderActive=true&core=collection1_shard1_replica_t21&coreNodeName=core_node24&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1001
[junit4] 2> 3084499 INFO (qtp1055364106-31065) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 3084508 INFO (qtp1055364106-31065) [ ] o.a.s.s.IndexSchema [collection1_shard1_replica_t25] Schema name=inplace-updates
[junit4] 2> 3084513 INFO (qtp1055364106-31065) [ ] o.a.s.s.IndexSchema Loaded schema inplace-updates/1.6 with uniqueid field id
[junit4] 2> 3084513 INFO (qtp1055364106-31065) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t25' using configuration from collection collection1, trusted=true
[junit4] 2> 3084514 INFO (qtp1055364106-31065) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t25' (registry 'solr.core.collection1.shard1.replica_t25') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b1fb5b0
[junit4] 2> 3084514 INFO (qtp1055364106-31065) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3084514 INFO (qtp1055364106-31065) [ ] o.a.s.c.SolrCore [[collection1_shard1_replica_t25] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\shard-3-001\cores\collection1_shard1_replica_t25], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.update.TestInPlaceUpdatesDistrib_1AA9A65B416E3B90-001\shard-3-001\cores\collection1_shard1_replica_t25\data\]
[junit4] 2> 3084518 WARN (qtp1055364106-31065) [ ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 3084554 INFO (recoveryExecutor-6086-thread-1) [ ] o.a.s.c.RecoveryStrategy Starting Replication Recovery.
[junit4] 2> 3084554 INFO (recoveryExecutor-6086-thread-1) [ ] o.a.s.c.RecoveryStrategy Attempting to replicate from [https://127.0.0.1:53843/collection1_shard1_replica_t21/].
[junit4] 2> 3084557 INFO (qtp1665186551-31001) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1578891338040999936,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 3084557 INFO (qtp1665186551-31001) [ ] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 3084557 INFO (qtp1665186551-31001) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 3084557 INFO (qtp1665186551-31001) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_t21] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&softCommit=false&commit_end_point=true&wt=javabin&version=2}{commit=} 0 1
[junit4] 2> 3084561 INFO (qtp1665186551-31002) [ ] o.a.s.c.S.Request [collection1_shard1_replica_t21] webapp= path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 3084561 INFO (recoveryExecutor-6086-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 3084561 INFO (recoveryExecutor-6086-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 3084561 INFO (recoveryExecutor-6086-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 3084561 INFO (recoveryExecutor-6086-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 3084561 INFO (recoveryExecutor-6086-thread-1) [ ] o.a.s.c.RecoveryStrategy Replication Recovery was successful.
[junit4] 2> 3084561 INFO (recoveryExecutor-6086-thread-1) [ ] o.a.s.c.RecoveryStrategy Registering as Active after recovery.
[junit4] 2> 3084561 INFO (recoveryExecutor-6086-thread-1) [ ] o.a.s.c.ZkController collection1_shard1_replica_t23 starting background replication from leader
[junit4] 2> 3084561 INFO (recoveryExecutor-6086-thread-1) [ ] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
[junit4] 2> 3084562 INFO (recoveryExecutor-6086-thread-1) [ ] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
[junit4] 2> 3084562 INFO (indexFetcher-13079-thread-1) [ ] o.a.s.h.IndexFetcher Updated masterUrl to https://127.0.0.1:53843/collection1_shard1_replica_t21/
[junit4] 2> 3084563 INFO (recoveryExecutor-6086-thread-1) [ ] o.a.s.c.RecoveryStrategy Updating version bucket highest from index after successful recovery.
[junit4] 2> 3084563 INFO (recoveryExecutor-6086-thread-1) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1578891338047291392
[junit4] 2> 3084564 INFO (recoveryExecutor-6086-thread-1) [ ] o.a.s.c.RecoveryStrategy Finished recovery process, successful=[true]
[junit4] 2> 3084566 INFO (qtp1665186551-31002) [ ] o.a.s.c.S.Request [collection1_shard1_replica_t21] webapp= path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 3084567 INFO (indexFetcher-13079-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 3084567 INFO (indexFetcher-13079-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 3084567 INFO (indexFetcher-13079-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 3084567 INFO (indexFetcher-13079-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 3084575 INFO (qtp1055364106-31065) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 3084575 INFO (qtp1055364106-31065) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 3084577 INFO (qtp1055364106-31065) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3084577 INFO (qtp1055364106-31065) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3084578 INFO (qtp1055364106-31065) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@666f9d6b[collection1_shard1_replica_t25] main]
[junit4] 2> 3084580 INFO (qtp1055364106-31065) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 3084581 INFO (qtp1055364106-31065) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3084581 INFO (qtp1055364106-31065) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 3084581 INFO (qtp1055364106-31065) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1578891338066165760
[junit4] 2> 3084582 INFO (searcherExecutor-13076-thread-1) [ ] o.a.s.c.SolrCore [collection1_shard1_replica_t25] Registered new searcher Searcher@666f9d6b[collection1_shard1_replica_t25] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3084585 INFO (qtp1055364106-31065) [ ] o.a.s.c.ZkController Core needs to recover:collection1_shard1_replica_t25
[junit4] 2> 3084585 INFO (updateExecutor-6092-thread-1) [ ] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 3084585 INFO (qtp1055364106-31065) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t25&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1106
[junit4] 2> 3084585 INFO (recoveryExecutor-6093-thread-1) [ ] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 3084585 INFO (recoveryExecutor-6093-thread-1) [ ] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 3084585 INFO (recoveryExecutor-6093-thread-1) [ ] o.a.s.c.ZkController collection1_shard1_replica_t25 stopping background replication from leader
[junit4] 2> 3084585 INFO (recoveryExecutor-6093-thread-1) [ ] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard1_replica_t25]
[junit4] 2> 3084585 INFO (recoveryExecutor-6093-thread-1) [ ] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 3084585 INFO (recoveryExecutor-6093-thread-1) [ ] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard1_replica_t25] as recovering, leader is [https://127.0.0.1:53843/collection1_shard1_replica_t21/] and I am [https://127.0.0.1:53945/collection1_shard1_replica_t25/]
[junit4] 2> 3084587 INFO (qtp399623538-31037) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:53945_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=1125
[junit4] 2> 3084587 INFO (recoveryExecutor-6093-thread-1) [ ] o.a.s.c.RecoveryStrategy Sending prep recovery command to [https://127.0.0.1:53843]; [WaitForState: action=PREPRECOVERY&core=collection1_shard1_replica_t21&nodeName=127.0.0.1:53945_&coreNodeName=core_node26&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 3084589 INFO (qtp1665186551-31001) [ ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node26, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
[junit4] 2> 3084590 INFO (qtp1665186551-31001) [ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_t21, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:53945_, coreNodeName=core_node26, onlyIfActiveCheckResult=false, nodeProps: core_node26:{"core":"collection1_shard1_replica_t25","base_url":"https://127.0.0.1:53945","node_name":"127.0.0.1:53945_","state":"down","type":"TLOG"}
[junit4] 2> 3084590 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test
[junit4] 2> 3084590 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):330
[junit4] 1> -
[junit4] 1> replica:core_node22 rstate:active live:true
[junit4] 1> replica:core_node24 rstate:recovering live:true
[junit4] 1> replica:core_node26 rstate:down live:true
[junit4] 2> 3084689 INFO (zkCallback-6082-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 3084689 INFO (zkCallback-6095-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 3084689 INFO (zkCallback-6088-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 3085468 INFO (OverseerCollectionConfigSetProcessor-98680708074831877-127.0.0.1:53822_-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000008 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 1> -
[junit4] 2> 3085591 INFO (qtp1665186551-31001) [ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_t21, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:53945_, coreNodeName=core_node26, onlyIfActiveCheckResult=false, nodeProps: core_node26:{"core":"collection1_shard1_replica_t25","base_url":"https://127.0.0.1:53945","node_name":"127.0.0.1:53945_","state":"recovering","type":"TLOG"}
[junit4] 2> 3085591 INFO (qtp1665186551-31001) [ ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node26, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4] 2> 3085591 INFO (qtp1665186551-31001) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:53945_&onlyIfLeaderActive=true&core=collection1_shard1_replica_t21&coreNodeName=core_node26&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1001
[junit4] 1> replica:core_node22 rstate:active live:true
[junit4] 1> replica:core_node24 rstate:active live:true
[junit4] 1> replica:core_node26 rstate:recovering live:true
[junit4] 2> 3086092 INFO (recoveryExecutor-6093-thread-1) [ ] o.a.s.c.RecoveryStrategy Starting Replication Recovery.
[junit4] 2> 3086092 INFO (recoveryExecutor-6093-thread-1) [ ] o.a.s.c.RecoveryStrategy Attempting to replicate from [https://127.0.0.1:53843/collection1_shard1_replica_t21/].
[junit4] 2> 3086098 INFO (qtp1665186551-30999) [ ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1578891339656855552,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 3086098 INFO (qtp1665186551-30999) [ ] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 3086098 INFO (qtp1665186551-30999) [ ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 3086098 INFO (qtp1665186551-30999) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_t21] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&softCommit=false&commit_end_point=true&wt=javabin&version=2}{commit=} 0 0
[junit4] 2> 3086104 INFO (qtp1665186551-30998) [ ] o.a.s.c.S.Request [collection1_shard1_replica_t21] webapp= path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 3086105 INFO (recoveryExecutor-6093-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 3086105 INFO (recoveryExecutor-6093-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 3086105 INFO (recoveryExecutor-6093-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 3086105 INFO (recoveryExecutor-6093-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 3086105 INFO (recoveryExecutor-6093-thread-1) [ ] o.a.s.c.RecoveryStrategy Replication Recovery was successful.
[junit4] 2> 3086105 INFO (recoveryExecutor-6093-thread-1) [ ] o.a.s.c.RecoveryStrategy Registering as Active after recovery.
[junit4] 2> 3086105 INFO (recoveryExecutor-6093-thread-1) [ ] o.a.s.c.ZkController collection1_shard1_replica_t25 starting background replication from leader
[junit4] 2> 3086105 INFO (recoveryExecutor-6093-thread-1) [ ] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
[junit4] 2> 3086107 INFO (recoveryExecutor-6093-thread-1) [ ] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
[junit4] 2> 3086108 INFO (indexFetcher-13084-thread-1) [ ] o.a.s.h.IndexFetcher Updated masterUrl to https://127.0.0.1:53843/collection1_shard1_replica_t21/
[junit4] 2> 3086111 INFO (qtp1665186551-31002) [ ] o.a.s.c.S.Request [collection1_shard1_replica_t21] webapp= path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 3086111 INFO (indexFetcher-13084-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 1
[junit4] 2> 3086112 INFO (indexFetcher-13084-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 0
[junit4] 2> 3086112 INFO (indexFetcher-13084-thread-1) [ ] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 3086112 INFO (indexFetcher-13084-thread-1) [ ] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 3086112 INFO (recoveryExecutor-6093-thread-1) [ ] o.a.s.c.RecoveryStrategy Updating version bucket highest from index after successful recovery.
[junit4] 2> 3086112 INFO (recoveryExecutor-6093-thread-1) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1578891339671535616
[junit4] 2> 3086115 INFO (recoveryExecutor-6093-thread-1) [ ] o.a.s.c.RecoveryStrategy Finished recovery process, successful=[true]
[junit4] 2> 3086218 INFO (zkCallback-6082-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 3086218 INFO (zkCallback-6088-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 3086218 INFO (zkCallback-6095-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 1> -
[junit4] 1> replica:core_node22 rstate:active live:true
[junit4] 1> replica:core_node24 rstate:active live:true
[junit4] 1> replica:core_node26 rstate:active live:true
[junit4] 1> no one is recoverying
[junit4] 2> 3086592 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: collection1
[junit4] 2> 3086601 INFO (qtp1665186551-31000) [ ] o.a.s.c.S.Request [collection1_shard1_replica_t21] webapp= path=/schema/fields/inplace_updatable_int params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3086607 INFO (qtp1055364106-31068) [ ] o.a.s.c.S.Request [collection1_shard1_replica_t25] webapp= path=/schema/fields/inplace_updatable_float params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3086608 INFO (qtp399623538-31025) [ ] o.a.s.c.S.Request [collection1_shard1_replica_t23] webapp= path=/schema/fields/_version_ params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 3086609 INFO (TEST-TestInPlaceUpdatesDistrib.test-seed#[1AA9A65B416E3B90]) [ ] o.a.s.u.TestInPlaceUpdatesDistrib Trying num docs = 25
[junit4] 2> 3086652 INFO (qtp399623538-31031) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_t23] webapp= path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:53843/collection1_shard1_replica_t21/&wt=javabin&version=2}{add=[-1 (1578891340197920768)]} 0 1
[junit4] 2> 3086652 INFO (qtp1055364106-31064) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_t25] webapp= path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:53843/collection1_shard1_replica_t21/&wt=javabin&version=2}{add=[-1 (1578891340197920768)]} 0 1
[junit4] 2> 3086654 INFO (qtp1665186551-30998) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_t21] webapp= path=/update params={versions=true&wt=javabin&version=2}{add=[-1 (1578891340197920768)]} 0 39
[junit4] 2> 3086656 INFO (qtp399623538-31032) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_t23] webapp= path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:53843/collection1_shard1_replica_t21/&wt=javabin&version=2}{add=[-2 (1578891340239863808)]} 0 0
[junit4] 2> 3086657 INFO (qtp1055364106-31066) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_t25] webapp= path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:53843/collection1_shard1_replica_t21/&wt=javabin&version=2}{add=[-2 (1578891340239863808)]} 0 1
[junit4] 2> 3086657 INFO (qtp1665186551-31002) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_t21] webapp= path=/update params={versions=true&wt=javabin&version=2}{add=[-2 (1578891340239863808)]} 0 3
[junit4] 2> 3086658 INFO (qtp399623538-31036) [ ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_t23] webapp= path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:53843/collection1_shard1_replica_t21/&wt=javabin&version=2}{add=[-3 (1578891340244058112)]} 0 0
[junit4] 2> 3086659 INFO (qtp1055364106-31067) [ ] o.a.s.u.p.LogUpda
[...truncated too long message...]
Format(name=Lucene70), _version_=DocValuesFormat(name=Direct), id=DocValuesFormat(name=Memory), inplace_updatable_int_with_default=DocValuesFormat(name=Direct), inplace_updatable_int=DocValuesFormat(name=Lucene70), inplace_updatable_float_with_default=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=661, maxMBSortInHeap=7.051964248577605, sim=RandomSimilarity(queryNorm=true): {}, locale=en-BE, timezone=Etc/GMT-14
[junit4] 2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 9 (64-bit)/cpus=3,threads=1,free=136390560,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [TestFieldCacheSortRandom, TestFieldResource, SolrTestCaseJ4Test, HttpSolrCallGetCoreTest, TestLFUCache, TestUninvertingReader, DistribJoinFromCollectionTest, TestLeaderInitiatedRecoveryThread, TestDocTermOrds, SortByFunctionTest, TestChildDocTransformer, CdcrVersionReplicationTest, TestSolrConfigHandler, PrimitiveFieldTypeTest, QueryElevationComponentTest, DistributedFacetExistsSmallTest, DateFieldTest, BitVectorTest, DisMaxRequestHandlerTest, FieldAnalysisRequestHandlerTest, TestManagedSchemaThreadSafety, InfixSuggestersTest, TestIBSimilarityFactory, TimeZoneUtilsTest, MigrateRouteKeyTest, MoveReplicaHDFSTest, CloneFieldUpdateProcessorFactoryTest, QueryParsingTest, SpatialRPTFieldTypeTest, TestGraphTermsQParserPlugin, AnalysisAfterCoreReloadTest, SoftAutoCommitTest, HdfsNNFailoverTest, TestCursorMarkWithoutUniqueKey, ChaosMonkeySafeLeaderWithPullReplicasTest, ZkStateWriterTest, TestCoreContainer, RecoveryZkTest, TestQuerySenderNoQuery, TestSQLHandler, TestUseDocValuesAsStored, TestSlowCompositeReaderWrapper, TestLMDirichletSimilarityFactory, ReplicationFactorTest, SolrMetricsIntegrationTest, UtilsToolTest, FullHLLTest, DistributedFacetPivotSmallTest, ResponseLogComponentTest, BinaryUpdateRequestHandlerTest, TestFuzzyAnalyzedSuggestions, TestLazyCores, TestSweetSpotSimilarityFactory, TestComplexPhraseQParserPlugin, ClusterStateTest, BlockJoinFacetDistribTest, ClassificationUpdateProcessorIntegrationTest, CoreAdminRequestStatusTest, TestGroupingSearch, TestDynamicLoading, TestConfigSetsAPIExclusivity, TestCollationFieldDocValues, HdfsRecoveryZkTest, TestInitQParser, TestLeaderElectionWithEmptyReplica, TestAuthorizationFramework, TestGraphMLResponseWriter, PeerSyncTest, OverseerModifyCollectionTest, TestSimpleQParserPlugin, TestCloudPivotFacet, AssignBackwardCompatibilityTest, CoreAdminHandlerTest, TestJsonFacetRefinement, TestCorePropertiesReload, TestExportWriter, RequestHandlersTest, TestTlogReplica, TestLockTree, HardAutoCommitTest, UUIDFieldTest, SegmentsInfoRequestHandlerTest, NoCacheHeaderTest, TestManagedSynonymFilterFactory, TestSchemaResource, TestStressInPlaceUpdates, AlternateDirectoryTest, TestCollectionsAPIViaSolrCloudCluster, TestWriterPerf, TestCryptoKeys, TestUpdate, OverseerTest, BlockJoinFacetSimpleTest, TestFieldCacheWithThreads, TestShardHandlerFactory, RemoteQueryErrorTest, SolrJmxReporterTest, DateRangeFieldTest, TestSolrDeletionPolicy2, SuggestComponentContextFilterQueryTest, ScriptEngineTest, TestClusterStateMutator, HighlighterTest, TestReRankQParserPlugin, CoreSorterTest, TestConfigsApi, CircularListTest, AnalyticsMergeStrategyTest, IndexSchemaTest, TestDelegationWithHadoopAuth, MultiTermTest, ZkControllerTest, TestLRUStatsCache, HdfsBasicDistributedZkTest, TestManagedSchema, AnalysisErrorHandlingTest, CollectionReloadTest, OverriddenZkACLAndCredentialsProvidersTest, TestBinaryField, TestOmitPositions, MetricsConfigTest, TestOverriddenPrefixQueryForCustomFieldType, TestSolrConfigHandlerCloud, TestJettySolrRunner, XmlUpdateRequestHandlerTest, CreateCollectionCleanupTest, TestConfigSetProperties, TestReloadDeadlock, TestIntervalFaceting, CdcrReplicationHandlerTest, SimpleMLTQParserTest, SuggesterTest, DefaultValueUpdateProcessorTest, TestFunctionQuery, TestPullReplica, DirectSolrConnectionTest, DistributedDebugComponentTest, TestSolr4Spatial2, WrapperMergePolicyFactoryTest, TestExceedMaxTermLength, SolrCoreTest, TestSort, TestSolrCloudWithDelegationTokens, TestAuthenticationFramework, TestManagedResource, TestShortCircuitedRequests, CdcrBootstrapTest, SimplePostToolTest, TestDFRSimilarityFactory, HighlighterConfigTest, BigEndianAscendingWordDeserializerTest, BlockDirectoryTest, XsltUpdateRequestHandlerTest, CleanupOldIndexTest, MetricUtilsTest, TestIndexingPerformance, TestRandomDVFaceting, TestDefaultStatsCache, LeaderElectionTest, FastVectorHighlighterTest, DistributedSuggestComponentTest, DistributedFacetPivotLongTailTest, ShufflingReplicaListTransformerTest, TestMaxScoreQueryParser, TestPerFieldSimilarityWithDefaultOverride, TestOnReconnectListenerSupport, TestUniqueKeyFieldResource, RequiredFieldsTest, AtomicUpdatesTest, DirectUpdateHandlerOptimizeTest, TestRebalanceLeaders, TestRuleBasedAuthorizationPlugin, ClusterStateUpdateTest, TestExtendedDismaxParser, SubstringBytesRefFilterTest, DistributedVersionInfoTest, PrimUtilsTest, BasicDistributedZkTest, TestSchemaManager, TestUtils, ZkSolrClientTest, TestFaceting, TestHashPartitioner, DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, TestStressReorder, TestStressVersions, SimpleFacetsTest, TestSolr4Spatial, SolrCmdDistributorTest, BadIndexSchemaTest, ConvertedLegacyTest, DirectUpdateHandlerTest, TestBadConfig, DistributedQueryElevationComponentTest, SignatureUpdateProcessorFactoryTest, SuggesterFSTTest, TestFoldingMultitermQuery, TestTrie, SpatialFilterTest, SuggesterWFSTTest, TestCSVLoader, WordBreakSolrSpellCheckerTest, SchemaVersionSpecificBehaviorTest, SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, TestAtomicUpdateErrorCases, TestWordDelimiterFilterFactory, StatelessScriptUpdateProcessorFactoryTest, DistanceFunctionTest, SolrInfoBeanTest, IndexBasedSpellCheckerTest, TestQueryUtils, TestReversedWildcardFilterFactory, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, RegexBoostProcessorTest, ReturnFieldsTest, TestCSVResponseWriter, TestAnalyzedSuggestions, UniqFieldsUpdateProcessorFactoryTest, TestPartialUpdateDeduplication, TestPHPSerializedResponseWriter, CSVRequestHandlerTest, TestQuerySenderListener, UpdateParamsTest, TestStressRecovery, SampleTest, TestDocSet, TestSearchPerf, NumericFieldsTest, MinimalSchemaTest, TestElisionMultitermQuery, OutputWriterTest, TestSolrCoreProperties, NotRequiredUniqueKeyTest, TestLuceneMatchVersion, TestPhraseSuggestions, SpellPossibilityIteratorTest, TestCharFilters, TestCodecSupport, TestXIncludeConfig, EchoParamsTest, TestFastWriter, ResourceLoaderTest, URLClassifyProcessorTest, PluginInfoTest, TestFastLRUCache, DateMathParserTest, ChaosMonkeyNothingIsSafeTest, CollectionsAPIAsyncDistributedZkTest, ConcurrentDeleteAndCreateCollectionTest, ConfigSetsAPITest, CustomCollectionTest, DeleteInactiveReplicaTest, DeleteReplicaTest, DistribCursorPagingTest, HttpPartitionTest, LeaderElectionContextKeyTest, LeaderFailoverAfterPartitionTest, MissingSegmentRecoveryTest, NodeMutatorTest, OverseerCollectionConfigSetProcessorTest, OverseerStatusTest, OverseerTaskQueueTest, RollingRestartTest, SSLMigrationTest, SaslZkACLProviderTest, ShardSplitTest, TestConfigSetsAPIZkFailure, TestDistribDocBasedVersion, TestExclusionRuleCollectionAccess, TestLeaderElectionZkExpiry, TestMiniSolrCloudClusterSSL, TestSolrCloudWithKerberosAlt, TestSolrCloudWithSecureImpersonation, TestStressCloudBlindAtomicUpdates, TestTolerantUpdateProcessorRandomCloud, ZkFailoverTest, BlobRepositoryCloudTest, DirectoryFactoryTest, ExitableDirectoryReaderTest, QueryResultKeyTest, TestBackupRepositoryFactory, TestConfigOverlay, TestConfigSetImmutable, TestInfoStreamLogging, TestNRTOpen, TestSimpleTextCodec, TestSolrXml, TestSolrCloudSnapshots, TestHdfsBackupRestoreCore, TestReplicationHandlerBackup, TestReqParamsAPI, TestSolrConfigHandlerConcurrent, V2ApiIntegrationTest, MetricsHandlerTest, TestApiFramework, TestCollectionAPIs, DistributedQueryComponentCustomSortTest, SuggestComponentTest, TestExpandComponent, TestHttpShardHandlerFactory, TestTrackingShardHandlerFactory, CheckHdfsIndexTest, TestLegacyField, TestLegacyFieldReuse, TestLegacyTerms, TestMultiValuedNumericRangeQuery, TestNumericRangeQuery32, TestNumericTokenStream, SolrCoreMetricManagerTest, SolrGraphiteReporterTest, SolrCloudReportersTest, TestMacroExpander, JSONWriterTest, SmileWriterTest, TestBinaryResponseWriter, TestCustomDocTransformer, TestGeoJSONResponseWriter, TestJavabinTupleStreamParser, TestPushWriter, TestRawTransformer, TestSubQueryTransformer, TestSubQueryTransformerCrossCore, TestManagedResourceStorage, TestRestManager, TestCopyFieldCollectionResource, TestDynamicFieldCollectionResource, TestDynamicFieldResource, TestFieldTypeCollectionResource, TestFieldTypeResource, TestSchemaNameResource, TestSchemaSimilarityResource, TestSchemaVersionResource, TestManagedStopFilterFactory, BadCopyFieldTest, ChangedSchemaMergeTest, CurrencyFieldTypeTest, EnumFieldTest, ManagedSchemaRoundRobinCloudTest, TestHalfAndHalfDocValues, CursorMarkTest, MergeStrategyTest, SortSpecParsingTest, TestAddFieldRealTimeGet, TestCollapseQParserPlugin, TestComplexPhraseLeadingWildcard, TestCustomSort, TestFieldSortValues, TestHashQParserPlugin, TestMultiWordSynonyms, TestPayloadCheckQParserPlugin, TestPayloadScoreQParserPlugin, TestQueryWrapperFilter, TestRandomCollapseQParserPlugin, TestSolrCoreParser, TestStressUserVersions, TestXmlQParser, TestMinMaxOnMultiValuedField, GraphQueryTest, TestScoreJoinQPNoScore, TestScoreJoinQPScore, TestJsonRequest, TestDFISimilarityFactory, TestExactSharedStatsCache, BasicAuthStandaloneTest, TestSolrCloudWithHadoopAuthPlugin, ConjunctionSolrSpellCheckerTest, SpellCheckCollatorWithCollapseTest, TestFileDictionaryLookup, TestHighFrequencyDictionaryFactory, TestFieldCacheReopen, TestNumericTerms32, TestNumericTerms64, SolrIndexMetricsTest, TestDocBasedVersionConstraints, TestInPlaceUpdatesDistrib]
[junit4] Completed [732/732 (1!)] on J0 in 202.24s, 1 test, 1 failure <<< FAILURES!
[...truncated 39074 lines...]