You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2016/10/06 10:29:51 UTC
[JENKINS] Lucene-Solr-6.x-Linux (32bit/jdk1.8.0_102) - Build # 1884
- Failure!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-6.x-Linux/1884/
Java: 32bit/jdk1.8.0_102 -client -XX:+UseSerialGC
6 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CdcrVersionReplicationTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([8C481350F7F063A2]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CdcrVersionReplicationTest
Error Message:
Captured an uncaught exception in thread: Thread[id=7397, name=solr-idle-connections-evictor, state=RUNNABLE, group=TGRP-CdcrVersionReplicationTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=7397, name=solr-idle-connections-evictor, state=RUNNABLE, group=TGRP-CdcrVersionReplicationTest]
Caused by: java.lang.OutOfMemoryError: Java heap space
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CdcrVersionReplicationTest
Error Message:
Captured an uncaught exception in thread: Thread[id=7396, name=solr-idle-connections-evictor, state=RUNNABLE, group=TGRP-CdcrVersionReplicationTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=7396, name=solr-idle-connections-evictor, state=RUNNABLE, group=TGRP-CdcrVersionReplicationTest]
Caused by: java.lang.OutOfMemoryError: Java heap space
at __randomizedtesting.SeedInfo.seed([8C481350F7F063A2]:0)
at org.apache.http.pool.AbstractConnPool.closeExpired(AbstractConnPool.java:558)
at org.apache.http.impl.conn.PoolingClientConnectionManager.closeExpiredConnections(PoolingClientConnectionManager.java:293)
at org.apache.solr.update.UpdateShardHandler$IdleConnectionsEvictor$1.run(UpdateShardHandler.java:188)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CdcrVersionReplicationTest
Error Message:
Captured an uncaught exception in thread: Thread[id=7370, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, group=TGRP-CdcrVersionReplicationTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=7370, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, group=TGRP-CdcrVersionReplicationTest]
Caused by: java.lang.OutOfMemoryError: Java heap space
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CdcrVersionReplicationTest
Error Message:
Captured an uncaught exception in thread: Thread[id=7430, name=solr-idle-connections-evictor, state=RUNNABLE, group=TGRP-CdcrVersionReplicationTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=7430, name=solr-idle-connections-evictor, state=RUNNABLE, group=TGRP-CdcrVersionReplicationTest]
Caused by: java.lang.OutOfMemoryError: Java heap space
FAILED: org.apache.solr.cloud.CdcrVersionReplicationTest.testCdcrDocVersions
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([8C481350F7F063A2]:0)
Build Log:
[...truncated 12801 lines...]
[junit4] Suite: org.apache.solr.cloud.CdcrVersionReplicationTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/init-core-data-001
[junit4] 2> 904001 INFO (SUITE-CdcrVersionReplicationTest-seed#[8C481350F7F063A2]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 904003 INFO (SUITE-CdcrVersionReplicationTest-seed#[8C481350F7F063A2]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 904005 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 904005 INFO (Thread-1893) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 904005 INFO (Thread-1893) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 904105 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.ZkTestServer start zk server on port:34759
[junit4] 2> 904116 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-cdcr.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 904118 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 904121 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 904122 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 904124 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 904125 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 904126 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 904127 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 904129 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 904130 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 904131 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 904136 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCdcrDocVersions
[junit4] 2> 904226 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-001/cores/collection1
[junit4] 2> 904229 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 904230 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@886fbd{/,null,AVAILABLE}
[junit4] 2> 904236 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.e.j.s.ServerConnector Started ServerConnector@1aaee17{SSL,[ssl, http/1.1]}{127.0.0.1:42157}
[junit4] 2> 904236 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.e.j.s.Server Started @905530ms
[junit4] 2> 904236 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard1, hostContext=/, hostPort=42157, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-001/cores}
[junit4] 2> 904237 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.3.0
[junit4] 2> 904237 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 904237 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 904237 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2016-10-06T08:22:30.405Z
[junit4] 2> 904240 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 904240 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-001/solr.xml
[junit4] 2> 904247 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 904248 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34759/solr
[junit4] 2> 904268 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [n:127.0.0.1:42157_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42157_
[junit4] 2> 904269 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [n:127.0.0.1:42157_ ] o.a.s.c.Overseer Overseer (id=96714237554589701-127.0.0.1:42157_-n_0000000000) starting
[junit4] 2> 904275 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [n:127.0.0.1:42157_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42157_
[junit4] 2> 904278 INFO (zkCallback-1287-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 904359 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [n:127.0.0.1:42157_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-001/cores
[junit4] 2> 904359 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [n:127.0.0.1:42157_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 904361 INFO (OverseerStateUpdate-96714237554589701-127.0.0.1:42157_-n_0000000000) [n:127.0.0.1:42157_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 905362 INFO (coreLoadExecutor-3632-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ c:tmp_collection x:collection1] o.a.s.c.ZkController Only one config set found in zk - using it:conf1
[junit4] 2> 905372 WARN (coreLoadExecutor-3632-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ c:tmp_collection x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 905373 INFO (coreLoadExecutor-3632-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ c:tmp_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.3.0
[junit4] 2> 905387 INFO (coreLoadExecutor-3632-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 905465 WARN (coreLoadExecutor-3632-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 905467 INFO (coreLoadExecutor-3632-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 905483 INFO (coreLoadExecutor-3632-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ c:tmp_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection tmp_collection
[junit4] 2> 905483 INFO (coreLoadExecutor-3632-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-001/cores/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-001/cores/collection1/data/]
[junit4] 2> 905483 INFO (coreLoadExecutor-3632-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@282c29
[junit4] 2> 905484 INFO (coreLoadExecutor-3632-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.689606684878425]
[junit4] 2> 905526 INFO (coreLoadExecutor-3632-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
[junit4] 2> 905526 INFO (coreLoadExecutor-3632-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 905526 INFO (coreLoadExecutor-3632-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 905527 INFO (coreLoadExecutor-3632-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 905527 INFO (coreLoadExecutor-3632-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=18, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3555662571539432]
[junit4] 2> 905528 INFO (coreLoadExecutor-3632-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@c27784[collection1] main]
[junit4] 2> 905529 INFO (coreLoadExecutor-3632-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 905529 INFO (coreLoadExecutor-3632-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 905529 INFO (coreLoadExecutor-3632-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 905534 INFO (coreLoadExecutor-3632-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.CdcrBufferStateManager Created znode /collections/tmp_collection/cdcr/state/buffer
[junit4] 2> 905537 INFO (coreLoadExecutor-3632-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.CdcrProcessStateManager Created znode /collections/tmp_collection/cdcr/state/process
[junit4] 2> 905549 INFO (searcherExecutor-3633-thread-1-processing-n:127.0.0.1:42157_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:42157_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@c27784[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 905550 INFO (coreLoadExecutor-3632-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1547427802479853568
[junit4] 2> 905555 INFO (coreZkRegister-3625-thread-1-processing-n:127.0.0.1:42157_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:42157_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 905555 INFO (coreZkRegister-3625-thread-1-processing-n:127.0.0.1:42157_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:42157_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 905555 INFO (coreZkRegister-3625-thread-1-processing-n:127.0.0.1:42157_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:42157_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:42157/collection1/
[junit4] 2> 905556 INFO (coreZkRegister-3625-thread-1-processing-n:127.0.0.1:42157_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:42157_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 905556 INFO (coreZkRegister-3625-thread-1-processing-n:127.0.0.1:42157_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:42157_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:42157/collection1/ has no replicas
[junit4] 2> 905558 INFO (zkCallback-1287-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ tmp_collection:shard2
[junit4] 2> 905559 INFO (coreZkRegister-3625-thread-1-processing-n:127.0.0.1:42157_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:42157_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:42157/collection1/ shard2
[junit4] 2> 905710 INFO (coreZkRegister-3625-thread-1-processing-n:127.0.0.1:42157_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:42157_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 905942 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-002/cores/collection1
[junit4] 2> 905944 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 905945 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1db97e9{/,null,AVAILABLE}
[junit4] 2> 905949 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.e.j.s.ServerConnector Started ServerConnector@1daba70{SSL,[ssl, http/1.1]}{127.0.0.1:33305}
[junit4] 2> 905949 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.e.j.s.Server Started @907242ms
[junit4] 2> 905949 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard2, hostContext=/, hostPort=33305, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-002/cores}
[junit4] 2> 905950 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.3.0
[junit4] 2> 905950 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 905950 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 905950 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2016-10-06T08:22:32.118Z
[junit4] 2> 905952 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 905952 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-002/solr.xml
[junit4] 2> 905959 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 905959 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34759/solr
[junit4] 2> 905965 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [n:127.0.0.1:33305_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 905969 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [n:127.0.0.1:33305_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33305_
[junit4] 2> 905970 INFO (zkCallback-1287-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 905970 INFO (zkCallback-1293-thread-1-processing-n:127.0.0.1:33305_) [n:127.0.0.1:33305_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 906002 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [n:127.0.0.1:33305_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-002/cores
[junit4] 2> 906002 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [n:127.0.0.1:33305_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 906003 INFO (OverseerStateUpdate-96714237554589701-127.0.0.1:42157_-n_0000000000) [n:127.0.0.1:42157_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 907016 WARN (coreLoadExecutor-3644-thread-1-processing-n:127.0.0.1:33305_) [n:127.0.0.1:33305_ c:tmp_collection x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 907017 INFO (coreLoadExecutor-3644-thread-1-processing-n:127.0.0.1:33305_) [n:127.0.0.1:33305_ c:tmp_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.3.0
[junit4] 2> 907030 INFO (coreLoadExecutor-3644-thread-1-processing-n:127.0.0.1:33305_) [n:127.0.0.1:33305_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 907123 WARN (coreLoadExecutor-3644-thread-1-processing-n:127.0.0.1:33305_) [n:127.0.0.1:33305_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 907125 INFO (coreLoadExecutor-3644-thread-1-processing-n:127.0.0.1:33305_) [n:127.0.0.1:33305_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 907141 INFO (coreLoadExecutor-3644-thread-1-processing-n:127.0.0.1:33305_) [n:127.0.0.1:33305_ c:tmp_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection tmp_collection
[junit4] 2> 907142 INFO (coreLoadExecutor-3644-thread-1-processing-n:127.0.0.1:33305_) [n:127.0.0.1:33305_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-002/cores/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-002/cores/collection1/data/]
[junit4] 2> 907142 INFO (coreLoadExecutor-3644-thread-1-processing-n:127.0.0.1:33305_) [n:127.0.0.1:33305_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@282c29
[junit4] 2> 907143 INFO (coreLoadExecutor-3644-thread-1-processing-n:127.0.0.1:33305_) [n:127.0.0.1:33305_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.689606684878425]
[junit4] 2> 907166 INFO (coreLoadExecutor-3644-thread-1-processing-n:127.0.0.1:33305_) [n:127.0.0.1:33305_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
[junit4] 2> 907166 INFO (coreLoadExecutor-3644-thread-1-processing-n:127.0.0.1:33305_) [n:127.0.0.1:33305_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 907167 INFO (coreLoadExecutor-3644-thread-1-processing-n:127.0.0.1:33305_) [n:127.0.0.1:33305_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 907167 INFO (coreLoadExecutor-3644-thread-1-processing-n:127.0.0.1:33305_) [n:127.0.0.1:33305_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 907169 INFO (coreLoadExecutor-3644-thread-1-processing-n:127.0.0.1:33305_) [n:127.0.0.1:33305_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=18, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3555662571539432]
[junit4] 2> 907169 INFO (coreLoadExecutor-3644-thread-1-processing-n:127.0.0.1:33305_) [n:127.0.0.1:33305_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@18ba595[collection1] main]
[junit4] 2> 907170 INFO (coreLoadExecutor-3644-thread-1-processing-n:127.0.0.1:33305_) [n:127.0.0.1:33305_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 907171 INFO (coreLoadExecutor-3644-thread-1-processing-n:127.0.0.1:33305_) [n:127.0.0.1:33305_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 907171 INFO (coreLoadExecutor-3644-thread-1-processing-n:127.0.0.1:33305_) [n:127.0.0.1:33305_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 907173 INFO (searcherExecutor-3645-thread-1-processing-n:127.0.0.1:33305_ x:collection1 s:shard1 c:tmp_collection r:core_node2) [n:127.0.0.1:33305_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@18ba595[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 907173 INFO (coreLoadExecutor-3644-thread-1-processing-n:127.0.0.1:33305_) [n:127.0.0.1:33305_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1547427804181692416
[junit4] 2> 907179 INFO (coreZkRegister-3639-thread-1-processing-n:127.0.0.1:33305_ x:collection1 s:shard1 c:tmp_collection r:core_node2) [n:127.0.0.1:33305_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 907179 INFO (coreZkRegister-3639-thread-1-processing-n:127.0.0.1:33305_ x:collection1 s:shard1 c:tmp_collection r:core_node2) [n:127.0.0.1:33305_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 907179 INFO (coreZkRegister-3639-thread-1-processing-n:127.0.0.1:33305_ x:collection1 s:shard1 c:tmp_collection r:core_node2) [n:127.0.0.1:33305_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:33305/collection1/
[junit4] 2> 907179 INFO (coreZkRegister-3639-thread-1-processing-n:127.0.0.1:33305_ x:collection1 s:shard1 c:tmp_collection r:core_node2) [n:127.0.0.1:33305_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 907179 INFO (coreZkRegister-3639-thread-1-processing-n:127.0.0.1:33305_ x:collection1 s:shard1 c:tmp_collection r:core_node2) [n:127.0.0.1:33305_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:33305/collection1/ has no replicas
[junit4] 2> 907182 INFO (zkCallback-1293-thread-1-processing-n:127.0.0.1:33305_) [n:127.0.0.1:33305_ ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ tmp_collection:shard1
[junit4] 2> 907183 INFO (coreZkRegister-3639-thread-1-processing-n:127.0.0.1:33305_ x:collection1 s:shard1 c:tmp_collection r:core_node2) [n:127.0.0.1:33305_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:33305/collection1/ shard1
[junit4] 2> 907334 INFO (coreZkRegister-3639-thread-1-processing-n:127.0.0.1:33305_ x:collection1 s:shard1 c:tmp_collection r:core_node2) [n:127.0.0.1:33305_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 907594 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-003/cores/collection1
[junit4] 2> 907596 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 907597 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1444940{/,null,AVAILABLE}
[junit4] 2> 907602 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.e.j.s.ServerConnector Started ServerConnector@53bcf2{SSL,[ssl, http/1.1]}{127.0.0.1:40292}
[junit4] 2> 907602 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.e.j.s.Server Started @908895ms
[junit4] 2> 907602 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard3, hostContext=/, hostPort=40292, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-003/cores}
[junit4] 2> 907603 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.3.0
[junit4] 2> 907603 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 907603 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 907603 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2016-10-06T08:22:33.771Z
[junit4] 2> 907605 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 907606 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-003/solr.xml
[junit4] 2> 907611 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 907613 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34759/solr
[junit4] 2> 907621 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [n:127.0.0.1:40292_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 907626 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [n:127.0.0.1:40292_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40292_
[junit4] 2> 907627 INFO (zkCallback-1287-thread-2-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 907627 INFO (zkCallback-1299-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 907627 INFO (zkCallback-1293-thread-1-processing-n:127.0.0.1:33305_) [n:127.0.0.1:33305_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 907668 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [n:127.0.0.1:40292_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-003/cores
[junit4] 2> 907668 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [n:127.0.0.1:40292_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 907669 INFO (OverseerStateUpdate-96714237554589701-127.0.0.1:42157_-n_0000000000) [n:127.0.0.1:42157_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 908681 WARN (coreLoadExecutor-3656-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ c:tmp_collection x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 908681 INFO (coreLoadExecutor-3656-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ c:tmp_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.3.0
[junit4] 2> 908711 INFO (coreLoadExecutor-3656-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 908779 WARN (coreLoadExecutor-3656-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 908781 INFO (coreLoadExecutor-3656-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 908796 INFO (coreLoadExecutor-3656-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ c:tmp_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection tmp_collection
[junit4] 2> 908797 INFO (coreLoadExecutor-3656-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-003/cores/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-003/cores/collection1/data/]
[junit4] 2> 908797 INFO (coreLoadExecutor-3656-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@282c29
[junit4] 2> 908798 INFO (coreLoadExecutor-3656-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.689606684878425]
[junit4] 2> 908840 INFO (coreLoadExecutor-3656-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
[junit4] 2> 908840 INFO (coreLoadExecutor-3656-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 908841 INFO (coreLoadExecutor-3656-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 908841 INFO (coreLoadExecutor-3656-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 908842 INFO (coreLoadExecutor-3656-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=18, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3555662571539432]
[junit4] 2> 908843 INFO (coreLoadExecutor-3656-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1b0c4a[collection1] main]
[junit4] 2> 908843 INFO (coreLoadExecutor-3656-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 908844 INFO (coreLoadExecutor-3656-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 908844 INFO (coreLoadExecutor-3656-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 908846 INFO (searcherExecutor-3657-thread-1-processing-n:127.0.0.1:40292_ x:collection1 s:shard2 c:tmp_collection r:core_node3) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1b0c4a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 908847 INFO (coreLoadExecutor-3656-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1547427805937008640
[junit4] 2> 908852 INFO (coreZkRegister-3651-thread-1-processing-n:127.0.0.1:40292_ x:collection1 s:shard2 c:tmp_collection r:core_node3) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.c.ZkController Core needs to recover:collection1
[junit4] 2> 908852 INFO (updateExecutor-1296-thread-1-processing-n:127.0.0.1:40292_ x:collection1 s:shard2 c:tmp_collection r:core_node3) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 908852 INFO (recoveryExecutor-1297-thread-1-processing-n:127.0.0.1:40292_ x:collection1 s:shard2 c:tmp_collection r:core_node3) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 908853 INFO (recoveryExecutor-1297-thread-1-processing-n:127.0.0.1:40292_ x:collection1 s:shard2 c:tmp_collection r:core_node3) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 908853 INFO (recoveryExecutor-1297-thread-1-processing-n:127.0.0.1:40292_ x:collection1 s:shard2 c:tmp_collection r:core_node3) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1]
[junit4] 2> 908853 INFO (recoveryExecutor-1297-thread-1-processing-n:127.0.0.1:40292_ x:collection1 s:shard2 c:tmp_collection r:core_node3) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 908853 INFO (recoveryExecutor-1297-thread-1-processing-n:127.0.0.1:40292_ x:collection1 s:shard2 c:tmp_collection r:core_node3) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Publishing state of core [collection1] as recovering, leader is [https://127.0.0.1:42157/collection1/] and I am [https://127.0.0.1:40292/collection1/]
[junit4] 2> 908855 INFO (recoveryExecutor-1297-thread-1-processing-n:127.0.0.1:40292_ x:collection1 s:shard2 c:tmp_collection r:core_node3) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Sending prep recovery command to [https://127.0.0.1:42157]; [WaitForState: action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1:40292_&coreNodeName=core_node3&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 908975 INFO (qtp27715329-7389) [n:127.0.0.1:42157_ ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true
[junit4] 2> 908976 INFO (qtp27715329-7389) [n:127.0.0.1:42157_ ] o.a.s.h.a.PrepRecoveryOp Will wait a max of 183 seconds to see collection1 (shard2 of tmp_collection) have state: recovering
[junit4] 2> 908976 INFO (qtp27715329-7389) [n:127.0.0.1:42157_ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=tmp_collection, shard=shard2, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:40292_, coreNodeName=core_node3, onlyIfActiveCheckResult=false, nodeProps: core_node3:{"core":"collection1","base_url":"https://127.0.0.1:40292","node_name":"127.0.0.1:40292_","state":"recovering"}
[junit4] 2> 908976 INFO (qtp27715329-7389) [n:127.0.0.1:42157_ ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true for: 0 seconds.
[junit4] 2> 908976 INFO (qtp27715329-7389) [n:127.0.0.1:42157_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:40292_&onlyIfLeaderActive=true&core=collection1&coreNodeName=core_node3&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 909251 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-004/cores/collection1
[junit4] 2> 909253 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 909254 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1565897{/,null,AVAILABLE}
[junit4] 2> 909258 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.e.j.s.ServerConnector Started ServerConnector@49c15b{SSL,[ssl, http/1.1]}{127.0.0.1:33039}
[junit4] 2> 909259 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.e.j.s.Server Started @910552ms
[junit4] 2> 909259 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard4, hostContext=/, hostPort=33039, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-004/cores}
[junit4] 2> 909259 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 6.3.0
[junit4] 2> 909259 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 909259 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 909259 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2016-10-06T08:22:35.427Z
[junit4] 2> 909262 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 909262 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-004/solr.xml
[junit4] 2> 909270 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 909271 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34759/solr
[junit4] 2> 909279 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [n:127.0.0.1:33039_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 909283 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [n:127.0.0.1:33039_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33039_
[junit4] 2> 909284 INFO (zkCallback-1293-thread-1-processing-n:127.0.0.1:33305_) [n:127.0.0.1:33305_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 909284 INFO (zkCallback-1299-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 909284 INFO (zkCallback-1287-thread-2-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 909285 INFO (zkCallback-1306-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 909323 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [n:127.0.0.1:33039_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-004/cores
[junit4] 2> 909323 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [n:127.0.0.1:33039_ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 909325 INFO (OverseerStateUpdate-96714237554589701-127.0.0.1:42157_-n_0000000000) [n:127.0.0.1:42157_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 910339 WARN (coreLoadExecutor-3667-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ c:tmp_collection x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
[junit4] 2> 910340 INFO (coreLoadExecutor-3667-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ c:tmp_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.3.0
[junit4] 2> 910361 INFO (coreLoadExecutor-3667-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 910486 WARN (coreLoadExecutor-3667-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
[junit4] 2> 910488 INFO (coreLoadExecutor-3667-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ c:tmp_collection x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 910509 INFO (coreLoadExecutor-3667-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ c:tmp_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection tmp_collection
[junit4] 2> 910510 INFO (coreLoadExecutor-3667-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-004/cores/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001/jetty-004/cores/collection1/data/]
[junit4] 2> 910510 INFO (coreLoadExecutor-3667-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@282c29
[junit4] 2> 910512 INFO (coreLoadExecutor-3667-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.689606684878425]
[junit4] 2> 910548 INFO (coreLoadExecutor-3667-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
[junit4] 2> 910548 INFO (coreLoadExecutor-3667-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 910549 INFO (coreLoadExecutor-3667-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 910549 INFO (coreLoadExecutor-3667-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 910550 INFO (coreLoadExecutor-3667-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=18, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3555662571539432]
[junit4] 2> 910551 INFO (coreLoadExecutor-3667-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1d978c8[collection1] main]
[junit4] 2> 910551 INFO (coreLoadExecutor-3667-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 910552 INFO (coreLoadExecutor-3667-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 910553 INFO (coreLoadExecutor-3667-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 910555 INFO (searcherExecutor-3668-thread-1-processing-n:127.0.0.1:33039_ x:collection1 s:shard1 c:tmp_collection r:core_node4) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1d978c8[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 910555 INFO (coreLoadExecutor-3667-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1547427807727976448
[junit4] 2> 910561 INFO (coreZkRegister-3662-thread-1-processing-n:127.0.0.1:33039_ x:collection1 s:shard1 c:tmp_collection r:core_node4) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.c.ZkController Core needs to recover:collection1
[junit4] 2> 910561 INFO (updateExecutor-1303-thread-1-processing-n:127.0.0.1:33039_ x:collection1 s:shard1 c:tmp_collection r:core_node4) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 910561 INFO (recoveryExecutor-1304-thread-1-processing-n:127.0.0.1:33039_ x:collection1 s:shard1 c:tmp_collection r:core_node4) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 910562 INFO (recoveryExecutor-1304-thread-1-processing-n:127.0.0.1:33039_ x:collection1 s:shard1 c:tmp_collection r:core_node4) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 910562 INFO (recoveryExecutor-1304-thread-1-processing-n:127.0.0.1:33039_ x:collection1 s:shard1 c:tmp_collection r:core_node4) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1]
[junit4] 2> 910562 INFO (recoveryExecutor-1304-thread-1-processing-n:127.0.0.1:33039_ x:collection1 s:shard1 c:tmp_collection r:core_node4) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 910562 INFO (recoveryExecutor-1304-thread-1-processing-n:127.0.0.1:33039_ x:collection1 s:shard1 c:tmp_collection r:core_node4) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.c.RecoveryStrategy Publishing state of core [collection1] as recovering, leader is [https://127.0.0.1:33305/collection1/] and I am [https://127.0.0.1:33039/collection1/]
[junit4] 2> 910568 INFO (recoveryExecutor-1304-thread-1-processing-n:127.0.0.1:33039_ x:collection1 s:shard1 c:tmp_collection r:core_node4) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.c.RecoveryStrategy Sending prep recovery command to [https://127.0.0.1:33305]; [WaitForState: action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1:33039_&coreNodeName=core_node4&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 910711 INFO (qtp10524575-7416) [n:127.0.0.1:33305_ ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node4, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true
[junit4] 2> 910712 INFO (qtp10524575-7416) [n:127.0.0.1:33305_ ] o.a.s.h.a.PrepRecoveryOp Will wait a max of 183 seconds to see collection1 (shard1 of tmp_collection) have state: recovering
[junit4] 2> 910712 INFO (qtp10524575-7416) [n:127.0.0.1:33305_ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=tmp_collection, shard=shard1, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:33039_, coreNodeName=core_node4, onlyIfActiveCheckResult=false, nodeProps: core_node4:{"core":"collection1","base_url":"https://127.0.0.1:33039","node_name":"127.0.0.1:33039_","state":"recovering"}
[junit4] 2> 910713 INFO (qtp10524575-7416) [n:127.0.0.1:33305_ ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node4, state: recovering, checkLive: true, onlyIfLeader: true for: 0 seconds.
[junit4] 2> 910713 INFO (qtp10524575-7416) [n:127.0.0.1:33305_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:33039_&onlyIfLeaderActive=true&core=collection1&coreNodeName=core_node4&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1
[junit4] 1> / (2)
[junit4] 1> DATA:
[junit4] 1>
[junit4] 1> /zookeeper (1)
[junit4] 1> DATA:
[junit4] 1>
[junit4] 1> /solr (9)
[junit4] 1> /solr/configs (1)
[junit4] 1> /solr/configs/conf1 (11)
[junit4] 1> /solr/configs/conf1/currency.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/enumsConfig.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/protwords.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/old_synonyms.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/solrconfig.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/synonyms.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/stopwords.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/schema.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/solrconfig.snippet.randomindexconfig.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/open-exchange-rates.json (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "disclaimer": "This data is not real, it was synthetically created to match currency.xml. It is modeled after the data format available from openexchangerates.org. See https://openexchangerates.org/documentation for details
[junit4] 1>
[junit4] 1>
[junit4] 1> IMPORTANT NOTE: In order for tests to work, this data must be kept in sync with ./currency.xml",
[junit4] 1>
[junit4] 1>
[junit4] 1> "license": "http://www.apache.org/licenses/LICENSE-2.0",
[junit4] 1> "timestamp": 1332070464,
[junit4] 1> "base": "USD",
[junit4] 1> "rates": {
[junit4] 1> "USD": 1,
[junit4] 1> "JPY": 81.29,
[junit4] 1> "EUR": 2.5,
[junit4] 1> "GBP": 0.5,
[junit4] 1> "MXN": 2.0
[junit4] 1> }
[junit4] 1> }
[junit4] 1>
[junit4] 1> /solr/overseer (6)
[junit4] 1> DATA:
[junit4] 1>
[junit4] 1> /solr/overseer/collection-queue-work (0)
[junit4] 1> /solr/overseer/queue-work (0)
[junit4] 1> /solr/overseer/collection-map-failure (0)
[junit4] 1> /solr/overseer/collection-map-completed (0)
[junit4] 1> /solr/overseer/queue (0)
[junit4] 1> /solr/overseer/collection-map-running (0)
[junit4] 1> /solr/aliases.json (0)
[junit4] 1> /solr/collections (3)
[junit4] 1> /solr/collections/collection1 (1)
[junit4] 1> DATA:
[junit4] 1> {"configName":"conf1"}
[junit4] 1> /solr/collections/collection1/shards (0)
[junit4] 1> /solr/collections/tmp_collection (3)
[junit4] 1> DATA:
[junit4] 1> {"configName":"conf1"}
[junit4] 1> /solr/collections/tmp_collection/leaders (2)
[junit4] 1> /solr/collections/tmp_collection/leaders/shard2 (1)
[junit4] 1> /solr/collections/tmp_collection/leaders/shard2/leader (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection1",
[junit4] 1> "core_node_name":"core_node1",
[junit4] 1> "base_url":"https://127.0.0.1:42157",
[junit4] 1> "node_name":"127.0.0.1:42157_"}
[junit4] 1> /solr/collections/tmp_collection/leaders/shard1 (1)
[junit4] 1> /solr/collections/tmp_collection/leaders/shard1/leader (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection1",
[junit4] 1> "core_node_name":"core_node2",
[junit4] 1> "base_url":"https://127.0.0.1:33305",
[junit4] 1> "node_name":"127.0.0.1:33305_"}
[junit4] 1> /solr/collections/tmp_collection/cdcr (1)
[junit4] 1> /solr/collections/tmp_collection/cdcr/state (2)
[junit4] 1> /solr/collections/tmp_collection/cdcr/state/process (0)
[junit4] 1> DATA:
[junit4] 1> stopped
[junit4] 1> /solr/collections/tmp_collection/cdcr/state/buffer (0)
[junit4] 1> DATA:
[junit4] 1> enabled
[junit4] 1> /solr/collections/tmp_collection/leader_elect (2)
[junit4] 1> /solr/collections/tmp_collection/leader_elect/shard2 (1)
[junit4] 1> /solr/collections/tmp_collection/leader_elect/shard2/election (2)
[junit4] 1> /solr/collections/tmp_collection/leader_elect/shard2/election/96714237554589707-core_node3-n_0000000001 (0)
[junit4] 1> /solr/collections/tmp_collection/leader_elect/shard2/election/96714237554589701-core_node1-n_0000000000 (0)
[junit4] 1> /solr/collections/tmp_collection/leader_elect/shard1 (1)
[junit4] 1> /solr/collections/tmp_collection/leader_elect/shard1/election (2)
[junit4] 1> /solr/collections/tmp_collection/leader_elect/shard1/election/96714237554589710-core_node4-n_0000000001 (0)
[junit4] 1> /solr/collections/tmp_collection/leader_elect/shard1/election/96714237554589704-core_node2-n_0000000000 (0)
[junit4] 1> /solr/collections/control_collection (1)
[junit4] 1> DATA:
[junit4] 1> {"configName":"conf1"}
[junit4] 1> /solr/collections/control_collection/shards (0)
[junit4] 1> /solr/live_nodes (4)
[junit4] 1> /solr/live_nodes/127.0.0.1:42157_ (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:33039_ (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:33305_ (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:40292_ (0)
[junit4] 1> /solr/overseer_elect (2)
[junit4] 1> /solr/overseer_elect/leader (0)
[junit4] 1> DATA:
[junit4] 1> {"id":"96714237554589701-127.0.0.1:42157_-n_0000000000"}
[junit4] 1> /solr/overseer_elect/election (4)
[junit4] 1> /solr/overseer_elect/election/96714237554589704-127.0.0.1:33305_-n_0000000001 (0)
[junit4] 1> /solr/overseer_elect/election/96714237554589707-127.0.0.1:40292_-n_0000000002 (0)
[junit4] 1> /solr/overseer_elect/election/96714237554589710-127.0.0.1:33039_-n_0000000003 (0)
[junit4] 1> /solr/overseer_elect/election/96714237554589701-127.0.0.1:42157_-n_0000000000 (0)
[junit4] 1> /solr/security.json (0)
[junit4] 1> DATA:
[junit4] 1> {}
[junit4] 1> /solr/clusterstate.json (0)
[junit4] 1> DATA:
[junit4] 1> {"tmp_collection":{
[junit4] 1> "replicationFactor":"1",
[junit4] 1> "router":{"name":"compositeId"},
[junit4] 1> "maxShardsPerNode":"1",
[junit4] 1> "autoAddReplicas":"false",
[junit4] 1> "autoCreated":"true",
[junit4] 1> "shards":{
[junit4] 1> "shard1":{
[junit4] 1> "range":"80000000-ffffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node2":{
[junit4] 1> "core":"collection1",
[junit4] 1> "base_url":"https://127.0.0.1:33305",
[junit4] 1> "node_name":"127.0.0.1:33305_",
[junit4] 1> "state":"active",
[junit4] 1> "leader":"true"},
[junit4] 1> "core_node4":{
[junit4] 1> "core":"collection1",
[junit4] 1> "base_url":"https://127.0.0.1:33039",
[junit4] 1> "node_name":"127.0.0.1:33039_",
[junit4] 1> "state":"recovering"}}},
[junit4] 1> "shard2":{
[junit4] 1> "range":"0-7fffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node1":{
[junit4] 1> "core":"collection1",
[junit4] 1> "base_url":"https://127.0.0.1:42157",
[junit4] 1> "node_name":"127.0.0.1:42157_",
[junit4] 1> "state":"active",
[junit4] 1> "leader":"true"},
[junit4] 1> "core_node3":{
[junit4] 1> "core":"collection1",
[junit4] 1> "base_url":"https://127.0.0.1:40292",
[junit4] 1> "node_name":"127.0.0.1:40292_",
[junit4] 1> "state":"recovering"}}}}}}
[junit4] 1> /solr/clusterprops.json (0)
[junit4] 1> DATA:
[junit4] 1> {"urlScheme":"https"}
[junit4] 1>
[junit4] 1> / (2)
[junit4] 1> DATA:
[junit4] 1>
[junit4] 1> /zookeeper (1)
[junit4] 1> DATA:
[junit4] 1>
[junit4] 1> /solr (9)
[junit4] 1> /solr/configs (1)
[junit4] 1> /solr/configs/conf1 (11)
[junit4] 1> /solr/configs/conf1/currency.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/enumsConfig.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/protwords.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/old_synonyms.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/solrconfig.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/synonyms.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/stopwords.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/schema.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/solrconfig.snippet.randomindexconfig.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/open-exchange-rates.json (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "disclaimer": "This data is not real, it was synthetically created to match currency.xml. It is modeled after the data format available from openexchangerates.org. See https://openexchangerates.org/documentation for details
[junit4] 1>
[junit4] 1>
[junit4] 1> IMPORTANT NOTE: In order for tests to work, this data must be kept in sync with ./currency.xml",
[junit4] 1>
[junit4] 1>
[junit4] 1> "license": "http://www.apache.org/licenses/LICENSE-2.0",
[junit4] 1> "timestamp": 1332070464,
[junit4] 1> "base": "USD",
[junit4] 1> "rates": {
[junit4] 1> "USD": 1,
[junit4] 1> "JPY": 81.29,
[junit4] 1> "EUR": 2.5,
[junit4] 1> "GBP": 0.5,
[junit4] 1> "MXN": 2.0
[junit4] 1> }
[junit4] 1> }
[junit4] 1>
[junit4] 1> /solr/overseer (6)
[junit4] 1> DATA:
[junit4] 1>
[junit4] 1> /solr/overseer/collection-queue-work (0)
[junit4] 1> /solr/overseer/queue-work (0)
[junit4] 1> /solr/overseer/collection-map-failure (0)
[junit4] 1> /solr/overseer/collection-map-completed (0)
[junit4] 1> /solr/overseer/queue (0)
[junit4] 1> /solr/overseer/collection-map-running (0)
[junit4] 1> /solr/aliases.json (0)
[junit4] 1> /solr/collections (3)
[junit4] 1> /solr/collections/collection1 (1)
[junit4] 1> DATA:
[junit4] 1> {"configName":"conf1"}
[junit4] 1> /solr/collections/collection1/shards (0)
[junit4] 1> /solr/collections/tmp_collection (3)
[junit4] 1> DATA:
[junit4] 1> {"configName":"conf1"}
[junit4] 1> /solr/collections/tmp_collection/leaders (2)
[junit4] 1> /solr/collections/tmp_collection/leaders/shard2 (1)
[junit4] 1> /solr/collections/tmp_collection/leaders/shard2/leader (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection1",
[junit4] 1> "core_node_name":"core_node1",
[junit4] 1> "base_url":"https://127.0.0.1:42157",
[junit4] 1> "node_name":"127.0.0.1:42157_"}
[junit4] 1> /solr/collections/tmp_collection/leaders/shard1 (1)
[junit4] 1> /solr/collections/tmp_collection/leaders/shard1/leader (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection1",
[junit4] 1> "core_node_name":"core_node2",
[junit4] 1> "base_url":"https://127.0.0.1:33305",
[junit4] 1> "node_name":"127.0.0.1:33305_"}
[junit4] 1> /solr/collections/tmp_collection/cdcr (1)
[junit4] 1> /solr/collections/tmp_collection/cdcr/state (2)
[junit4] 1> /solr/collections/tmp_collection/cdcr/state/process (0)
[junit4] 1> DATA:
[junit4] 1> stopped
[junit4] 1> /solr/collections/tmp_collection/cdcr/state/buffer (0)
[junit4] 1> DATA:
[junit4] 1> enabled
[junit4] 1> /solr/collections/tmp_collection/leader_elect (2)
[junit4] 1> /solr/collections/tmp_collection/leader_elect/shard2 (1)
[junit4] 1> /solr/collections/tmp_collection/leader_elect/shard2/election (2)
[junit4] 1> /solr/collections/tmp_collection/leader_elect/shard2/election/96714237554589707-core_node3-n_0000000001 (0)
[junit4] 1> /solr/collections/tmp_collection/leader_elect/shard2/election/96714237554589701-core_node1-n_0000000000 (0)
[junit4] 1> /solr/collections/tmp_collection/leader_elect/shard1 (1)
[junit4] 1> /solr/collections/tmp_collection/leader_elect/shard1/election (2)
[junit4] 1> /solr/collections/tmp_collection/leader_elect/shard1/election/96714237554589710-core_node4-n_0000000001 (0)
[junit4] 1> /solr/collections/tmp_collection/leader_elect/shard1/election/96714237554589704-core_node2-n_0000000000 (0)
[junit4] 1> /solr/collections/control_collection (1)
[junit4] 1> DATA:
[junit4] 1> {"configName":"conf1"}
[junit4] 1> /solr/collections/control_collection/shards (0)
[junit4] 1> /solr/live_nodes (4)
[junit4] 1> /solr/live_nodes/127.0.0.1:42157_ (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:33039_ (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:33305_ (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:40292_ (0)
[junit4] 1> /solr/overseer_elect (2)
[junit4] 1> /solr/overseer_elect/leader (0)
[junit4] 1> DATA:
[junit4] 1> {"id":"96714237554589701-127.0.0.1:42157_-n_0000000000"}
[junit4] 1> /solr/overseer_elect/election (4)
[junit4] 1> /solr/overseer_elect/election/96714237554589704-127.0.0.1:33305_-n_0000000001 (0)
[junit4] 1> /solr/overseer_elect/election/96714237554589707-127.0.0.1:40292_-n_0000000002 (0)
[junit4] 1> /solr/overseer_elect/election/96714237554589710-127.0.0.1:33039_-n_0000000003 (0)
[junit4] 1> /solr/overseer_elect/election/96714237554589701-127.0.0.1:42157_-n_0000000000 (0)
[junit4] 1> /solr/security.json (0)
[junit4] 1> DATA:
[junit4] 1> {}
[junit4] 1> /solr/clusterstate.json (0)
[junit4] 1> DATA:
[junit4] 1> {"tmp_collection":{
[junit4] 1> "replicationFactor":"1",
[junit4] 1> "router":{"name":"compositeId"},
[junit4] 1> "maxShardsPerNode":"1",
[junit4] 1> "autoAddReplicas":"false",
[junit4] 1> "autoCreated":"true",
[junit4] 1> "shards":{
[junit4] 1> "shard1":{
[junit4] 1> "range":"80000000-ffffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node2":{
[junit4] 1> "core":"collection1",
[junit4] 1> "base_url":"https://127.0.0.1:33305",
[junit4] 1> "node_name":"127.0.0.1:33305_",
[junit4] 1> "state":"active",
[junit4] 1> "leader":"true"},
[junit4] 1> "core_node4":{
[junit4] 1> "core":"collection1",
[junit4] 1> "base_url":"https://127.0.0.1:33039",
[junit4] 1> "node_name":"127.0.0.1:33039_",
[junit4] 1> "state":"recovering"}}},
[junit4] 1> "shard2":{
[junit4] 1> "range":"0-7fffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node1":{
[junit4] 1> "core":"collection1",
[junit4] 1> "base_url":"https://127.0.0.1:42157",
[junit4] 1> "node_name":"127.0.0.1:42157_",
[junit4] 1> "state":"active",
[junit4] 1> "leader":"true"},
[junit4] 1> "core_node3":{
[junit4] 1> "core":"collection1",
[junit4] 1> "base_url":"https://127.0.0.1:40292",
[junit4] 1> "node_name":"127.0.0.1:40292_",
[junit4] 1> "state":"recovering"}}}}}}
[junit4] 1> /solr/clusterprops.json (0)
[junit4] 1> DATA:
[junit4] 1> {"urlScheme":"https"}
[junit4] 1>
[junit4] 2> 910880 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 910890 INFO (qtp27715329-7388) [n:127.0.0.1:42157_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=tmp_collection&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 910892 INFO (OverseerThreadFactory-3630-thread-1-processing-n:127.0.0.1:42157_) [n:127.0.0.1:42157_ ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
[junit4] 2> 910915 INFO (qtp27715329-7385) [n:127.0.0.1:42157_ ] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@133eded
[junit4] 2> 910915 INFO (qtp10524575-7422) [n:127.0.0.1:33305_ ] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@103f1a
[junit4] 2> 910915 INFO (qtp10524575-7422) [n:127.0.0.1:33305_ ] o.a.s.h.CdcrRequestHandler Solr core is being closed - shutting down CDCR handler @ tmp_collection:shard1
[junit4] 2> 910915 INFO (qtp27715329-7385) [n:127.0.0.1:42157_ ] o.a.s.h.CdcrRequestHandler Solr core is being closed - shutting down CDCR handler @ tmp_collection:shard2
[junit4] 2> 910951 INFO (zkCallback-1306-thread-2-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ tmp_collection:shard1
[junit4] 2> 910952 INFO (qtp10524575-7422) [n:127.0.0.1:33305_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=collection1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=40
[junit4] 2> 910953 INFO (zkCallback-1299-thread-2-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ tmp_collection:shard2
[junit4] 2> 910954 INFO (qtp27715329-7385) [n:127.0.0.1:42157_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=collection1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=40
[junit4] 2> 910956 INFO (zkCallback-1306-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than us - going back into recovery
[junit4] 2> 910957 INFO (zkCallback-1299-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.c.ShardLeaderElectionContext There may be a better leader candidate than us - going back into recovery
[junit4] 2> 910957 INFO (zkCallback-1306-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader parent node, won't remove previous leader registration.
[junit4] 2> 910958 INFO (zkCallback-1299-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader parent node, won't remove previous leader registration.
[junit4] 2> 910959 INFO (zkCallback-1306-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.c.ActionThrottle The last leader attempt started 7ms ago.
[junit4] 2> 910959 INFO (zkCallback-1306-thread-1-processing-n:127.0.0.1:33039_) [n:127.0.0.1:33039_ c:tmp_collection s:shard1 r:core_node4 x:collection1] o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 4992ms
[junit4] 2> 910961 INFO (zkCallback-1299-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.c.ActionThrottle The last leader attempt started 10ms ago.
[junit4] 2> 910961 INFO (zkCallback-1299-thread-1-processing-n:127.0.0.1:40292_) [n:127.0.0.1:40292_ c:tmp_collection s:shard2 r:core_node3 x:collection1] o.a.s.c.ActionThrottle Throttling leader attempts - waiting for 4989ms
[junit4] 2> 911046 WARN (qtp8729288-7446) [n:127.0.0.1:40292_ ] o.a.s.c.RecoveryStrategy Stopping recovery for core=[collection1] coreNodeName=[core_node3]
[junit4] 2> 911046 INFO (qtp8729288-7446) [n:127.0.0.1:40292_ ] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 911058 WARN (qtp12692482-7480) [n:127.0.0.1:33039_ ] o.a.s.c.RecoveryStrategy Stopping recovery for core=[collection1] coreNodeName=[core_node4]
[junit4] 2> 911058 INFO (qtp12692482-7480) [n:127.0.0.1:33039_ ] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 911146 INFO (qtp8729288-7446) [n:127.0.0.1:40292_ ] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 911158 INFO (qtp12692482-7480) [n:127.0.0.1:33039_ ] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 911246 INFO (qtp8729288-7446) [n:127.0.0.1:40292_ ] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 911258 INFO (qtp12692482-7480) [n:127.0.0.1:33039_ ] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 911347 INFO (qtp8729288-7446) [n:127.0.0.1:40292_ ] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 911358 INFO (qtp12692482-7480) [n:127.0.0.1:33039_ ] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 911447 INFO (qtp8729288-7446) [n:127.0.0.1:40292_ ] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 911458 INFO (qtp12692482-7480) [n:127.0.0.1:33039_ ] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 911547 INFO (qtp8729288-7446) [n:127.0.0.1:40292_ ] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 911558 INFO (qtp12692482-7480) [n:127.0.0.1:33039_ ] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 911647 INFO (qtp8729288-7446) [n:127.0.0.1:40292_ ] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 911659 INFO (qtp12692482-7480) [n:127.0.0.1:33039_ ] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 911747 INFO (qtp8729288-7446) [n:127.0.0.1:40292_ ] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 911759 INFO (qtp12692482-7480) [n:127.0.0.1:33039_ ] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 911848 INFO (qtp8729288-7446) [n:127.0.0.1:40292_ ] o.a.s.c.SolrCore Core collection1
[...truncated too long message...]
ava:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 8130004 ERROR (zkCallback-1306-thread-6-processing-n:127.0.0.1:33039_-EventThread) [n:127.0.0.1:33039_ ] o.a.z.ClientCnxn Event thread exiting due to interruption
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2048)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
[junit4] 2> 8130004 WARN (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.ZkController Could not publish node as down: java.lang.InterruptedException
[junit4] 2> 8130035 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@49c15b{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 8130035 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1565897{/,null,UNAVAILABLE}
[junit4] 2> 8130063 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testCdcrDocVersions
[junit4] 2> 8130064 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[8C481350F7F063A2]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34759 34759
[junit4] 2> 8130114 INFO (SUITE-CdcrVersionReplicationTest-seed#[8C481350F7F063A2]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrVersionReplicationTest_8C481350F7F063A2-001
[junit4] 2> Oct 06, 2016 10:22:56 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: All leaked threads terminated.
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {}, docValues:{}, maxPointsInLeafNode=624, maxMBSortInHeap=5.395726055489867, sim=RandomSimilarity(queryNorm=false,coord=yes): {}, locale=be, timezone=America/Thunder_Bay
[junit4] 2> NOTE: Linux 4.4.0-36-generic i386/Oracle Corporation 1.8.0_102 (32-bit)/cpus=12,threads=1,free=270574664,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [AlternateDirectoryTest, BJQParserTest, TestTolerantUpdateProcessorCloud, TestDefaultSearchFieldResource, TestCloudDeleteByQuery, TestSolrQueryResponse, TestFastWriter, TestFunctionQuery, TestScoreJoinQPScore, RuleEngineTest, RequiredFieldsTest, CreateCollectionCleanupTest, TestShardHandlerFactory, TestRemoteStreaming, SolrCloudExampleTest, XsltUpdateRequestHandlerTest, TestFastLRUCache, TestSolr4Spatial, ZkStateReaderTest, TestMinMaxOnMultiValuedField, HighlighterConfigTest, BigEndianAscendingWordDeserializerTest, DistributedFacetExistsSmallTest, TestQuerySenderNoQuery, HighlighterMaxOffsetTest, OverseerTaskQueueTest, CoreAdminCreateDiscoverTest, TestFieldCollectionResource, ConcurrentDeleteAndCreateCollectionTest, StatsReloadRaceTest, TestAtomicUpdateErrorCases, BlockJoinFacetSimpleTest, ZkNodePropsTest, TestUseDocValuesAsStored, SimpleMLTQParserTest, TestHighFrequencyDictionaryFactory, FastVectorHighlighterTest, TestCodecSupport, TestDynamicLoading, TestJoin, TestShortCircuitedRequests, LeaderElectionIntegrationTest, TriLevelCompositeIdRoutingTest, DocExpirationUpdateProcessorFactoryTest, TestOverriddenPrefixQueryForCustomFieldType, TestManagedStopFilterFactory, TestBlobHandler, TestBinaryResponseWriter, DistribDocExpirationUpdateProcessorTest, InfoHandlerTest, SyncSliceTest, SolrRequestParserTest, TestStandardQParsers, TestPivotHelperCode, DocumentAnalysisRequestHandlerTest, CurrencyFieldOpenExchangeTest, TestHdfsCloudBackupRestore, BooleanFieldTest, TestNumericTerms32, TestDocSet, TestStressLucene, TestSmileRequest, ActionThrottleTest, ScriptEngineTest, TestReplicationHandler, DistributedSpellCheckComponentTest, SignatureUpdateProcessorFactoryTest, AddBlockUpdateTest, TestMacros, TestLockTree, BufferStoreTest, TestSQLHandler, TestSolrCoreProperties, DistributedQueryComponentCustomSortTest, TestRandomDVFaceting, RestartWhileUpdatingTest, TestComponentsName, SuggestComponentTest, HLLUtilTest, TestMiniSolrCloudClusterSSL, TestBlendedInfixSuggestions, CollectionTooManyReplicasTest, TestFieldCacheSanityChecker, TestDocTermOrds, DistributedVersionInfoTest, BasicDistributedZkTest, RegexBoostProcessorTest, TestGraphTermsQParserPlugin, TestFaceting, CdcrReplicationDistributedZkTest, CdcrVersionReplicationTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CdcrVersionReplicationTest -Dtests.seed=8C481350F7F063A2 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=be -Dtests.timezone=America/Thunder_Bay -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.00s J0 | CdcrVersionReplicationTest (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([8C481350F7F063A2]:0)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=7397, name=solr-idle-connections-evictor, state=RUNNABLE, group=TGRP-CdcrVersionReplicationTest]
[junit4] > Caused by: java.lang.OutOfMemoryError: Java heap spaceThrowable #3: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=7396, name=solr-idle-connections-evictor, state=RUNNABLE, group=TGRP-CdcrVersionReplicationTest]
[junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] > at __randomizedtesting.SeedInfo.seed([8C481350F7F063A2]:0)
[junit4] > at org.apache.http.pool.AbstractConnPool.closeExpired(AbstractConnPool.java:558)
[junit4] > at org.apache.http.impl.conn.PoolingClientConnectionManager.closeExpiredConnections(PoolingClientConnectionManager.java:293)
[junit4] > at org.apache.solr.update.UpdateShardHandler$IdleConnectionsEvictor$1.run(UpdateShardHandler.java:188)
[junit4] > at java.lang.Thread.run(Thread.java:745)Throwable #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=7370, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, group=TGRP-CdcrVersionReplicationTest]
[junit4] > Caused by: java.lang.OutOfMemoryError: Java heap spaceThrowable #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=7430, name=solr-idle-connections-evictor, state=RUNNABLE, group=TGRP-CdcrVersionReplicationTest]
[junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space
[junit4] Completed [629/637 (1!)] on J0 in 7226.15s, 1 test, 6 errors <<< FAILURES!
[...truncated 25 lines...]
[junit4] JVM J0: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-6.x-Linux/solr/build/solr-core/test/temp/junit4-J0-20161006_080724_790.sysout
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] java.lang.OutOfMemoryError: Java heap space
[junit4] Dumping heap to /home/jenkins/workspace/Lucene-Solr-6.x-Linux/heapdumps/java_pid23863.hprof ...
[junit4] Heap dump file created [558422802 bytes in 25.452 secs]
[junit4] <<< JVM J0: EOF ----
[...truncated 11051 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-6.x-Linux/build.xml:763: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-6.x-Linux/build.xml:715: Some of the tests produced a heap dump, but did not fail. Maybe a suppressed OutOfMemoryError? Dumps created:
* java_pid23863.hprof
Total time: 172 minutes 39 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any