You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2015/05/10 22:27:08 UTC
[JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 843 - Still
Failing
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/843/
1 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test
Error Message:
shard2 is not consistent. Got 999 from http://127.0.0.1:21065/ku_evu/collection1lastClient and got 679 from http://127.0.0.1:21105/ku_evu/collection1
Stack Trace:
java.lang.AssertionError: shard2 is not consistent. Got 999 from http://127.0.0.1:21065/ku_evu/collection1lastClient and got 679 from http://127.0.0.1:21105/ku_evu/collection1
at __randomizedtesting.SeedInfo.seed([74A355EF9CAA9D35:FCF76A353256F0CD]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1293)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1272)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test(ChaosMonkeySafeLeaderTest.java:174)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10244 lines...]
[junit4] JVM J1: stdout was not empty, see: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/temp/junit4-J1-20150510_184710_997.sysout
[junit4] >>> JVM J1: stdout (verbatim) ----
[junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] Dumping heap to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/heapdumps/java_pid50420.hprof ...
[junit4] Heap dump file created [513651532 bytes in 4.544 secs]
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J1: stderr was not empty, see: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/temp/junit4-J1-20150510_184710_997.syserr
[junit4] >>> JVM J1: stderr (verbatim) ----
[junit4] WARN: Unhandled exception in event serialization. -> java.lang.OutOfMemoryError: GC overhead limit exceeded
[junit4] <<< JVM J1: EOF ----
[...truncated 434 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/init-core-data-001
[junit4] 2> 1071072 T7177 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
[junit4] 2> 1071072 T7177 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /ku_evu/
[junit4] 2> 1071080 T7177 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1071081 T7178 oasc.ZkTestServer$2$1.setClientPort client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1071081 T7178 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1071181 T7177 oasc.ZkTestServer.run start zk server on port:54735
[junit4] 2> 1071182 T7177 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1071183 T7177 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1071187 T7185 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5c5bb641 name:ZooKeeperConnection Watcher:127.0.0.1:54735 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1071187 T7177 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1071188 T7177 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1071188 T7177 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1071190 T7177 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1071191 T7177 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1071192 T7188 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@35b64f4a name:ZooKeeperConnection Watcher:127.0.0.1:54735/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1071192 T7177 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1071193 T7177 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1071193 T7177 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1071194 T7177 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1071195 T7177 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1071197 T7177 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1071198 T7177 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1071198 T7177 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1071200 T7177 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1071201 T7177 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1071304 T7177 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1071305 T7177 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1071306 T7177 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1071307 T7177 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1071309 T7177 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1071309 T7177 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1071311 T7177 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1071311 T7177 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1071313 T7177 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1071314 T7177 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1071315 T7177 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1071316 T7177 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1071317 T7177 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1071318 T7177 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1071320 T7177 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1071320 T7177 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1071322 T7177 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1071322 T7177 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1072789 T7177 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/control-001/cores/collection1
[junit4] 2> 1072794 T7177 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 1072796 T7177 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@809f9a3{/ku_evu,null,AVAILABLE}
[junit4] 2> 1072799 T7177 oejs.AbstractConnector.doStart Started ServerConnector@1dc62383{HTTP/1.1}{127.0.0.1:61443}
[junit4] 2> 1072799 T7177 oejs.Server.doStart Started @1077616ms
[junit4] 2> 1072799 T7177 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostPort=61443, hostContext=/ku_evu, solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/tempDir-001/control/data, coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/control-001/cores}
[junit4] 2> 1072800 T7177 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@17072b90
[junit4] 2> 1072801 T7177 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/control-001/'
[junit4] 2> 1072853 T7177 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/control-001/solr.xml
[junit4] 2> 1072921 T7177 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/control-001/cores
[junit4] 2> 1072922 T7177 oasc.CoreContainer.<init> New CoreContainer 523123630
[junit4] 2> 1072922 T7177 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/control-001/]
[junit4] 2> 1072923 T7177 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/control-001/lib
[junit4] 2> 1072924 T7177 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/control-001/lib).
[junit4] 2> 1072937 T7177 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1072946 T7177 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1072947 T7177 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1072948 T7177 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1072948 T7177 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 1072948 T7177 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54735/solr
[junit4] 2> 1072949 T7177 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1072949 T7177 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1072950 T7177 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1072952 T7202 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a10a0c8 name:ZooKeeperConnection Watcher:127.0.0.1:54735 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1072953 T7177 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1072953 T7177 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1072955 T7177 n:127.0.0.1:61443_ku_evu oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1072956 T7205 n:127.0.0.1:61443_ku_evu oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13288ad9 name:ZooKeeperConnection Watcher:127.0.0.1:54735/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1072956 T7177 n:127.0.0.1:61443_ku_evu oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1072958 T7177 n:127.0.0.1:61443_ku_evu oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1072959 T7177 n:127.0.0.1:61443_ku_evu oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1072961 T7177 n:127.0.0.1:61443_ku_evu oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 1072962 T7177 n:127.0.0.1:61443_ku_evu oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 1072964 T7177 n:127.0.0.1:61443_ku_evu oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 1072965 T7177 n:127.0.0.1:61443_ku_evu oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1072967 T7177 n:127.0.0.1:61443_ku_evu oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1072968 T7177 n:127.0.0.1:61443_ku_evu oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1072968 T7177 n:127.0.0.1:61443_ku_evu oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:61443_ku_evu
[junit4] 2> 1072969 T7177 n:127.0.0.1:61443_ku_evu oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:61443_ku_evu
[junit4] 2> 1072970 T7177 n:127.0.0.1:61443_ku_evu oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1072971 T7177 n:127.0.0.1:61443_ku_evu oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1072972 T7177 n:127.0.0.1:61443_ku_evu oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1072974 T7177 n:127.0.0.1:61443_ku_evu oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:61443_ku_evu
[junit4] 2> 1072974 T7177 n:127.0.0.1:61443_ku_evu oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1072975 T7177 n:127.0.0.1:61443_ku_evu oasc.Overseer.start Overseer (id=93800674560245763-127.0.0.1:61443_ku_evu-n_0000000000) starting
[junit4] 2> 1072977 T7177 n:127.0.0.1:61443_ku_evu oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1072981 T7177 n:127.0.0.1:61443_ku_evu oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1072982 T7207 n:127.0.0.1:61443_ku_evu oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1072982 T7177 n:127.0.0.1:61443_ku_evu oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1072982 T7206 n:127.0.0.1:61443_ku_evu oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1072986 T7177 n:127.0.0.1:61443_ku_evu oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/control-001/cores
[junit4] 2> 1072990 T7177 n:127.0.0.1:61443_ku_evu oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {name=collection1, config=solrconfig.xml, transient=false, loadOnStartup=true, schema=schema.xml, shard=, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/control-001/cores/collection1, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/control-001/cores/collection1/, dataDir=data/, collection=control_collection, coreNodeName=}
[junit4] 2> 1072990 T7177 n:127.0.0.1:61443_ku_evu oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/control-001/cores/collection1/
[junit4] 2> 1072990 T7177 n:127.0.0.1:61443_ku_evu oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1072991 T7209 n:127.0.0.1:61443_ku_evu c:control_collection x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 1072991 T7209 n:127.0.0.1:61443_ku_evu c:control_collection x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1072992 T7209 n:127.0.0.1:61443_ku_evu oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1072992 T7205 n:127.0.0.1:61443_ku_evu oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1072993 T7206 n:127.0.0.1:61443_ku_evu oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "state":"down",
[junit4] 2> "numShards":"1",
[junit4] 2> "shard":null,
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:61443/ku_evu",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "node_name":"127.0.0.1:61443_ku_evu",
[junit4] 2> "core":"collection1"} current state version: 0
[junit4] 2> 1072994 T7206 n:127.0.0.1:61443_ku_evu oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "state":"down",
[junit4] 2> "numShards":"1",
[junit4] 2> "shard":null,
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:61443/ku_evu",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "node_name":"127.0.0.1:61443_ku_evu",
[junit4] 2> "core":"collection1"}
[junit4] 2> 1072994 T7206 n:127.0.0.1:61443_ku_evu oasco.ClusterStateMutator.createCollection building a new cName: control_collection
[junit4] 2> 1072994 T7206 n:127.0.0.1:61443_ku_evu oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1072995 T7205 n:127.0.0.1:61443_ku_evu oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1073993 T7209 n:127.0.0.1:61443_ku_evu oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1073994 T7209 n:127.0.0.1:61443_ku_evu oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 1073994 T7209 n:127.0.0.1:61443_ku_evu oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1073994 T7209 n:127.0.0.1:61443_ku_evu oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1073995 T7209 n:127.0.0.1:61443_ku_evu oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1073995 T7209 n:127.0.0.1:61443_ku_evu oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/control-001/cores/collection1/'
[junit4] 2> 1074010 T7209 n:127.0.0.1:61443_ku_evu oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 1074018 T7209 n:127.0.0.1:61443_ku_evu oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 1074052 T7209 n:127.0.0.1:61443_ku_evu oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 1074089 T7209 n:127.0.0.1:61443_ku_evu oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1074191 T7209 n:127.0.0.1:61443_ku_evu oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1074198 T7209 n:127.0.0.1:61443_ku_evu oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1074461 T7209 n:127.0.0.1:61443_ku_evu oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1074463 T7209 n:127.0.0.1:61443_ku_evu oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1074465 T7209 n:127.0.0.1:61443_ku_evu oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1074468 T7209 n:127.0.0.1:61443_ku_evu oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1074478 T7209 n:127.0.0.1:61443_ku_evu oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1074479 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1074512 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 1074513 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@24c560f1
[junit4] 2> 1074514 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/control-001/cores/collection1/data
[junit4] 2> 1074515 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/control-001/cores/collection1/data/index/
[junit4] 2> 1074515 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1074516 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/control-001/cores/collection1/data/index
[junit4] 2> 1074516 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=16, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8162448688378181]
[junit4] 2> 1074549 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/control-001/cores/collection1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1074550 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1074554 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1074554 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1074554 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1074555 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1074555 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1074555 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1074555 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1074556 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1074556 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1074570 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1074572 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1074573 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1074575 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1074579 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/luke,/replication,standard,/admin/logging,/update,/admin/plugins,/admin/segments,/admin/system,/update/json,/admin/threads,/schema,/admin/mbeans,/update/json/docs,/admin/properties,/get,/admin/ping,/config,/update/csv,/admin/file
[junit4] 2> 1074580 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1074581 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1074581 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
[junit4] 2> 1074582 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1074582 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1074583 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=39.38671875, floorSegmentMB=1.412109375, forceMergeDeletesPctAllowed=3.2377046302334844, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8722497498394539
[junit4] 2> 1074584 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/control-001/cores/collection1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1074584 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1074584 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@7ee368eb[collection1] main
[junit4] 2> 1074584 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1074585 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1074585 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1074585 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1074586 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1074586 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1074586 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1074586 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1074587 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1074587 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 1074587 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasc.ZkController.getConfDirListeners watch zkdir /configs/conf1
[junit4] 2> 1074588 T7210 n:127.0.0.1:61443_ku_evu x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7ee368eb[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1074588 T7209 n:127.0.0.1:61443_ku_evu x:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1074589 T7213 n:127.0.0.1:61443_ku_evu c:control_collection s:shard1 x:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:61443/ku_evu collection:control_collection shard:shard1
[junit4] 2> 1074589 T7177 n:127.0.0.1:61443_ku_evu oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0
[junit4] 2> 1074589 T7177 n:127.0.0.1:61443_ku_evu oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1074589 T7213 n:127.0.0.1:61443_ku_evu c:control_collection s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1074591 T7177 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1074591 T7177 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1074592 T7216 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e5eb3a4 name:ZooKeeperConnection Watcher:127.0.0.1:54735/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1074592 T7213 n:127.0.0.1:61443_ku_evu c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1074592 T7177 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1074593 T7177 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1074593 T7177 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1074593 T7205 n:127.0.0.1:61443_ku_evu oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1074594 T7213 n:127.0.0.1:61443_ku_evu c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1074594 T7213 n:127.0.0.1:61443_ku_evu c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C3567 name=collection1 org.apache.solr.core.SolrCore@6db47a55 url=http://127.0.0.1:61443/ku_evu/collection1 node=127.0.0.1:61443_ku_evu C3567_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:61443/ku_evu, node_name=127.0.0.1:61443_ku_evu, core=collection1}
[junit4] 2> 1074594 T7213 n:127.0.0.1:61443_ku_evu c:control_collection s:shard1 x:collection1 C3567 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:61443/ku_evu/collection1/
[junit4] 2> 1074594 T7206 n:127.0.0.1:61443_ku_evu oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 1074594 T7213 n:127.0.0.1:61443_ku_evu c:control_collection s:shard1 x:collection1 C3567 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1074594 T7213 n:127.0.0.1:61443_ku_evu c:control_collection s:shard1 x:collection1 C3567 oasc.SyncStrategy.syncToMe http://127.0.0.1:61443/ku_evu/collection1/ has no replicas
[junit4] 2> 1074595 T7213 n:127.0.0.1:61443_ku_evu c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:61443/ku_evu/collection1/ shard1
[junit4] 2> 1074595 T7213 n:127.0.0.1:61443_ku_evu c:control_collection s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1074595 T7177 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1074595 T7216 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1074595 T7205 n:127.0.0.1:61443_ku_evu oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1074598 T7205 n:127.0.0.1:61443_ku_evu oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1074599 T7206 n:127.0.0.1:61443_ku_evu oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:61443/ku_evu",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 2
[junit4] 2> 1074701 T7205 n:127.0.0.1:61443_ku_evu oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1074701 T7216 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1074751 T7213 n:127.0.0.1:61443_ku_evu c:control_collection s:shard1 x:collection1 oasc.ZkController.register We are http://127.0.0.1:61443/ku_evu/collection1/ and leader is http://127.0.0.1:61443/ku_evu/collection1/
[junit4] 2> 1074752 T7213 n:127.0.0.1:61443_ku_evu c:control_collection s:shard1 x:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:61443/ku_evu
[junit4] 2> 1074752 T7213 n:127.0.0.1:61443_ku_evu c:control_collection s:shard1 x:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1074752 T7213 n:127.0.0.1:61443_ku_evu c:control_collection s:shard1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 1074752 T7213 n:127.0.0.1:61443_ku_evu c:control_collection s:shard1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1074754 T7205 n:127.0.0.1:61443_ku_evu oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1074755 T7206 n:127.0.0.1:61443_ku_evu oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "state":"active",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:61443/ku_evu",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "node_name":"127.0.0.1:61443_ku_evu",
[junit4] 2> "core":"collection1"} current state version: 3
[junit4] 2> 1074755 T7206 n:127.0.0.1:61443_ku_evu oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "state":"active",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:61443/ku_evu",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "node_name":"127.0.0.1:61443_ku_evu",
[junit4] 2> "core":"collection1"}
[junit4] 2> 1074858 T7205 n:127.0.0.1:61443_ku_evu oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1074858 T7216 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1075756 T7177 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-1-001/cores/collection1
[junit4] 2> 1075758 T7177 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 in directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-1-001
[junit4] 2> 1075759 T7177 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 1075761 T7177 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@42434f34{/ku_evu,null,AVAILABLE}
[junit4] 2> 1075761 T7177 oejs.AbstractConnector.doStart Started ServerConnector@1f7ea8e6{HTTP/1.1}{127.0.0.1:20931}
[junit4] 2> 1075762 T7177 oejs.Server.doStart Started @1080579ms
[junit4] 2> 1075762 T7177 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-1-001/cores, hostPort=20931, hostContext=/ku_evu}
[junit4] 2> 1075762 T7177 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@17072b90
[junit4] 2> 1075763 T7177 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-1-001/'
[junit4] 2> 1075797 T7177 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-1-001/solr.xml
[junit4] 2> 1075841 T7177 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-1-001/cores
[junit4] 2> 1075841 T7177 oasc.CoreContainer.<init> New CoreContainer 1962055623
[junit4] 2> 1075841 T7177 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-1-001/]
[junit4] 2> 1075841 T7177 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-1-001/lib
[junit4] 2> 1075842 T7177 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-1-001/lib).
[junit4] 2> 1075853 T7177 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1075859 T7177 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1075860 T7177 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1075860 T7177 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1075861 T7177 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 1075861 T7177 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54735/solr
[junit4] 2> 1075861 T7177 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1075861 T7177 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1075862 T7177 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1075863 T7230 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6815492e name:ZooKeeperConnection Watcher:127.0.0.1:54735 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1075864 T7177 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1075864 T7177 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1075866 T7177 n:127.0.0.1:20931_ku_evu oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1075867 T7233 n:127.0.0.1:20931_ku_evu oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@336623a7 name:ZooKeeperConnection Watcher:127.0.0.1:54735/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1075867 T7177 n:127.0.0.1:20931_ku_evu oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1075870 T7177 n:127.0.0.1:20931_ku_evu oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1076873 T7177 n:127.0.0.1:20931_ku_evu oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:20931_ku_evu
[junit4] 2> 1076873 T7177 n:127.0.0.1:20931_ku_evu oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:20931_ku_evu
[junit4] 2> 1076876 T7177 n:127.0.0.1:20931_ku_evu oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1076878 T7177 n:127.0.0.1:20931_ku_evu oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-1-001/cores
[junit4] 2> 1076882 T7177 n:127.0.0.1:20931_ku_evu oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-1-001/cores/collection1/, name=collection1, loadOnStartup=true, collection=collection1, coreNodeName=, schema=schema.xml, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-1-001/cores/collection1, shard=, config=solrconfig.xml, dataDir=data/, transient=false}
[junit4] 2> 1076882 T7177 n:127.0.0.1:20931_ku_evu oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-1-001/cores/collection1/
[junit4] 2> 1076882 T7177 n:127.0.0.1:20931_ku_evu oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1076883 T7234 n:127.0.0.1:20931_ku_evu c:collection1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1076884 T7234 n:127.0.0.1:20931_ku_evu c:collection1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1076884 T7234 n:127.0.0.1:20931_ku_evu oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1076884 T7205 n:127.0.0.1:61443_ku_evu oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1076885 T7206 n:127.0.0.1:61443_ku_evu oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "state":"down",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":null,
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:20931/ku_evu",
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:20931_ku_evu",
[junit4] 2> "core":"collection1"} current state version: 4
[junit4] 2> 1076886 T7206 n:127.0.0.1:61443_ku_evu oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "state":"down",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":null,
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:20931/ku_evu",
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:20931_ku_evu",
[junit4] 2> "core":"collection1"}
[junit4] 2> 1076886 T7206 n:127.0.0.1:61443_ku_evu oasco.ClusterStateMutator.createCollection building a new cName: collection1
[junit4] 2> 1076886 T7206 n:127.0.0.1:61443_ku_evu oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard2
[junit4] 2> 1076887 T7216 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1076887 T7233 n:127.0.0.1:20931_ku_evu oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1076887 T7205 n:127.0.0.1:61443_ku_evu oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1077885 T7234 n:127.0.0.1:20931_ku_evu oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1077886 T7234 n:127.0.0.1:20931_ku_evu oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1077886 T7234 n:127.0.0.1:20931_ku_evu oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1077886 T7234 n:127.0.0.1:20931_ku_evu oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1077887 T7234 n:127.0.0.1:20931_ku_evu oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1077887 T7234 n:127.0.0.1:20931_ku_evu oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-1-001/cores/collection1/'
[junit4] 2> 1077903 T7234 n:127.0.0.1:20931_ku_evu oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 1077911 T7234 n:127.0.0.1:20931_ku_evu oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 1077928 T7234 n:127.0.0.1:20931_ku_evu oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 1077965 T7234 n:127.0.0.1:20931_ku_evu oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1078067 T7234 n:127.0.0.1:20931_ku_evu oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1078075 T7234 n:127.0.0.1:20931_ku_evu oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1078386 T7234 n:127.0.0.1:20931_ku_evu oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1078389 T7234 n:127.0.0.1:20931_ku_evu oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1078390 T7234 n:127.0.0.1:20931_ku_evu oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1078395 T7234 n:127.0.0.1:20931_ku_evu oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1078410 T7234 n:127.0.0.1:20931_ku_evu oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1078410 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1078412 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-1-001/cores/collection1/], dataDir=[null]
[junit4] 2> 1078412 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@24c560f1
[junit4] 2> 1078414 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-1-001/cores/collection1/data
[junit4] 2> 1078415 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-1-001/cores/collection1/data/index/
[junit4] 2> 1078416 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1078416 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-1-001/cores/collection1/data/index
[junit4] 2> 1078417 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=16, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8162448688378181]
[junit4] 2> 1078424 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-1-001/cores/collection1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1078424 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1078429 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1078429 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1078430 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1078430 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1078430 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1078430 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1078431 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1078431 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1078431 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1078446 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1078448 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1078450 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1078451 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1078458 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/luke,/replication,standard,/admin/logging,/update,/admin/plugins,/admin/segments,/admin/system,/update/json,/admin/threads,/schema,/admin/mbeans,/update/json/docs,/admin/properties,/get,/admin/ping,/config,/update/csv,/admin/file
[junit4] 2> 1078460 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1078460 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1078460 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
[junit4] 2> 1078461 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1078461 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1078463 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=39.38671875, floorSegmentMB=1.412109375, forceMergeDeletesPctAllowed=3.2377046302334844, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8722497498394539
[junit4] 2> 1078464 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-1-001/cores/collection1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1078464 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1078464 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@2e37ec81[collection1] main
[junit4] 2> 1078464 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1078465 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1078465 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1078466 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1078466 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1078466 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1078467 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1078467 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1078467 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1078467 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 1078468 T7235 n:127.0.0.1:20931_ku_evu x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2e37ec81[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1078468 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasc.ZkController.getConfDirListeners watch zkdir /configs/conf1
[junit4] 2> 1078469 T7234 n:127.0.0.1:20931_ku_evu x:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1078470 T7238 n:127.0.0.1:20931_ku_evu c:collection1 s:shard2 x:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:20931/ku_evu collection:collection1 shard:shard2
[junit4] 2> 1078470 T7177 n:127.0.0.1:20931_ku_evu oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0
[junit4] 2> 1078470 T7177 n:127.0.0.1:20931_ku_evu oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1078471 T7238 n:127.0.0.1:20931_ku_evu c:collection1 s:shard2 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 1078475 T7238 n:127.0.0.1:20931_ku_evu c:collection1 s:shard2 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 1078476 T7205 n:127.0.0.1:61443_ku_evu oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1078476 T7238 n:127.0.0.1:20931_ku_evu c:collection1 s:shard2 x:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1078476 T7238 n:127.0.0.1:20931_ku_evu c:collection1 s:shard2 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 1078477 T7206 n:127.0.0.1:61443_ku_evu oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1"} current state version: 5
[junit4] 2> ASYNC NEW_CORE C3568 name=collection1 org.apache.solr.core.SolrCore@62553f96 url=http://127.0.0.1:20931/ku_evu/collection1 node=127.0.0.1:20931_ku_evu C3568_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:20931/ku_evu, node_name=127.0.0.1:20931_ku_evu, core=collection1}
[junit4] 2> 1078477 T7238 n:127.0.0.1:20931_ku_evu c:collection1 s:shard2 x:collection1 C3568 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:20931/ku_evu/collection1/
[junit4] 2> 1078477 T7238 n:127.0.0.1:20931_ku_evu c:collection1 s:shard2 x:collection1 C3568 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1078477 T7238 n:127.0.0.1:20931_ku_evu c:collection1 s:shard2 x:collection1 C3568 oasc.SyncStrategy.syncToMe http://127.0.0.1:20931/ku_evu/collection1/ has no replicas
[junit4] 2> 1078478 T7238 n:127.0.0.1:20931_ku_evu c:collection1 s:shard2 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:20931/ku_evu/collection1/ shard2
[junit4] 2> 1078478 T7216 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1078478 T7238 n:127.0.0.1:20931_ku_evu c:collection1 s:shard2 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 1078478 T7233 n:127.0.0.1:20931_ku_evu oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1078478 T7205 n:127.0.0.1:61443_ku_evu oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1078482 T7205 n:127.0.0.1:61443_ku_evu oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1078482 T7206 n:127.0.0.1:61443_ku_evu oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:20931/ku_evu",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 6
[junit4] 2> 1078586 T7205 n:127.0.0.1:61443_ku_evu oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1078587 T7233 n:127.0.0.1:20931_ku_evu oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1078587 T7216 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1078636 T7238 n:127.0.0.1:20931_ku_evu c:collection1 s:shard2 x:collection1 oasc.ZkController.register We are http://127.0.0.1:20931/ku_evu/collection1/ and leader is http://127.0.0.1:20931/ku_evu/collection1/
[junit4] 2> 1078637 T7238 n:127.0.0.1:20931_ku_evu c:collection1 s:shard2 x:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:20931/ku_evu
[junit4] 2> 1078637 T7238 n:127.0.0.1:20931_ku_evu c:collection1 s:shard2 x:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1078637 T7238 n:127.0.0.1:20931_ku_evu c:collection1 s:shard2 x:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 1078637 T7238 n:127.0.0.1:20931_ku_evu c:collection1 s:shard2 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1078639 T7205 n:127.0.0.1:61443_ku_evu oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1078639 T7206 n:127.0.0.1:61443_ku_evu oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "state":"active",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:20931/ku_evu",
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:20931_ku_evu",
[junit4] 2> "core":"collection1"} current state version: 7
[junit4] 2> 1078640 T7206 n:127.0.0.1:61443_ku_evu oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "state":"active",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:20931/ku_evu",
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:20931_ku_evu",
[junit4] 2> "core":"collection1"}
[junit4] 2> 1078743 T7216 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1078743 T7233 n:127.0.0.1:20931_ku_evu oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1078743 T7205 n:127.0.0.1:61443_ku_evu oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1079748 T7177 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-2-001/cores/collection1
[junit4] 2> 1079750 T7177 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2 in directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-2-001
[junit4] 2> 1079752 T7177 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 1079754 T7177 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@eb360e4{/ku_evu,null,AVAILABLE}
[junit4] 2> 1079754 T7177 oejs.AbstractConnector.doStart Started ServerConnector@3b58e56b{HTTP/1.1}{127.0.0.1:20957}
[junit4] 2> 1079754 T7177 oejs.Server.doStart Started @1084571ms
[junit4] 2> 1079755 T7177 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-2-001/cores, solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/tempDir-001/jetty2, solrconfig=solrconfig.xml, hostContext=/ku_evu, hostPort=20957}
[junit4] 2> 1079755 T7177 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@17072b90
[junit4] 2> 1079755 T7177 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-2-001/'
[junit4] 2> 1079786 T7177 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-2-001/solr.xml
[junit4] 2> 1079822 T7177 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-2-001/cores
[junit4] 2> 1079822 T7177 oasc.CoreContainer.<init> New CoreContainer 1689377630
[junit4] 2> 1079822 T7177 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-2-001/]
[junit4] 2> 1079823 T7177 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-2-001/lib
[junit4] 2> 1079823 T7177 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-2-001/lib).
[junit4] 2> 1079833 T7177 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1079838 T7177 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1079840 T7177 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1079840 T7177 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1079840 T7177 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 1079840 T7177 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54735/solr
[junit4] 2> 1079841 T7177 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1079841 T7177 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1079842 T7177 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1079843 T7252 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@783bd10a name:ZooKeeperConnection Watcher:127.0.0.1:54735 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1079844 T7177 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1079845 T7177 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1079846 T7177 n:127.0.0.1:20957_ku_evu oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1079847 T7255 n:127.0.0.1:20957_ku_evu oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d02385f name:ZooKeeperConnection Watcher:127.0.0.1:54735/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1079847 T7177 n:127.0.0.1:20957_ku_evu oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1079850 T7177 n:127.0.0.1:20957_ku_evu oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1080855 T7177 n:127.0.0.1:20957_ku_evu oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:20957_ku_evu
[junit4] 2> 1080860 T7177 n:127.0.0.1:20957_ku_evu oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:20957_ku_evu
[junit4] 2> 1080863 T7177 n:127.0.0.1:20957_ku_evu oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1080865 T7177 n:127.0.0.1:20957_ku_evu oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-2-001/cores
[junit4] 2> 1080869 T7177 n:127.0.0.1:20957_ku_evu oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {coreNodeName=, dataDir=data/, collection=collection1, config=solrconfig.xml, transient=false, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-2-001/cores/collection1, shard=, name=collection1, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-2-001/cores/collection1/, schema=schema.xml, loadOnStartup=true}
[junit4] 2> 1080870 T7177 n:127.0.0.1:20957_ku_evu oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest 74A355EF9CAA9D35-001/shard-2-001/cores/collection1/
[junit4] 2> 1080870 T7177 n:127.0.0.1:20957_ku_evu oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1080872 T7256 n:127.0.0.1:20957_ku_evu c:collection1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1080872 T7256 n:127.0.0.1:20957_ku_evu c:collection1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1080874 T7205 n:127.0.0.1:61443_ku_evu oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1080875 T7206 n:127.0.0.1:61443_ku_evu oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "state":"down",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":null,
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:20957/ku_evu",
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:20957_ku_evu",
[junit4] 2> "core":"collection1"} current state version: 8
[junit4] 2> 1080876 T7206 n:127.0.0.1:61443_ku_evu oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "state":"down",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":null,
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:20957/ku_evu",
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:20957_ku_evu",
[junit4] 2> "core":"collection1"}
[junit4] 2> 1080876 T7206 n:127.0.0.1:61443_ku_evu oasco.ReplicaMutator.updateState Collection already exists with numShards=2
[junit4] 2> 1080876 T7206 n:127.0.0.1:61443_ku_evu oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1080877 T7256 n:127.0.0.1:20957_ku_evu oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1080878 T7216 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1080878 T7255 n:127.0.0.1:20957_ku_evu oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1080878 T7205 n:127.0.0.1:61443_ku_evu oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1080878 T7233 n:127.0.0.1:20931_ku_evu oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1081878 T7256 n:127.0.0.1:20957_ku_evu oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1081879 T7256 n:127.0.0.1:20957_ku_evu oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1081880 T7256 n:127.0.0.1:20957_ku_evu oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1081881 T7256 n:127.0.0.1:20957_ku_evu oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1081882 T7256 n:127.0.0.1:20957_ku_evu oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified confi
[...truncated too long message...]
ne-Solr-NightlyTests-5.x/solr/solrj/lib/httpmime-4.4.1.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/solrj/lib/noggit-0.6.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/solrj/lib/slf4j-api-1.7.7.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/solrj/lib/stax2-api-3.1.4.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/solrj/lib/woodstox-core-asl-4.4.1.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/solrj/lib/zookeeper-3.4.6.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/server/lib/javax.servlet-api-3.1.0.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/server/lib/jetty-continuation-9.2.10.v20150310.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/server/lib/jetty-deploy-9.2.10.v20150310.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/server/lib/jetty-http-9.2.10.v20150310.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/server/lib/jetty-io-9.2.10.v20150310.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/server/lib/jetty-jmx-9.2.10.v20150310.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/server/lib/jetty-rewrite-9.2.10.v20150310.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/server/lib/jetty-security-9.2.10.v20150310.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/server/lib/jetty-server-9.2.10.v20150310.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/server/lib/jetty-servlet-9.2.10.v20150310.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/server/lib/jetty-servlets-9.2.10.v20150310.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/server/lib/jetty-util-9.2.10.v20150310.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/server/lib/jetty-webapp-9.2.10.v20150310.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/server/lib/jetty-xml-9.2.10.v20150310.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/core/classes/java:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/test-framework/lib/junit-4.10.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/test-framework/lib/randomizedtesting-runner-2.1.13.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-all-2.0.0-M15.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/cglib-nodep-2.2.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/commons-collections-3.2.1.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/commons-math3-3.4.1.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/easymock-3.0.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/hadoop-common-2.6.0-tests.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/hadoop-hdfs-2.6.0-tests.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/hadoop-minikdc-2.6.0.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/jcl-over-slf4j-1.7.7.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/jersey-core-1.9.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/jersey-server-1.9.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/jetty-6.1.26.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/jetty-util-6.1.26.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/objenesis-1.2.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/analysis/icu/lucene-analyzers-icu-5.2.0-SNAPSHOT.jar:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-analysis-extras/classes/java:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/contrib/analysis-extras/lib/icu4j-54.1.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/home/jenkins/.ant/lib/ivy-2.3.0.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/usr/local/openjdk7/lib/tools.jar:/home/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.1.13.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/temp/junit4-J1-20150510_184710_997.events @/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/temp/junit4-J1-20150510_184710_997.suites
[junit4] ERROR: JVM J1 ended with an exception: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1504)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:133)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:964)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:961)
[junit4] at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] at java.lang.Thread.run(Thread.java:745)
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:543: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:484: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:229: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:511: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1433: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:991: At least one slave process threw an exception, first: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
Total time: 175 minutes 32 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #841
Archived 6 artifacts
Archive block size is 32768
Received 0 blocks and 1491251986 bytes
Compression is 0.0%
Took 4 min 49 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 844 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/844/
1 tests failed.
REGRESSION: org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload
Error Message:
expected:<[{indexVersion=1431359399025,generation=2,filelist=[_0.fdt, _0.fdx, _0.fnm, _0.nvd, _0.nvm, _0.si, _0_Asserting_0.doc, _0_Asserting_0.tim, _0_Asserting_0.tip, _1.fdt, _1.fdx, _1.fnm, _1.nvd, _1.nvm, _1.si, _1_Asserting_0.doc, _1_Asserting_0.tim, _1_Asserting_0.tip, _2.fdt, _2.fdx, _2.fnm, _2.nvd, _2.nvm, _2.si, _2_Asserting_0.doc, _2_Asserting_0.tim, _2_Asserting_0.tip, _3.fdt, _3.fdx, _3.fnm, _3.nvd, _3.nvm, _3.si, _3_Asserting_0.doc, _3_Asserting_0.tim, _3_Asserting_0.tip, _4.fdt, _4.fdx, _4.fnm, _4.nvd, _4.nvm, _4.si, _4_Asserting_0.doc, _4_Asserting_0.tim, _4_Asserting_0.tip, _5.fdt, _5.fdx, _5.fnm, _5.nvd, _5.nvm, _5.si, _5_Asserting_0.doc, _5_Asserting_0.tim, _5_Asserting_0.tip, segments_2]}]> but was:<[{indexVersion=1431359399025,generation=3,filelist=[_6.fdt, _6.fdx, _6.fnm, _6.nvd, _6.nvm, _6.si, _6_Asserting_0.doc, _6_Asserting_0.tim, _6_Asserting_0.tip, segments_3]}, {indexVersion=1431359399025,generation=2,filelist=[_0.fdt, _0.fdx, _0.fnm, _0.nvd, _0.nvm, _0.si, _0_Asserting_0.doc, _0_Asserting_0.tim, _0_Asserting_0.tip, _1.fdt, _1.fdx, _1.fnm, _1.nvd, _1.nvm, _1.si, _1_Asserting_0.doc, _1_Asserting_0.tim, _1_Asserting_0.tip, _2.fdt, _2.fdx, _2.fnm, _2.nvd, _2.nvm, _2.si, _2_Asserting_0.doc, _2_Asserting_0.tim, _2_Asserting_0.tip, _3.fdt, _3.fdx, _3.fnm, _3.nvd, _3.nvm, _3.si, _3_Asserting_0.doc, _3_Asserting_0.tim, _3_Asserting_0.tip, _4.fdt, _4.fdx, _4.fnm, _4.nvd, _4.nvm, _4.si, _4_Asserting_0.doc, _4_Asserting_0.tim, _4_Asserting_0.tip, _5.fdt, _5.fdx, _5.fnm, _5.nvd, _5.nvm, _5.si, _5_Asserting_0.doc, _5_Asserting_0.tim, _5_Asserting_0.tip, segments_2]}]>
Stack Trace:
java.lang.AssertionError: expected:<[{indexVersion=1431359399025,generation=2,filelist=[_0.fdt, _0.fdx, _0.fnm, _0.nvd, _0.nvm, _0.si, _0_Asserting_0.doc, _0_Asserting_0.tim, _0_Asserting_0.tip, _1.fdt, _1.fdx, _1.fnm, _1.nvd, _1.nvm, _1.si, _1_Asserting_0.doc, _1_Asserting_0.tim, _1_Asserting_0.tip, _2.fdt, _2.fdx, _2.fnm, _2.nvd, _2.nvm, _2.si, _2_Asserting_0.doc, _2_Asserting_0.tim, _2_Asserting_0.tip, _3.fdt, _3.fdx, _3.fnm, _3.nvd, _3.nvm, _3.si, _3_Asserting_0.doc, _3_Asserting_0.tim, _3_Asserting_0.tip, _4.fdt, _4.fdx, _4.fnm, _4.nvd, _4.nvm, _4.si, _4_Asserting_0.doc, _4_Asserting_0.tim, _4_Asserting_0.tip, _5.fdt, _5.fdx, _5.fnm, _5.nvd, _5.nvm, _5.si, _5_Asserting_0.doc, _5_Asserting_0.tim, _5_Asserting_0.tip, segments_2]}]> but was:<[{indexVersion=1431359399025,generation=3,filelist=[_6.fdt, _6.fdx, _6.fnm, _6.nvd, _6.nvm, _6.si, _6_Asserting_0.doc, _6_Asserting_0.tim, _6_Asserting_0.tip, segments_3]}, {indexVersion=1431359399025,generation=2,filelist=[_0.fdt, _0.fdx, _0.fnm, _0.nvd, _0.nvm, _0.si, _0_Asserting_0.doc, _0_Asserting_0.tim, _0_Asserting_0.tip, _1.fdt, _1.fdx, _1.fnm, _1.nvd, _1.nvm, _1.si, _1_Asserting_0.doc, _1_Asserting_0.tim, _1_Asserting_0.tip, _2.fdt, _2.fdx, _2.fnm, _2.nvd, _2.nvm, _2.si, _2_Asserting_0.doc, _2_Asserting_0.tim, _2_Asserting_0.tip, _3.fdt, _3.fdx, _3.fnm, _3.nvd, _3.nvm, _3.si, _3_Asserting_0.doc, _3_Asserting_0.tim, _3_Asserting_0.tip, _4.fdt, _4.fdx, _4.fnm, _4.nvd, _4.nvm, _4.si, _4_Asserting_0.doc, _4_Asserting_0.tim, _4_Asserting_0.tip, _5.fdt, _5.fdx, _5.fnm, _5.nvd, _5.nvm, _5.si, _5_Asserting_0.doc, _5_Asserting_0.tim, _5_Asserting_0.tip, segments_2]}]>
at __randomizedtesting.SeedInfo.seed([96E4FBA48CC6F6FA:B333E094FC8EF8F9]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:147)
at org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload(TestReplicationHandler.java:1138)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10586 lines...]
[junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4] 2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/init-core-data-001
[junit4] 2> 160542 T537 oas.SolrTestCaseJ4.setUp ###Starting testEmptyCommits
[junit4] 2> 160543 T537 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-001/collection1
[junit4] 2> 160555 T537 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 160557 T537 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@4463db73{/solr,null,AVAILABLE}
[junit4] 2> 160559 T537 oejs.AbstractConnector.doStart Started ServerConnector@3c586002{HTTP/1.1}{127.0.0.1:20510}
[junit4] 2> 160559 T537 oejs.Server.doStart Started @165367ms
[junit4] 2> 160559 T537 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-001/collection1/data, hostContext=/solr, hostPort=20510}
[junit4] 2> 160560 T537 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@631d75b9
[junit4] 2> 160560 T537 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-001/'
[junit4] 2> 160591 T537 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-001/solr.xml
[junit4] 2> 160628 T537 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-001/.
[junit4] 2> 160629 T537 oasc.CoreContainer.<init> New CoreContainer 628512283
[junit4] 2> 160629 T537 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-001/]
[junit4] 2> 160630 T537 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-001/lib
[junit4] 2> 160630 T537 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-001/lib).
[junit4] 2> 160640 T537 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 160645 T537 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 160646 T537 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 160646 T537 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 160647 T537 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 160648 T537 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-001/.
[junit4] 2> 160650 T537 oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {dataDir=data/, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-001/./collection1/, name=collection1, schema=schema.xml, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-001/./collection1, transient=false, loadOnStartup=true, config=solrconfig.xml}
[junit4] 2> 160651 T537 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-001/./collection1/
[junit4] 2> 160652 T537 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 160653 T549 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-001/./collection1/'
[junit4] 2> 160684 T549 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 160705 T549 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 160752 T549 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 160753 T549 oass.IndexSchema.readSchema Reading Solr Schema from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-001/./collection1/conf/schema.xml
[junit4] 2> 160759 T549 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 160775 T549 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 160776 T549 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-001/./collection1/
[junit4] 2> 160776 T549 x:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 160776 T549 x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-001/./collection1/], dataDir=[null]
[junit4] 2> 160776 T549 x:collection1 oasc.SolrCore.initInfoRegistry JMX monitoring not detected for core: collection1
[junit4] 2> 160777 T549 x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-001/./collection1/data
[junit4] 2> 160777 T549 x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-001/./collection1/data/index/
[junit4] 2> 160777 T549 x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-001/./collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 160779 T549 x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-001/./collection1/data/index
[junit4] 2> 160779 T549 x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=29, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=0.3642578125, floorSegmentMB=1.2841796875, forceMergeDeletesPctAllowed=1.5217254368493605, segmentsPerTier=46.0, maxCFSSegmentSizeMB=1.990234375, noCFSRatio=0.7229454889689245
[junit4] 2> 160790 T549 x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_1,generation=1}
[junit4] 2> 160791 T549 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 160793 T549 x:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 160809 T549 x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 160811 T549 x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 160813 T549 x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 160814 T549 x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 160835 T549 x:collection1 oasc.PluginBag.createPlugin requestHandler : 'lazy' created with startup=lazy
[junit4] 2> 160835 T549 x:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: standard,/update/json/docs,defaults,/config,/admin/segments,lazy,/admin/properties,/admin/luke,/admin/ping,/update/json,/update,/admin/mbeans,/get,/admin/logging,/replication,/schema,/admin/file,/update/csv,/admin/plugins,/admin/threads,/admin/system
[junit4] 2> 160837 T549 x:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 160838 T549 x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 160838 T549 x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 160838 T549 x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=6, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4530104062323511]
[junit4] 2> 160842 T549 x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_1,generation=1}
[junit4] 2> 160842 T549 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 160842 T549 x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@2fb6030c[collection1] main
[junit4] 2> 160843 T549 x:collection1 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-001/./collection1/conf
[junit4] 2> 160843 T549 x:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-001/./collection1/conf}
[junit4] 2> 160844 T549 x:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-001/./collection1/conf
[junit4] 2> 160844 T549 x:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 160845 T549 x:collection1 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 160845 T549 x:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 160845 T550 x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2fb6030c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 160845 T549 x:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 160846 T537 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2
[junit4] 2> 160846 T537 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 160848 T537 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/collection1
[junit4] 2> 160861 T537 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 160862 T537 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@93b94a5{/solr,null,AVAILABLE}
[junit4] 2> 160863 T537 oejs.AbstractConnector.doStart Started ServerConnector@43e937c6{HTTP/1.1}{127.0.0.1:20511}
[junit4] 2> 160863 T537 oejs.Server.doStart Started @165671ms
[junit4] 2> 160864 T537 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/collection1/data, hostContext=/solr, hostPort=20511}
[junit4] 2> 160864 T537 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@631d75b9
[junit4] 2> 160865 T537 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/'
[junit4] 2> 160899 T537 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/solr.xml
[junit4] 2> 160943 T537 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/.
[junit4] 2> 160944 T537 oasc.CoreContainer.<init> New CoreContainer 1418074325
[junit4] 2> 160944 T537 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/]
[junit4] 2> 160944 T537 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/lib
[junit4] 2> 160945 T537 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/lib).
[junit4] 2> 160956 T537 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 160961 T537 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 160962 T537 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 160962 T537 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 160963 T537 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 160964 T537 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/.
[junit4] 2> 160966 T537 oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {schema=schema.xml, name=collection1, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/./collection1, loadOnStartup=true, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/./collection1/, dataDir=data/, transient=false, config=solrconfig.xml}
[junit4] 2> 160966 T537 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/./collection1/
[junit4] 2> 160967 T537 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 160968 T563 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/./collection1/'
[junit4] 2> 160998 T563 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 161017 T563 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 161076 T563 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 161077 T563 oass.IndexSchema.readSchema Reading Solr Schema from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/./collection1/conf/schema.xml
[junit4] 2> 161083 T563 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 161096 T563 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 161097 T563 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/./collection1/
[junit4] 2> 161098 T563 x:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 161098 T563 x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/./collection1/], dataDir=[null]
[junit4] 2> 161098 T563 x:collection1 oasc.SolrCore.initInfoRegistry JMX monitoring not detected for core: collection1
[junit4] 2> 161099 T563 x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/./collection1/data
[junit4] 2> 161099 T563 x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/./collection1/data/index/
[junit4] 2> 161099 T563 x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/./collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 161101 T563 x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/./collection1/data/index
[junit4] 2> 161101 T563 x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=29, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=0.3642578125, floorSegmentMB=1.2841796875, forceMergeDeletesPctAllowed=1.5217254368493605, segmentsPerTier=46.0, maxCFSSegmentSizeMB=1.990234375, noCFSRatio=0.7229454889689245
[junit4] 2> 161109 T563 x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_1,generation=1}
[junit4] 2> 161109 T563 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 161125 T563 x:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 161148 T563 x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 161150 T563 x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 161152 T563 x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 161154 T563 x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 161159 T563 x:collection1 oasc.PluginBag.createPlugin requestHandler : 'lazy' created with startup=lazy
[junit4] 2> 161159 T563 x:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: standard,/update/json/docs,defaults,/config,/admin/segments,lazy,/admin/properties,/admin/luke,/admin/ping,/update/json,/update,/admin/mbeans,/get,/admin/logging,/replication,/schema,/admin/file,/update/csv,/admin/plugins,/admin/threads,/admin/system
[junit4] 2> 161161 T563 x:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 161162 T563 x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 161162 T563 x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 161163 T563 x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=6, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4530104062323511]
[junit4] 2> 161166 T563 x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_1,generation=1}
[junit4] 2> 161166 T563 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 161168 T563 x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@636477ae[collection1] main
[junit4] 2> 161168 T563 x:collection1 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/./collection1/conf
[junit4] 2> 161169 T563 x:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/./collection1/conf}
[junit4] 2> 161169 T563 x:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/./collection1/conf
[junit4] 2> 161170 T563 x:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 161176 T563 x:collection1 oash.ReplicationHandler.setupPolling Poll Scheduled at an interval of 1000ms
[junit4] 2> 161177 T563 x:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 161177 T564 x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@636477ae[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 161177 T537 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2
[junit4] 2> 161178 T537 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> ASYNC NEW_CORE C92 name=collection1 org.apache.solr.core.SolrCore@55b8bd70
[junit4] 2> 161187 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={version=2&wt=javabin&sort=id+desc&q=*:*} hits=0 status=0 QTime=6
[junit4] 2> 161192 T546 x:collection1 C92 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[1]} 0 2
[junit4] 2> 161195 T545 x:collection1 C92 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 161273 T545 x:collection1 C92 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_2,generation=2}
[junit4] 2> 161274 T545 x:collection1 C92 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4] 2> 161287 T545 x:collection1 C92 oass.SolrIndexSearcher.<init> Opening Searcher@755fe083[collection1] main
[junit4] 2> 161288 T545 x:collection1 C92 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 161288 T550 x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@755fe083[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(5.2.0):C1)))}
[junit4] 2> 161288 T545 x:collection1 C92 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin&commit=true} {commit=} 0 93
[junit4] 2> 161300 T569 x:collection1 oash.IndexFetcher.<init> WARN 'masterUrl' must be specified without the /replication suffix
[junit4] 2> 161303 T546 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&qt=/replication&command=indexversion} status=0 QTime=0
[junit4] 2> 161304 T569 x:collection1 oash.IndexFetcher.fetchLatestIndex Master's generation: 2
[junit4] 2> 161304 T569 x:collection1 oash.IndexFetcher.fetchLatestIndex Slave's generation: 1
[junit4] 2> 161305 T569 x:collection1 oash.IndexFetcher.fetchLatestIndex Starting replication process
[junit4] 2> 161331 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&qt=/replication&command=filelist&generation=2} status=0 QTime=24
[junit4] 2> 161332 T569 x:collection1 oash.IndexFetcher.fetchLatestIndex Number of files in latest index in master: 10
[junit4] 2> 161333 T569 x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/./collection1/data/index.20150511103632545
[junit4] 2> 161341 T569 x:collection1 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4] 2> 161342 T569 x:collection1 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4] 2> 161342 T569 x:collection1 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4] 2> 161344 T569 x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@1f5497ca
[junit4] 2> 161348 T569 x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_1,generation=1}
[junit4] 2> 161348 T569 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 161349 T569 x:collection1 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4] 2> 161349 T569 x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_1,generation=1}
[junit4] 2> 161349 T569 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 161351 T569 x:collection1 oasu.DefaultSolrCoreState.closeIndexWriter Closing IndexWriter...
[junit4] 2> 161351 T569 x:collection1 oasu.DefaultSolrCoreState.closeIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4] 2> 161351 T569 x:collection1 oasu.DefaultSolrCoreState.closeIndexWriter Rollback old IndexWriter... core=collection1
[junit4] 2> 161353 T569 x:collection1 oash.IndexFetcher.fetchLatestIndex Starting download to MockDirectoryWrapper(RAMDirectory@14b15573 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@660fba2) fullCopy=false
[junit4] 2> 161356 T546 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_0.fnm&qt=/replication&checksum=true&command=filecontent&generation=2} status=0 QTime=0
[junit4] 2> 161361 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_0.nvd&qt=/replication&checksum=true&command=filecontent&generation=2} status=0 QTime=0
[junit4] 2> 161366 T546 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_0.si&qt=/replication&checksum=true&command=filecontent&generation=2} status=0 QTime=0
[junit4] 2> 161371 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_0.nvm&qt=/replication&checksum=true&command=filecontent&generation=2} status=0 QTime=0
[junit4] 2> 161376 T546 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_0_Asserting_0.tim&qt=/replication&checksum=true&command=filecontent&generation=2} status=0 QTime=0
[junit4] 2> 161381 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_0.fdx&qt=/replication&checksum=true&command=filecontent&generation=2} status=0 QTime=0
[junit4] 2> 161387 T546 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_0_Asserting_0.tip&qt=/replication&checksum=true&command=filecontent&generation=2} status=0 QTime=0
[junit4] 2> 161393 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_0.fdt&qt=/replication&checksum=true&command=filecontent&generation=2} status=0 QTime=0
[junit4] 2> 161398 T546 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_0_Asserting_0.doc&qt=/replication&checksum=true&command=filecontent&generation=2} status=0 QTime=0
[junit4] 2> 161403 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=segments_2&qt=/replication&checksum=true&command=filecontent&generation=2} status=0 QTime=0
[junit4] 2> 161407 T569 x:collection1 oash.IndexFetcher.fetchLatestIndex Total time taken for download : 0 secs
[junit4] 2> 161418 T569 x:collection1 oasu.DefaultSolrCoreState.openIndexWriter Creating new IndexWriter...
[junit4] 2> 161418 T569 x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=1.2763671875, floorSegmentMB=0.3642578125, forceMergeDeletesPctAllowed=16.263378940984847, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 161437 T569 x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_2,generation=2}
[junit4] 2> 161437 T569 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4] 2> 161438 T569 x:collection1 oasu.DefaultSolrCoreState.openIndexWriter New IndexWriter is ready to be used.
[junit4] 2> 161448 T569 x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@3a52ba0a[collection1] main
[junit4] 2> 161448 T564 x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3a52ba0a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(5.2.0):C1)))}
[junit4] 2> 161449 T569 x:collection1 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/./collection1/data/index.20150511103632545 [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/./collection1/data/index.20150511103632545;done=true>>]
[junit4] 2> 161449 T569 x:collection1 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/./collection1/data/index.20150511103632545
[junit4] 2> ASYNC NEW_CORE C93 name=collection1 org.apache.solr.core.SolrCore@2cf3846f
[junit4] 2> 161449 T559 x:collection1 C93 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wait=true&command=fetchindex&masterUrl=http://127.0.0.1:20510/solr/collection1/replication} status=0 QTime=150
[junit4] 2> 161538 T560 x:collection1 C93 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={version=2&wt=javabin&sort=id+desc&q=name:empty1} hits=1 status=0 QTime=83
[junit4] 2> 161539 T537 oash.TestReplicationHandler.rQuery Waited for 0ms and found 1 docs
[junit4] 2> 161544 T546 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&qt=/replication&_trace=getDetails&command=details} status=0 QTime=2
[junit4] 2> 161548 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&qt=/replication&_trace=getDetails&command=details} status=0 QTime=1
[junit4] 2> 161557 T546 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&qt=/replication&command=details&slave=false} status=0 QTime=1
[junit4] 2> 161558 T559 x:collection1 C93 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&qt=/replication&_trace=getDetails&command=details} status=0 QTime=7
[junit4] 2> 161562 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&qt=/replication&_trace=assertVersions&command=indexversion} status=0 QTime=0
[junit4] 2> 161565 T560 x:collection1 C93 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&qt=/replication&_trace=assertVersions&command=indexversion} status=0 QTime=0
[junit4] 2> 161568 T546 x:collection1 C92 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 161569 T546 x:collection1 C92 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 161569 T546 x:collection1 C92 oasc.SolrCore.openNewSearcher SolrIndexSearcher has not changed - not re-opening: org.apache.solr.search.SolrIndexSearcher
[junit4] 2> 161570 T546 x:collection1 C92 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 161570 T546 x:collection1 C92 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin&commit=true} {commit=} 0 2
[junit4] 2> 161572 T572 x:collection1 oash.IndexFetcher.<init> WARN 'masterUrl' must be specified without the /replication suffix
[junit4] 2> 161582 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&qt=/replication&command=indexversion} status=0 QTime=0
[junit4] 2> 161583 T572 x:collection1 oash.IndexFetcher.fetchLatestIndex Slave in sync with master.
[junit4] 2> 161583 T559 x:collection1 C93 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wait=true&command=fetchindex&masterUrl=http://127.0.0.1:20510/solr/collection1/replication} status=0 QTime=11
[junit4] 2> 161589 T546 x:collection1 C92 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[2]} 0 3
[junit4] 2> 161592 T545 x:collection1 C92 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 161651 T545 x:collection1 C92 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_3,generation=3}
[junit4] 2> 161652 T545 x:collection1 C92 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 161653 T545 x:collection1 C92 oass.SolrIndexSearcher.<init> Opening Searcher@16fac64[collection1] main
[junit4] 2> 161654 T545 x:collection1 C92 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 161654 T550 x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16fac64[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(5.2.0):C1) Uninverting(_1(5.2.0):C1)))}
[junit4] 2> 161655 T545 x:collection1 C92 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin&commit=true} {commit=} 0 63
[junit4] 2> 161657 T573 x:collection1 oash.IndexFetcher.<init> WARN 'masterUrl' must be specified without the /replication suffix
[junit4] 2> 161661 T546 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&qt=/replication&command=indexversion} status=0 QTime=0
[junit4] 2> 161662 T573 x:collection1 oash.IndexFetcher.fetchLatestIndex Master's generation: 3
[junit4] 2> 161662 T573 x:collection1 oash.IndexFetcher.fetchLatestIndex Slave's generation: 2
[junit4] 2> 161662 T573 x:collection1 oash.IndexFetcher.fetchLatestIndex Starting replication process
[junit4] 2> 161691 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&qt=/replication&command=filelist&generation=3} status=0 QTime=27
[junit4] 2> 161692 T573 x:collection1 oash.IndexFetcher.fetchLatestIndex Number of files in latest index in master: 19
[junit4] 2> 161693 T573 x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/./collection1/data/index.20150511103632906
[junit4] 2> 161714 T573 x:collection1 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4] 2> 161714 T573 x:collection1 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4] 2> 161715 T573 x:collection1 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4] 2> 161717 T573 x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@18229761
[junit4] 2> 161724 T573 x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_2,generation=2}
[junit4] 2> 161724 T573 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4] 2> 161724 T573 x:collection1 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4] 2> 161724 T573 x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_2,generation=2}
[junit4] 2> 161724 T573 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4] 2> 161777 T573 x:collection1 oasu.DefaultSolrCoreState.closeIndexWriter Closing IndexWriter...
[junit4] 2> 161778 T573 x:collection1 oasu.DefaultSolrCoreState.closeIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4] 2> 161778 T573 x:collection1 oasu.DefaultSolrCoreState.closeIndexWriter Rollback old IndexWriter... core=collection1
[junit4] 2> 161779 T573 x:collection1 oash.IndexFetcher.fetchLatestIndex Starting download to MockDirectoryWrapper(RAMDirectory@2a507f30 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@ace3e04) fullCopy=false
[junit4] 2> 161780 T573 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _0.fnm because it already exists
[junit4] 2> 161781 T573 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _0.nvd because it already exists
[junit4] 2> 161782 T573 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _0.si because it already exists
[junit4] 2> 161783 T573 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _0.nvm because it already exists
[junit4] 2> 161784 T573 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _0_Asserting_0.tim because it already exists
[junit4] 2> 161785 T573 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _0.fdx because it already exists
[junit4] 2> 161786 T573 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _0_Asserting_0.tip because it already exists
[junit4] 2> 161786 T573 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _0.fdt because it already exists
[junit4] 2> 161787 T573 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _0_Asserting_0.doc because it already exists
[junit4] 2> 161790 T546 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_1.fdx&qt=/replication&checksum=true&command=filecontent&generation=3} status=0 QTime=0
[junit4] 2> 161795 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_1.nvd&qt=/replication&checksum=true&command=filecontent&generation=3} status=0 QTime=0
[junit4] 2> 161800 T546 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_1_Asserting_0.tim&qt=/replication&checksum=true&command=filecontent&generation=3} status=0 QTime=0
[junit4] 2> 161805 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_1_Asserting_0.tip&qt=/replication&checksum=true&command=filecontent&generation=3} status=0 QTime=0
[junit4] 2> 161810 T546 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_1.fdt&qt=/replication&checksum=true&command=filecontent&generation=3} status=0 QTime=0
[junit4] 2> 161815 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_1_Asserting_0.doc&qt=/replication&checksum=true&command=filecontent&generation=3} status=0 QTime=0
[junit4] 2> 161820 T546 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_1.nvm&qt=/replication&checksum=true&command=filecontent&generation=3} status=0 QTime=0
[junit4] 2> 161825 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_1.si&qt=/replication&checksum=true&command=filecontent&generation=3} status=0 QTime=0
[junit4] 2> 161830 T546 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_1.fnm&qt=/replication&checksum=true&command=filecontent&generation=3} status=0 QTime=0
[junit4] 2> 161835 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=segments_3&qt=/replication&checksum=true&command=filecontent&generation=3} status=0 QTime=0
[junit4] 2> 161837 T573 x:collection1 oash.IndexFetcher.fetchLatestIndex Total time taken for download : 0 secs
[junit4] 2> 161849 T573 x:collection1 oasu.DefaultSolrCoreState.openIndexWriter Creating new IndexWriter...
[junit4] 2> 161849 T573 x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=1.2763671875, floorSegmentMB=0.3642578125, forceMergeDeletesPctAllowed=16.263378940984847, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 161864 T573 x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_3,generation=3}
[junit4] 2> 161865 T573 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 161865 T573 x:collection1 oasu.DefaultSolrCoreState.openIndexWriter New IndexWriter is ready to be used.
[junit4] 2> 161884 T573 x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@1e9cc33d[collection1] main
[junit4] 2> 161885 T564 x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1e9cc33d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(5.2.0):C1) Uninverting(_1(5.2.0):C1)))}
[junit4] 2> 161885 T573 x:collection1 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/./collection1/data/index.20150511103632906 [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/./collection1/data/index.20150511103632906;done=true>>]
[junit4] 2> 161885 T573 x:collection1 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/./collection1/data/index.20150511103632906
[junit4] 2> 161886 T560 x:collection1 C93 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wait=true&command=fetchindex&masterUrl=http://127.0.0.1:20510/solr/collection1/replication} status=0 QTime=230
[junit4] 2> 161892 T559 x:collection1 C93 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={version=2&wt=javabin&sort=id+desc&q=name:empty2} hits=1 status=0 QTime=2
[junit4] 2> 161893 T537 oash.TestReplicationHandler.rQuery Waited for 0ms and found 1 docs
[junit4] 2> 161898 T546 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&qt=/replication&_trace=getDetails&command=details} status=0 QTime=3
[junit4] 2> 161903 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&qt=/replication&_trace=getDetails&command=details} status=0 QTime=2
[junit4] 2> 161913 T546 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&qt=/replication&command=details&slave=false} status=0 QTime=2
[junit4] 2> 161915 T560 x:collection1 C93 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&qt=/replication&_trace=getDetails&command=details} status=0 QTime=8
[junit4] 2> 161918 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&qt=/replication&_trace=assertVersions&command=indexversion} status=0 QTime=0
[junit4] 2> 161921 T559 x:collection1 C93 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&qt=/replication&_trace=assertVersions&command=indexversion} status=0 QTime=0
[junit4] 2> 161927 T546 x:collection1 C92 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[3]} 0 3
[junit4] 2> 161930 T545 x:collection1 C92 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 162054 T545 x:collection1 C92 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_3,generation=3}
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_4,generation=4}
[junit4] 2> 162055 T545 x:collection1 C92 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4] 2> 162057 T545 x:collection1 C92 oass.SolrIndexSearcher.<init> Opening Searcher@604e1375[collection1] realtime
[junit4] 2> 162057 T545 x:collection1 C92 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 162057 T545 x:collection1 C92 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin&openSearcher=false&commit=true} {commit=} 0 127
[junit4] 2> 162060 T575 x:collection1 oash.IndexFetcher.<init> WARN 'masterUrl' must be specified without the /replication suffix
[junit4] 2> 162064 T546 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&qt=/replication&command=indexversion} status=0 QTime=0
[junit4] 2> 162065 T575 x:collection1 oash.IndexFetcher.fetchLatestIndex Master's generation: 4
[junit4] 2> 162065 T575 x:collection1 oash.IndexFetcher.fetchLatestIndex Slave's generation: 3
[junit4] 2> 162065 T575 x:collection1 oash.IndexFetcher.fetchLatestIndex Starting replication process
[junit4] 2> 162109 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&qt=/replication&command=filelist&generation=4} status=0 QTime=41
[junit4] 2> 162110 T575 x:collection1 oash.IndexFetcher.fetchLatestIndex Number of files in latest index in master: 28
[junit4] 2> 162110 T575 x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-002/./collection1/data/index.20150511103633323
[junit4] 2> 162203 T575 x:collection1 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4] 2> 162203 T575 x:collection1 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4] 2> 162203 T575 x:collection1 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4] 2> 162207 T575 x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@5c12446e
[junit4] 2> 162222 T575 x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_3,generation=3}
[junit4] 2> 162222 T575 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 162222 T575 x:collection1 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4] 2> 162223 T575 x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_3,generation=3}
[junit4] 2> 162223 T575 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 162227 T575 x:collection1 oash.IndexFetcher.hasUnusedFiles Found unused file: segments_2
[junit4] 2> 162228 T575 x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_3,generation=3}
[junit4] 2> 162228 T575 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 162228 T575 x:collection1 oash.IndexFetcher.fetchLatestIndex Sleeping for 1000ms to wait for unused lucene index files to be delete-able
[junit4] 2> 163234 T575 x:collection1 oash.IndexFetcher.hasUnusedFiles Found unused file: segments_2
[junit4] 2> 163234 T575 x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_3,generation=3}
[junit4] 2> 163235 T575 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 163235 T575 x:collection1 oash.IndexFetcher.fetchLatestIndex Sleeping for 1000ms to wait for unused lucene index files to be delete-able
[junit4] 2> 164240 T575 x:collection1 oash.IndexFetcher.hasUnusedFiles Found unused file: segments_2
[junit4] 2> 164241 T575 x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_3,generation=3}
[junit4] 2> 164241 T575 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 164242 T575 x:collection1 oash.IndexFetcher.fetchLatestIndex Sleeping for 1000ms to wait for unused lucene index files to be delete-able
[junit4] 2> 165246 T575 x:collection1 oash.IndexFetcher.hasUnusedFiles Found unused file: segments_2
[junit4] 2> 165246 T575 x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_3,generation=3}
[junit4] 2> 165247 T575 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 165247 T575 x:collection1 oash.IndexFetcher.fetchLatestIndex Sleeping for 1000ms to wait for unused lucene index files to be delete-able
[junit4] 2> 166252 T575 x:collection1 oash.IndexFetcher.hasUnusedFiles Found unused file: segments_2
[junit4] 2> 166253 T575 x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_3,generation=3}
[junit4] 2> 166253 T575 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 166253 T575 x:collection1 oash.IndexFetcher.fetchLatestIndex Sleeping for 1000ms to wait for unused lucene index files to be delete-able
[junit4] 2> 167259 T575 x:collection1 oash.IndexFetcher.hasUnusedFiles Found unused file: segments_2
[junit4] 2> 167259 T575 x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_3,generation=3}
[junit4] 2> 167260 T575 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 167260 T575 x:collection1 oash.IndexFetcher.fetchLatestIndex Sleeping for 1000ms to wait for unused lucene index files to be delete-able
[junit4] 2> 168264 T575 x:collection1 oash.IndexFetcher.hasUnusedFiles Found unused file: segments_2
[junit4] 2> 168265 T575 x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_3,generation=3}
[junit4] 2> 168265 T575 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 168265 T575 x:collection1 oash.IndexFetcher.fetchLatestIndex Sleeping for 1000ms to wait for unused lucene index files to be delete-able
[junit4] 2> 169271 T575 x:collection1 oash.IndexFetcher.hasUnusedFiles Found unused file: segments_2
[junit4] 2> 169272 T575 x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_3,generation=3}
[junit4] 2> 169272 T575 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 169272 T575 x:collection1 oash.IndexFetcher.fetchLatestIndex Sleeping for 1000ms to wait for unused lucene index files to be delete-able
[junit4] 2> 170278 T575 x:collection1 oash.IndexFetcher.hasUnusedFiles Found unused file: segments_2
[junit4] 2> 170278 T575 x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_3,generation=3}
[junit4] 2> 170279 T575 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 170279 T575 x:collection1 oash.IndexFetcher.fetchLatestIndex Sleeping for 1000ms to wait for unused lucene index files to be delete-able
[junit4] 2> 171284 T575 x:collection1 oash.IndexFetcher.hasUnusedFiles Found unused file: segments_2
[junit4] 2> 171284 T575 x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_3,generation=3}
[junit4] 2> 171284 T575 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 171285 T575 x:collection1 oash.IndexFetcher.fetchLatestIndex Sleeping for 1000ms to wait for unused lucene index files to be delete-able
[junit4] 2> 172289 T575 x:collection1 oash.IndexFetcher.hasUnusedFiles Found unused file: segments_2
[junit4] 2> 172289 T575 x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_3,generation=3}
[junit4] 2> 172289 T575 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 172290 T575 x:collection1 oash.IndexFetcher.fetchLatestIndex Sleeping for 1000ms to wait for unused lucene index files to be delete-able
[junit4] 2> 173295 T575 x:collection1 oash.IndexFetcher.fetchLatestIndex IndexFetcher slept for 11000ms for unused lucene index files to be delete-able
[junit4] 2> 173296 T575 x:collection1 oasu.DefaultSolrCoreState.closeIndexWriter Closing IndexWriter...
[junit4] 2> 173296 T575 x:collection1 oasu.DefaultSolrCoreState.closeIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4] 2> 173296 T575 x:collection1 oasu.DefaultSolrCoreState.closeIndexWriter Rollback old IndexWriter... core=collection1
[junit4] 2> 173298 T575 x:collection1 oash.IndexFetcher.fetchLatestIndex Starting download to MockDirectoryWrapper(RAMDirectory@655d267a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@46894793) fullCopy=false
[junit4] 2> 173299 T575 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _0.fnm because it already exists
[junit4] 2> 173300 T575 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _0.nvd because it already exists
[junit4] 2> 173302 T575 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _0.si because it already exists
[junit4] 2> 173303 T575 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _0.nvm because it already exists
[junit4] 2> 173304 T575 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _0_Asserting_0.tim because it already exists
[junit4] 2> 173306 T575 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _0.fdx because it already exists
[junit4] 2> 173307 T575 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _0_Asserting_0.tip because it already exists
[junit4] 2> 173308 T575 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _0.fdt because it already exists
[junit4] 2> 173309 T575 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _0_Asserting_0.doc because it already exists
[junit4] 2> 173311 T575 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _1.fdx because it already exists
[junit4] 2> 173312 T575 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _1.nvd because it already exists
[junit4] 2> 173313 T575 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _1_Asserting_0.tim because it already exists
[junit4] 2> 173315 T575 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _1_Asserting_0.tip because it already exists
[junit4] 2> 173316 T575 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _1.fdt because it already exists
[junit4] 2> 173317 T575 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _1_Asserting_0.doc because it already exists
[junit4] 2> 173318 T575 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _1.nvm because it already exists
[junit4] 2> 173320 T575 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _1.si because it already exists
[junit4] 2> 173321 T575 x:collection1 oash.IndexFetcher.downloadIndexFiles Skipping download for _1.fnm because it already exists
[junit4] 2> 173324 T546 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_2.fdt&qt=/replication&checksum=true&command=filecontent&generation=4} status=0 QTime=0
[junit4] 2> 173330 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_2.nvm&qt=/replication&checksum=true&command=filecontent&generation=4} status=0 QTime=0
[junit4] 2> 173335 T546 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_2_Asserting_0.doc&qt=/replication&checksum=true&command=filecontent&generation=4} status=0 QTime=0
[junit4] 2> 173340 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_2_Asserting_0.tim&qt=/replication&checksum=true&command=filecontent&generation=4} status=0 QTime=0
[junit4] 2> 173345 T546 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_2.si&qt=/replication&checksum=true&command=filecontent&generation=4} status=0 QTime=0
[junit4] 2> 173350 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_2_Asserting_0.tip&qt=/replication&checksum=true&command=filecontent&generation=4} status=0 QTime=0
[junit4] 2> 173355 T546 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_2.fdx&qt=/replication&checksum=true&command=filecontent&generation=4} status=0 QTime=0
[junit4] 2> 173360 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_2.fnm&qt=/replication&checksum=true&command=filecontent&generation=4} status=0 QTime=0
[junit4] 2> 173365 T546 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=_2.nvd&qt=/replication&checksum=true&command=filecontent&generation=4} status=0 QTime=0
[junit4] 2> 173370 T545 x:collection1 C92 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&file=segments_4&qt=/replication&checksum=true&command=filecontent&generation=4} status=0 QTime=0
[junit4] 2> 173372 T575 x:collection1 oash.IndexFetcher.fetchLatestIndex Total time taken for download : 11 secs
[junit4] 2> 173380 T575 x:collection1 oasu.DefaultSolrCoreState.openIndexWriter Creating new IndexWriter...
[junit4] 2> 173381 T575 x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=1.2763671875, floorSegmentMB=0.3642578125, forceMergeDeletesPctAllowed=16.263378940984847, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 173395 T575 x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_3,generation=3}
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f9caf98),segFN=segments_4,generation=4}
[junit4] 2> 173396 T575 x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4] 2> 173396 T575 x:collection1 oasu.DefaultSolrCoreState.openIndexWriter New IndexWriter is ready to be used.
[junit4] 2> 173417 T575 x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@187c1450[collection1] main
[junit4] 2
[...truncated too long message...]
se>>]
[junit4] 2> 981683 T537 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-028/./collection1/data
[junit4] 2> 981683 T537 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-028/./collection1/data/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-028/./collection1/data/index;done=false>>]
[junit4] 2> 981684 T537 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-028/./collection1/data/index
[junit4] 2> 981684 T537 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@7bb327d5{/solr,null,UNAVAILABLE}
[junit4] 2> 981685 T537 oas.SolrTestCaseJ4.tearDown ###Ending doTestDetails
[junit4] 2> 981686 T537 oejs.AbstractConnector.doStop Stopped ServerConnector@1ccaec83{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 981686 T537 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=2044063610
[junit4] 2> 981687 T537 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@467eceb2
[junit4] 2> 981687 T537 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=3,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=3,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 981687 T537 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 981688 T537 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 981688 T537 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 981690 T537 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 981691 T537 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 981692 T537 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-026/./collection1/data/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-026/./collection1/data/index;done=false>>]
[junit4] 2> 981692 T537 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-026/./collection1/data/index
[junit4] 2> 981692 T537 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-026/./collection1/data [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-026/./collection1/data;done=false>>]
[junit4] 2> 981692 T537 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-026/./collection1/data
[junit4] 2> 981693 T537 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@61353633{/solr,null,UNAVAILABLE}
[junit4] 2> 981695 T537 oejs.AbstractConnector.doStop Stopped ServerConnector@7049efc0{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 981695 T537 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=124255736
[junit4] 2> 981695 T537 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@58a9d94e
[junit4] 2> 981696 T537 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 981696 T537 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 981696 T537 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 981697 T537 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 981699 T537 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 981699 T537 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 981700 T537 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-027/./collection1/data/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-027/./collection1/data/index;done=false>>]
[junit4] 2> 981700 T537 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-027/./collection1/data/index
[junit4] 2> 981700 T537 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-027/./collection1/data [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-027/./collection1/data;done=false>>]
[junit4] 2> 981700 T537 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001/solr-instance-027/./collection1/data
[junit4] 2> 981701 T537 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@2c14ffb{/solr,null,UNAVAILABLE}
[junit4] 2> 981703 T537 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler 96E4FBA48CC6F6FA-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {newname=PostingsFormat(name=Asserting), name=PostingsFormat(name=Asserting), id=PostingsFormat(name=Asserting)}, docValues:{}, sim=DefaultSimilarity, locale=ja, timezone=America/Panama
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=16,threads=1,free=87936456,total=176685056
[junit4] 2> NOTE: All tests run in this JVM: [DistributedFacetPivotSmallAdvancedTest, TestSchemaVersionResource, RAMDirectoryFactoryTest, TestElisionMultitermQuery, ChaosMonkeyNothingIsSafeTest, TestReplicationHandler]
[junit4] Completed [160/488] on J2 in 821.21s, 13 tests, 1 failure <<< FAILURES!
[...truncated 1062 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:543: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:484: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:229: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:511: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1433: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:991: There were test failures: 488 suites, 1958 tests, 1 failure, 65 ignored (11 assumptions)
Total time: 172 minutes 10 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #841
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 869669803 bytes
Compression is 0.0%
Took 2 min 33 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure