You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2014/09/26 22:59:34 UTC
[JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 633 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/633/
1 tests failed.
REGRESSION: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core [halfcollection_shard1_replica1] Caused by: Could not get shard id for core: halfcollection_shard1_replica1
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core [halfcollection_shard1_replica1] Caused by: Could not get shard id for core: halfcollection_shard1_replica1
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:556)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:212)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:208)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:583)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:205)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 12181 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/init-core-data-001
[junit4] 2> 1214121 T8431 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
[junit4] 2> 1214122 T8431 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /zmz/
[junit4] 2> 1214126 T8431 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 1214127 T8431 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1214127 T8432 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1214227 T8431 oasc.ZkTestServer.run start zk server on port:32209
[junit4] 2> 1214228 T8431 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1214228 T8431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1214231 T8438 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@595b1512 name:ZooKeeperConnection Watcher:127.0.0.1:32209 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1214232 T8431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1214232 T8431 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1214232 T8431 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1214234 T8431 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1214235 T8431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1214236 T8440 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5cb020f7 name:ZooKeeperConnection Watcher:127.0.0.1:32209/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1214236 T8431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1214236 T8431 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1214237 T8431 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1214238 T8431 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1214240 T8431 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1214241 T8431 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1214242 T8431 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1214243 T8431 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1214245 T8431 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1214246 T8431 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1214349 T8431 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1214350 T8431 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1214352 T8431 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1214352 T8431 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1214354 T8431 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1214354 T8431 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1214356 T8431 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1214357 T8431 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1214358 T8431 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1214359 T8431 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1214361 T8431 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1214361 T8431 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1214363 T8431 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1214363 T8431 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1214365 T8431 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1214366 T8431 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1214367 T8431 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1214368 T8431 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1214370 T8431 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1214370 T8431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1214371 T8442 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@28d9241d name:ZooKeeperConnection Watcher:127.0.0.1:32209/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1214371 T8431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1214372 T8431 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> Using new style solr.xml
[junit4] 2> 1214373 T8431 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1214374 T8431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1214374 T8444 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33c371d name:ZooKeeperConnection Watcher:127.0.0.1:32209 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1214375 T8431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1214375 T8431 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1214375 T8431 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1214376 T8431 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1214377 T8431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1214377 T8446 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5da348e7 name:ZooKeeperConnection Watcher:127.0.0.1:32209/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1214378 T8431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1214378 T8431 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1214380 T8431 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
[junit4] 2> 1214380 T8431 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.xml
[junit4] 2> 1214382 T8431 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
[junit4] 2> 1214382 T8431 oascc.SolrZkClient.makePath makePath: /configs/conf2/schema.xml
[junit4] 2> 1214484 T8431 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1214485 T8431 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1214487 T8431 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
[junit4] 2> 1214487 T8431 oascc.SolrZkClient.makePath makePath: /configs/conf2/stopwords.txt
[junit4] 2> 1214489 T8431 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
[junit4] 2> 1214489 T8431 oascc.SolrZkClient.makePath makePath: /configs/conf2/protwords.txt
[junit4] 2> 1214490 T8431 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
[junit4] 2> 1214491 T8431 oascc.SolrZkClient.makePath makePath: /configs/conf2/currency.xml
[junit4] 2> 1214492 T8431 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
[junit4] 2> 1214493 T8431 oascc.SolrZkClient.makePath makePath: /configs/conf2/open-exchange-rates.json
[junit4] 2> 1214494 T8431 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 1214495 T8431 oascc.SolrZkClient.makePath makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 1214496 T8431 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
[junit4] 2> 1214497 T8431 oascc.SolrZkClient.makePath makePath: /configs/conf2/old_synonyms.txt
[junit4] 2> 1214498 T8431 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
[junit4] 2> 1214499 T8431 oascc.SolrZkClient.makePath makePath: /configs/conf2/synonyms.txt
[junit4] 2> 1214501 T8431 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
[junit4] 2> 1214501 T8431 oascc.SolrZkClient.makePath makePath: /configs/conf2/elevate.xml
[junit4] 2> 1216254 T8431 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1216260 T8431 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1216263 T8431 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:32220
[junit4] 2> 1216266 T8431 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1216266 T8431 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1216266 T8431 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-002
[junit4] 2> 1216267 T8431 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-002/'
[junit4] 2> 1216326 T8431 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-002/solr.xml
[junit4] 2> 1216407 T8431 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-002
[junit4] 2> 1216407 T8431 oasc.CoreContainer.<init> New CoreContainer 1380403761
[junit4] 2> 1216408 T8431 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-002/]
[junit4] 2> 1216409 T8431 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1216409 T8431 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1216409 T8431 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1216409 T8431 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1216410 T8431 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1216410 T8431 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1216410 T8431 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1216410 T8431 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1216410 T8431 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1216413 T8431 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 1216414 T8431 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1216414 T8431 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1216415 T8431 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1216415 T8431 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:32209/solr
[junit4] 2> 1216415 T8431 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1216415 T8431 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1216416 T8431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1216418 T8457 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2173888c name:ZooKeeperConnection Watcher:127.0.0.1:32209 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1216418 T8431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1216419 T8431 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1216421 T8431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1216422 T8459 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1970846e name:ZooKeeperConnection Watcher:127.0.0.1:32209/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1216422 T8431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1216424 T8431 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1216426 T8431 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1216428 T8431 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 1216430 T8431 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 1216432 T8431 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 1216435 T8431 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1216436 T8431 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32220_zmz
[junit4] 2> 1216437 T8431 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:32220_zmz
[junit4] 2> 1216438 T8431 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1216440 T8431 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1216441 T8431 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1216443 T8431 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:32220_zmz
[junit4] 2> 1216443 T8431 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1216444 T8431 oasc.Overseer.start Overseer (id=92521231672213510-127.0.0.1:32220_zmz-n_0000000000) starting
[junit4] 2> 1216446 T8431 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1216452 T8431 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1216453 T8461 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1216454 T8431 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1216455 T8431 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1216457 T8431 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1216459 T8460 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1216462 T8431 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-002
[junit4] 2> 1216565 T8431 oasc.CorePropertiesLocator.discoverUnder Found core conf in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-002/conf/
[junit4] 2> 1218040 T8431 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1218041 T8431 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
[junit4] 2> 1218042 T8431 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1218045 T8431 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1218046 T8431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1218047 T8465 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18d2d28b name:ZooKeeperConnection Watcher:127.0.0.1:32209/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1218047 T8431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1218048 T8431 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1218049 T8431 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1218051 T8431 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1218051 T8431 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
[junit4] 2> 1218051 T8431 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1218052 T8431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1218053 T8467 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@59148a6 name:ZooKeeperConnection Watcher:127.0.0.1:32209/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1218053 T8431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1218053 T8431 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1218055 T8468 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1218057 T8460 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: collection1
[junit4] 2> 1218057 T8460 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 1218057 T8460 oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 2
[junit4] 2> 1218059 T8460 oasc.Overseer$ClusterStateUpdater.updateZkStates going to create_collection /collections/collection1/state.json
[junit4] 2> 1218059 T8468 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1218060 T8469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1219065 T8431 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 1219066 T8431 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1219069 T8431 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1219071 T8431 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:32231
[junit4] 2> 1219076 T8431 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1219076 T8431 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1219077 T8431 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-003
[junit4] 2> 1219077 T8431 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-003/'
[junit4] 2> 1219110 T8431 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-003/solr.xml
[junit4] 2> 1219153 T8431 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-003
[junit4] 2> 1219154 T8431 oasc.CoreContainer.<init> New CoreContainer 1477865822
[junit4] 2> 1219154 T8431 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-003/]
[junit4] 2> 1219155 T8431 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1219155 T8431 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1219155 T8431 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1219156 T8431 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1219156 T8431 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1219156 T8431 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1219156 T8431 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1219157 T8431 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1219157 T8431 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1219159 T8431 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 1219160 T8431 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1219161 T8431 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1219161 T8431 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1219161 T8431 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:32209/solr
[junit4] 2> 1219161 T8431 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1219162 T8431 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1219162 T8431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1219164 T8480 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@205be6d7 name:ZooKeeperConnection Watcher:127.0.0.1:32209 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1219164 T8431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1219165 T8431 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1219166 T8431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1219167 T8482 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@257bfe34 name:ZooKeeperConnection Watcher:127.0.0.1:32209/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1219167 T8431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1219171 T8431 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1220175 T8431 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32231_zmz
[junit4] 2> 1220176 T8431 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:32231_zmz
[junit4] 2> 1220180 T8431 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1220185 T8431 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-003
[junit4] 2> 1220293 T8431 oasc.CorePropertiesLocator.discoverUnder Found core conf in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-003/conf/
[junit4] 2> 1221610 T8431 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1221611 T8431 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
[junit4] 2> 1221611 T8431 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1222632 T8431 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 1222633 T8431 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1222637 T8431 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1222638 T8431 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:32239
[junit4] 2> 1222640 T8431 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1222641 T8431 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1222641 T8431 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-004
[junit4] 2> 1222641 T8431 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-004/'
[junit4] 2> 1222675 T8431 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-004/solr.xml
[junit4] 2> 1222725 T8431 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-004
[junit4] 2> 1222726 T8431 oasc.CoreContainer.<init> New CoreContainer 1446484044
[junit4] 2> 1222726 T8431 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-004/]
[junit4] 2> 1222727 T8431 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1222727 T8431 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1222727 T8431 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1222728 T8431 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1222728 T8431 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1222728 T8431 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1222728 T8431 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1222729 T8431 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1222729 T8431 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1222731 T8431 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 1222732 T8431 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1222732 T8431 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1222733 T8431 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1222733 T8431 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:32209/solr
[junit4] 2> 1222733 T8431 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1222733 T8431 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1222734 T8431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1222735 T8495 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a94b064 name:ZooKeeperConnection Watcher:127.0.0.1:32209 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1222736 T8431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1222737 T8431 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1222738 T8431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1222739 T8497 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1aa4f12f name:ZooKeeperConnection Watcher:127.0.0.1:32209/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1222739 T8431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1222743 T8431 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1223746 T8431 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32239_zmz
[junit4] 2> 1223747 T8431 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:32239_zmz
[junit4] 2> 1223750 T8431 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1223755 T8431 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-004
[junit4] 2> 1224097 T8431 oasc.CorePropertiesLocator.discoverUnder Found core conf in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-004/conf/
[junit4] 2> 1225641 T8431 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1225642 T8431 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
[junit4] 2> 1225642 T8431 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1226674 T8431 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 1226675 T8431 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1226679 T8431 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1226680 T8431 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:32245
[junit4] 2> 1226682 T8431 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1226683 T8431 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1226683 T8431 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-005
[junit4] 2> 1226683 T8431 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-005/'
[junit4] 2> 1226717 T8431 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-005/solr.xml
[junit4] 2> 1226763 T8431 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-005
[junit4] 2> 1226764 T8431 oasc.CoreContainer.<init> New CoreContainer 730363266
[junit4] 2> 1226764 T8431 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-005/]
[junit4] 2> 1226765 T8431 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1226765 T8431 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1226765 T8431 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1226765 T8431 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1226766 T8431 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1226766 T8431 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1226766 T8431 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1226766 T8431 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1226766 T8431 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1226768 T8431 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 1226770 T8431 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1226770 T8431 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1226770 T8431 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1226771 T8431 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:32209/solr
[junit4] 2> 1226771 T8431 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1226771 T8431 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1226772 T8431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1226773 T8510 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@445f0117 name:ZooKeeperConnection Watcher:127.0.0.1:32209 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1226774 T8431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1226774 T8431 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1226776 T8431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1226776 T8512 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36339a6a name:ZooKeeperConnection Watcher:127.0.0.1:32209/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1226777 T8431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1226780 T8431 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1227783 T8431 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32245_zmz
[junit4] 2> 1227784 T8431 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:32245_zmz
[junit4] 2> 1227788 T8431 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1227792 T8431 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-005
[junit4] 2> 1227836 T8431 oasc.CorePropertiesLocator.discoverUnder Found core conf in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-005/conf/
[junit4] 2> 1229964 T8431 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1229966 T8431 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
[junit4] 2> 1229966 T8431 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1231183 T8431 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
[junit4] 2> 1231183 T8431 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1231188 T8431 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1231189 T8431 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:49357
[junit4] 2> 1231191 T8431 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1231191 T8431 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1231191 T8431 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-006
[junit4] 2> 1231192 T8431 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-006/'
[junit4] 2> 1231222 T8431 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-006/solr.xml
[junit4] 2> 1231310 T8431 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-006
[junit4] 2> 1231310 T8431 oasc.CoreContainer.<init> New CoreContainer 97837866
[junit4] 2> 1231311 T8431 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-006/]
[junit4] 2> 1231312 T8431 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1231312 T8431 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1231312 T8431 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1231312 T8431 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1231313 T8431 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1231313 T8431 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1231313 T8431 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1231313 T8431 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1231313 T8431 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1231315 T8431 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 1231317 T8431 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1231317 T8431 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1231317 T8431 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1231318 T8431 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:32209/solr
[junit4] 2> 1231318 T8431 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1231318 T8431 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1231319 T8431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1231320 T8525 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4aa3bddd name:ZooKeeperConnection Watcher:127.0.0.1:32209 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1231321 T8431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1231321 T8431 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1231323 T8431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1231324 T8527 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ca4469 name:ZooKeeperConnection Watcher:127.0.0.1:32209/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1231325 T8431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1231329 T8431 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1232333 T8431 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49357_zmz
[junit4] 2> 1232334 T8431 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49357_zmz
[junit4] 2> 1232337 T8431 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1232341 T8431 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-006
[junit4] 2> 1233207 T8431 oasc.CorePropertiesLocator.discoverUnder Found core conf in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-006/conf/
[junit4] 2> 1233209 T8431 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1233210 T8431 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
[junit4] 2> 1233210 T8431 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1233343 T8476 oasha.CollectionsHandler.handleCreateAction Creating Collection : name=solrj_collection&wt=javabin&numShards=2&replicationFactor=2&collection.configName=conf1&version=2&action=CREATE&router.field=myOwnField
[junit4] 2> 1233345 T8468 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1233346 T8461 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"create",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField"}
[junit4] 2> 1233347 T8531 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : create , {
[junit4] 2> "operation":"create",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField"}
[junit4] 2> 1233348 T8531 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/solrj_collection
[junit4] 2> 1233348 T8531 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
[junit4] 2> 1233350 T8468 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1233352 T8460 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: solrj_collection
[junit4] 2> 1233352 T8460 oasc.Overseer$ClusterStateUpdater.createCollection Create collection solrj_collection with shards [shard1, shard2]
[junit4] 2> 1233353 T8460 oasc.Overseer$ClusterStateUpdater.createCollection state version solrj_collection 1
[junit4] 2> 1233354 T8468 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1233354 T8483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1233354 T8498 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1233354 T8528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1233354 T8469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1233354 T8513 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1233451 T8531 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection solrj_collection, shardNames [shard1, shard2] , replicationFactor : 2
[junit4] 2> 1233452 T8531 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of collection solrj_collection on 127.0.0.1:49357_zmz
[junit4] 2> 1233453 T8531 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of collection solrj_collection on 127.0.0.1:32245_zmz
[junit4] 2> 1233454 T8531 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of collection solrj_collection on 127.0.0.1:32220_zmz
[junit4] 2> 1233456 T8531 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of collection solrj_collection on 127.0.0.1:32239_zmz
[junit4] 2> 1233577 T8517 oasha.CoreAdminHandler.handleCreateAction core create command shard=shard1&name=solrj_collection_shard1_replica1&wt=javabin&numShards=2&collection=solrj_collection&collection.configName=conf1&qt=/admin/cores&version=2&action=CREATE
[junit4] 2> 1233578 T8489 oasha.CoreAdminHandler.handleCreateAction core create command shard=shard2&name=solrj_collection_shard2_replica2&wt=javabin&numShards=2&collection=solrj_collection&collection.configName=conf1&qt=/admin/cores&version=2&action=CREATE
[junit4] 2> 1233581 T8517 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica1 state=down collection=solrj_collection
[junit4] 2> 1233582 T8468 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1233582 T8517 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1233582 T8489 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica2 state=down collection=solrj_collection
[junit4] 2> 1233583 T8489 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1233584 T8460 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "shard":"shard1",
[junit4] 2> "state":"down",
[junit4] 2> "numShards":"2",
[junit4] 2> "roles":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "node_name":"127.0.0.1:49357_zmz",
[junit4] 2> "operation":"state",
[junit4] 2> "core":"solrj_collection_shard1_replica1",
[junit4] 2> "base_url":"https://127.0.0.1:49357/zmz"}
[junit4] 2> 1233585 T8503 oasha.CoreAdminHandler.handleCreateAction core create command shard=shard1&name=solrj_collection_shard1_replica2&wt=javabin&numShards=2&collection=solrj_collection&collection.configName=conf1&qt=/admin/cores&version=2&action=CREATE
[junit4] 2> 1233585 T8449 oasha.CoreAdminHandler.handleCreateAction core create command shard=shard2&name=solrj_collection_shard2_replica1&wt=javabin&numShards=2&collection=solrj_collection&collection.configName=conf1&qt=/admin/cores&version=2&action=CREATE
[junit4] 2> 1233587 T8460 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "shard":"shard2",
[junit4] 2> "state":"down",
[junit4] 2> "numShards":"2",
[junit4] 2> "roles":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "node_name":"127.0.0.1:32239_zmz",
[junit4] 2> "operation":"state",
[junit4] 2> "core":"solrj_collection_shard2_replica2",
[junit4] 2> "base_url":"https://127.0.0.1:32239/zmz"}
[junit4] 2> 1233588 T8468 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1233589 T8468 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1233589 T8528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1233589 T8513 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1233590 T8503 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica2 state=down collection=solrj_collection
[junit4] 2> 1233589 T8483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1233589 T8498 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1233589 T8469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1233590 T8449 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica1 state=down collection=solrj_collection
[junit4] 2> 1233591 T8503 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1233592 T8449 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1233595 T8460 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "shard":"shard1",
[junit4] 2> "state":"down",
[junit4] 2> "numShards":"2",
[junit4] 2> "roles":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "node_name":"127.0.0.1:32245_zmz",
[junit4] 2> "operation":"state",
[junit4] 2> "core":"solrj_collection_shard1_replica2",
[junit4] 2> "base_url":"https://127.0.0.1:32245/zmz"}
[junit4] 2> 1233596 T8468 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1233597 T8460 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "shard":"shard2",
[junit4] 2> "state":"down",
[junit4] 2> "numShards":"2",
[junit4] 2> "roles":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "node_name":"127.0.0.1:32220_zmz",
[junit4] 2> "operation":"state",
[junit4] 2> "core":"solrj_collection_shard2_replica1",
[junit4] 2> "base_url":"https://127.0.0.1:32220/zmz"}
[junit4] 2> 1233700 T8468 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1233700 T8469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1233700 T8498 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1233700 T8483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1233700 T8513 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1233700 T8528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1234582 T8517 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica1
[junit4] 2> 1234583 T8517 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 1234583 T8517 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1234583 T8489 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica2
[junit4] 2> 1234584 T8517 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 1234584 T8489 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 1234585 T8517 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1234585 T8489 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1234585 T8517 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-006/solrj_collection_shard1_replica1/'
[junit4] 2> 1234586 T8489 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 1234587 T8489 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1234587 T8489 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-004/solrj_collection_shard2_replica2/'
[junit4] 2> 1234592 T8449 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica1
[junit4] 2> 1234592 T8503 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica2
[junit4] 2> 1234593 T8449 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 1234593 T8503 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 1234593 T8449 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1234594 T8449 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 1234594 T8503 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1234595 T8449 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1234595 T8503 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 1234595 T8449 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-002/solrj_collection_shard2_replica1/'
[junit4] 2> 1234596 T8503 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1234598 T8503 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-005/solrj_collection_shard1_replica2/'
[junit4] 2> 1234749 T8449 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 1234751 T8489 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 1234753 T8517 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 1234754 T8503 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 1234802 T8449 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1234804 T8449 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1234804 T8489 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1234812 T8449 oass.IndexSchema.readSchema [solrj_collection_shard2_replica1] Schema name=test
[junit4] 2> 1234812 T8517 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1234821 T8503 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1234906 T8489 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1234914 T8517 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1234918 T8489 oass.IndexSchema.readSchema [solrj_collection_shard2_replica2] Schema name=test
[junit4] 2> 1234923 T8503 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1234923 T8517 oass.IndexSchema.readSchema [solrj_collection_shard1_replica1] Schema name=test
[junit4] 2> 1234933 T8503 oass.IndexSchema.readSchema [solrj_collection_shard1_replica2] Schema name=test
[junit4] 2> 1235221 T8449 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1235235 T8449 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1235239 T8449 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1235261 T8449 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1235268 T8449 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1235273 T8449 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1235274 T8449 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1235276 T8449 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1235276 T8449 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1235277 T8449 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1235278 T8449 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1235278 T8449 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica1' using configuration from collection solrj_collection
[junit4] 2> 1235279 T8449 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1235279 T8449 oasc.SolrCore.<init> [solrj_collection_shard2_replica1] Opening new SolrCore at ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-002/solrj_collection_shard2_replica1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-002/solrj_collection_shard2_replica1/data/
[junit4] 2> 1235280 T8449 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b58a8bb
[junit4] 2> 1235282 T8449 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-002/solrj_collection_shard2_replica1/data
[junit4] 2> 1235283 T8449 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-002/solrj_collection_shard2_replica1/data/index/
[junit4] 2> 1235283 T8449 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-002/solrj_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1235284 T8449 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-002/solrj_collection_shard2_replica1/data/index
[junit4] 2> 1235285 T8449 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=75.966796875, floorSegmentMB=1.2001953125, forceMergeDeletesPctAllowed=25.88963239223628, segmentsPerTier=43.0, maxCFSSegmentSizeMB=1.0302734375, noCFSRatio=0.8531188099796888
[junit4] 2> 1235286 T8449 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-7ad4a0bb)),segFN=segments_1,generation=1}
[junit4] 2> 1235287 T8449 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1235293 T8449 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1235293 T8449 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1235294 T8449 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1235294 T8449 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1235294 T8449 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1235295 T8449 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1235296 T8449 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1235296 T8449 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1235297 T8449 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1235298 T8449 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 1235298 T8449 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 1235299 T8449 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 1235300 T8449 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1235300 T8449 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1235301 T8449 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1235301 T8449 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1235302 T8449 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1235303 T8449 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1235303 T8489 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1235303 T8449 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1235304 T8449 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 1235308 T8489 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1235311 T8489 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1235321 T8489 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1235326 T8489 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1235330 T8489 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1235331 T8489 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1235332 T8489 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1235332 T8489 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1235333 T8489 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1235333 T8449 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1235333 T8489 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1235334 T8489 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica2' using configuration from collection solrj_collection
[junit4] 2> 1235334 T8489 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1235334 T8489 oasc.SolrCore.<init> [solrj_collection_shard2_replica2] Opening new SolrCore at ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-004/solrj_collection_shard2_replica2/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-004/solrj_collection_shard2_replica2/data/
[junit4] 2> 1235335 T8489 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b58a8bb
[junit4] 2> 1235335 T8489 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-004/solrj_collection_shard2_replica2/data
[junit4] 2> 1235335 T8449 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1235336 T8489 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-004/solrj_collection_shard2_replica2/data/index/
[junit4] 2> 1235336 T8489 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica2] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-004/solrj_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 1235337 T8489 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001/tempDir-004/solrj_collection_shard2_replica2/data/index
[junit4] 2> 1235337 T8489 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=75.966796875, floorSegmentMB=1.2001953125, forceMergeDeletesPctAllowed=25.88963239223628, segmentsPerTier=43.0, maxCFSSegmentSizeMB=1.0302734375, noCFSRatio=0.8531188099796888
[junit4] 2> 1235338 T8489 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-40103669)),segFN=segments_1,generation=1}
[junit4] 2> 1235338 T8449 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1235338 T8489 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1235341 T8449 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1235343 T8489 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1235343 T8489 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1235344 T8489 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1235344 T8489 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1235344 T8489 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1235344 T8489 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1235345 T8489 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1235345 T8489 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1235345 T8489 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1235346 T8489 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 1235346 T8489 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 1235347 T8489 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 1235347 T8489 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1235348 T8489 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1235348 T8489 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1235348 T8489 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1235349 T8489 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1235349 T8449 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1235349 T8489 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1235349 T8449 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1235350 T8489 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1235350 T8489 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 1235351 T8449 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeD
[...truncated too long message...]
tractFullDistribZkTestBase.java:1543)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1569)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1037)Throwable #3: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=10213, name=Thread-2953, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not fully create collection: awholynewstresscollection_collection0_3
[junit4] > at __randomizedtesting.SeedInfo.seed([4A099FA7E133D9BE]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:556)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:212)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:208)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1543)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1569)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1037)Throwable #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=10214, name=Thread-2954, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not fully create collection: awholynewstresscollection_collection1_3
[junit4] > at __randomizedtesting.SeedInfo.seed([4A099FA7E133D9BE]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:556)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:212)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:208)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1543)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1569)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1037)Throwable #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=10218, name=Thread-2958, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not fully create collection: awholynewstresscollection_collection5_3
[junit4] > at __randomizedtesting.SeedInfo.seed([4A099FA7E133D9BE]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:556)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:212)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:208)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1543)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1569)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1037)Throwable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=10216, name=Thread-2956, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not fully create collection: awholynewstresscollection_collection3_3
[junit4] > at __randomizedtesting.SeedInfo.seed([4A099FA7E133D9BE]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:556)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:212)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:208)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1543)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1569)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1037)Throwable #7: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=10215, name=Thread-2955, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not fully create collection: awholynewstresscollection_collection2_4
[junit4] > at __randomizedtesting.SeedInfo.seed([4A099FA7E133D9BE]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:556)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:212)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:208)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1543)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1569)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1037)
[junit4] 2> 2166336 T8431 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-4A099FA7E133D9BE-001
[junit4] 2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=300), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=300)), sim=DefaultSimilarity, locale=es_BO, timezone=Europe/Vilnius
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=16,threads=1,free=209605952,total=529530880
[junit4] 2> NOTE: All tests run in this JVM: [IndexBasedSpellCheckerTest, TestSearchPerf, HdfsBasicDistributedZk2Test, BlockCacheTest, StandardRequestHandlerTest, UUIDFieldTest, EnumFieldTest, TermVectorComponentDistributedTest, TestSolrXml, TestSolrXmlPersistor, BadIndexSchemaTest, TestPivotHelperCode, SuggesterTest, SolrIndexSplitterTest, OutputWriterTest, HdfsBasicDistributedZkTest, TermVectorComponentTest, TestDistribDocBasedVersion, FileBasedSpellCheckerTest, TestRecoveryHdfs, RankQueryTest, DocExpirationUpdateProcessorFactoryTest, TestPHPSerializedResponseWriter, DeleteLastCustomShardedReplicaTest, TestSchemaVersionResource, TestCloudManagedSchemaConcurrent, CoreAdminHandlerTest, DocumentAnalysisRequestHandlerTest, TestCloudManagedSchema, HighlighterMaxOffsetTest, TestFastWriter, SolrInfoMBeanTest, ResponseLogComponentTest, ConnectionManagerTest, TestRawResponseWriter, SliceStateTest, TestSort, TestReplicationHandlerBackup, TestCoreDiscovery, UnloadDistributedZkTest, TimeZoneUtilsTest, SOLR749Test, TestCloudSchemaless, TestCSVResponseWriter, TestMergePolicyConfig, TestManagedResourceStorage, SpellPossibilityIteratorTest, ReplicationFactorTest, TestLMJelinekMercerSimilarityFactory, CoreContainerCoreInitFailuresTest, TestCustomSort, EchoParamsTest, ChaosMonkeySafeLeaderTest, CollectionsAPIDistributedZkTest]
[junit4] Completed on J3 in 952.25s, 1 test, 1 error <<< FAILURES!
[...truncated 698 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:531: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:472: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:496: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1360: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:962: There were test failures: 431 suites, 1778 tests, 1 error, 55 ignored (11 assumptions)
Total time: 186 minutes 31 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #632
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 432387487 bytes
Compression is 0.0%
Took 1 min 12 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 637 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/637/
8 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest
Error Message:
Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=6658, name=qtp1091572250-6658, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest], registration stack trace below.
Stack Trace:
com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=6658, name=qtp1091572250-6658, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest], registration stack trace below.
at java.lang.Thread.getStackTrace(Thread.java:1589)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:166)
at org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:688)
at org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:1231)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1122)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1114)
at org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:47)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:350)
at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:275)
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:487)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:793)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:651)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:466)
at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:575)
at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:199)
at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:188)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:744)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:253)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:202)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:137)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
at org.eclipse.jetty.server.Server.handle(Server.java:368)
at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
at org.eclipse.jetty.server.ssl.SslSocketConnector$SslConnectorEndPoint.run(SslSocketConnector.java:670)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: Directory not closed: MockDirectoryWrapper(NIOFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/index-NIOFSDirectory-251 lockFactory=NativeFSLockFactory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/index-NIOFSDirectory-251)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:699)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:696)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:183)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:712)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
... 1 more
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest
Error Message:
Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=6658, name=qtp1091572250-6658, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest], registration stack trace below.
Stack Trace:
com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=6658, name=qtp1091572250-6658, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest], registration stack trace below.
at java.lang.Thread.getStackTrace(Thread.java:1589)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:166)
at org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:688)
at org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:1231)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1122)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1114)
at org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:47)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:350)
at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:62)
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:528)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:793)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:651)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:466)
at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:575)
at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:199)
at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:188)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:744)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:253)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:202)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:137)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
at org.eclipse.jetty.server.Server.handle(Server.java:368)
at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
at org.eclipse.jetty.server.ssl.SslSocketConnector$SslConnectorEndPoint.run(SslSocketConnector.java:670)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: Directory not closed: MockDirectoryWrapper(RAMDirectory(id=lucene-128dfd3c))
at org.junit.Assert.fail(Assert.java:93)
at org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:699)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:696)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:183)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:712)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
... 1 more
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest
Error Message:
Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=993, name=qtp1091572250-993, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest], registration stack trace below.
Stack Trace:
com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=993, name=qtp1091572250-993, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest], registration stack trace below.
at java.lang.Thread.getStackTrace(Thread.java:1589)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:166)
at org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:688)
at org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:1231)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1122)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1114)
at org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:47)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:350)
at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:275)
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:487)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:793)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:651)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:466)
at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:575)
at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:199)
at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:188)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:744)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:253)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:202)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:137)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
at org.eclipse.jetty.server.Server.handle(Server.java:368)
at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
at org.eclipse.jetty.server.ssl.SslSocketConnector$SslConnectorEndPoint.run(SslSocketConnector.java:670)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: Directory not closed: MockDirectoryWrapper(RateLimitedDirectoryWrapper(RAMDirectory(id=lucene-66742886)))
at org.junit.Assert.fail(Assert.java:93)
at org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:699)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:696)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:183)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:712)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
... 1 more
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest
Error Message:
Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=993, name=qtp1091572250-993, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest], registration stack trace below.
Stack Trace:
com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=993, name=qtp1091572250-993, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest], registration stack trace below.
at java.lang.Thread.getStackTrace(Thread.java:1589)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:166)
at org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:688)
at org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:1225)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1122)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1114)
at org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:47)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:350)
at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:62)
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:528)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:793)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:651)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:466)
at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:575)
at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:199)
at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:188)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:744)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:253)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:202)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:137)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
at org.eclipse.jetty.server.Server.handle(Server.java:368)
at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
at org.eclipse.jetty.server.ssl.SslSocketConnector$SslConnectorEndPoint.run(SslSocketConnector.java:670)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: Directory not closed: BaseDirectoryWrapper(RAMDirectory(id=lucene-68e48466))
at org.junit.Assert.fail(Assert.java:93)
at org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:699)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:696)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:183)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:712)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
... 1 more
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest: 1) Thread[id=8231, name=Thread-649-SendThread(127.0.0.1:29674), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest:
1) Thread[id=8231, name=Thread-649-SendThread(127.0.0.1:29674), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
at __randomizedtesting.SeedInfo.seed([7B54C811F17E9AF3]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=8231, name=Thread-649-SendThread(127.0.0.1:29674), state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] at sun.nio.ch.IOUtil.drain(Native Method) at sun.nio.ch.KQueueSelectorImpl.updateSelectedKeys(KQueueSelectorImpl.java:167) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:108) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=8231, name=Thread-649-SendThread(127.0.0.1:29674), state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
at sun.nio.ch.IOUtil.drain(Native Method)
at sun.nio.ch.KQueueSelectorImpl.updateSelectedKeys(KQueueSelectorImpl.java:167)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:108)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
at __randomizedtesting.SeedInfo.seed([7B54C811F17E9AF3]:0)
REGRESSION: org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload
Error Message:
expected:<[{indexVersion=1412129110018,generation=2,filelist=[_5u.fdt, _5u.fdx, _5u.fnm, _5u.nvd, _5u.nvm, _5u.si, _5u_Lucene41VarGapFixedInterval_0.doc, _5u_Lucene41VarGapFixedInterval_0.tib, _5u_Lucene41VarGapFixedInterval_0.tiv, _bo.fdt, _bo.fdx, _bo.fnm, _bo.nvd, _bo.nvm, _bo.si, _bo_Lucene41VarGapFixedInterval_0.doc, _bo_Lucene41VarGapFixedInterval_0.tib, _bo_Lucene41VarGapFixedInterval_0.tiv, _hi.cfe, _hi.cfs, _hi.si, _nc.cfe, _nc.cfs, _nc.si, _t6.cfe, _t6.cfs, _t6.si, _wu.cfe, _wu.cfs, _wu.si, _wv.cfe, _wv.cfs, _wv.si, _ww.cfe, _ww.cfs, _ww.si, _wx.cfe, _wx.cfs, _wx.si, _wy.cfe, _wy.cfs, _wy.si, _wz.cfe, _wz.cfs, _wz.si, _x0.cfe, _x0.cfs, _x0.si, _x1.cfe, _x1.cfs, _x1.si, _x2.cfe, _x2.cfs, _x2.si, _x3.cfe, _x3.cfs, _x3.si, _x4.cfe, _x4.cfs, _x4.si, _x5.cfe, _x5.cfs, _x5.si, segments_2]}]> but was:<[{indexVersion=1412129110018,generation=3,filelist=[_5u.fdt, _5u.fdx, _5u.fnm, _5u.nvd, _5u.nvm, _5u.si, _5u_Lucene41VarGapFixedInterval_0.doc, _5u_Lucene41VarGapFixedInterval_0.tib, _5u_Lucene41VarGapFixedInterval_0.tiv, _bo.fdt, _bo.fdx, _bo.fnm, _bo.nvd, _bo.nvm, _bo.si, _bo_Lucene41VarGapFixedInterval_0.doc, _bo_Lucene41VarGapFixedInterval_0.tib, _bo_Lucene41VarGapFixedInterval_0.tiv, _hi.cfe, _hi.cfs, _hi.si, _nc.cfe, _nc.cfs, _nc.si, _t6.cfe, _t6.cfs, _t6.si, _x5.cfe, _x5.cfs, _x5.si, _x6.cfe, _x6.cfs, _x6.si, segments_3]}, {indexVersion=1412129110018,generation=2,filelist=[_5u.fdt, _5u.fdx, _5u.fnm, _5u.nvd, _5u.nvm, _5u.si, _5u_Lucene41VarGapFixedInterval_0.doc, _5u_Lucene41VarGapFixedInterval_0.tib, _5u_Lucene41VarGapFixedInterval_0.tiv, _bo.fdt, _bo.fdx, _bo.fnm, _bo.nvd, _bo.nvm, _bo.si, _bo_Lucene41VarGapFixedInterval_0.doc, _bo_Lucene41VarGapFixedInterval_0.tib, _bo_Lucene41VarGapFixedInterval_0.tiv, _hi.cfe, _hi.cfs, _hi.si, _nc.cfe, _nc.cfs, _nc.si, _t6.cfe, _t6.cfs, _t6.si, _wu.cfe, _wu.cfs, _wu.si, _wv.cfe, _wv.cfs, _wv.si, _ww.cfe, _ww.cfs, _ww.si, _wx.cfe, _wx.cfs, _wx.si, _wy.cfe, _wy.cfs, _wy.si, _wz.cfe, _wz.cfs, _wz.si, _x0.cfe, _x0.cfs, _x0.si, _x1.cfe, _x1.cfs, _x1.si, _x2.cfe, _x2.cfs, _x2.si, _x3.cfe, _x3.cfs, _x3.si, _x4.cfe, _x4.cfs, _x4.si, _x5.cfe, _x5.cfs, _x5.si, segments_2]}]>
Stack Trace:
java.lang.AssertionError: expected:<[{indexVersion=1412129110018,generation=2,filelist=[_5u.fdt, _5u.fdx, _5u.fnm, _5u.nvd, _5u.nvm, _5u.si, _5u_Lucene41VarGapFixedInterval_0.doc, _5u_Lucene41VarGapFixedInterval_0.tib, _5u_Lucene41VarGapFixedInterval_0.tiv, _bo.fdt, _bo.fdx, _bo.fnm, _bo.nvd, _bo.nvm, _bo.si, _bo_Lucene41VarGapFixedInterval_0.doc, _bo_Lucene41VarGapFixedInterval_0.tib, _bo_Lucene41VarGapFixedInterval_0.tiv, _hi.cfe, _hi.cfs, _hi.si, _nc.cfe, _nc.cfs, _nc.si, _t6.cfe, _t6.cfs, _t6.si, _wu.cfe, _wu.cfs, _wu.si, _wv.cfe, _wv.cfs, _wv.si, _ww.cfe, _ww.cfs, _ww.si, _wx.cfe, _wx.cfs, _wx.si, _wy.cfe, _wy.cfs, _wy.si, _wz.cfe, _wz.cfs, _wz.si, _x0.cfe, _x0.cfs, _x0.si, _x1.cfe, _x1.cfs, _x1.si, _x2.cfe, _x2.cfs, _x2.si, _x3.cfe, _x3.cfs, _x3.si, _x4.cfe, _x4.cfs, _x4.si, _x5.cfe, _x5.cfs, _x5.si, segments_2]}]> but was:<[{indexVersion=1412129110018,generation=3,filelist=[_5u.fdt, _5u.fdx, _5u.fnm, _5u.nvd, _5u.nvm, _5u.si, _5u_Lucene41VarGapFixedInterval_0.doc, _5u_Lucene41VarGapFixedInterval_0.tib, _5u_Lucene41VarGapFixedInterval_0.tiv, _bo.fdt, _bo.fdx, _bo.fnm, _bo.nvd, _bo.nvm, _bo.si, _bo_Lucene41VarGapFixedInterval_0.doc, _bo_Lucene41VarGapFixedInterval_0.tib, _bo_Lucene41VarGapFixedInterval_0.tiv, _hi.cfe, _hi.cfs, _hi.si, _nc.cfe, _nc.cfs, _nc.si, _t6.cfe, _t6.cfs, _t6.si, _x5.cfe, _x5.cfs, _x5.si, _x6.cfe, _x6.cfs, _x6.si, segments_3]}, {indexVersion=1412129110018,generation=2,filelist=[_5u.fdt, _5u.fdx, _5u.fnm, _5u.nvd, _5u.nvm, _5u.si, _5u_Lucene41VarGapFixedInterval_0.doc, _5u_Lucene41VarGapFixedInterval_0.tib, _5u_Lucene41VarGapFixedInterval_0.tiv, _bo.fdt, _bo.fdx, _bo.fnm, _bo.nvd, _bo.nvm, _bo.si, _bo_Lucene41VarGapFixedInterval_0.doc, _bo_Lucene41VarGapFixedInterval_0.tib, _bo_Lucene41VarGapFixedInterval_0.tiv, _hi.cfe, _hi.cfs, _hi.si, _nc.cfe, _nc.cfs, _nc.si, _t6.cfe, _t6.cfs, _t6.si, _wu.cfe, _wu.cfs, _wu.si, _wv.cfe, _wv.cfs, _wv.si, _ww.cfe, _ww.cfs, _ww.si, _wx.cfe, _wx.cfs, _wx.si, _wy.cfe, _wy.cfs, _wy.si, _wz.cfe, _wz.cfs, _wz.si, _x0.cfe, _x0.cfs, _x0.si, _x1.cfe, _x1.cfs, _x1.si, _x2.cfe, _x2.cfs, _x2.si, _x3.cfe, _x3.cfs, _x3.si, _x4.cfe, _x4.cfs, _x4.si, _x5.cfe, _x5.cfs, _x5.si, segments_2]}]>
at __randomizedtesting.SeedInfo.seed([7B54C811F17E9AF3:5E83D321813694F0]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:147)
at org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload(TestReplicationHandler.java:1175)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
Captured an uncaught exception in thread: Thread[id=831, name=qtp81597283-831, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=831, name=qtp81597283-831, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.OutOfMemoryError: unable to create new native thread
at __randomizedtesting.SeedInfo.seed([7B54C811F17E9AF3]:0)
at java.lang.Thread.start0(Native Method)
at java.lang.Thread.start(Thread.java:714)
at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:1047)
at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1312)
at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1339)
at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1323)
at org.eclipse.jetty.server.ssl.SslSocketConnector$SslConnectorEndPoint.run(SslSocketConnector.java:665)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11590 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/init-core-data-001
[junit4] 2> 371519 T750 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
[junit4] 2> 371519 T750 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /gnvi/
[junit4] 2> 371527 T750 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 371528 T750 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 371529 T751 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 371629 T750 oasc.ZkTestServer.run start zk server on port:29674
[junit4] 2> 371630 T750 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 371637 T750 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 371642 T757 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a12e1e6 name:ZooKeeperConnection Watcher:127.0.0.1:29674 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 371643 T750 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 371643 T750 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 371644 T750 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 371648 T750 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 371649 T750 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 371652 T759 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3199ee4 name:ZooKeeperConnection Watcher:127.0.0.1:29674/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 371652 T750 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 371652 T750 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 371653 T750 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 371657 T750 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 371659 T750 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 371661 T750 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 371665 T750 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 371666 T750 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 371671 T750 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 371672 T750 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 371676 T750 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 371677 T750 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 371681 T750 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 371682 T750 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 371687 T750 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 371688 T750 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 371691 T750 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 371692 T750 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 371696 T750 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 371697 T750 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 371700 T750 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 371701 T750 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 371705 T750 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 371706 T750 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 371709 T750 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 371711 T750 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 371714 T750 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 371715 T750 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 371719 T750 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 371721 T750 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 371722 T761 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5a56124c name:ZooKeeperConnection Watcher:127.0.0.1:29674/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 371723 T750 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 371723 T750 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> Using old style solr.xml
[junit4] 2> 373447 T750 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 373452 T750 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 373456 T750 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:31406
[junit4] 2> 373458 T750 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 373459 T750 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 373459 T750 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-002
[junit4] 2> 373459 T750 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-002/'
[junit4] 2> 373493 T750 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-002/solr.xml
[junit4] 2> 373547 T750 oasc.CoreContainer.<init> New CoreContainer 848254579
[junit4] 2> 373547 T750 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-002/]
[junit4] 2> 373548 T750 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 373548 T750 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 373549 T750 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 373549 T750 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 373549 T750 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 373549 T750 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 373550 T750 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 373550 T750 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 373550 T750 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 373552 T750 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false
[junit4] 2> 373554 T750 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 373554 T750 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 373555 T750 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 373555 T750 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:29674/solr
[junit4] 2> 373555 T750 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 373555 T750 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 373556 T750 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 373558 T772 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5688e4ae name:ZooKeeperConnection Watcher:127.0.0.1:29674 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 373558 T750 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 373559 T750 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 373560 T750 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 373562 T774 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@34e09ae9 name:ZooKeeperConnection Watcher:127.0.0.1:29674/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 373562 T750 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 373563 T750 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 373565 T750 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 373567 T750 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 373569 T750 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 373571 T750 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 373573 T750 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 373574 T750 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:31406_gnvi
[junit4] 2> 373574 T750 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:31406_gnvi
[junit4] 2> 373576 T750 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 373577 T750 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 373579 T750 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 373580 T750 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:31406_gnvi
[junit4] 2> 373580 T750 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 373581 T750 oasc.Overseer.start Overseer (id=92545190187958276-127.0.0.1:31406_gnvi-n_0000000000) starting
[junit4] 2> 373583 T750 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 373590 T750 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 373590 T776 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 373591 T750 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 373592 T750 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 373594 T750 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 373596 T775 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 373598 T750 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
[junit4] 2> 373599 T750 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 373602 T750 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 373603 T750 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 373604 T780 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5f8dedc name:ZooKeeperConnection Watcher:127.0.0.1:29674/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 373604 T750 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 373604 T750 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 373605 T750 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 373607 T750 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 374512 T750 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 374513 T750 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 374517 T750 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 374519 T750 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:31412
[junit4] 2> 374521 T750 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 374522 T750 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 374522 T750 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-003
[junit4] 2> 374522 T750 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-003/'
[junit4] 2> 374552 T750 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-003/solr.xml
[junit4] 2> 374620 T750 oasc.CoreContainer.<init> New CoreContainer 334332667
[junit4] 2> 374621 T750 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-003/]
[junit4] 2> 374622 T750 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 374622 T750 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 374622 T750 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 374622 T750 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 374623 T750 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 374623 T750 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 374623 T750 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 374623 T750 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 374624 T750 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 374626 T750 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false
[junit4] 2> 374628 T750 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 374628 T750 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 374628 T750 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 374628 T750 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:29674/solr
[junit4] 2> 374629 T750 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 374629 T750 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 374630 T750 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 374631 T791 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2fe6db89 name:ZooKeeperConnection Watcher:127.0.0.1:29674 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 374632 T750 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 374632 T750 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 374634 T750 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 374635 T793 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1042b366 name:ZooKeeperConnection Watcher:127.0.0.1:29674/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 374635 T750 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 374640 T750 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 375643 T750 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:31412_gnvi
[junit4] 2> 375644 T750 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:31412_gnvi
[junit4] 2> 375647 T750 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 375653 T750 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
[junit4] 2> 375653 T750 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 377283 T750 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 377284 T750 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 377289 T750 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 377290 T750 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:31420
[junit4] 2> 377293 T750 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 377293 T750 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 377293 T750 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-004
[junit4] 2> 377293 T750 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-004/'
[junit4] 2> 377337 T750 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-004/solr.xml
[junit4] 2> 377412 T750 oasc.CoreContainer.<init> New CoreContainer 1770894633
[junit4] 2> 377413 T750 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-004/]
[junit4] 2> 377414 T750 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 377414 T750 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 377414 T750 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 377414 T750 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 377415 T750 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 377415 T750 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 377415 T750 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 377415 T750 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 377416 T750 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 377418 T750 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false
[junit4] 2> 377420 T750 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 377420 T750 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 377420 T750 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 377420 T750 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:29674/solr
[junit4] 2> 377421 T750 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 377421 T750 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 377422 T750 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 377423 T808 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2f8b95a3 name:ZooKeeperConnection Watcher:127.0.0.1:29674 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 377424 T750 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 377424 T750 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 377426 T750 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 377427 T810 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10a55706 name:ZooKeeperConnection Watcher:127.0.0.1:29674/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 377427 T750 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 377431 T750 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 378433 T750 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:31420_gnvi
[junit4] 2> 378434 T750 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:31420_gnvi
[junit4] 2> 378437 T750 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 378442 T750 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
[junit4] 2> 378442 T750 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 380311 T750 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 380312 T750 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 380318 T750 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 380322 T750 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:32994
[junit4] 2> 380325 T750 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 380326 T750 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 380326 T750 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-005
[junit4] 2> 380326 T750 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-005/'
[junit4] 2> 380404 T750 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-005/solr.xml
[junit4] 2> 380521 T750 oasc.CoreContainer.<init> New CoreContainer 856264067
[junit4] 2> 380522 T750 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-005/]
[junit4] 2> 380524 T750 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 380524 T750 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 380525 T750 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 380525 T750 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 380526 T750 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 380526 T750 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 380527 T750 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 380527 T750 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 380528 T750 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 380532 T750 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false
[junit4] 2> 380536 T750 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 380537 T750 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 380537 T750 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 380538 T750 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:29674/solr
[junit4] 2> 380538 T750 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 380539 T750 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 380540 T750 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 380544 T823 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c466787 name:ZooKeeperConnection Watcher:127.0.0.1:29674 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 380549 T750 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 380549 T750 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 380552 T750 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 380554 T825 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12901eaa name:ZooKeeperConnection Watcher:127.0.0.1:29674/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 380555 T750 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 380563 T750 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 381567 T750 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32994_gnvi
[junit4] 2> 381568 T750 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:32994_gnvi
[junit4] 2> 381573 T750 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 381580 T750 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
[junit4] 2> 381581 T750 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 383317 T750 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
[junit4] 2> 383318 T750 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 383328 T750 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 383332 T750 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:37043
[junit4] 2> 383340 T750 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 383340 T750 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 383341 T750 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-006
[junit4] 2> 383341 T750 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-006/'
[junit4] 2> 383396 T750 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-006/solr.xml
[junit4] 2> 383537 T750 oasc.CoreContainer.<init> New CoreContainer 598588302
[junit4] 2> 383538 T750 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-006/]
[junit4] 2> 383539 T750 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 383540 T750 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 383541 T750 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 383541 T750 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 383541 T750 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 383542 T750 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 383542 T750 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 383543 T750 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 383543 T750 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 383547 T750 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false
[junit4] 2> 383550 T750 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 383551 T750 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 383551 T750 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 383551 T750 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:29674/solr
[junit4] 2> 383552 T750 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 383553 T750 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 383554 T750 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 383556 T838 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7be768 name:ZooKeeperConnection Watcher:127.0.0.1:29674 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 383556 T750 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 383557 T750 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 383560 T750 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 383562 T840 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c3c8a6b name:ZooKeeperConnection Watcher:127.0.0.1:29674/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 383562 T750 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 383569 T750 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 384574 T750 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37043_gnvi
[junit4] 2> 384577 T750 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37043_gnvi
[junit4] 2> 384585 T750 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 384591 T750 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
[junit4] 2> 384591 T750 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 384759 T789 oasha.CollectionsHandler.handleCreateAction Creating Collection : version=2&router.field=myOwnField&numShards=2&name=solrj_collection&collection.configName=conf1&wt=javabin&replicationFactor=2&action=CREATE
[junit4] 2> 384761 T796 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 384763 T776 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"create",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField"}
[junit4] 2> 384764 T844 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : create , {
[junit4] 2> "operation":"create",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField"}
[junit4] 2> 384765 T844 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/solrj_collection
[junit4] 2> 384766 T844 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
[junit4] 2> 384770 T796 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 384773 T775 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: solrj_collection
[junit4] 2> 384774 T775 oasc.Overseer$ClusterStateUpdater.createCollection Create collection solrj_collection with shards [shard1, shard2]
[junit4] 2> 384774 T775 oasc.Overseer$ClusterStateUpdater.createCollection state version solrj_collection 1
[junit4] 2> 384778 T826 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 384778 T841 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 384778 T811 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 384778 T794 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 384778 T795 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 384778 T796 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 384870 T844 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection solrj_collection, shardNames [shard1, shard2] , replicationFactor : 2
[junit4] 2> 384871 T844 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of collection solrj_collection on 127.0.0.1:31412_gnvi
[junit4] 2> 384872 T844 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of collection solrj_collection on 127.0.0.1:31420_gnvi
[junit4] 2> 384875 T844 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of collection solrj_collection on 127.0.0.1:37043_gnvi
[junit4] 2> 384877 T844 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of collection solrj_collection on 127.0.0.1:32994_gnvi
[junit4] 2> 385015 T788 oasha.CoreAdminHandler.handleCreateAction core create command version=2&shard=shard1&qt=/admin/cores&numShards=2&collection=solrj_collection&name=solrj_collection_shard1_replica1&collection.configName=conf1&wt=javabin&action=CREATE
[junit4] 2> 385021 T788 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica1 state=down collection=solrj_collection
[junit4] 2> 385022 T788 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 385022 T796 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 385028 T815 oasha.CoreAdminHandler.handleCreateAction core create command version=2&shard=shard2&qt=/admin/cores&numShards=2&collection=solrj_collection&name=solrj_collection_shard2_replica2&collection.configName=conf1&wt=javabin&action=CREATE
[junit4] 2> 385028 T801 oasha.CoreAdminHandler.handleCreateAction core create command version=2&shard=shard1&qt=/admin/cores&numShards=2&collection=solrj_collection&name=solrj_collection_shard1_replica2&collection.configName=conf1&wt=javabin&action=CREATE
[junit4] 2> 385031 T775 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "core":"solrj_collection_shard1_replica1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "numShards":"2",
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "base_url":"https://127.0.0.1:31412/gnvi",
[junit4] 2> "node_name":"127.0.0.1:31412_gnvi"}
[junit4] 2> 385034 T830 oasha.CoreAdminHandler.handleCreateAction core create command version=2&shard=shard2&qt=/admin/cores&numShards=2&collection=solrj_collection&name=solrj_collection_shard2_replica1&collection.configName=conf1&wt=javabin&action=CREATE
[junit4] 2> 385036 T815 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica2 state=down collection=solrj_collection
[junit4] 2> 385036 T801 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica2 state=down collection=solrj_collection
[junit4] 2> 385037 T815 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 385038 T801 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 385038 T775 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "core":"solrj_collection_shard2_replica2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard2",
[junit4] 2> "numShards":"2",
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "base_url":"https://127.0.0.1:32994/gnvi",
[junit4] 2> "node_name":"127.0.0.1:32994_gnvi"}
[junit4] 2> 385039 T796 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 385040 T830 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica1 state=down collection=solrj_collection
[junit4] 2> 385042 T830 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 385043 T775 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "core":"solrj_collection_shard1_replica2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "numShards":"2",
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "base_url":"https://127.0.0.1:31420/gnvi",
[junit4] 2> "node_name":"127.0.0.1:31420_gnvi"}
[junit4] 2> 385046 T796 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 385047 T775 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null,
[junit4] 2> "core":"solrj_collection_shard2_replica1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard2",
[junit4] 2> "numShards":"2",
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "base_url":"https://127.0.0.1:37043/gnvi",
[junit4] 2> "node_name":"127.0.0.1:37043_gnvi"}
[junit4] 2> 385153 T796 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 385153 T811 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 385153 T841 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 385153 T794 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 385153 T826 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 385153 T795 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 386023 T788 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica1
[junit4] 2> 386024 T788 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 386025 T788 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 386026 T788 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 386027 T788 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 386027 T788 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-003/solrj_collection_shard1_replica1/'
[junit4] 2> 386038 T815 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica2
[junit4] 2> 386038 T801 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica2
[junit4] 2> 386039 T815 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 386040 T801 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 386041 T815 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 386041 T801 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 386041 T815 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 386042 T801 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 386043 T815 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 386043 T801 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 386044 T815 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-005/solrj_collection_shard2_replica2/'
[junit4] 2> 386043 T830 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica1
[junit4] 2> 386044 T801 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-004/solrj_collection_shard1_replica2/'
[junit4] 2> 386045 T830 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 386046 T830 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 386047 T830 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 386050 T830 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 386050 T830 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-006/solrj_collection_shard2_replica1/'
[junit4] 2> 386114 T788 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 386153 T815 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 386157 T801 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 386170 T830 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 386204 T788 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 386206 T788 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 386228 T815 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 386230 T815 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 386231 T801 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 386231 T788 oass.IndexSchema.readSchema [solrj_collection_shard1_replica1] Schema name=test
[junit4] 2> 386233 T801 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 386257 T830 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 386260 T830 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 386265 T815 oass.IndexSchema.readSchema [solrj_collection_shard2_replica2] Schema name=test
[junit4] 2> 386267 T801 oass.IndexSchema.readSchema [solrj_collection_shard1_replica2] Schema name=test
[junit4] 2> 386283 T830 oass.IndexSchema.readSchema [solrj_collection_shard2_replica1] Schema name=test
[junit4] 2> 386869 T788 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 386888 T788 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 386894 T801 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 386894 T788 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 386900 T815 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 386903 T801 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 386906 T801 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 386909 T815 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 386914 T815 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 386919 T788 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 386927 T788 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 386929 T801 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 386934 T788 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 386937 T788 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 386939 T788 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 386940 T801 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 386940 T788 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 386942 T788 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 386943 T788 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 386943 T815 oass.FileExchangeRateProvider.reload Reloadin
[...truncated too long message...]
junit4] 2> 2082279 T3909 C1128 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={qt=/replication&version=2&command=indexversion&wt=javabin} status=0 QTime=0
[junit4] 2> 2082280 T3928 oash.SnapPuller.fetchLatestIndex Slave in sync with master.
[junit4] 2> 2083279 T3909 C1128 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={qt=/replication&version=2&command=indexversion&wt=javabin} status=0 QTime=0
[junit4] 2> 2083279 T3928 oash.SnapPuller.fetchLatestIndex Slave in sync with master.
[junit4] 2> 2084279 T3909 C1128 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={qt=/replication&version=2&command=indexversion&wt=javabin} status=0 QTime=0
[junit4] 2> 2084281 T3928 oash.SnapPuller.fetchLatestIndex Slave in sync with master.
[junit4] 2> 2084607 T2879 oas.SolrTestCaseJ4.tearDown ###Ending doTestDetails
[junit4] 2> 2084608 T2879 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1172815473
[junit4] 2> 2084610 T2879 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@64ed108c
[junit4] 2> 2084610 T2879 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=3,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=3,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2084611 T2879 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2084611 T2879 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2084612 T2879 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2084613 T2879 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 2084614 T2879 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2084614 T2879 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-001/collection1/data/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-001/collection1/data/index;done=false>>]
[junit4] 2> 2084614 T2879 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-001/collection1/data/index
[junit4] 2> 2084618 T2879 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-001/collection1/data [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-001/collection1/data;done=false>>]
[junit4] 2> 2084618 T2879 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-001/collection1/data
[junit4] 2> 2084619 T2879 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 2089612 T2879 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1159813864
[junit4] 2> 2089614 T2879 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@7467b64c
[junit4] 2> 2100277 T3928 oash.SnapPuller.fetchLatestIndex ERROR Master at: http://127.0.0.1:24557/solr is not available. Index fetch failed. Exception: IOException occured when talking to server at: http://127.0.0.1:24557/solr
[junit4] 2> 2100279 T2879 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 2100280 T2879 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2100280 T2879 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2100281 T2879 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2100281 T2879 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 2100282 T2879 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2100282 T2879 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-002/collection1/data/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-002/collection1/data/index;done=false>>]
[junit4] 2> 2100283 T2879 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-002/collection1/data/index
[junit4] 2> 2100288 T2879 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-002/collection1/data [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-002/collection1/data;done=false>>]
[junit4] 2> 2100288 T2879 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-002/collection1/data
[junit4] 2> 2100289 T2879 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 2104631 T2879 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {id=PostingsFormat(name=Lucene41VarGapFixedInterval), newname=PostingsFormat(name=Lucene41VarGapFixedInterval), name=PostingsFormat(name=Lucene41VarGapFixedInterval)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ar, timezone=Pacific/Kosrae
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=16,threads=1,free=75538232,total=281542656
[junit4] 2> NOTE: All tests run in this JVM: [HdfsCollectionsAPIDistributedZkTest, LegacyHTMLStripCharFilterTest, CustomCollectionTest, TestDynamicFieldResource, BasicDistributedZk2Test, AtomicUpdatesTest, NumericFieldsTest, TestLuceneMatchVersion, DistributedExpandComponentTest, TestQueryUtils, XmlUpdateRequestHandlerTest, TestComplexPhraseQParserPlugin, MergeStrategyTest, SpellCheckCollatorTest, RollingRestartTest, CopyFieldTest, TestExpandComponent, InfoHandlerTest, TestSuggestSpellingConverter, TestReplicationHandler]
[junit4] Completed on J2 in 974.85s, 14 tests, 1 failure <<< FAILURES!
[...truncated 201 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:531: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:472: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:496: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1360: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:962: There were test failures: 431 suites, 1778 tests, 6 suite-level errors, 1 error, 1 failure, 949 ignored (9 assumptions)
Total time: 147 minutes 32 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #632
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 322347717 bytes
Compression is 0.0%
Took 54 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 636 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/636/
1 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core [halfcollection_shard1_replica1] Caused by: null
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core [halfcollection_shard1_replica1] Caused by: null
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:568)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:583)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:205)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11622 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/init-core-data-001
[junit4] 2> 447874 T1129 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
[junit4] 2> 447875 T1129 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 447887 T1129 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 447889 T1129 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 447890 T1130 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 447990 T1129 oasc.ZkTestServer.run start zk server on port:32088
[junit4] 2> 447991 T1129 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 447992 T1129 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 447999 T1136 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5f3df1e7 name:ZooKeeperConnection Watcher:127.0.0.1:32088 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 448000 T1129 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 448001 T1129 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 448001 T1129 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 448006 T1129 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 448008 T1129 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 448010 T1138 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@65d40076 name:ZooKeeperConnection Watcher:127.0.0.1:32088/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 448010 T1129 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 448011 T1129 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 448011 T1129 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 448016 T1129 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 448019 T1129 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 448022 T1129 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 448025 T1129 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 448026 T1129 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 448032 T1129 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 448033 T1129 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 448037 T1129 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 448038 T1129 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 448042 T1129 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 448043 T1129 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 448047 T1129 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 448048 T1129 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 448051 T1129 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 448052 T1129 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 448056 T1129 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 448057 T1129 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 448060 T1129 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 448062 T1129 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 448065 T1129 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 448066 T1129 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 448069 T1129 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 448070 T1129 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 448073 T1129 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 448074 T1129 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> Using new style solr.xml
[junit4] 2> 450312 T1129 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 450316 T1129 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:32097
[junit4] 2> 450317 T1129 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 450317 T1129 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 450318 T1129 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-002
[junit4] 2> 450318 T1129 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-002/'
[junit4] 2> 450374 T1129 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-002/solr.xml
[junit4] 2> 450477 T1129 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-002
[junit4] 2> 450478 T1129 oasc.CoreContainer.<init> New CoreContainer 927824809
[junit4] 2> 450478 T1129 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-002/]
[junit4] 2> 450480 T1129 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 450481 T1129 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 450482 T1129 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 450482 T1129 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 450483 T1129 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 450483 T1129 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 450484 T1129 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 450484 T1129 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 450485 T1129 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 450486 T1129 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 450487 T1129 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 450488 T1129 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 450488 T1129 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 450489 T1129 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:32088/solr
[junit4] 2> 450490 T1129 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 450490 T1129 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 450492 T1129 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 450495 T1149 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3ff1b09c name:ZooKeeperConnection Watcher:127.0.0.1:32088 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 450497 T1129 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 450498 T1129 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 450502 T1129 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 450504 T1151 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5aaed393 name:ZooKeeperConnection Watcher:127.0.0.1:32088/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 450504 T1129 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 450508 T1129 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 450512 T1129 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 450517 T1129 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 450523 T1129 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 450528 T1129 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 450533 T1129 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 450536 T1129 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32097_
[junit4] 2> 450537 T1129 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:32097_
[junit4] 2> 450542 T1129 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 450545 T1129 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 450547 T1129 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 450550 T1129 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:32097_
[junit4] 2> 450551 T1129 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 450553 T1129 oasc.Overseer.start Overseer (id=92539852977602563-127.0.0.1:32097_-n_0000000000) starting
[junit4] 2> 450557 T1129 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 450568 T1129 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 450569 T1153 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 450571 T1129 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 450574 T1129 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 450577 T1129 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 450583 T1152 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 450592 T1129 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-002
[junit4] 2> 450605 T1129 oasc.CorePropertiesLocator.discoverUnder Found core conf in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-002/conf/
[junit4] 2> 453083 T1129 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 453085 T1129 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
[junit4] 2> 453085 T1129 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 453086 T1129 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 453087 T1129 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 453089 T1157 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@51db9d13 name:ZooKeeperConnection Watcher:127.0.0.1:32088/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 453089 T1129 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 453090 T1129 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 453092 T1129 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 453096 T1129 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 453096 T1129 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
[junit4] 2> 453097 T1129 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 453098 T1129 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 453100 T1159 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@67119fe4 name:ZooKeeperConnection Watcher:127.0.0.1:32088/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 453100 T1129 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 453100 T1129 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 453104 T1160 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 453108 T1152 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: collection1
[junit4] 2> 453108 T1152 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 453108 T1152 oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 2
[junit4] 2> 453112 T1152 oasc.Overseer$ClusterStateUpdater.updateZkStates going to create_collection /collections/collection1/state.json
[junit4] 2> 453114 T1160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 453114 T1161 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 455046 T1129 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 455048 T1129 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 455051 T1129 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:32104
[junit4] 2> 455053 T1129 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 455053 T1129 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 455054 T1129 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-003
[junit4] 2> 455054 T1129 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-003/'
[junit4] 2> 455151 T1129 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-003/solr.xml
[junit4] 2> 455260 T1129 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-003
[junit4] 2> 455260 T1129 oasc.CoreContainer.<init> New CoreContainer 942883397
[junit4] 2> 455261 T1129 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-003/]
[junit4] 2> 455266 T1129 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 455267 T1129 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 455267 T1129 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 455268 T1129 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 455268 T1129 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 455269 T1129 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 455269 T1129 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 455270 T1129 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 455270 T1129 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 455271 T1129 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 455272 T1129 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 455272 T1129 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 455273 T1129 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 455273 T1129 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:32088/solr
[junit4] 2> 455274 T1129 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 455274 T1129 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 455275 T1129 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455277 T1172 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d43dcd6 name:ZooKeeperConnection Watcher:127.0.0.1:32088 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455279 T1129 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455279 T1129 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 455282 T1129 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 455284 T1174 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1feedc7 name:ZooKeeperConnection Watcher:127.0.0.1:32088/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 455284 T1129 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 455293 T1129 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 456309 T1129 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32104_
[junit4] 2> 456311 T1129 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:32104_
[junit4] 2> 456318 T1129 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 456327 T1129 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-003
[junit4] 2> 456662 T1129 oasc.CorePropertiesLocator.discoverUnder Found core conf in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-003/conf/
[junit4] 2> 458357 T1129 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 458359 T1129 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
[junit4] 2> 458359 T1129 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 460343 T1129 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 460344 T1129 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 460348 T1129 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:32112
[junit4] 2> 460349 T1129 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 460349 T1129 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 460350 T1129 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-004
[junit4] 2> 460350 T1129 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-004/'
[junit4] 2> 460404 T1129 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-004/solr.xml
[junit4] 2> 460513 T1129 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-004
[junit4] 2> 460514 T1129 oasc.CoreContainer.<init> New CoreContainer 420856053
[junit4] 2> 460515 T1129 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-004/]
[junit4] 2> 460518 T1129 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 460518 T1129 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 460519 T1129 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 460519 T1129 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 460520 T1129 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 460520 T1129 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 460521 T1129 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 460521 T1129 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 460522 T1129 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 460522 T1129 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 460523 T1129 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 460523 T1129 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 460524 T1129 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 460525 T1129 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:32088/solr
[junit4] 2> 460525 T1129 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 460526 T1129 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 460527 T1129 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 460529 T1187 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@632f21b0 name:ZooKeeperConnection Watcher:127.0.0.1:32088 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 460530 T1129 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 460531 T1129 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 460535 T1129 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 460537 T1189 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d7ff2c3 name:ZooKeeperConnection Watcher:127.0.0.1:32088/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 460537 T1129 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 460546 T1129 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 461553 T1129 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32112_
[junit4] 2> 461555 T1129 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:32112_
[junit4] 2> 461562 T1129 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 461572 T1129 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-004
[junit4] 2> 461680 T1129 oasc.CorePropertiesLocator.discoverUnder Found core conf in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-004/conf/
[junit4] 2> 463607 T1129 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 463609 T1129 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
[junit4] 2> 463609 T1129 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 465571 T1129 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 465572 T1129 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 465576 T1129 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:32125
[junit4] 2> 465577 T1129 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 465577 T1129 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 465578 T1129 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-005
[junit4] 2> 465578 T1129 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-005/'
[junit4] 2> 465637 T1129 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-005/solr.xml
[junit4] 2> 465719 T1129 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-005
[junit4] 2> 465720 T1129 oasc.CoreContainer.<init> New CoreContainer 641499378
[junit4] 2> 465720 T1129 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-005/]
[junit4] 2> 465722 T1129 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 465722 T1129 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 465723 T1129 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 465723 T1129 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 465724 T1129 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 465724 T1129 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 465725 T1129 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 465725 T1129 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 465725 T1129 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 465726 T1129 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 465727 T1129 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 465727 T1129 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 465728 T1129 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 465728 T1129 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:32088/solr
[junit4] 2> 465729 T1129 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 465729 T1129 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 465730 T1129 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 465732 T1202 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4e35a37a name:ZooKeeperConnection Watcher:127.0.0.1:32088 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 465733 T1129 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 465734 T1129 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 465737 T1129 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 465738 T1204 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@55d770a0 name:ZooKeeperConnection Watcher:127.0.0.1:32088/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 465739 T1129 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 465747 T1129 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 466754 T1129 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32125_
[junit4] 2> 466756 T1129 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:32125_
[junit4] 2> 466761 T1129 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 466768 T1129 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-005
[junit4] 2> 468352 T1129 oasc.CorePropertiesLocator.discoverUnder Found core conf in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-005/conf/
[junit4] 2> 468777 T1129 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 468779 T1129 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
[junit4] 2> 468779 T1129 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 470246 T1129 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
[junit4] 2> 470247 T1129 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 470250 T1129 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:32129
[junit4] 2> 470251 T1129 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 470251 T1129 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 470251 T1129 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-006
[junit4] 2> 470252 T1129 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-006/'
[junit4] 2> 470329 T1129 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-006/solr.xml
[junit4] 2> 470399 T1129 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-006
[junit4] 2> 470400 T1129 oasc.CoreContainer.<init> New CoreContainer 1284285005
[junit4] 2> 470400 T1129 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-006/]
[junit4] 2> 470401 T1129 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 470402 T1129 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 470402 T1129 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 470402 T1129 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 470403 T1129 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 470403 T1129 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 470403 T1129 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 470404 T1129 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 470404 T1129 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 470405 T1129 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 470405 T1129 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 470405 T1129 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 470406 T1129 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 470406 T1129 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:32088/solr
[junit4] 2> 470406 T1129 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 470407 T1129 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 470407 T1129 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 470409 T1217 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24f3947e name:ZooKeeperConnection Watcher:127.0.0.1:32088 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 470410 T1129 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 470410 T1129 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 470412 T1129 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 470413 T1219 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1220a635 name:ZooKeeperConnection Watcher:127.0.0.1:32088/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 470414 T1129 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 470420 T1129 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 471425 T1129 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32129_
[junit4] 2> 471426 T1129 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:32129_
[junit4] 2> 471431 T1129 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 471439 T1129 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-006
[junit4] 2> 471573 T1129 oasc.CorePropertiesLocator.discoverUnder Found core conf in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-006/conf/
[junit4] 2> 472740 T1129 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 472741 T1129 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
[junit4] 2> 472742 T1129 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 472776 T1166 oasha.CollectionsHandler.handleCreateAction Creating Collection : version=2&replicationFactor=2&router.field=myOwnField&numShards=2&wt=javabin&collection.configName=conf1&name=solrj_collection&action=CREATE
[junit4] 2> 472778 T1160 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 472780 T1153 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"create",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField"}
[junit4] 2> 472789 T1222 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : create , {
[junit4] 2> "operation":"create",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField"}
[junit4] 2> 472796 T1222 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/solrj_collection
[junit4] 2> 472797 T1222 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
[junit4] 2> 472801 T1160 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 472806 T1152 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: solrj_collection
[junit4] 2> 472806 T1152 oasc.Overseer$ClusterStateUpdater.createCollection Create collection solrj_collection with shards [shard1, shard2]
[junit4] 2> 472806 T1152 oasc.Overseer$ClusterStateUpdater.createCollection state version solrj_collection 1
[junit4] 2> 472810 T1175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 472810 T1220 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 472810 T1160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 472810 T1190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 472810 T1205 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 472810 T1161 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 472902 T1222 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection solrj_collection, shardNames [shard1, shard2] , replicationFactor : 2
[junit4] 2> 472903 T1222 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of collection solrj_collection on 127.0.0.1:32112_
[junit4] 2> 472904 T1222 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of collection solrj_collection on 127.0.0.1:32104_
[junit4] 2> 472907 T1222 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of collection solrj_collection on 127.0.0.1:32097_
[junit4] 2> 472909 T1222 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of collection solrj_collection on 127.0.0.1:32125_
[junit4] 2> 472910 T1180 oasha.CoreAdminHandler.handleCreateAction core create command version=2&numShards=2&qt=/admin/cores&collection=solrj_collection&wt=javabin&collection.configName=conf1&name=solrj_collection_shard1_replica1&shard=shard1&action=CREATE
[junit4] 2> 472910 T1167 oasha.CoreAdminHandler.handleCreateAction core create command version=2&numShards=2&qt=/admin/cores&collection=solrj_collection&wt=javabin&collection.configName=conf1&name=solrj_collection_shard1_replica2&shard=shard1&action=CREATE
[junit4] 2> 472912 T1146 oasha.CoreAdminHandler.handleCreateAction core create command version=2&numShards=2&qt=/admin/cores&collection=solrj_collection&wt=javabin&collection.configName=conf1&name=solrj_collection_shard2_replica1&shard=shard2&action=CREATE
[junit4] 2> 472914 T1196 oasha.CoreAdminHandler.handleCreateAction core create command version=2&numShards=2&qt=/admin/cores&collection=solrj_collection&wt=javabin&collection.configName=conf1&name=solrj_collection_shard2_replica2&shard=shard2&action=CREATE
[junit4] 2> 472942 T1196 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica2 state=down collection=solrj_collection
[junit4] 2> 472942 T1146 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica1 state=down collection=solrj_collection
[junit4] 2> 472942 T1180 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica1 state=down collection=solrj_collection
[junit4] 2> 472944 T1160 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 472942 T1167 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica2 state=down collection=solrj_collection
[junit4] 2> 472944 T1146 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 472944 T1196 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 472945 T1180 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 472946 T1167 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 472950 T1152 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "state":"down",
[junit4] 2> "numShards":"2",
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "core":"solrj_collection_shard2_replica2",
[junit4] 2> "base_url":"http://127.0.0.1:32125",
[junit4] 2> "roles":null,
[junit4] 2> "shard":"shard2",
[junit4] 2> "node_name":"127.0.0.1:32125_",
[junit4] 2> "operation":"state"}
[junit4] 2> 472954 T1152 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "state":"down",
[junit4] 2> "numShards":"2",
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "core":"solrj_collection_shard2_replica1",
[junit4] 2> "base_url":"http://127.0.0.1:32097",
[junit4] 2> "roles":null,
[junit4] 2> "shard":"shard2",
[junit4] 2> "node_name":"127.0.0.1:32097_",
[junit4] 2> "operation":"state"}
[junit4] 2> 472957 T1160 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 472959 T1152 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "state":"down",
[junit4] 2> "numShards":"2",
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "core":"solrj_collection_shard1_replica1",
[junit4] 2> "base_url":"http://127.0.0.1:32112",
[junit4] 2> "roles":null,
[junit4] 2> "shard":"shard1",
[junit4] 2> "node_name":"127.0.0.1:32112_",
[junit4] 2> "operation":"state"}
[junit4] 2> 472963 T1152 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "state":"down",
[junit4] 2> "numShards":"2",
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "core":"solrj_collection_shard1_replica2",
[junit4] 2> "base_url":"http://127.0.0.1:32104",
[junit4] 2> "roles":null,
[junit4] 2> "shard":"shard1",
[junit4] 2> "node_name":"127.0.0.1:32104_",
[junit4] 2> "operation":"state"}
[junit4] 2> 472966 T1160 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 472968 T1160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 472968 T1205 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 472968 T1190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 472968 T1175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 472968 T1161 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 472968 T1220 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 473945 T1146 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica1
[junit4] 2> 473946 T1146 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 473946 T1196 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica2
[junit4] 2> 473947 T1146 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 473947 T1180 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica1
[junit4] 2> 473947 T1196 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 473948 T1146 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 473947 T1167 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica2
[junit4] 2> 473949 T1196 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 473948 T1180 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 473950 T1196 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 473950 T1146 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 473950 T1167 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 473952 T1196 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 473952 T1146 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-002/solrj_collection_shard2_replica1/'
[junit4] 2> 473951 T1180 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 473953 T1196 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-005/solrj_collection_shard2_replica2/'
[junit4] 2> 473953 T1167 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 473954 T1180 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 473955 T1167 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 473956 T1180 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 473957 T1180 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-004/solrj_collection_shard1_replica1/'
[junit4] 2> 473957 T1167 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 473958 T1167 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-003/solrj_collection_shard1_replica2/'
[junit4] 2> 474164 T1167 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 474166 T1180 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 474167 T1196 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 474169 T1146 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 474259 T1167 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 474261 T1167 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 474266 T1196 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 474268 T1196 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 474271 T1180 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 474271 T1146 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 474273 T1180 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 474273 T1146 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 474305 T1167 oass.IndexSchema.readSchema [solrj_collection_shard1_replica2] Schema name=test
[junit4] 2> 474312 T1196 oass.IndexSchema.readSchema [solrj_collection_shard2_replica2] Schema name=test
[junit4] 2> 474314 T1146 oass.IndexSchema.readSchema [solrj_collection_shard2_replica1] Schema name=test
[junit4] 2> 474325 T1180 oass.IndexSchema.readSchema [solrj_collection_shard1_replica1] Schema name=test
[junit4] 2> 474991 T1146 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 474996 T1167 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 474997 T1180 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 475008 T1146 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 475010 T1180 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 475010 T1167 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 475013 T1196 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 475014 T1146 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 475014 T1180 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 475015 T1167 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 475022 T1196 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 475026 T1196 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 475040 T1167 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 475040 T1146 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 475040 T1180 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 475049 T1167 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 475049 T1180 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 475049 T1146 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 475052 T1196 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 475074 T1167 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 475074 T1196 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 475074 T1146 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 475076 T1167 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 475074 T1180 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 475079 T1146 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 475079 T1167 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 475080 T1180 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 475080 T1146 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 475081 T1180 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 475081 T1167 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 475083 T1180 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 475082 T1146 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 475084 T1167 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 475084 T1196 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 475085 T1146 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 475085 T1167 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 475085 T1180 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 475087 T1167 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica2' using configuration from collection solrj_collection
[junit4] 2> 475086 T1196 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 475086 T1146 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 475088 T1196 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 475088 T1167 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 475087 T1180 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 475090 T1167 oasc.SolrCore.<init> [solrj_collection_shard1_replica2] Opening new SolrCore at ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-003/solrj_collection_shard1_replica2/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-003/solrj_collection_shard1_replica2/data/
[junit4] 2> 475089 T1196 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 475089 T1146 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica1' using configuration from collection solrj_collection
[junit4] 2> 475093 T1167 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@25f556c5
[junit4] 2> 475091 T1180 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica1' using configuration from collection solrj_collection
[junit4] 2> 475094 T1196 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 475094 T1146 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 475096 T1196 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 475095 T1180 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 475097 T1196 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica2' using configuration from collection solrj_collection
[junit4] 2> 475096 T1146 oasc.SolrCore.<init> [solrj_collection_shard2_replica1] Opening new SolrCore at ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-002/solrj_collection_shard2_replica1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-002/solrj_collection_shard2_replica1/data/
[junit4] 2> 475098 T1196 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 475097 T1180 oasc.SolrCore.<init> [solrj_collection_shard1_replica1] Opening new SolrCore at ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-004/solrj_collection_shard1_replica1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-004/solrj_collection_shard1_replica1/data/
[junit4] 2> 475097 T1167 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-003/solrj_collection_shard1_replica2/data
[junit4] 2> 475100 T1180 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@25f556c5
[junit4] 2> 475099 T1196 oasc.SolrCore.<init> [solrj_collection_shard2_replica2] Opening new SolrCore at ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-005/solrj_collection_shard2_replica2/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-005/solrj_collection_shard2_replica2/data/
[junit4] 2> 475098 T1146 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@25f556c5
[junit4] 2> 475101 T1196 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@25f556c5
[junit4] 2> 475101 T1167 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-003/solrj_collection_shard1_replica2/data/index/
[junit4] 2> 475103 T1167 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica2] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-003/solrj_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 475103 T1167 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-003/solrj_collection_shard1_replica2/data/index
[junit4] 2> 475104 T1167 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1212431635, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 475105 T1180 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-004/solrj_collection_shard1_replica1/data
[junit4] 2> 475106 T1167 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-71fc7d4c)),segFN=segments_1,generation=1}
[junit4] 2> 475106 T1167 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 475106 T1146 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-002/solrj_collection_shard2_replica1/data
[junit4] 2> 475107 T1180 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-004/solrj_collection_shard1_replica1/data/index/
[junit4] 2> 475107 T1196 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-005/solrj_collection_shard2_replica2/data
[junit4] 2> 475108 T1180 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-004/solrj_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 475108 T1146 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-002/solrj_collection_shard2_replica1/data/index/
[junit4] 2> 475109 T1180 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-004/solrj_collection_shard1_replica1/data/index
[junit4] 2> 475109 T1196 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-005/solrj_collection_shard2_replica2/data/index/
[junit4] 2> 475111 T1180 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1212431635, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 475112 T1196 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica2] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-005/solrj_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 475110 T1146 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-002/solrj_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 475113 T1196 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-005/solrj_collection_shard2_replica2/data/index
[junit4] 2> 475114 T1146 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001/tempDir-002/solrj_collection_shard2_replica1/data/index
[junit4] 2> 475113 T1180 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-3e21abae)),segFN=segments_1,generation=1}
[junit4] 2> 475115 T1146 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1212431635, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 475114 T1196 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1212431635, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 475114 T1167 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 475117 T1196 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-543a9587)),segFN=segments_1,generation=1}
[junit4] 2> 475117 T1146 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-5454114)),segFN=segments_1,generation=1}
[junit4] 2> 475115 T1180 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 475118 T1146 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 475118 T1196 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 475127 T1196 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 475127 T1180 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 475127 T1146 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 475261 T1167 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 475261 T1180 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 475261 T1196 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 475261 T1146 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 475263 T1196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 475262 T1180 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 475262 T1167 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 475264 T1180 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 475264 T1196 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 475263 T1146 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 475266 T1196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 475266 T1180 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 475265 T1167 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 475268 T1180 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 475267 T1196 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 475267 T1146 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 475270 T1196 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 475270 T1146 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 475271 T1146 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 475269 T1180 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 475268 T1167 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 475273 T1180 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 475272 T1146 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 475275 T1180 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 475271 T1196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 475275 T1146 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 475277 T1146 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 475273 T1167 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 475279 T1146 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 475276 T1180 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 475280 T1146 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 475281 T1180 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler
[...truncated too long message...]
2097]
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:322)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:880)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:658)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:601)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1548)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1569)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1037)
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not fully create collection: awholynewstresscollection_collection2_1
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:568)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:343)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:304)
[junit4] > ... 6 moreThrowable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1597, name=Thread-463, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:32125, http://127.0.0.1:32129, http://127.0.0.1:32112, http://127.0.0.1:32104, http://127.0.0.1:32097]
[junit4] > at __randomizedtesting.SeedInfo.seed([79BF4887963062F6]:0)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1056)
[junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:32125, http://127.0.0.1:32129, http://127.0.0.1:32112, http://127.0.0.1:32104, http://127.0.0.1:32097]
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:322)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:880)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:658)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:601)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1548)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1569)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1037)
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not fully create collection: awholynewstresscollection_collection3_1
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:568)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:343)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:304)
[junit4] > ... 6 moreThrowable #7: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1598, name=Thread-464, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:32125, http://127.0.0.1:32129, http://127.0.0.1:32112, http://127.0.0.1:32104, http://127.0.0.1:32097]
[junit4] > at __randomizedtesting.SeedInfo.seed([79BF4887963062F6]:0)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1056)
[junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:32125, http://127.0.0.1:32129, http://127.0.0.1:32112, http://127.0.0.1:32104, http://127.0.0.1:32097]
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:322)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:880)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:658)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:601)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1548)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1569)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1037)
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not fully create collection: awholynewstresscollection_collection4_1
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:568)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:343)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:304)
[junit4] > ... 6 more
[junit4] 2> 733718 T1129 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-79BF4887963062F6-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {timestamp=FSTOrd41, a_i1=FSTOrd41, id=PostingsFormat(name=Memory doPackFST= true), range_facet_l=FSTOrd41, intDefault=FSTOrd41, a_t=FSTOrd41, text=OrdsLucene41(blocksize=128), multiDefault=PostingsFormat(name=Memory doPackFST= false), other_tl1=FSTOrd41, _version_=FSTOrd41}, docValues:{timestamp=DocValuesFormat(name=Lucene410)}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=en_US, timezone=Australia/Darwin
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=16,threads=1,free=180865656,total=366477312
[junit4] 2> NOTE: All tests run in this JVM: [SuggesterTest, ReplicationFactorTest, TestOrdValues, ClusterStateUpdateTest, TestNonNRTOpen, TestCursorMarkWithoutUniqueKey, DocValuesMultiTest, TestPHPSerializedResponseWriter, EchoParamsTest, UUIDFieldTest, SolrTestCaseJ4Test, TestCoreDiscovery, TestCloudManagedSchemaConcurrent, DocExpirationUpdateProcessorFactoryTest, SolrPluginUtilsTest, TestDistribDocBasedVersion, TestSolrXmlPersistor, LoggingHandlerTest, TestMergePolicyConfig, StatelessScriptUpdateProcessorFactoryTest, IndexBasedSpellCheckerTest, RequestHandlersTest, TestRawResponseWriter, SearchHandlerTest, OutputWriterTest, CollectionsAPIDistributedZkTest]
[junit4] Completed on J3 in 285.91s, 1 test, 1 error <<< FAILURES!
[...truncated 1112 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:531: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:472: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:496: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1360: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:962: There were test failures: 431 suites, 1778 tests, 1 error, 55 ignored (11 assumptions)
Total time: 204 minutes 27 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #632
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 391693101 bytes
Compression is 0.0%
Took 1 min 10 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 635 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/635/
3 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
Captured an uncaught exception in thread: Thread[id=13668, name=qtp1148022701-13668, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=13668, name=qtp1148022701-13668, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
Caused by: java.lang.OutOfMemoryError: unable to create new native thread
at __randomizedtesting.SeedInfo.seed([C76C029776C01205]:0)
at java.lang.Thread.start0(Native Method)
at java.lang.Thread.start(Thread.java:714)
at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:1047)
at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1312)
at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1339)
at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1323)
at org.eclipse.jetty.server.ssl.SslSocketConnector$SslConnectorEndPoint.run(SslSocketConnector.java:665)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandler
Error Message:
Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=259, name=coreLoadExecutor-163-thread-1, state=RUNNABLE, group=TGRP-TestReplicationHandler], registration stack trace below.
Stack Trace:
com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=259, name=coreLoadExecutor-163-thread-1, state=RUNNABLE, group=TGRP-TestReplicationHandler], registration stack trace below.
at __randomizedtesting.SeedInfo.seed([C76C029776C01205]:0)
at java.lang.Thread.getStackTrace(Thread.java:1589)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:166)
at org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:688)
at org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:1231)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1122)
at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1114)
at org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:47)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:350)
at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:275)
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:487)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:793)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:651)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: Directory not closed: MockDirectoryWrapper(NIOFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/index-NIOFSDirectory-028 lockFactory=NativeFSLockFactory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/index-NIOFSDirectory-028)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:699)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:696)
at com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:183)
at com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:712)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
... 1 more
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core [halfcollection_shard1_replica1] Caused by: Could not get shard id for core: halfcollection_shard1_replica1
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core [halfcollection_shard1_replica1] Caused by: Could not get shard id for core: halfcollection_shard1_replica1
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:568)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:583)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:205)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11788 lines...]
[junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4] 2> log4j:WARN No such property [conversionPattern] in org.apache.solr.util.SolrLogLayout.
[junit4] 2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/init-core-data-001
[junit4] 2> 5042 T11 oas.SolrTestCaseJ4.setUp ###Starting doTestIndexAndConfigReplication
[junit4] 2> 6417 T11 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 6962 T11 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:20827
[junit4] 2> 7591 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 7821 T11 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 7823 T11 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-001
[junit4] 2> 7824 T11 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-001/'
[junit4] 2> 9323 T11 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-001/solr.xml
[junit4] 2> 9758 T11 oasc.CoreContainer.<init> New CoreContainer 2136427538
[junit4] 2> 9770 T11 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-001/]
[junit4] 2> 10049 T11 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 10049 T11 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 10050 T11 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 10051 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 10052 T11 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 10052 T11 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 10055 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 10056 T11 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 10057 T11 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 10915 T11 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 10951 T11 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 10962 T11 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 10979 T11 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 11896 T23 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-001/collection1/'
[junit4] 2> 12132 T23 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 12508 T23 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 12561 T23 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 12618 T23 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 13022 T23 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 13038 T23 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-001/collection1/
[junit4] 2> 13338 T23 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 13376 T23 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-001/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-001/collection1/data/
[junit4] 2> 13377 T23 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 13633 T23 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-001/collection1/data
[junit4] 2> 13636 T23 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-001/collection1/data/index/
[junit4] 2> 13637 T23 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-001/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 13711 T23 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-001/collection1/data/index
[junit4] 2> 13716 T23 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1996173002, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 14107 T23 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-545b72a8)),segFN=segments_1,generation=1}
[junit4] 2> 14115 T23 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 15742 T23 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 15872 T23 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 15873 T23 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 15874 T23 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 15952 T23 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 16050 T23 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 16051 T23 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 16051 T23 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 16061 T23 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 16100 T23 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 16399 T23 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 16450 T23 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 16453 T23 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 16455 T23 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 16597 T23 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 16598 T23 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 16600 T23 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=2.3994140625, floorSegmentMB=0.9765625, forceMergeDeletesPctAllowed=11.879980049748163, segmentsPerTier=34.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 16613 T23 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-545b72a8)),segFN=segments_1,generation=1}
[junit4] 2> 16613 T23 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 16890 T23 oass.SolrIndexSearcher.<init> Opening Searcher@3f2e1584[collection1] main
[junit4] 2> 16976 T23 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-001/collection1/conf
[junit4] 2> 16977 T23 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-001/collection1/conf}
[junit4] 2> 17175 T23 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-001/collection1/conf
[junit4] 2> 17177 T23 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 17193 T23 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using file:dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-001/collection1/conf
[junit4] 2> 17194 T23 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 17428 T23 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 17438 T23 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 17439 T23 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 17449 T24 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3f2e1584[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 17459 T11 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2
[junit4] 2> 17460 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 17574 T11 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 17577 T11 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:50400
[junit4] 2> 17579 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 17579 T11 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 17580 T11 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-002
[junit4] 2> 17581 T11 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-002/'
[junit4] 2> 17645 T11 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-002/solr.xml
[junit4] 2> 17801 T11 oasc.CoreContainer.<init> New CoreContainer 2120707443
[junit4] 2> 17801 T11 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-002/]
[junit4] 2> 17804 T11 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 17804 T11 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 17805 T11 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 17805 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 17806 T11 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 17807 T11 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 17808 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 17808 T11 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 17809 T11 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 17810 T11 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 17811 T11 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 17811 T11 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 17812 T11 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 17820 T35 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-002/collection1/'
[junit4] 2> 17900 T35 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 17979 T35 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 17981 T35 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 17993 T35 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 18033 T35 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 18035 T35 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-002/collection1/
[junit4] 2> 18035 T35 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 18036 T35 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-002/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-002/collection1/data/
[junit4] 2> 18037 T35 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 18041 T35 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-002/collection1/data
[junit4] 2> 18042 T35 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-002/collection1/data/index/
[junit4] 2> 18043 T35 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-002/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 18043 T35 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-002/collection1/data/index
[junit4] 2> 18044 T35 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1996173002, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 18046 T35 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-3fa39595)),segFN=segments_1,generation=1}
[junit4] 2> 18047 T35 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 18049 T35 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 18050 T35 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 18051 T35 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 18051 T35 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 18052 T35 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 18052 T35 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 18053 T35 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 18053 T35 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 18054 T35 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 18055 T35 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 18086 T35 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 18089 T35 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 18092 T35 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 18095 T35 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 18098 T35 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 18099 T35 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 18100 T35 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=2.3994140625, floorSegmentMB=0.9765625, forceMergeDeletesPctAllowed=11.879980049748163, segmentsPerTier=34.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 18101 T35 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-3fa39595)),segFN=segments_1,generation=1}
[junit4] 2> 18102 T35 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 18102 T35 oass.SolrIndexSearcher.<init> Opening Searcher@3e888183[collection1] main
[junit4] 2> 18104 T35 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-002/collection1/conf
[junit4] 2> 18104 T35 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-002/collection1/conf}
[junit4] 2> 18105 T35 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-002/collection1/conf
[junit4] 2> 18107 T35 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 18108 T35 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using file:dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-C76C029776C01205-001/solr-instance-002/collection1/conf
[junit4] 2> 18108 T35 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 18329 T35 oash.SnapPuller.startExecutorService Poll Scheduled at an interval of 1000ms
[junit4] 2> 18329 T36 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3e888183[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 18330 T35 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 18331 T11 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2
[junit4] 2> 18332 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> ASYNC NEW_CORE C0 name=collection1 org.apache.solr.core.SolrCore@53a21d0b
[junit4] 2> 20292 T19 C0 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=javabin&command=indexversion&version=2&qt=/replication} status=0 QTime=133
[junit4] 2> 20738 T19 C0 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=javabin&command=indexversion&version=2&qt=/replication} status=0 QTime=1
[junit4] 2> 20744 T19 C0 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=javabin&command=indexversion&version=2&qt=/replication} status=0 QTime=0
[junit4] 2> 21201 T17 C0 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={wt=javabin&sort=id+desc&version=2&q=*:*} hits=0 status=0 QTime=1042
[junit4] 2> 21743 T19 C0 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=javabin&command=indexversion&version=2&qt=/replication} status=0 QTime=0
[junit4] 2> 22743 T19 C0 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=javabin&command=indexversion&version=2&qt=/replication} status=0 QTime=0
[junit4] 2> 23010 T17 C0 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[0]} 0 1626
[junit4] 2> 23016 T17 C0 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[1]} 0 0
[junit4] 2> 23022 T17 C0 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[2]} 0 1
[junit4] 2> 23026 T17 C0 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[3]} 0 1
[junit4] 2> 23030 T17 C0 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[4]} 0 1
[junit4] 2> 23035 T17 C0 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[5]} 0 1
[junit4] 2> 23039 T17 C0 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[6]} 0 1
[junit4] 2> 23044 T17 C0 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[7]} 0 1
[junit4] 2> 23049 T17 C0 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[8]} 0 1
[junit4] 2> 23054 T17 C0 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[9]} 0 1
[junit4] 2> 23060 T17 C0 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[10]} 0 0
[junit4] 2> 23065 T17 C0 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[11]} 0 1
[junit4] 2> 23070 T17 C0 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[12]} 0 1
[junit4] 2> 23074 T17 C0 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[13]} 0 1
[junit4] 2> ASYNC NEW_CORE C1 name=collection1 org.apache.solr.core.SolrCore@53a21d0b
[junit4] 2> 23474 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[14]} 0 397
[junit4] 2> 23481 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[15]} 0 1
[junit4] 2> 23486 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[16]} 0 0
[junit4] 2> 23492 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[17]} 0 0
[junit4] 2> 23498 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[18]} 0 0
[junit4] 2> 23504 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[19]} 0 0
[junit4] 2> 23510 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[20]} 0 1
[junit4] 2> 23515 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[21]} 0 0
[junit4] 2> 23521 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[22]} 0 0
[junit4] 2> 23527 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[23]} 0 0
[junit4] 2> 23533 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[24]} 0 1
[junit4] 2> 23538 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[25]} 0 0
[junit4] 2> 23543 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[26]} 0 1
[junit4] 2> 23548 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[27]} 0 1
[junit4] 2> 23554 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[28]} 0 1
[junit4] 2> 23559 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[29]} 0 1
[junit4] 2> 23565 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[30]} 0 1
[junit4] 2> 23570 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[31]} 0 1
[junit4] 2> 23575 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[32]} 0 1
[junit4] 2> 23579 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[33]} 0 0
[junit4] 2> 23584 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[34]} 0 1
[junit4] 2> 23589 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[35]} 0 1
[junit4] 2> 23594 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[36]} 0 1
[junit4] 2> 23599 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[37]} 0 0
[junit4] 2> 23605 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[38]} 0 1
[junit4] 2> 23608 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[39]} 0 1
[junit4] 2> 23612 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[40]} 0 1
[junit4] 2> 23616 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[41]} 0 1
[junit4] 2> 23620 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[42]} 0 1
[junit4] 2> 23626 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[43]} 0 1
[junit4] 2> 23631 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[44]} 0 0
[junit4] 2> 23643 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[45]} 0 1
[junit4] 2> 23648 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[46]} 0 1
[junit4] 2> 23653 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[47]} 0 1
[junit4] 2> 23658 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[48]} 0 1
[junit4] 2> 23663 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[49]} 0 1
[junit4] 2> 23668 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[50]} 0 1
[junit4] 2> 23673 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[51]} 0 1
[junit4] 2> 23678 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[52]} 0 1
[junit4] 2> 23683 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[53]} 0 0
[junit4] 2> 23688 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[54]} 0 1
[junit4] 2> 23693 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[55]} 0 0
[junit4] 2> 23698 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[56]} 0 1
[junit4] 2> 23703 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[57]} 0 0
[junit4] 2> 23709 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[58]} 0 1
[junit4] 2> 23715 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[59]} 0 1
[junit4] 2> 23720 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[60]} 0 0
[junit4] 2> 23725 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[61]} 0 0
[junit4] 2> 23730 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[62]} 0 0
[junit4] 2> 23736 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[63]} 0 1
[junit4] 2> 23742 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[64]} 0 0
[junit4] 2> 23745 T19 C1 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=javabin&command=indexversion&version=2&qt=/replication} status=0 QTime=0
[junit4] 2> 23747 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[65]} 0 0
[junit4] 2> 23752 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[66]} 0 1
[junit4] 2> 23757 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[67]} 0 0
[junit4] 2> 23763 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[68]} 0 0
[junit4] 2> 23768 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[69]} 0 0
[junit4] 2> 23774 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[70]} 0 1
[junit4] 2> 23778 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[71]} 0 0
[junit4] 2> 23783 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[72]} 0 1
[junit4] 2> 23788 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[73]} 0 1
[junit4] 2> 23793 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[74]} 0 0
[junit4] 2> 23798 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[75]} 0 1
[junit4] 2> 23803 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[76]} 0 1
[junit4] 2> 23809 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[77]} 0 1
[junit4] 2> 23815 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[78]} 0 1
[junit4] 2> 23819 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[79]} 0 1
[junit4] 2> 23824 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[80]} 0 1
[junit4] 2> 23828 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[81]} 0 1
[junit4] 2> 23834 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[82]} 0 1
[junit4] 2> 23839 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[83]} 0 0
[junit4] 2> 23844 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[84]} 0 0
[junit4] 2> 23850 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[85]} 0 1
[junit4] 2> 23854 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[86]} 0 1
[junit4] 2> 23858 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[87]} 0 1
[junit4] 2> 23863 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[88]} 0 1
[junit4] 2> 23867 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[89]} 0 1
[junit4] 2> 23871 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[90]} 0 0
[junit4] 2> 23876 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[91]} 0 1
[junit4] 2> 23880 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[92]} 0 0
[junit4] 2> 23885 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[93]} 0 0
[junit4] 2> 23891 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[94]} 0 0
[junit4] 2> 23896 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[95]} 0 0
[junit4] 2> 23902 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[96]} 0 1
[junit4] 2> 23907 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[97]} 0 1
[junit4] 2> 23912 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[98]} 0 1
[junit4] 2> 23917 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[99]} 0 1
[junit4] 2> 23922 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[100]} 0 1
[junit4] 2> 23927 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[101]} 0 1
[junit4] 2> 23932 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[102]} 0 1
[junit4] 2> 23938 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[103]} 0 0
[junit4] 2> 23944 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[104]} 0 1
[junit4] 2> 23950 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[105]} 0 1
[junit4] 2> 23956 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[106]} 0 0
[junit4] 2> 23962 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[107]} 0 1
[junit4] 2> 23969 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[108]} 0 1
[junit4] 2> 23974 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[109]} 0 0
[junit4] 2> 23979 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[110]} 0 1
[junit4] 2> 23986 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[111]} 0 1
[junit4] 2> 23992 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[112]} 0 1
[junit4] 2> 23997 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[113]} 0 0
[junit4] 2> 24005 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[114]} 0 2
[junit4] 2> 24010 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[115]} 0 1
[junit4] 2> 24018 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[116]} 0 1
[junit4] 2> 24025 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[117]} 0 1
[junit4] 2> 24031 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[118]} 0 1
[junit4] 2> 24036 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[119]} 0 1
[junit4] 2> 24041 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[120]} 0 1
[junit4] 2> 24046 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[121]} 0 1
[junit4] 2> 24052 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[122]} 0 1
[junit4] 2> 24058 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[123]} 0 1
[junit4] 2> 24063 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[124]} 0 1
[junit4] 2> 24068 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[125]} 0 1
[junit4] 2> 24073 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[126]} 0 1
[junit4] 2> 24078 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[127]} 0 1
[junit4] 2> 24083 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[128]} 0 1
[junit4] 2> 24087 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[129]} 0 1
[junit4] 2> 24092 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[130]} 0 1
[junit4] 2> 24098 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[131]} 0 1
[junit4] 2> 24103 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[132]} 0 1
[junit4] 2> 24108 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[133]} 0 1
[junit4] 2> 24112 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[134]} 0 1
[junit4] 2> 24116 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[135]} 0 1
[junit4] 2> 24121 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[136]} 0 1
[junit4] 2> 24125 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[137]} 0 1
[junit4] 2> 24129 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[138]} 0 1
[junit4] 2> 24133 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[139]} 0 1
[junit4] 2> 24137 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[140]} 0 1
[junit4] 2> 24142 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[141]} 0 1
[junit4] 2> 24148 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[142]} 0 1
[junit4] 2> 24153 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[143]} 0 1
[junit4] 2> 24157 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[144]} 0 1
[junit4] 2> 24162 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[145]} 0 1
[junit4] 2> 24167 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[146]} 0 1
[junit4] 2> 24172 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[147]} 0 1
[junit4] 2> 24177 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[148]} 0 1
[junit4] 2> 24182 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[149]} 0 1
[junit4] 2> 24187 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[150]} 0 1
[junit4] 2> 24193 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[151]} 0 1
[junit4] 2> 24198 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[152]} 0 1
[junit4] 2> 24203 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[153]} 0 1
[junit4] 2> 24209 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[154]} 0 1
[junit4] 2> 24214 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[155]} 0 1
[junit4] 2> 24219 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[156]} 0 1
[junit4] 2> 24225 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[157]} 0 1
[junit4] 2> 24230 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[158]} 0 1
[junit4] 2> 24235 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[159]} 0 1
[junit4] 2> 24240 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[160]} 0 1
[junit4] 2> 24245 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[161]} 0 1
[junit4] 2> 24250 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[162]} 0 1
[junit4] 2> 24255 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[163]} 0 0
[junit4] 2> 24260 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[164]} 0 1
[junit4] 2> 24265 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[165]} 0 1
[junit4] 2> 24270 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[166]} 0 1
[junit4] 2> 24275 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[167]} 0 1
[junit4] 2> 24280 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[168]} 0 1
[junit4] 2> 24285 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[169]} 0 1
[junit4] 2> 24291 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[170]} 0 1
[junit4] 2> 24298 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[171]} 0 0
[junit4] 2> 24305 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[172]} 0 1
[junit4] 2> 24311 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[173]} 0 1
[junit4] 2> 24317 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[174]} 0 0
[junit4] 2> 24322 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[175]} 0 1
[junit4] 2> 24327 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[176]} 0 1
[junit4] 2> 24332 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[177]} 0 1
[junit4] 2> 24337 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[178]} 0 1
[junit4] 2> 24342 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[179]} 0 1
[junit4] 2> 24348 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[180]} 0 1
[junit4] 2> 24353 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[181]} 0 1
[junit4] 2> 24358 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[182]} 0 1
[junit4] 2> 24363 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[183]} 0 1
[junit4] 2> 24368 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[184]} 0 1
[junit4] 2> 24374 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[185]} 0 1
[junit4] 2> 24379 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[186]} 0 1
[junit4] 2> 24384 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[187]} 0 1
[junit4] 2> 24389 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[188]} 0 1
[junit4] 2> 24394 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[189]} 0 1
[junit4] 2> 24399 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[190]} 0 1
[junit4] 2> 24404 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[191]} 0 1
[junit4] 2> 24409 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[192]} 0 1
[junit4] 2> 24414 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[193]} 0 1
[junit4] 2> 24419 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[194]} 0 1
[junit4] 2> 24424 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[195]} 0 1
[junit4] 2> 24429 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[196]} 0 1
[junit4] 2> 24434 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[197]} 0 1
[junit4] 2> 24439 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[198]} 0 1
[junit4] 2> 24444 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[199]} 0 1
[junit4] 2> 24449 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[200]} 0 1
[junit4] 2> 24454 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[201]} 0 1
[junit4] 2> 24459 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[202]} 0 1
[junit4] 2> 24464 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[203]} 0 1
[junit4] 2> 24469 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[204]} 0 1
[junit4] 2> 24474 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[205]} 0 1
[junit4] 2> 24479 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[206]} 0 1
[junit4] 2> 24484 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[207]} 0 1
[junit4] 2> 24489 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[208]} 0 1
[junit4] 2> 24494 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[209]} 0 1
[junit4] 2> 24499 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[210]} 0 1
[junit4] 2> 24504 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[211]} 0 1
[junit4] 2> 24509 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[212]} 0 0
[junit4] 2> 24515 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[213]} 0 1
[junit4] 2> 24520 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[214]} 0 1
[junit4] 2> 24526 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[215]} 0 1
[junit4] 2> 24531 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[216]} 0 1
[junit4] 2> 24537 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[217]} 0 1
[junit4] 2> 24543 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[218]} 0 0
[junit4] 2> 24548 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[219]} 0 1
[junit4] 2> 24553 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[220]} 0 1
[junit4] 2> 24558 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[221]} 0 1
[junit4] 2> 24563 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[222]} 0 1
[junit4] 2> 24568 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[223]} 0 1
[junit4] 2> 24574 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[224]} 0 1
[junit4] 2> 24580 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[225]} 0 1
[junit4] 2> 24585 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[226]} 0 1
[junit4] 2> 24590 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[227]} 0 1
[junit4] 2> 24595 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[228]} 0 1
[junit4] 2> 24600 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[229]} 0 1
[junit4] 2> 24605 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[230]} 0 0
[junit4] 2> 24610 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[231]} 0 1
[junit4] 2> 24615 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[232]} 0 1
[junit4] 2> 24620 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[233]} 0 1
[junit4] 2> 24626 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[234]} 0 1
[junit4] 2> 24631 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[235]} 0 1
[junit4] 2> 24636 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[236]} 0 1
[junit4] 2> 24642 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[237]} 0 1
[junit4] 2> 24650 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[238]} 0 1
[junit4] 2> 24658 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[239]} 0 1
[junit4] 2> 24663 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[240]} 0 0
[junit4] 2> 24668 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[241]} 0 1
[junit4] 2> 24673 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[242]} 0 1
[junit4] 2> 24678 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[243]} 0 1
[junit4] 2> 24683 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[244]} 0 1
[junit4] 2> 24688 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[245]} 0 1
[junit4] 2> 24693 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[246]} 0 1
[junit4] 2> 24698 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[247]} 0 1
[junit4] 2> 24703 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[248]} 0 1
[junit4] 2> 24708 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[249]} 0 1
[junit4] 2> 24714 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[250]} 0 1
[junit4] 2> 24720 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[251]} 0 1
[junit4] 2> 24725 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[252]} 0 1
[junit4] 2> 24730 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[253]} 0 1
[junit4] 2> 24735 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[254]} 0 1
[junit4] 2> 24741 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[255]} 0 2
[junit4] 2> 24743 T19 C1 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=javabin&command=indexversion&version=2&qt=/replication} status=0 QTime=0
[junit4] 2> 24746 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[256]} 0 1
[junit4] 2> 24752 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[257]} 0 1
[junit4] 2> 24757 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[258]} 0 1
[junit4] 2> 24762 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[259]} 0 1
[junit4] 2> 24767 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[260]} 0 1
[junit4] 2> 24773 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[261]} 0 1
[junit4] 2> 24778 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[262]} 0 1
[junit4] 2> 24784 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[263]} 0 1
[junit4] 2> 24789 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[264]} 0 0
[junit4] 2> 24795 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[265]} 0 0
[junit4] 2> 24800 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[266]} 0 1
[junit4] 2> 24805 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[267]} 0 1
[junit4] 2> 24810 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[268]} 0 1
[junit4] 2> 24815 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[269]} 0 1
[junit4] 2> 24821 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[270]} 0 1
[junit4] 2> 24826 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[271]} 0 0
[junit4] 2> 24832 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[272]} 0 1
[junit4] 2> 24837 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[273]} 0 1
[junit4] 2> 24843 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[274]} 0 1
[junit4] 2> 24848 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[275]} 0 1
[junit4] 2> 24853 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[276]} 0 1
[junit4] 2> 24859 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[277]} 0 1
[junit4] 2> 24864 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[278]} 0 1
[junit4] 2> 24869 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[279]} 0 1
[junit4] 2> 24875 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[280]} 0 1
[junit4] 2> 24879 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[281]} 0 1
[junit4] 2> 24885 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[282]} 0 1
[junit4] 2> 24891 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[283]} 0 1
[junit4] 2> 24896 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[284]} 0 1
[junit4] 2> 24901 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[285]} 0 1
[junit4] 2> 24906 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[286]} 0 1
[junit4] 2> 24911 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[287]} 0 1
[junit4] 2> 24916 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[288]} 0 1
[junit4] 2> 24921 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[289]} 0 1
[junit4] 2> 24926 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[290]} 0 1
[junit4] 2> 24932 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[291]} 0 1
[junit4] 2> 24937 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[292]} 0 1
[junit4] 2> 24942 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[293]} 0 1
[junit4] 2> 24948 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[294]} 0 1
[junit4] 2> 24953 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[295]} 0 1
[junit4] 2> 24958 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[296]} 0 1
[junit4] 2> 24963 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[297]} 0 1
[junit4] 2> 24968 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[298]} 0 1
[junit4] 2> 24973 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[299]} 0 1
[junit4] 2> 24978 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[300]} 0 1
[junit4] 2> 24983 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[301]} 0 1
[junit4] 2> 24988 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[302]} 0 1
[junit4] 2> 24993 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[303]} 0 1
[junit4] 2> 24999 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[304]} 0 1
[junit4] 2> 25005 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[305]} 0 1
[junit4] 2> 25742 T19 C1 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=javabin&command=indexversion&version=2&qt=/replication} status=0 QTime=0
[junit4] 2> 26101 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[306]} 0 1092
[junit4] 2> 26118 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[307]} 0 13
[junit4] 2> 26123 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[308]} 0 1
[junit4] 2> 26128 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[309]} 0 1
[junit4] 2> 26133 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[310]} 0 1
[junit4] 2> 26137 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[311]} 0 1
[junit4] 2> 26142 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[312]} 0 1
[junit4] 2> 26147 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[313]} 0 1
[junit4] 2> 26152 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[314]} 0 1
[junit4] 2> 26157 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[315]} 0 1
[junit4] 2> 26162 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[316]} 0 1
[junit4] 2> 26167 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[317]} 0 1
[junit4] 2> 26172 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[318]} 0 1
[junit4] 2> 26176 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[319]} 0 1
[junit4] 2> 26180 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[320]} 0 1
[junit4] 2> 26186 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[321]} 0 1
[junit4] 2> 26191 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[322]} 0 1
[junit4] 2> 26196 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[323]} 0 1
[junit4] 2> 26201 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[324]} 0 1
[junit4] 2> 26206 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[325]} 0 1
[junit4] 2> 26212 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[326]} 0 1
[junit4] 2> 26216 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[327]} 0 1
[junit4] 2> 26221 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[328]} 0 1
[junit4] 2> 26226 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[329]} 0 2
[junit4] 2> 26231 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[330]} 0 1
[junit4] 2> 26237 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[331]} 0 1
[junit4] 2> 26242 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[332]} 0 1
[junit4] 2> 26247 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[333]} 0 1
[junit4] 2> 26252 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[334]} 0 1
[junit4] 2> 26257 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[335]} 0 1
[junit4] 2> 26262 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[336]} 0 1
[junit4] 2> 26266 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[337]} 0 1
[junit4] 2> 26271 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[338]} 0 1
[junit4] 2> 26277 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[339]} 0 1
[junit4] 2> 26282 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[340]} 0 1
[junit4] 2> 26287 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[341]} 0 1
[junit4] 2> 26293 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[342]} 0 1
[junit4] 2> 26299 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[343]} 0 1
[junit4] 2> 26304 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[344]} 0 1
[junit4] 2> 26310 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[345]} 0 1
[junit4] 2> 26316 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[346]} 0 1
[junit4] 2> 26321 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[347]} 0 1
[junit4] 2> 26326 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[348]} 0 1
[junit4] 2> 26331 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[349]} 0 1
[junit4] 2> 26336 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[350]} 0 1
[junit4] 2> 26341 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[351]} 0 1
[junit4] 2> 26346 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[352]} 0 1
[junit4] 2> 26350 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[353]} 0 1
[junit4] 2> 26355 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[354]} 0 1
[junit4] 2> 26359 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[355]} 0 1
[junit4] 2> 26364 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[356]} 0 1
[junit4] 2> 26388 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[357]} 0 0
[junit4] 2> 26393 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[358]} 0 1
[junit4] 2> 26398 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[359]} 0 1
[junit4] 2> 26401 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[360]} 0 1
[junit4] 2> 26406 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[361]} 0 1
[junit4] 2> 26411 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[362]} 0 1
[junit4] 2> 26416 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[363]} 0 1
[junit4] 2> 26420 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[364]} 0 1
[junit4] 2> 26425 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[365]} 0 1
[junit4] 2> 26431 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[366]} 0 1
[junit4] 2> 26436 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[367]} 0 1
[junit4] 2> 26442 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[368]} 0 1
[junit4] 2> 26447 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[369]} 0 1
[junit4] 2> 26453 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[370]} 0 1
[junit4] 2> 26459 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[371]} 0 1
[junit4] 2> 26464 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[372]} 0 1
[junit4] 2> 26469 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[373]} 0 1
[junit4] 2> 26474 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[374]} 0 1
[junit4] 2> 26479 T17 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update par
[...truncated too long message...]
sAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1037)
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not fully create collection: awholynewstresscollection_collection0_1
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:568)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:343)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:304)
[junit4] > ... 6 moreThrowable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=29604, name=Thread-6492, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:33216, http://127.0.0.1:12976, http://127.0.0.1:44525, http://127.0.0.1:30076, http://127.0.0.1:49956]
[junit4] > at __randomizedtesting.SeedInfo.seed([C76C029776C01205]:0)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1056)
[junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:33216, http://127.0.0.1:12976, http://127.0.0.1:44525, http://127.0.0.1:30076, http://127.0.0.1:49956]
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:322)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:880)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:658)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:601)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1548)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1569)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1037)
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not fully create collection: awholynewstresscollection_collection2_1
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:568)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:343)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:304)
[junit4] > ... 6 moreThrowable #7: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=29603, name=Thread-6491, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:33216, http://127.0.0.1:12976, http://127.0.0.1:44525, http://127.0.0.1:30076, http://127.0.0.1:49956]
[junit4] > at __randomizedtesting.SeedInfo.seed([C76C029776C01205]:0)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1056)
[junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:33216, http://127.0.0.1:12976, http://127.0.0.1:44525, http://127.0.0.1:30076, http://127.0.0.1:49956]
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:322)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:880)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:658)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:601)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1548)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1569)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1037)
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not fully create collection: awholynewstresscollection_collection1_1
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:568)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:343)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:304)
[junit4] > ... 6 more
[junit4] 2> 2147965 T29197 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C76C029776C01205-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {text=PostingsFormat(name=Lucene41VarGapFixedInterval), a_t=PostingsFormat(name=MockRandom), _version_=OrdsLucene41(blocksize=128), multiDefault=PostingsFormat(name=MockRandom), timestamp=PostingsFormat(name=MockRandom), range_facet_l=PostingsFormat(name=MockRandom), intDefault=OrdsLucene41(blocksize=128), id=FSTOrd41, other_tl1=OrdsLucene41(blocksize=128), a_i1=PostingsFormat(name=MockRandom)}, docValues:{timestamp=DocValuesFormat(name=Asserting)}, sim=DefaultSimilarity, locale=ro_RO, timezone=Europe/Zaporozhye
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=16,threads=1,free=205115336,total=503316480
[junit4] 2> NOTE: All tests run in this JVM: [DocumentAnalysisRequestHandlerTest, TestSchemaVersionResource, TriLevelCompositeIdRoutingTest, ConnectionManagerTest, TestCustomSort, TestBadConfig, ResponseLogComponentTest, HdfsBasicDistributedZk2Test, SolrXmlInZkTest, TestSolrXmlPersistor, MultiThreadedOCPTest, SearchHandlerTest, TestReplicationHandlerBackup, TestPhraseSuggestions, SimpleFacetsTest, HighlighterMaxOffsetTest, SolrInfoMBeanTest, TestMergePolicyConfig, TestCSVLoader, CoreContainerCoreInitFailuresTest, CoreAdminHandlerTest, TestFastWriter, TestLMJelinekMercerSimilarityFactory, ShardRoutingTest, IndexBasedSpellCheckerTest, DocValuesMultiTest, UnloadDistributedZkTest, TestPivotHelperCode, TermVectorComponentTest, TestSearchPerf, RequestHandlersTest, SuggesterTSTTest, TestSolrXml, ExternalCollectionsTest, CoreAdminRequestStatusTest, SpellPossibilityIteratorTest, TestPHPSerializedResponseWriter, BadIndexSchemaTest, TestExceedMaxTermLength, TestFieldResource, TestJoin, TermVectorComponentDistributedTest, ReplicationFactorTest, BadCopyFieldTest, LeaderElectionTest, TestLeaderElectionZkExpiry, TestFastLRUCache, StandardRequestHandlerTest, TestDistributedGrouping, SolrPluginUtilsTest, AnalysisErrorHandlingTest, TestCursorMarkWithoutUniqueKey, ChaosMonkeySafeLeaderTest, CollectionsAPIDistributedZkTest]
[junit4] Completed on J3 in 909.30s, 1 test, 1 error <<< FAILURES!
[...truncated 641 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:531: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:472: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:496: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1360: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:962: There were test failures: 431 suites, 1778 tests, 1 suite-level error, 2 errors, 55 ignored (11 assumptions)
Total time: 220 minutes 54 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #632
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 695091772 bytes
Compression is 0.0%
Took 2 min 0 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 634 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/634/
2 tests failed.
REGRESSION: org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.testDistribSearch
Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:60696, https://127.0.0.1:60737, https://127.0.0.1:60786]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:60696, https://127.0.0.1:60737, https://127.0.0.1:60786]
at __randomizedtesting.SeedInfo.seed([C4EA06733FC6396B:450C886B48995957]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:322)
at org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:880)
at org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:658)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:601)
at org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.removeAndWaitForLastReplicaGone(DeleteLastCustomShardedReplicaTest.java:117)
at org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.doTest(DeleteLastCustomShardedReplicaTest.java:107)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not remove replica : customcollreplicadeletion/a/core_node2
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:568)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:343)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:304)
... 46 more
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core [halfcollection_shard1_replica1] Caused by: Could not get shard id for core: halfcollection_shard1_replica1
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core [halfcollection_shard1_replica1] Caused by: Could not get shard id for core: halfcollection_shard1_replica1
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:568)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:583)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:205)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 12109 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/init-core-data-001
[junit4] 2> 790260 T3128 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
[junit4] 2> 790260 T3128 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 790265 T3128 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 790266 T3128 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 790266 T3129 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 790366 T3128 oasc.ZkTestServer.run start zk server on port:34586
[junit4] 2> 790367 T3128 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 790368 T3128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 790371 T3135 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@59fb99e7 name:ZooKeeperConnection Watcher:127.0.0.1:34586 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 790371 T3128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 790372 T3128 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 790372 T3128 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 790375 T3128 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 790376 T3128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 790377 T3137 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3956de9a name:ZooKeeperConnection Watcher:127.0.0.1:34586/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 790377 T3128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 790378 T3128 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 790378 T3128 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 790380 T3128 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 790382 T3128 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 790383 T3128 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 790385 T3128 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 790386 T3128 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 790388 T3128 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 790389 T3128 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 790492 T3128 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 790493 T3128 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 790495 T3128 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 790495 T3128 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 790497 T3128 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 790498 T3128 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 790500 T3128 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 790500 T3128 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 790502 T3128 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 790503 T3128 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 790505 T3128 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 790505 T3128 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 790507 T3128 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 790508 T3128 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 790510 T3128 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 790510 T3128 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 790512 T3128 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 790513 T3128 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> Using old style solr.xml
[junit4] 2> 790515 T3128 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 790516 T3128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 790517 T3139 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@74b33e3f name:ZooKeeperConnection Watcher:127.0.0.1:34586 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 790518 T3128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 790518 T3128 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 790518 T3128 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 790520 T3128 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 790521 T3128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 790522 T3141 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e9c391e name:ZooKeeperConnection Watcher:127.0.0.1:34586/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 790522 T3128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 790522 T3128 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 790524 T3128 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
[junit4] 2> 790525 T3128 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.xml
[junit4] 2> 790527 T3128 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
[junit4] 2> 790528 T3128 oascc.SolrZkClient.makePath makePath: /configs/conf2/schema.xml
[junit4] 2> 790631 T3128 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 790631 T3128 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 790633 T3128 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
[junit4] 2> 790634 T3128 oascc.SolrZkClient.makePath makePath: /configs/conf2/stopwords.txt
[junit4] 2> 790636 T3128 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
[junit4] 2> 790636 T3128 oascc.SolrZkClient.makePath makePath: /configs/conf2/protwords.txt
[junit4] 2> 790638 T3128 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
[junit4] 2> 790639 T3128 oascc.SolrZkClient.makePath makePath: /configs/conf2/currency.xml
[junit4] 2> 790641 T3128 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
[junit4] 2> 790641 T3128 oascc.SolrZkClient.makePath makePath: /configs/conf2/open-exchange-rates.json
[junit4] 2> 790643 T3128 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 790644 T3128 oascc.SolrZkClient.makePath makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 790653 T3128 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
[junit4] 2> 790653 T3128 oascc.SolrZkClient.makePath makePath: /configs/conf2/old_synonyms.txt
[junit4] 2> 790655 T3128 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
[junit4] 2> 790656 T3128 oascc.SolrZkClient.makePath makePath: /configs/conf2/synonyms.txt
[junit4] 2> 790658 T3128 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
[junit4] 2> 790659 T3128 oascc.SolrZkClient.makePath makePath: /configs/conf2/elevate.xml
[junit4] 2> 791854 T3128 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 791858 T3128 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:34602
[junit4] 2> 791858 T3128 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 791858 T3128 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 791859 T3128 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-002
[junit4] 2> 791859 T3128 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-002/'
[junit4] 2> 791887 T3128 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-002/solr.xml
[junit4] 2> 791939 T3128 oasc.CoreContainer.<init> New CoreContainer 551364517
[junit4] 2> 791940 T3128 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-002/]
[junit4] 2> 791940 T3128 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 791941 T3128 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 791941 T3128 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 791941 T3128 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 791941 T3128 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 791942 T3128 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 791942 T3128 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 791942 T3128 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 791942 T3128 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 791943 T3128 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false
[junit4] 2> 791943 T3128 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 791943 T3128 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 791944 T3128 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 791944 T3128 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:34586/solr
[junit4] 2> 791944 T3128 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 791944 T3128 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 791945 T3128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 791947 T3152 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1755d27e name:ZooKeeperConnection Watcher:127.0.0.1:34586 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 791947 T3128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 791948 T3128 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 791949 T3128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 791951 T3154 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e8f37f2 name:ZooKeeperConnection Watcher:127.0.0.1:34586/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 791951 T3128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 791952 T3128 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 791954 T3128 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 791956 T3128 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 791958 T3128 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 791960 T3128 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 791962 T3128 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 791964 T3128 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34602_
[junit4] 2> 791964 T3128 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34602_
[junit4] 2> 791966 T3128 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 791968 T3128 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 791969 T3128 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 791971 T3128 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:34602_
[junit4] 2> 791971 T3128 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 791972 T3128 oasc.Overseer.start Overseer (id=92529042730254341-127.0.0.1:34602_-n_0000000000) starting
[junit4] 2> 791974 T3128 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 791980 T3128 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 791981 T3156 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 791981 T3128 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 791983 T3128 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 791984 T3128 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 791987 T3155 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 791990 T3128 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
[junit4] 2> 791990 T3128 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 791991 T3128 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 791992 T3128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 791993 T3160 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3b31a09c name:ZooKeeperConnection Watcher:127.0.0.1:34586/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 791993 T3128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 791994 T3128 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 791995 T3128 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 791997 T3128 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 791997 T3128 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
[junit4] 2> 791998 T3128 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 791998 T3128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 791999 T3162 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5cef6f34 name:ZooKeeperConnection Watcher:127.0.0.1:34586/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 792000 T3128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 792000 T3128 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 792002 T3163 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 792004 T3155 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: collection1
[junit4] 2> 792004 T3155 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 792004 T3155 oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 2
[junit4] 2> 792006 T3155 oasc.Overseer$ClusterStateUpdater.updateZkStates going to create_collection /collections/collection1/state.json
[junit4] 2> 792007 T3163 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 792007 T3164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 793188 T3128 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 793189 T3128 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 793191 T3128 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:34609
[junit4] 2> 793192 T3128 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 793192 T3128 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 793192 T3128 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-003
[junit4] 2> 793193 T3128 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-003/'
[junit4] 2> 793222 T3128 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-003/solr.xml
[junit4] 2> 793275 T3128 oasc.CoreContainer.<init> New CoreContainer 1968942049
[junit4] 2> 793275 T3128 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-003/]
[junit4] 2> 793276 T3128 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 793276 T3128 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 793276 T3128 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 793277 T3128 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 793277 T3128 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 793277 T3128 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 793277 T3128 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 793278 T3128 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 793278 T3128 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 793278 T3128 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false
[junit4] 2> 793279 T3128 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 793279 T3128 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 793279 T3128 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 793279 T3128 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:34586/solr
[junit4] 2> 793280 T3128 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 793280 T3128 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 793281 T3128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 793282 T3175 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@55717cf8 name:ZooKeeperConnection Watcher:127.0.0.1:34586 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 793283 T3128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 793283 T3128 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 793285 T3128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 793286 T3177 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5c17d1de name:ZooKeeperConnection Watcher:127.0.0.1:34586/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 793286 T3128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 793290 T3128 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 794295 T3128 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34609_
[junit4] 2> 794296 T3128 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34609_
[junit4] 2> 794299 T3128 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 794304 T3128 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
[junit4] 2> 794304 T3128 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 795435 T3128 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 795436 T3128 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 795438 T3128 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:34612
[junit4] 2> 795439 T3128 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 795439 T3128 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 795439 T3128 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-004
[junit4] 2> 795439 T3128 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-004/'
[junit4] 2> 795468 T3128 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-004/solr.xml
[junit4] 2> 795519 T3128 oasc.CoreContainer.<init> New CoreContainer 1103158997
[junit4] 2> 795520 T3128 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-004/]
[junit4] 2> 795520 T3128 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 795521 T3128 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 795521 T3128 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 795521 T3128 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 795521 T3128 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 795522 T3128 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 795522 T3128 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 795522 T3128 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 795522 T3128 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 795523 T3128 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false
[junit4] 2> 795523 T3128 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 795523 T3128 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 795524 T3128 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 795524 T3128 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:34586/solr
[junit4] 2> 795524 T3128 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 795524 T3128 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 795525 T3128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 795527 T3190 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5d6593ac name:ZooKeeperConnection Watcher:127.0.0.1:34586 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 795527 T3128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 795527 T3128 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 795529 T3128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 795530 T3192 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4b67ea8e name:ZooKeeperConnection Watcher:127.0.0.1:34586/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 795530 T3128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 795535 T3128 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 796539 T3128 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34612_
[junit4] 2> 796540 T3128 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34612_
[junit4] 2> 796543 T3128 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 796547 T3128 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
[junit4] 2> 796548 T3128 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 797789 T3128 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 797790 T3128 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 797793 T3128 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:34615
[junit4] 2> 797793 T3128 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 797794 T3128 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 797794 T3128 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-005
[junit4] 2> 797794 T3128 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-005/'
[junit4] 2> 797823 T3128 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-005/solr.xml
[junit4] 2> 797874 T3128 oasc.CoreContainer.<init> New CoreContainer 1391322661
[junit4] 2> 797875 T3128 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-005/]
[junit4] 2> 797876 T3128 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 797876 T3128 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 797876 T3128 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 797876 T3128 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 797877 T3128 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 797877 T3128 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 797877 T3128 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 797877 T3128 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 797878 T3128 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 797878 T3128 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false
[junit4] 2> 797878 T3128 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 797879 T3128 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 797879 T3128 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 797879 T3128 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:34586/solr
[junit4] 2> 797879 T3128 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 797880 T3128 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 797880 T3128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 797882 T3205 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a0b1ac name:ZooKeeperConnection Watcher:127.0.0.1:34586 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 797883 T3128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 797883 T3128 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 797884 T3128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 797885 T3207 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@195e3cb0 name:ZooKeeperConnection Watcher:127.0.0.1:34586/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 797885 T3128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 797890 T3128 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 798894 T3128 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34615_
[junit4] 2> 798895 T3128 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34615_
[junit4] 2> 798899 T3128 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 798904 T3128 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
[junit4] 2> 798904 T3128 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 800059 T3128 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
[junit4] 2> 800059 T3128 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 800062 T3128 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:34628
[junit4] 2> 800063 T3128 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 800063 T3128 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 800063 T3128 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-006
[junit4] 2> 800064 T3128 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-006/'
[junit4] 2> 800093 T3128 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-006/solr.xml
[junit4] 2> 800145 T3128 oasc.CoreContainer.<init> New CoreContainer 1211233683
[junit4] 2> 800146 T3128 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-006/]
[junit4] 2> 800146 T3128 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 800147 T3128 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 800147 T3128 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 800147 T3128 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 800147 T3128 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 800148 T3128 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 800148 T3128 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 800148 T3128 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 800148 T3128 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 800149 T3128 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false
[junit4] 2> 800149 T3128 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 800149 T3128 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 800150 T3128 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 800150 T3128 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:34586/solr
[junit4] 2> 800150 T3128 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 800151 T3128 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 800151 T3128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 800153 T3220 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@47f1aaec name:ZooKeeperConnection Watcher:127.0.0.1:34586 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 800153 T3128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 800154 T3128 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 800155 T3128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 800156 T3222 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@69841df5 name:ZooKeeperConnection Watcher:127.0.0.1:34586/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 800156 T3128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 800161 T3128 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 801165 T3128 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34628_
[junit4] 2> 801166 T3128 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34628_
[junit4] 2> 801170 T3128 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 801174 T3128 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
[junit4] 2> 801175 T3128 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 801186 T3167 oasha.CollectionsHandler.handleCreateAction Creating Collection : wt=javabin&replicationFactor=2&name=solrj_collection&router.field=myOwnField&numShards=2&collection.configName=conf1&version=2&action=CREATE
[junit4] 2> 801187 T3163 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 801189 T3156 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"create",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField"}
[junit4] 2> 801196 T3225 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : create , {
[junit4] 2> "operation":"create",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField"}
[junit4] 2> 801202 T3225 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/solrj_collection
[junit4] 2> 801203 T3225 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
[junit4] 2> 801205 T3163 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 801208 T3155 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: solrj_collection
[junit4] 2> 801208 T3155 oasc.Overseer$ClusterStateUpdater.createCollection Create collection solrj_collection with shards [shard1, shard2]
[junit4] 2> 801208 T3155 oasc.Overseer$ClusterStateUpdater.createCollection state version solrj_collection 1
[junit4] 2> 801210 T3164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 801210 T3208 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 801210 T3193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 801210 T3178 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 801210 T3163 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 801210 T3223 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 801305 T3225 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection solrj_collection, shardNames [shard1, shard2] , replicationFactor : 2
[junit4] 2> 801306 T3225 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of collection solrj_collection on 127.0.0.1:34628_
[junit4] 2> 801307 T3225 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of collection solrj_collection on 127.0.0.1:34612_
[junit4] 2> 801308 T3225 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of collection solrj_collection on 127.0.0.1:34602_
[junit4] 2> 801310 T3225 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of collection solrj_collection on 127.0.0.1:34609_
[junit4] 2> 801310 T3212 oasha.CoreAdminHandler.handleCreateAction core create command wt=javabin&name=solrj_collection_shard1_replica1&shard=shard1&qt=/admin/cores&numShards=2&collection.configName=conf1&version=2&collection=solrj_collection&action=CREATE
[junit4] 2> 801310 T3182 oasha.CoreAdminHandler.handleCreateAction core create command wt=javabin&name=solrj_collection_shard1_replica2&shard=shard1&qt=/admin/cores&numShards=2&collection.configName=conf1&version=2&collection=solrj_collection&action=CREATE
[junit4] 2> 801311 T3148 oasha.CoreAdminHandler.handleCreateAction core create command wt=javabin&name=solrj_collection_shard2_replica1&shard=shard2&qt=/admin/cores&numShards=2&collection.configName=conf1&version=2&collection=solrj_collection&action=CREATE
[junit4] 2> 801312 T3168 oasha.CoreAdminHandler.handleCreateAction core create command wt=javabin&name=solrj_collection_shard2_replica2&shard=shard2&qt=/admin/cores&numShards=2&collection.configName=conf1&version=2&collection=solrj_collection&action=CREATE
[junit4] 2> 801314 T3182 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica2 state=down collection=solrj_collection
[junit4] 2> 801314 T3212 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica1 state=down collection=solrj_collection
[junit4] 2> 801315 T3163 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 801315 T3168 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica2 state=down collection=solrj_collection
[junit4] 2> 801315 T3212 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 801315 T3148 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica1 state=down collection=solrj_collection
[junit4] 2> 801316 T3168 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 801315 T3182 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 801317 T3148 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 801318 T3155 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "base_url":"http://127.0.0.1:34612",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"solrj_collection_shard1_replica2",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:34612_",
[junit4] 2> "operation":"state"}
[junit4] 2> 801320 T3155 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "base_url":"http://127.0.0.1:34628",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"solrj_collection_shard1_replica1",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:34628_",
[junit4] 2> "operation":"state"}
[junit4] 2> 801322 T3163 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 801322 T3155 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "base_url":"http://127.0.0.1:34609",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"solrj_collection_shard2_replica2",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:34609_",
[junit4] 2> "operation":"state"}
[junit4] 2> 801325 T3155 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "base_url":"http://127.0.0.1:34602",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"solrj_collection_shard2_replica1",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:34602_",
[junit4] 2> "operation":"state"}
[junit4] 2> 801327 T3163 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 801327 T3208 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 801327 T3193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 801327 T3164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 801327 T3223 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 801327 T3163 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 801327 T3178 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 802316 T3212 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica1
[junit4] 2> 802317 T3212 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 802317 T3182 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica2
[junit4] 2> 802318 T3212 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 802318 T3168 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica2
[junit4] 2> 802317 T3148 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica1
[junit4] 2> 802319 T3168 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 802318 T3212 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 802319 T3168 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 802320 T3168 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 802318 T3182 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 802320 T3212 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 802321 T3182 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 802319 T3148 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 802321 T3182 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 802322 T3148 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 802321 T3212 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-006/solrj_collection_shard1_replica1/'
[junit4] 2> 802321 T3168 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 802322 T3182 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 802322 T3148 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 802323 T3182 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-004/solrj_collection_shard1_replica2/'
[junit4] 2> 802323 T3168 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-003/solrj_collection_shard2_replica2/'
[junit4] 2> 802324 T3148 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 802325 T3148 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-002/solrj_collection_shard2_replica1/'
[junit4] 2> 802377 T3212 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 802381 T3148 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 802386 T3168 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 802392 T3182 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 802441 T3212 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 802444 T3148 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 802445 T3148 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 802449 T3168 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 802454 T3182 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 802455 T3148 oass.IndexSchema.readSchema [solrj_collection_shard2_replica1] Schema name=test
[junit4] 2> 802543 T3212 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 802551 T3168 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 802553 T3212 oass.IndexSchema.readSchema [solrj_collection_shard1_replica1] Schema name=test
[junit4] 2> 802556 T3182 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 802562 T3168 oass.IndexSchema.readSchema [solrj_collection_shard2_replica2] Schema name=test
[junit4] 2> 802568 T3182 oass.IndexSchema.readSchema [solrj_collection_shard1_replica2] Schema name=test
[junit4] 2> 802867 T3148 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 802879 T3148 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 802882 T3148 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 802894 T3148 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 802899 T3148 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 802904 T3148 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 802905 T3148 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 802907 T3148 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 802907 T3148 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 802908 T3148 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 802909 T3148 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 802909 T3148 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica1' using configuration from collection solrj_collection
[junit4] 2> 802909 T3148 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 802910 T3148 oasc.SolrCore.<init> [solrj_collection_shard2_replica1] Opening new SolrCore at ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-002/solrj_collection_shard2_replica1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-002/solrj_collection_shard2_replica1/data/
[junit4] 2> 802910 T3148 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e5cd73c
[junit4] 2> 802911 T3148 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-002/solrj_collection_shard2_replica1/data
[junit4] 2> 802912 T3148 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-002/solrj_collection_shard2_replica1/data/index/
[junit4] 2> 802912 T3148 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-002/solrj_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 802913 T3148 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-002/solrj_collection_shard2_replica1/data/index
[junit4] 2> 802914 T3148 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=34, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 802915 T3148 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-71cbb270)),segFN=segments_1,generation=1}
[junit4] 2> 802921 T3148 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 802926 T3148 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 802927 T3148 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 802927 T3148 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 802928 T3148 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 802928 T3148 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 802929 T3148 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 802929 T3148 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 802930 T3148 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 802930 T3148 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 802931 T3148 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 802931 T3148 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 802932 T3148 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 802932 T3148 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 802933 T3148 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 802933 T3148 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 802934 T3148 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 802934 T3148 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 802935 T3148 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 802935 T3148 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 802936 T3148 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 802967 T3148 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 802970 T3148 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 802972 T3148 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 802975 T3148 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 802983 T3148 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 802983 T3148 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 802984 T3148 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=2.6943359375, floorSegmentMB=0.94140625, forceMergeDeletesPctAllowed=15.516444439038867, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 802985 T3148 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-71cbb270)),segFN=segments_1,generation=1}
[junit4] 2> 802986 T3148 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 802987 T3148 oass.SolrIndexSearcher.<init> Opening Searcher@612e3937[solrj_collection_shard2_replica1] main
[junit4] 2> 802987 T3148 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 802988 T3148 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 802988 T3148 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 802989 T3148 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 802990 T3148 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 802990 T3148 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 802991 T3148 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 802991 T3148 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 802992 T3148 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
[junit4] 2> 802992 T3212 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 802994 T3148 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
[junit4] 2> 802994 T3148 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 802995 T3148 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 802999 T3230 oasc.SolrCore.registerSearcher [solrj_collection_shard2_replica1] Registered new searcher Searcher@612e3937[solrj_collection_shard2_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 802999 T3212 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 803002 T3148 oasc.CoreContainer.registerCore registering core: solrj_collection_shard2_replica1
[junit4] 2> 803003 T3212 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 803003 T3148 oasc.ZkController.register Register replica - core:solrj_collection_shard2_replica1 address:http://127.0.0.1:34602 collection:solrj_collection shard:shard2
[junit4] 2> 803004 T3168 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 803004 T3148 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection/leader_elect/shard2/election
[junit4] 2> 803008 T3182 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 803008 T3148 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 803010 T3168 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 803010 T3163 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 803010 T3148 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=6.3583115E15ms
[junit4] 2> 803011 T3148 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Was waiting for replicas to come up, but they are taking too long - assuming they won't come back till later
[junit4] 2> 803011 T3148 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1069 name=solrj_collection_shard2_replica1 org.apache.solr.core.SolrCore@70b13ca url=http://127.0.0.1:34602/solrj_collection_shard2_replica1 node=127.0.0.1:34602_ C1069_STATE=coll:solrj_collection core:solrj_collection_shard2_replica1 props:{base_url=http://127.0.0.1:34602, core=solrj_collection_shard2_replica1, state=down, node_name=127.0.0.1:34602_}
[junit4] 2> 803012 T3148 C1069 P34602 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:34602/solrj_collection_shard2_replica1/
[junit4] 2> 803012 T3148 C1069 P34602 oasu.PeerSync.sync PeerSync: core=solrj_collection_shard2_replica1 url=http://127.0.0.1:34602 START replicas=[http://127.0.0.1:34609/solrj_collection_shard2_replica2/] nUpdates=100
[junit4] 2> 803013 T3148 C1069 P34602 oasu.PeerSync.sync PeerSync: core=solrj_collection_shard2_replica1 url=http://127.0.0.1:34602 DONE. We have no versions. sync failed.
[junit4] 2> 803014 T3148 C1069 P34602 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 803013 T3168 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 803014 T3148 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 803015 T3182 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 803016 T3212 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 803015 T3148 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:34602/solrj_collection_shard2_replica1/ shard2
[junit4] 2> 803016 T3223 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 803016 T3193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 803016 T3164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 803016 T3208 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 803016 T3163 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 803016 T3178 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 803017 T3148 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection/leaders/shard2
[junit4] 2> 803019 T3182 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 803022 T3212 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 803023 T3163 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 803026 T3212 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 803027 T3212 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 803028 T3168 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 803028 T3212 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 803028 T3212 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 803029 T3212 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 803030 T3212 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 803030 T3212 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica1' using configuration from collection solrj_collection
[junit4] 2> 803030 T3212 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 803031 T3212 oasc.SolrCore.<init> [solrj_collection_shard1_replica1] Opening new SolrCore at ../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-006/solrj_collection_shard1_replica1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-006/solrj_collection_shard1_replica1/data/
[junit4] 2> 803031 T3182 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 803031 T3212 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e5cd73c
[junit4] 2> 803032 T3168 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 803033 T3212 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-006/solrj_collection_shard1_replica1/data
[junit4] 2> 803033 T3212 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-006/solrj_collection_shard1_replica1/data/index/
[junit4] 2> 803034 T3212 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-006/solrj_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 803034 T3212 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-C4EA06733FC6396B-001/tempDir-006/solrj_collection_shard1_replica1/data/index
[jun
[...truncated too long message...]
ExecutorService.java:110)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:263)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 2561564 T6582 oaz.ClientCnxn$EventThread.processEvent ERROR Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@70eb85a7 rejected from java.util.concurrent.ThreadPoolExecutor@3b336a0e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 4]
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
[junit4] 2> at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:263)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 2561565 T6582 oaz.ClientCnxn$EventThread.processEvent ERROR Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@627516ae rejected from java.util.concurrent.ThreadPoolExecutor@3b336a0e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 4]
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
[junit4] 2> at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:263)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 2561565 T6582 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ac0d386 name:ZooKeeperConnection Watcher:127.0.0.1:60685/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 2561566 T6582 oascc.ConnectionManager.process Client->ZooKeeper status change trigger but we are already closed
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=DeleteLastCustomShardedReplicaTest -Dtests.method=testDistribSearch -Dtests.seed=C4EA06733FC6396B -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=es_AR -Dtests.timezone=Europe/Malta -Dtests.file.encoding=UTF-8
[junit4] ERROR 140s J3 | DeleteLastCustomShardedReplicaTest.testDistribSearch <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:60696, https://127.0.0.1:60737, https://127.0.0.1:60786]
[junit4] > at __randomizedtesting.SeedInfo.seed([C4EA06733FC6396B:450C886B48995957]:0)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:322)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:880)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:658)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:601)
[junit4] > at org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.removeAndWaitForLastReplicaGone(DeleteLastCustomShardedReplicaTest.java:117)
[junit4] > at org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.doTest(DeleteLastCustomShardedReplicaTest.java:107)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not remove replica : customcollreplicadeletion/a/core_node2
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:568)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:343)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:304)
[junit4] > ... 46 more
[junit4] 2> 2561574 T6516 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-C4EA06733FC6396B-001
[junit4] 2> 139578 T6515 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=es_AR, timezone=Europe/Malta
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=16,threads=1,free=214987056,total=465567744
[junit4] 2> NOTE: All tests run in this JVM: [DistributedSuggestComponentTest, WordBreakSolrSpellCheckerTest, AnalysisErrorHandlingTest, TestSort, DocumentAnalysisRequestHandlerTest, CoreAdminRequestStatusTest, TestSolrXmlPersistor, TestManagedResourceStorage, FieldAnalysisRequestHandlerTest, UnloadDistributedZkTest, TestCustomSort, FieldMutatingUpdateProcessorTest, TestIndexSearcher, SpellPossibilityIteratorTest, BlockDirectoryTest, TestRecoveryHdfs, UUIDFieldTest, StandardRequestHandlerTest, SuggesterTest, IndexBasedSpellCheckerTest, ClusterStateUpdateTest, EnumFieldTest, SolrInfoMBeanTest, TestPHPSerializedResponseWriter, TestMergePolicyConfig, DocExpirationUpdateProcessorFactoryTest, SolrIndexSplitterTest, BadIndexSchemaTest, TermVectorComponentDistributedTest, TestCursorMarkWithoutUniqueKey, DocValuesMultiTest, TermVectorComponentTest, SliceStateTest, LoggingHandlerTest, ZkCLITest, BadCopyFieldTest, TestDistribDocBasedVersion, TestCloudManagedSchemaConcurrent, FileBasedSpellCheckerTest, SearchHandlerTest, TestFastLRUCache, HdfsBasicDistributedZk2Test, SOLR749Test, LeaderElectionTest, ReplicationFactorTest, TestCSVResponseWriter, TestLeaderElectionZkExpiry, StatelessScriptUpdateProcessorFactoryTest, TestOrdValues, EchoParamsTest, SpellCheckComponentTest, CollectionsAPIDistributedZkTest, RecoveryZkTest, TestRandomFaceting, ShardRoutingCustomTest, TestDistributedSearch, SolrCmdDistributorTest, DirectUpdateHandlerTest, OverseerCollectionProcessorTest, DistributedQueryElevationComponentTest, TestAtomicUpdateErrorCases, QueryEqualityTest, CacheHeaderTest, TermsComponentTest, PathHierarchyTokenizerFactoryTest, RegexBoostProcessorTest, ReturnFieldsTest, TestPartialUpdateDeduplication, TestLFUCache, ResponseLogComponentTest, TestSearchPerf, MinimalSchemaTest, TestFuzzyAnalyzedSuggestions, TestSolrCoreProperties, TestSystemIdResolver, TestSuggestSpellingConverter, DOMUtilTest, ClusterStateTest, TestSolrJ, TestLRUCache, SystemInfoHandlerTest, FileUtilsTest, CircularListTest, TestRTGBase, TestDistributedMissingSort, AsyncMigrateRouteKeyTest, DeleteLastCustomShardedReplicaTest]
[junit4] Completed on J3 in 140.39s, 1 test, 1 error <<< FAILURES!
[...truncated 328 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:531: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:472: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:496: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1360: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:962: There were test failures: 431 suites, 1778 tests, 2 errors, 55 ignored (11 assumptions)
Total time: 224 minutes 13 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #632
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 450454878 bytes
Compression is 0.0%
Took 1 min 15 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure