You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/05/19 22:43:05 UTC
[JENKINS] Lucene-Solr-4.8-Linux (64bit/jdk1.7.0_55) - Build # 201 -
Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.8-Linux/201/
Java: 64bit/jdk1.7.0_55 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
4 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest
Error Message:
ERROR: SolrZkClient opens=19 closes=18
Stack Trace:
java.lang.AssertionError: ERROR: SolrZkClient opens=19 closes=18
at __randomizedtesting.SeedInfo.seed([BE2B129D2426A676]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.SolrTestCaseJ4.endTrackingZkClients(SolrTestCaseJ4.java:434)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:180)
at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:790)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest: 1) Thread[id=3951, name=TEST-CollectionsAPIDistributedZkTest.testDistribSearch-seed#[BE2B129D2426A676]-SendThread(127.0.0.1:35666), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:230) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1185) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1110) 2) Thread[id=3952, name=TEST-CollectionsAPIDistributedZkTest.testDistribSearch-seed#[BE2B129D2426A676]-EventThread, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest:
1) Thread[id=3951, name=TEST-CollectionsAPIDistributedZkTest.testDistribSearch-seed#[BE2B129D2426A676]-SendThread(127.0.0.1:35666), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:230)
at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1185)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1110)
2) Thread[id=3952, name=TEST-CollectionsAPIDistributedZkTest.testDistribSearch-seed#[BE2B129D2426A676]-EventThread, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
at __randomizedtesting.SeedInfo.seed([BE2B129D2426A676]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=3951, name=TEST-CollectionsAPIDistributedZkTest.testDistribSearch-seed#[BE2B129D2426A676]-SendThread(127.0.0.1:35666), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=3951, name=TEST-CollectionsAPIDistributedZkTest.testDistribSearch-seed#[BE2B129D2426A676]-SendThread(127.0.0.1:35666), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
at __randomizedtesting.SeedInfo.seed([BE2B129D2426A676]:0)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
collection already exists: awholynewcollection_0
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: collection already exists: awholynewcollection_0
at __randomizedtesting.SeedInfo.seed([BE2B129D2426A676:3FCD9C855379C64A]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:554)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:340)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:301)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:636)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1661)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1687)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:710)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:205)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11222 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/init-core-data-001
[junit4] 2> 865609 T3799 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
[junit4] 2> 865610 T3799 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /ag_y/hp
[junit4] 2> 865614 T3799 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 865615 T3799 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 865615 T3800 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 865715 T3799 oasc.ZkTestServer.run start zk server on port:35666
[junit4] 2> 865716 T3799 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 875860 T3803 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 10141ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 875862 T3801 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14616365fc40000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 876929 T3806 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@32fa8d70 name:ZooKeeperConnection Watcher:127.0.0.1:35666 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 876930 T3799 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 876931 T3799 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 876936 T3799 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 876938 T3808 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@215c13bc name:ZooKeeperConnection Watcher:127.0.0.1:35666/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 876938 T3799 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 876939 T3799 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 876943 T3799 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 876947 T3799 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 876949 T3799 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 876953 T3799 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 876953 T3799 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 876959 T3799 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 876960 T3799 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 876964 T3799 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 876965 T3799 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 876969 T3799 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 876970 T3799 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 876973 T3799 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 876974 T3799 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 876978 T3799 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 876978 T3799 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 876982 T3799 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 876983 T3799 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 876986 T3799 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 876987 T3799 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 876990 T3799 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 876990 T3799 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 876995 T3799 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 876995 T3799 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 876999 T3799 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 877000 T3799 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 877004 T3799 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 877006 T3810 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3bdebf20 name:ZooKeeperConnection Watcher:127.0.0.1:35666/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 877007 T3799 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> Using new style solr.xml
[junit4] 2> 877010 T3799 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 877020 T3812 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1bfe8b58 name:ZooKeeperConnection Watcher:127.0.0.1:35666 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 877020 T3799 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 877021 T3799 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 877025 T3799 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 877027 T3814 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c47ce17 name:ZooKeeperConnection Watcher:127.0.0.1:35666/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 877027 T3799 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 877028 T3799 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf2/solrconfig.xml
[junit4] 2> 877029 T3799 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.xml
[junit4] 2> 877035 T3799 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
[junit4] 2> 877035 T3799 oascc.SolrZkClient.makePath makePath: /configs/conf2/schema.xml
[junit4] 2> 877040 T3799 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 877040 T3799 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 877045 T3799 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
[junit4] 2> 877045 T3799 oascc.SolrZkClient.makePath makePath: /configs/conf2/stopwords.txt
[junit4] 2> 877049 T3799 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
[junit4] 2> 877050 T3799 oascc.SolrZkClient.makePath makePath: /configs/conf2/protwords.txt
[junit4] 2> 877054 T3799 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
[junit4] 2> 877054 T3799 oascc.SolrZkClient.makePath makePath: /configs/conf2/currency.xml
[junit4] 2> 877057 T3799 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
[junit4] 2> 877058 T3799 oascc.SolrZkClient.makePath makePath: /configs/conf2/open-exchange-rates.json
[junit4] 2> 877061 T3799 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 877062 T3799 oascc.SolrZkClient.makePath makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 877066 T3799 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
[junit4] 2> 877066 T3799 oascc.SolrZkClient.makePath makePath: /configs/conf2/old_synonyms.txt
[junit4] 2> 877070 T3799 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
[junit4] 2> 877071 T3799 oascc.SolrZkClient.makePath makePath: /configs/conf2/synonyms.txt
[junit4] 2> 877075 T3799 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
[junit4] 2> 877076 T3799 oascc.SolrZkClient.makePath makePath: /configs/conf2/elevate.xml
[junit4] 2> 877313 T3799 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 877316 T3799 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 877317 T3799 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:52383
[junit4] 2> 877319 T3799 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 877320 T3799 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 877320 T3799 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-002
[junit4] 2> 877320 T3799 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-002/'
[junit4] 2> 877333 T3799 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-002/solr.xml
[junit4] 2> 877379 T3799 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-002
[junit4] 2> 877379 T3799 oasc.CoreContainer.<init> New CoreContainer 165789148
[junit4] 2> 877379 T3799 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-002/]
[junit4] 2> 877380 T3799 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 877380 T3799 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 877381 T3799 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 877381 T3799 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 877381 T3799 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 877381 T3799 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 877381 T3799 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 877382 T3799 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 877382 T3799 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 877384 T3799 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 877384 T3799 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 877385 T3799 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 877385 T3799 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35666/solr
[junit4] 2> 877385 T3799 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 877386 T3799 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 877411 T3825 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2fba712a name:ZooKeeperConnection Watcher:127.0.0.1:35666 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 877412 T3799 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 877414 T3799 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 877415 T3827 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5fef6cfc name:ZooKeeperConnection Watcher:127.0.0.1:35666/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 877415 T3799 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 877416 T3799 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 877419 T3799 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 877423 T3799 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 877425 T3799 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 877427 T3799 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 877429 T3799 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 877430 T3799 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52383_ag_y%2Fhp
[junit4] 2> 877431 T3799 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52383_ag_y%2Fhp
[junit4] 2> 877433 T3799 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 877434 T3799 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 877436 T3799 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:52383_ag_y%2Fhp
[junit4] 2> 877436 T3799 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 877447 T3799 oasc.Overseer.start Overseer (id=91785265198399495-127.0.0.1:52383_ag_y%2Fhp-n_0000000000) starting
[junit4] 2> 877451 T3799 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 877463 T3829 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 877463 T3799 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 877463 T3829 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes at 127.0.0.1:52383_ag_y%2Fhp
[junit4] 2> 877465 T3799 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 877467 T3799 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 877470 T3828 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 877472 T3799 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-002
[junit4] 2> 877476 T3799 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-002/conf/
[junit4] 2> 877562 T3799 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 877563 T3799 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0
[junit4] 2> 877563 T3799 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 877565 T3799 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 877567 T3832 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24d78181 name:ZooKeeperConnection Watcher:127.0.0.1:35666/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 877567 T3799 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 877568 T3799 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 877569 T3799 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 877801 T3799 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 877801 T3799 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 877805 T3799 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 877806 T3799 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:53217
[junit4] 2> 877808 T3799 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 877808 T3799 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 877808 T3799 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-003
[junit4] 2> 877809 T3799 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-003/'
[junit4] 2> 877821 T3799 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-003/solr.xml
[junit4] 2> 877862 T3799 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-003
[junit4] 2> 877862 T3799 oasc.CoreContainer.<init> New CoreContainer 948764529
[junit4] 2> 877862 T3799 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-003/]
[junit4] 2> 877863 T3799 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 877863 T3799 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 877864 T3799 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 877864 T3799 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 877864 T3799 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 877864 T3799 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 877864 T3799 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 877865 T3799 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 877865 T3799 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 877867 T3799 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 877867 T3799 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 877867 T3799 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 877868 T3799 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35666/solr
[junit4] 2> 877868 T3799 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 877869 T3799 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 877870 T3843 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8f55d23 name:ZooKeeperConnection Watcher:127.0.0.1:35666 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 877870 T3799 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 877872 T3799 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 877873 T3845 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c1c85f9 name:ZooKeeperConnection Watcher:127.0.0.1:35666/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 877873 T3799 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 877878 T3799 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 878880 T3799 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53217_ag_y%2Fhp
[junit4] 2> 878881 T3799 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53217_ag_y%2Fhp
[junit4] 2> 878883 T3845 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 878883 T3832 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 878884 T3827 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 878887 T3799 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-003
[junit4] 2> 878893 T3799 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-003/conf/
[junit4] 2> 878981 T3799 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 878982 T3799 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0
[junit4] 2> 878982 T3799 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 879204 T3799 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 879204 T3799 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 879207 T3799 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 879208 T3799 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:49168
[junit4] 2> 879211 T3799 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 879211 T3799 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 879211 T3799 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-004
[junit4] 2> 879211 T3799 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-004/'
[junit4] 2> 879223 T3799 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-004/solr.xml
[junit4] 2> 879265 T3799 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-004
[junit4] 2> 879266 T3799 oasc.CoreContainer.<init> New CoreContainer 2006098499
[junit4] 2> 879266 T3799 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-004/]
[junit4] 2> 879267 T3799 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 879267 T3799 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 879267 T3799 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 879267 T3799 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 879268 T3799 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 879268 T3799 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 879268 T3799 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 879268 T3799 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 879269 T3799 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 879271 T3799 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 879271 T3799 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 879271 T3799 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 879272 T3799 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35666/solr
[junit4] 2> 879272 T3799 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 879272 T3799 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 879274 T3857 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24fba2c9 name:ZooKeeperConnection Watcher:127.0.0.1:35666 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 879274 T3799 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 879276 T3799 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 879277 T3859 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@474cd2e1 name:ZooKeeperConnection Watcher:127.0.0.1:35666/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 879277 T3799 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 879284 T3799 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 880287 T3799 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49168_ag_y%2Fhp
[junit4] 2> 880289 T3799 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49168_ag_y%2Fhp
[junit4] 2> 880292 T3827 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 880292 T3845 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 880292 T3859 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 880292 T3832 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 880299 T3799 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-004
[junit4] 2> 880304 T3799 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-004/conf/
[junit4] 2> 880401 T3799 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 880403 T3799 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0
[junit4] 2> 880404 T3799 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 880623 T3799 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 880623 T3799 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 880627 T3799 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 880628 T3799 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:49497
[junit4] 2> 880631 T3799 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 880631 T3799 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 880631 T3799 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-005
[junit4] 2> 880632 T3799 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-005/'
[junit4] 2> 880646 T3799 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-005/solr.xml
[junit4] 2> 880690 T3799 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-005
[junit4] 2> 880690 T3799 oasc.CoreContainer.<init> New CoreContainer 723345229
[junit4] 2> 880691 T3799 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-005/]
[junit4] 2> 880692 T3799 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 880692 T3799 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 880692 T3799 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 880692 T3799 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 880693 T3799 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 880693 T3799 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 880693 T3799 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 880693 T3799 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 880694 T3799 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 880696 T3799 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 880696 T3799 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 880696 T3799 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 880697 T3799 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35666/solr
[junit4] 2> 880697 T3799 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 880698 T3799 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 880700 T3871 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2cbfc9c9 name:ZooKeeperConnection Watcher:127.0.0.1:35666 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 880701 T3799 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 880703 T3799 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 880704 T3873 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4990349e name:ZooKeeperConnection Watcher:127.0.0.1:35666/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 880705 T3799 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 880710 T3799 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 881713 T3799 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49497_ag_y%2Fhp
[junit4] 2> 881715 T3799 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49497_ag_y%2Fhp
[junit4] 2> 881718 T3845 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 881718 T3859 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 881719 T3827 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 881718 T3832 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 881718 T3873 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 881725 T3799 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-005
[junit4] 2> 881737 T3799 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-005/conf/
[junit4] 2> 881857 T3799 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 881858 T3799 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0
[junit4] 2> 881859 T3799 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 882088 T3799 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
[junit4] 2> 882088 T3799 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 882092 T3799 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 882094 T3799 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:49752
[junit4] 2> 882096 T3799 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 882096 T3799 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 882096 T3799 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-006
[junit4] 2> 882096 T3799 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-006/'
[junit4] 2> 882110 T3799 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-006/solr.xml
[junit4] 2> 882151 T3799 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-006
[junit4] 2> 882152 T3799 oasc.CoreContainer.<init> New CoreContainer 1067078250
[junit4] 2> 882152 T3799 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-006/]
[junit4] 2> 882153 T3799 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 882153 T3799 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 882153 T3799 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 882153 T3799 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 882154 T3799 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 882154 T3799 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 882154 T3799 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 882154 T3799 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 882155 T3799 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 882157 T3799 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 882157 T3799 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 882157 T3799 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 882158 T3799 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35666/solr
[junit4] 2> 882158 T3799 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 882159 T3799 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 882161 T3885 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d744fdf name:ZooKeeperConnection Watcher:127.0.0.1:35666 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 882162 T3799 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 882163 T3799 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 882165 T3887 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b8c918f name:ZooKeeperConnection Watcher:127.0.0.1:35666/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 882165 T3799 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 882171 T3799 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 883173 T3799 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49752_ag_y%2Fhp
[junit4] 2> 883175 T3799 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49752_ag_y%2Fhp
[junit4] 2> 883178 T3845 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 883179 T3873 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 883179 T3859 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 883179 T3827 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 883180 T3832 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 883180 T3887 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 883188 T3799 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-006
[junit4] 2> 883200 T3799 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-006/conf/
[junit4] 2> 883315 T3799 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 883317 T3799 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0
[junit4] 2> 883317 T3799 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 883386 T3840 oasha.CollectionsHandler.handleCreateAction Creating Collection : wt=javabin&numShards=2&version=2&collection.configName=conf1&router.field=myOwnField&action=CREATE&replicationFactor=2&router.name=compositeId&name=solrj_collection
[junit4] 2> 883389 T3827 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 883390 T3829 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField",
[junit4] 2> "router.name":"compositeId"}
[junit4] 2> 883391 T3829 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField",
[junit4] 2> "router.name":"compositeId"}
[junit4] 2> 883392 T3829 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/solrj_collection
[junit4] 2> 883393 T3829 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
[junit4] 2> 883398 T3827 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 883400 T3828 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 883401 T3828 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: solrj_collection
[junit4] 2> 883402 T3828 oasc.Overseer$ClusterStateUpdater.createCollection Create collection solrj_collection with shards [shard1, shard2]
[junit4] 2> 883405 T3827 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 883406 T3873 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 883407 T3845 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 883407 T3832 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 883407 T3859 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 883407 T3827 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 883406 T3887 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 883499 T3829 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection, shardNames [shard1, shard2] , replicationFactor : 2
[junit4] 2> 883499 T3829 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of collection solrj_collection on 127.0.0.1:49752_ag_y%2Fhp
[junit4] 2> 883503 T3829 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of collection solrj_collection on 127.0.0.1:49497_ag_y%2Fhp
[junit4] 2> 883505 T3829 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of collection solrj_collection on 127.0.0.1:53217_ag_y%2Fhp
[junit4] 2> 883508 T3829 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of collection solrj_collection on 127.0.0.1:49168_ag_y%2Fhp
[junit4] 2> 883556 T3881 oasha.CoreAdminHandler.handleCreateAction core create command wt=javabin&numShards=2&shard=shard1&collection=solrj_collection&qt=/admin/cores&version=2&collection.configName=conf1&action=CREATE&name=solrj_collection_shard1_replica1
[junit4] 2> 883559 T3881 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica1 state=down collection=solrj_collection
[junit4] 2> 883561 T3881 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 883561 T3827 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 883562 T3828 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 883563 T3828 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:49752/ag_y/hp",
[junit4] 2> "core":"solrj_collection_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:49752_ag_y%2Fhp",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 883566 T3827 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 883585 T3838 oasha.CoreAdminHandler.handleCreateAction core create command wt=javabin&numShards=2&shard=shard2&collection=solrj_collection&qt=/admin/cores&version=2&collection.configName=conf1&action=CREATE&name=solrj_collection_shard2_replica1
[junit4] 2> 883585 T3868 oasha.CoreAdminHandler.handleCreateAction core create command wt=javabin&numShards=2&shard=shard1&collection=solrj_collection&qt=/admin/cores&version=2&collection.configName=conf1&action=CREATE&name=solrj_collection_shard1_replica2
[junit4] 2> 883589 T3838 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica1 state=down collection=solrj_collection
[junit4] 2> 883589 T3868 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica2 state=down collection=solrj_collection
[junit4] 2> 883591 T3827 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 883591 T3838 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 883592 T3868 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 883593 T3828 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:53217/ag_y/hp",
[junit4] 2> "core":"solrj_collection_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:53217_ag_y%2Fhp",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 883594 T3855 oasha.CoreAdminHandler.handleCreateAction core create command wt=javabin&numShards=2&shard=shard2&collection=solrj_collection&qt=/admin/cores&version=2&collection.configName=conf1&action=CREATE&name=solrj_collection_shard2_replica2
[junit4] 2> 883596 T3827 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 883597 T3828 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:49497/ag_y/hp",
[junit4] 2> "core":"solrj_collection_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:49497_ag_y%2Fhp",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 883597 T3855 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica2 state=down collection=solrj_collection
[junit4] 2> 883600 T3827 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 883600 T3855 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 883604 T3828 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:49168/ag_y/hp",
[junit4] 2> "core":"solrj_collection_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:49168_ag_y%2Fhp",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 883607 T3827 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 883710 T3845 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 883710 T3873 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 883710 T3827 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 883710 T3887 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 883710 T3859 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 883710 T3832 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 884561 T3881 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica1
[junit4] 2> 884563 T3881 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 884564 T3881 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 884564 T3881 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 884566 T3881 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 884567 T3881 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-006/solrj_collection_shard1_replica1/'
[junit4] 2> 884593 T3838 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica1
[junit4] 2> 884593 T3868 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica2
[junit4] 2> 884594 T3838 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 884595 T3868 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 884595 T3838 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 884596 T3868 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 884596 T3868 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 884596 T3838 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 884598 T3868 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 884598 T3868 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-005/solrj_collection_shard1_replica2/'
[junit4] 2> 884598 T3838 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 884599 T3838 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-003/solrj_collection_shard2_replica1/'
[junit4] 2> 884600 T3855 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica2
[junit4] 2> 884602 T3855 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 884603 T3855 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 884604 T3855 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 884605 T3855 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 884606 T3855 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-004/solrj_collection_shard2_replica2/'
[junit4] 2> 884646 T3881 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 884665 T3868 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 884684 T3838 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 884688 T3855 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_48
[junit4] 2> 884716 T3881 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 884717 T3881 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 884734 T3881 oass.IndexSchema.readSchema [solrj_collection_shard1_replica1] Schema name=test
[junit4] 2> 884735 T3868 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 884737 T3868 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 884744 T3868 oass.IndexSchema.readSchema [solrj_collection_shard1_replica2] Schema name=test
[junit4] 2> 884744 T3838 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 884746 T3838 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 884754 T3855 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 884755 T3855 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 884758 T3838 oass.IndexSchema.readSchema [solrj_collection_shard2_replica1] Schema name=test
[junit4] 2> 884761 T3855 oass.IndexSchema.readSchema [solrj_collection_shard2_replica2] Schema name=test
[junit4] 2> 885304 T3855 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 885305 T3855 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 885305 T3855 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 885311 T3855 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 885314 T3855 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 885328 T3855 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 885332 T3855 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 885333 T3868 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 885333 T3868 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 885334 T3868 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 885335 T3855 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 885336 T3855 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 885336 T3855 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 885337 T3855 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 885337 T3855 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 885338 T3855 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 885338 T3881 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 885338 T3855 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica2' using configuration from collection solrj_collection
[junit4] 2> 885338 T3881 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 885338 T3855 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 885339 T3855 oasc.SolrCore.<init> [solrj_collection_shard2_replica2] Opening new SolrCore at ./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-004/solrj_collection_shard2_replica2/, dataDir=./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-004/solrj_collection_shard2_replica2/data/
[junit4] 2> 885339 T3881 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 885344 T3855 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@11846d13
[junit4] 2> 885345 T3868 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 885345 T3855 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-004/solrj_collection_shard2_replica2/data
[junit4] 2> 885346 T3855 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-004/solrj_collection_shard2_replica2/data/index/
[junit4] 2> 885346 T3855 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica2] Solr index directory './solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-004/solrj_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 885346 T3855 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-004/solrj_collection_shard2_replica2/data/index
[junit4] 2> 885347 T3855 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=86.8388671875, floorSegmentMB=2.01953125, forceMergeDeletesPctAllowed=27.72037083287894, segmentsPerTier=29.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6647392793314963
[junit4] 2> 885348 T3855 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@4d0cc32a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@602fc944),segFN=segments_1,generation=1}
[junit4] 2> 885348 T3868 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 885348 T3855 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 885350 T3881 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 885352 T3881 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 885352 T3855 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 885353 T3855 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 885353 T3855 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 885354 T3855 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 885354 T3855 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 885354 T3855 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 885355 T3855 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 885355 T3855 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 885355 T3855 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 885356 T3855 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 885357 T3855 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 885357 T3855 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 885357 T3855 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 885358 T3855 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 885358 T3868 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 885358 T3855 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 885359 T3855 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 885361 T3855 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 885361 T3881 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 885361 T3868 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 885363 T3838 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 885364 T3838 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 885364 T3855 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 885364 T3855 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 885364 T3881 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 885364 T3838 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 885365 T3868 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 885366 T3868 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 885366 T3868 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 885366 T3868 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 885367 T3855 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=39, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=79.212890625, floorSegmentMB=1.712890625, forceMergeDeletesPctAllowed=26.330402379454487, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 885367 T3868 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 885367 T3868 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 885367 T3855 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@4d0cc32a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@602fc944),segFN=segments_1,generation=1}
[junit4] 2> 885368 T3855 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 885367 T3881 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 885368 T3855 oass.SolrIndexSearcher.<init> Opening Searcher@7a385701[solrj_collection_shard2_replica2] main
[junit4] 2> 885368 T3868 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica2' using configuration from collection solrj_collection
[junit4] 2> 885369 T3855 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 885369 T3881 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 885369 T3881 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 885369 T3868 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 885370 T3855 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 885370 T3838 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 885370 T3881 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 885370 T3855 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 885370 T3868 oasc.SolrCore.<init> [solrj_collection_shard1_replica2] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-005/solrj_collection_shard1_replica2/, dataDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-005/solrj_collection_shard1_replica2/data/
[junit4] 2> 885371 T3855 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 885371 T3855 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 885371 T3868 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@11846d13
[junit4] 2> 885372 T3855 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 885371 T3881 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 885372 T3881 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 885373 T3838 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 885373 T3868 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-005/solrj_collection_shard1_replica2/data
[junit4] 2> 885372 T3855 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 885373 T3868 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-005/solrj_collection_shard1_replica2/data/index/
[junit4] 2> 885373 T3881 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica1' using configuration from collection solrj_collection
[junit4] 2> 885374 T3868 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica2] Solr index directory '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-005/solrj_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 885373 T3855 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 885380 T3868 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-005/solrj_collection_shard1_replica2/data/index
[junit4] 2> 885374 T3881 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 885381 T3868 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=86.8388671875, floorSegmentMB=2.01953125, forceMergeDeletesPctAllowed=27.72037083287894, segmentsPerTier=29.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6647392793314963
[junit4] 2> 885381 T3855 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 885381 T3881 oasc.SolrCore.<init> [solrj_collection_shard1_replica1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-006/solrj_collection_shard1_replica1/, dataDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-006/solrj_collection_shard1_replica1/data/
[junit4] 2> 885382 T3868 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@311361c0 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@246fd10b),segFN=segments_1,generation=1}
[junit4] 2> 885382 T3868 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 885382 T3855 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 885382 T3881 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@11846d13
[junit4] 2> 885384 T3881 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-006/solrj_collection_shard1_replica1/data
[junit4] 2> 885384 T3881 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-BE2B129D2426A676-001/tempDir-006/solrj_collection_shard1_replica1/data/index/
[junit4] 2> 885385 T3881 oasc.SolrCore.initIndex WARN [solr
[...truncated too long message...]
nection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
[junit4] 2>
[junit4] 2> 946397 T3951 oaz.ClientCnxn$SendThread.run WARN Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
[junit4] 2>
[junit4] 2> 946898 T3951 oazc.StaticHostProvider.next WARN Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
[junit4] 2>
[junit4] 2> 946899 T3951 oaz.ClientCnxn$SendThread.run WARN Session 0x14616365fc40012 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
[junit4] 2>
[junit4] 2> 947398 T3951 oaz.ClientCnxn$SendThread.run WARN Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
[junit4] 2>
[junit4] 2> 82290 T3798 ccr.ThreadLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=3951, name=TEST-CollectionsAPIDistributedZkTest.testDistribSearch-seed#[BE2B129D2426A676]-SendThread(127.0.0.1:35666), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
[junit4] 2> NOTE: test params are: codec=Lucene3x, sim=DefaultSimilarity, locale=ar_IQ, timezone=Pacific/Apia
[junit4] 2> NOTE: Linux 3.8.0-39-generic amd64/Oracle Corporation 1.7.0_55 (64-bit)/cpus=8,threads=2,free=75341656,total=228556800
[junit4] 2> NOTE: All tests run in this JVM: [RemoteQueryErrorTest, MBeansHandlerTest, CacheHeaderTest, QueryElevationComponentTest, TestPostingsSolrHighlighter, SearchHandlerTest, TermsComponentTest, ZkControllerTest, TestElisionMultitermQuery, TestSuggestSpellingConverter, TestLFUCache, LoggingHandlerTest, DistributedQueryComponentOptimizationTest, PrimitiveFieldTypeTest, TestSolrDeletionPolicy1, TestLMJelinekMercerSimilarityFactory, SolrCoreTest, InfoHandlerTest, HdfsBasicDistributedZk2Test, SuggestComponentTest, TestFieldTypeCollectionResource, DistributedSpellCheckComponentTest, OverseerRolesTest, TestExpandComponent, TestDistributedMissingSort, DocumentBuilderTest, TestPerFieldSimilarity, TestDocSet, TestSerializedLuceneMatchVersion, SpatialFilterTest, TestSchemaNameResource, TestFieldCollectionResource, TestExtendedDismaxParser, DocExpirationUpdateProcessorFactoryTest, UpdateRequestProcessorFactoryTest, LukeRequestHandlerTest, TestHighFrequencyDictionaryFactory, QueryParsingTest, TestWriterPerf, TestBM25SimilarityFactory, ResponseLogComponentTest, RegexBoostProcessorTest, DistributedQueryComponentCustomSortTest, TestCursorMarkWithoutUniqueKey, TestBadConfig, DirectUpdateHandlerOptimizeTest, TestStressVersions, PolyFieldTest, TestSolrQueryParserDefaultOperatorResource, OverseerTest, BasicDistributedZkTest, SimpleFacetsTest, PeerSyncTest, ParsingFieldUpdateProcessorsTest, TestRandomDVFaceting, DocValuesTest, ShardRoutingTest, IndexSchemaTest, BJQParserTest, TestCollapseQParserPlugin, SuggesterTest, TestTrie, TestFieldSortValues, RecoveryZkTest, SuggesterFSTTest, LeaderElectionTest, BadCopyFieldTest, CollectionsAPIAsyncDistributedZkTest, DeleteReplicaTest, TestRandomMergePolicy, TestUniqueKeyFieldResource, LegacyHTMLStripCharFilterTest, CSVRequestHandlerTest, TestLuceneMatchVersion, DocValuesMissingTest, FieldMutatingUpdateProcessorTest, TestRestManager, SOLR749Test, TestSolrQueryParser, ZkCLITest, TestJmxMonitoredMap, DateMathParserTest, OverseerCollectionProcessorTest, AutoCommitTest, HdfsRecoveryZkTest, SystemInfoHandlerTest, TestPseudoReturnFields, TermVectorComponentTest, SliceStateTest, TestImplicitCoreProperties, EchoParamsTest, TestInfoStreamLogging, AddBlockUpdateTest, ShowFileRequestHandlerTest, TestCharFilters, BinaryUpdateRequestHandlerTest, BasicDistributedZk2Test, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.seed=BE2B129D2426A676 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_IQ -Dtests.timezone=Pacific/Apia -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | CollectionsAPIDistributedZkTest (suite) <<<
[junit4] > Throwable #1: java.lang.AssertionError: ERROR: SolrZkClient opens=19 closes=18
[junit4] > at __randomizedtesting.SeedInfo.seed([BE2B129D2426A676]:0)
[junit4] > at org.apache.solr.SolrTestCaseJ4.endTrackingZkClients(SolrTestCaseJ4.java:434)
[junit4] > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:180)
[junit4] > at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest:
[junit4] > 1) Thread[id=3951, name=TEST-CollectionsAPIDistributedZkTest.testDistribSearch-seed#[BE2B129D2426A676]-SendThread(127.0.0.1:35666), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:230)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1185)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1110)
[junit4] > 2) Thread[id=3952, name=TEST-CollectionsAPIDistributedZkTest.testDistribSearch-seed#[BE2B129D2426A676]-EventThread, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
[junit4] > at __randomizedtesting.SeedInfo.seed([BE2B129D2426A676]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=3951, name=TEST-CollectionsAPIDistributedZkTest.testDistribSearch-seed#[BE2B129D2426A676]-SendThread(127.0.0.1:35666), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
[junit4] > at __randomizedtesting.SeedInfo.seed([BE2B129D2426A676]:0)
[junit4] Completed on J0 in 82.35s, 1 test, 1 failure, 3 errors <<< FAILURES!
[...truncated 581 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/lucene/common-build.xml:1293: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.8-Linux/lucene/common-build.xml:919: There were test failures: 387 suites, 1624 tests, 3 suite-level errors, 1 error, 771 ignored (9 assumptions)
Total time: 49 minutes 15 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_55 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure