You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/03/28 19:15:17 UTC
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_60-ea-b10) -
Build # 9931 - Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/9931/
Java: 64bit/jdk1.7.0_60-ea-b10 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
1 tests failed.
FAILED: org.apache.solr.client.solrj.impl.CloudSolrServerTest.testDistribSearch
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([506D80A227C6F06E:D18B0EBA50999052]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.client.solrj.impl.CloudSolrServerTest.doTest(CloudSolrServerTest.java:256)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at java.lang.Thread.run(Thread.java:744)
Build Log:
[...truncated 11652 lines...]
[junit4] Suite: org.apache.solr.client.solrj.impl.CloudSolrServerTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396030451530
[junit4] 2> 37078 T102 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
[junit4] 2> 37078 T102 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 37081 T102 oasc.AbstractZkTestCase.<clinit> WARN TEST_HOME() does not exist - solrj test?
[junit4] 2> 37085 T102 oas.SolrTestCaseJ4.setUp ###Starting testShutdown
[junit4] 2> 37087 T102 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 37089 T103 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 37189 T102 oasc.ZkTestServer.run start zk server on port:36639
[junit4] 2> 37232 T102 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 37279 T109 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@66626ce9 name:ZooKeeperConnection Watcher:127.0.0.1:36639 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 37279 T102 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 37281 T102 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 37302 T102 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 37304 T111 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@73e8f917 name:ZooKeeperConnection Watcher:127.0.0.1:36639/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 37304 T102 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 37307 T102 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 37312 T102 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 37315 T102 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 37319 T102 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 37323 T102 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 37324 T102 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 37329 T102 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 37330 T102 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 37334 T102 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml because it doesn't exist
[junit4] 2> 37334 T102 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/stopwords.txt because it doesn't exist
[junit4] 2> 37334 T102 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/protwords.txt because it doesn't exist
[junit4] 2> 37335 T102 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/currency.xml because it doesn't exist
[junit4] 2> 37335 T102 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/enumsConfig.xml because it doesn't exist
[junit4] 2> 37335 T102 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/open-exchange-rates.json because it doesn't exist
[junit4] 2> 37335 T102 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/mapping-ISOLatin1Accent.txt because it doesn't exist
[junit4] 2> 37336 T102 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/old_synonyms.txt because it doesn't exist
[junit4] 2> 37336 T102 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/synonyms.txt because it doesn't exist
[junit4] 2> 37343 T102 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 37344 T112 oaz.ClientCnxnSocketNIO.connect ERROR Unable to open socket to ff01::114/ff01:0:0:0:0:0:0:114:33332
[junit4] 2> 37345 T112 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.SocketException: Network is unreachable
[junit4] 2> at sun.nio.ch.Net.connect0(Native Method)
[junit4] 2> at sun.nio.ch.Net.connect(Net.java:465)
[junit4] 2> at sun.nio.ch.Net.connect(Net.java:457)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:277)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:287)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:967)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
[junit4] 2>
[junit4] 2> 38447 T112 oaz.ClientCnxnSocketNIO.connect ERROR Unable to open socket to ff01::114/ff01:0:0:0:0:0:0:114:33332
[junit4] 2> 38549 T102 oas.SolrTestCaseJ4.tearDown ###Ending testShutdown
[junit4] 2> 38551 T102 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:36639 36639
[junit4] 2> 58697 T103 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:36639 36639
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 58706 T102 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 58707 T102 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 58707 T114 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 58807 T102 oasc.ZkTestServer.run start zk server on port:50572
[junit4] 2> 58808 T102 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 58838 T120 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10a5b964 name:ZooKeeperConnection Watcher:127.0.0.1:50572 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 58838 T102 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 58838 T102 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 58844 T102 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 58845 T122 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@62b05661 name:ZooKeeperConnection Watcher:127.0.0.1:50572/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 58846 T102 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 58846 T102 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 58850 T102 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 58854 T102 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 58858 T102 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 58864 T102 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 58865 T102 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 58870 T102 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 58871 T102 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 58874 T102 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml because it doesn't exist
[junit4] 2> 58874 T102 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/stopwords.txt because it doesn't exist
[junit4] 2> 58875 T102 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/protwords.txt because it doesn't exist
[junit4] 2> 58875 T102 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/currency.xml because it doesn't exist
[junit4] 2> 58875 T102 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/enumsConfig.xml because it doesn't exist
[junit4] 2> 58875 T102 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/open-exchange-rates.json because it doesn't exist
[junit4] 2> 58875 T102 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/mapping-ISOLatin1Accent.txt because it doesn't exist
[junit4] 2> 58876 T102 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/old_synonyms.txt because it doesn't exist
[junit4] 2> 58876 T102 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/synonyms.txt because it doesn't exist
[junit4] 2> 58940 T102 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 58943 T102 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49462
[junit4] 2> 58944 T102 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 58944 T102 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 58944 T102 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396030473330
[junit4] 2> 58944 T102 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396030473330/'
[junit4] 2> 58968 T102 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396030473330/solr.xml
[junit4] 2> 58997 T102 oasc.CoreContainer.<init> New CoreContainer 1794160301
[junit4] 2> 58998 T102 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396030473330/]
[junit4] 2> 58999 T102 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 58999 T102 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 58999 T102 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 58999 T102 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 58999 T102 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 59000 T102 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 59000 T102 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 59000 T102 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 59000 T102 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 59001 T102 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 59001 T102 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 59001 T102 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 59002 T102 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50572/solr
[junit4] 2> 59010 T102 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 59011 T102 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 59014 T133 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@28ef7c67 name:ZooKeeperConnection Watcher:127.0.0.1:50572 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 59014 T102 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 59019 T102 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 59021 T135 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c4b51e1 name:ZooKeeperConnection Watcher:127.0.0.1:50572/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 59021 T102 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 59027 T102 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 59033 T102 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 59039 T102 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 59043 T102 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 59047 T102 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 59053 T102 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 59055 T102 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49462_
[junit4] 2> 59058 T102 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49462_
[junit4] 2> 59062 T102 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 59065 T102 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 59075 T102 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:49462_
[junit4] 2> 59075 T102 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 59078 T102 oasc.Overseer.start Overseer (id=91490253089079299-127.0.0.1:49462_-n_0000000000) starting
[junit4] 2> 59086 T102 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 59105 T137 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 59106 T102 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 59109 T102 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 59110 T137 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 59112 T102 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 59120 T136 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 59126 T138 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 59126 T138 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 59129 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 59129 T138 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 59133 T136 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 59134 T136 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:49462",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:49462_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 59134 T136 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 59141 T136 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 59145 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 59149 T135 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 60130 T138 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 60130 T138 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 60131 T138 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 60131 T138 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 60133 T138 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 60133 T138 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396030473330/collection1/'
[junit4] 2> 60170 T138 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 60195 T138 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 60197 T138 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 60216 T138 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 60447 T138 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 60449 T138 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 60451 T138 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 60451 T138 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 60452 T138 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 60452 T138 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 60452 T138 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396030473330/collection1/, dataDir=./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/control/data/
[junit4] 2> 60452 T138 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 60453 T138 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/control/data
[junit4] 2> 60453 T138 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/control/data/index/
[junit4] 2> 60453 T138 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 60453 T138 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/control/data/index
[junit4] 2> 60455 T138 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@543c5bbd lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 60455 T138 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 60456 T138 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 60456 T138 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 60456 T138 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 60456 T138 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 60457 T138 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 60457 T138 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 60457 T138 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 60457 T138 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 60459 T138 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 60461 T138 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 60461 T138 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 60462 T138 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@543c5bbd lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 60462 T138 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 60463 T138 oass.SolrIndexSearcher.<init> Opening Searcher@2a6e67f7[collection1] main
[junit4] 2> 60463 T138 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 60465 T138 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 60465 T138 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 60467 T138 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 60468 T138 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 60468 T138 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 60469 T138 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 60469 T138 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 60469 T138 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 60469 T138 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 60470 T139 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2a6e67f7[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 60470 T138 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 60471 T142 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49462 collection:control_collection shard:shard1
[junit4] 2> 60472 T102 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 60472 T102 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 60473 T102 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 60475 T144 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11f873b6 name:ZooKeeperConnection Watcher:127.0.0.1:50572/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 60475 T102 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 60479 T142 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 60479 T102 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 60485 T102 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 60489 T142 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 60493 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 60494 T142 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 60495 T142 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 60495 T136 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C21 name=collection1 org.apache.solr.core.SolrCore@663c7162 url=http://127.0.0.1:49462/collection1 node=127.0.0.1:49462_ C21_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:49462, core=collection1, node_name=127.0.0.1:49462_}
[junit4] 2> 60496 T142 C21 P49462 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49462/collection1/
[junit4] 2> 60496 T142 C21 P49462 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 60497 T142 C21 P49462 oasc.SyncStrategy.syncToMe http://127.0.0.1:49462/collection1/ has no replicas
[junit4] 2> 60497 T142 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49462/collection1/ shard1
[junit4] 2> 60499 T142 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 60503 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 60559 T102 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 60562 T102 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 60565 T102 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:45668
[junit4] 2> 60565 T102 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 60566 T102 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 60566 T102 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396030474938
[junit4] 2> 60566 T102 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396030474938/'
[junit4] 2> 60578 T102 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396030474938/solr.xml
[junit4] 2> 60603 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 60611 T102 oasc.CoreContainer.<init> New CoreContainer 1592010632
[junit4] 2> 60611 T102 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396030474938/]
[junit4] 2> 60612 T102 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 60613 T102 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 60613 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 60613 T102 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 60613 T102 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 60613 T102 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 60614 T102 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 60614 T102 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 60614 T102 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 60614 T102 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 60615 T102 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 60615 T102 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 60615 T102 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 60615 T102 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50572/solr
[junit4] 2> 60616 T102 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 60616 T102 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 60618 T155 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43e02a42 name:ZooKeeperConnection Watcher:127.0.0.1:50572 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 60619 T102 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 60621 T102 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 60623 T157 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43e412cf name:ZooKeeperConnection Watcher:127.0.0.1:50572/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 60623 T102 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 60632 T102 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 60716 T135 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 60716 T144 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 60717 T157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 60759 T142 oasc.ZkController.register We are http://127.0.0.1:49462/collection1/ and leader is http://127.0.0.1:49462/collection1/
[junit4] 2> 60760 T142 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49462
[junit4] 2> 60760 T142 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 60760 T142 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 60760 T142 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 60762 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 60762 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 60762 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 60762 T142 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 60764 T136 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 60765 T136 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:49462",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:49462_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 60769 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 60872 T144 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 60872 T135 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 60872 T157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 61635 T102 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45668_
[junit4] 2> 61638 T102 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45668_
[junit4] 2> 61641 T135 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 61641 T157 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 61641 T144 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 61650 T158 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 61650 T158 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 61651 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 61651 T158 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 61651 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 61652 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 61654 T136 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 61655 T136 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:45668",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:45668_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 61655 T136 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 61655 T136 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 61661 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 61764 T135 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 61764 T157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 61764 T144 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 62652 T158 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 62652 T158 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 62653 T158 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 62653 T158 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 62654 T158 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 62655 T158 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396030474938/collection1/'
[junit4] 2> 62682 T158 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 62708 T158 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 62710 T158 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 62729 T158 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 62956 T158 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 62957 T158 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 62959 T158 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 62959 T158 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 62960 T158 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 62960 T158 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 62960 T158 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396030474938/collection1/, dataDir=./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty1/
[junit4] 2> 62960 T158 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 62961 T158 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty1
[junit4] 2> 62961 T158 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty1/index/
[junit4] 2> 62961 T158 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 62961 T158 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty1/index
[junit4] 2> 62962 T158 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@465652da lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 62963 T158 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 62964 T158 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 62964 T158 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 62964 T158 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 62964 T158 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 62964 T158 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 62965 T158 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 62965 T158 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 62965 T158 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 62967 T158 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 62969 T158 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 62969 T158 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 62970 T158 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@465652da lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 62970 T158 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 62970 T158 oass.SolrIndexSearcher.<init> Opening Searcher@7b92eec4[collection1] main
[junit4] 2> 62971 T158 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 62972 T158 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 62972 T158 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 62973 T158 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 62973 T158 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 62973 T158 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 62974 T158 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 62974 T158 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 62975 T158 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 62975 T158 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 62976 T158 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 62976 T159 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7b92eec4[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 62977 T162 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:45668 collection:collection1 shard:shard2
[junit4] 2> 62977 T102 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 62977 T102 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 62978 T162 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 62988 T162 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 62991 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 62991 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 62991 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 62991 T162 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 62991 T162 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C22 name=collection1 org.apache.solr.core.SolrCore@7bfdd357 url=http://127.0.0.1:45668/collection1 node=127.0.0.1:45668_ C22_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:45668, core=collection1, node_name=127.0.0.1:45668_}
[junit4] 2> 62992 T162 C22 P45668 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45668/collection1/
[junit4] 2> 62992 T162 C22 P45668 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 62992 T162 C22 P45668 oasc.SyncStrategy.syncToMe http://127.0.0.1:45668/collection1/ has no replicas
[junit4] 2> 62992 T162 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45668/collection1/ shard2
[junit4] 2> 62992 T162 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 62993 T136 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 63000 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63004 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63011 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63040 T102 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 63041 T102 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 63043 T102 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:36530
[junit4] 2> 63043 T102 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 63044 T102 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 63044 T102 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396030477431
[junit4] 2> 63044 T102 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396030477431/'
[junit4] 2> 63055 T102 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396030477431/solr.xml
[junit4] 2> 63088 T102 oasc.CoreContainer.<init> New CoreContainer 1148278221
[junit4] 2> 63088 T102 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396030477431/]
[junit4] 2> 63089 T102 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 63089 T102 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 63089 T102 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 63090 T102 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 63090 T102 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 63090 T102 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 63090 T102 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 63090 T102 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 63091 T102 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 63091 T102 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 63092 T102 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 63092 T102 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 63092 T102 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50572/solr
[junit4] 2> 63092 T102 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 63093 T102 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 63095 T173 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6cb828d5 name:ZooKeeperConnection Watcher:127.0.0.1:50572 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 63095 T102 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 63098 T102 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 63099 T175 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@494ddddb name:ZooKeeperConnection Watcher:127.0.0.1:50572/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 63099 T102 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 63111 T102 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 63113 T175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 63113 T144 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 63114 T135 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 63114 T157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 63155 T162 oasc.ZkController.register We are http://127.0.0.1:45668/collection1/ and leader is http://127.0.0.1:45668/collection1/
[junit4] 2> 63155 T162 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45668
[junit4] 2> 63156 T162 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 63156 T162 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 63156 T162 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 63173 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63173 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63173 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63174 T162 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 63175 T136 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 63176 T136 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:45668",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:45668_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 63180 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 63282 T144 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 63283 T157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 63282 T135 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 63282 T175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 64116 T102 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36530_
[junit4] 2> 64117 T102 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36530_
[junit4] 2> 64120 T144 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 64120 T157 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 64120 T135 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 64120 T175 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 64129 T176 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 64130 T176 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 64132 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 64132 T176 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 64132 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 64132 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 64134 T136 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 64135 T136 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:36530",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:36530_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 64136 T136 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 64136 T136 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 64140 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 64243 T144 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 64243 T175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 64243 T135 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 64243 T157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 65132 T176 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 65133 T176 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 65134 T176 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 65134 T176 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 65136 T176 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 65136 T176 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396030477431/collection1/'
[junit4] 2> 65166 T176 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 65203 T176 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 65206 T176 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 65225 T176 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 65483 T176 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 65485 T176 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 65486 T176 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 65487 T176 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 65487 T176 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 65488 T176 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 65488 T176 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396030477431/collection1/, dataDir=./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty2/
[junit4] 2> 65488 T176 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 65489 T176 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty2
[junit4] 2> 65489 T176 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty2/index/
[junit4] 2> 65489 T176 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 65489 T176 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty2/index
[junit4] 2> 65490 T176 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@233ac2f3 lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 65490 T176 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 65492 T176 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 65492 T176 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 65492 T176 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 65492 T176 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 65492 T176 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 65492 T176 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 65493 T176 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 65493 T176 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 65495 T176 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 65497 T176 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 65497 T176 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 65498 T176 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@233ac2f3 lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 65498 T176 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 65499 T176 oass.SolrIndexSearcher.<init> Opening Searcher@f0f9a00[collection1] main
[junit4] 2> 65499 T176 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 65501 T176 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 65501 T176 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 65502 T176 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 65502 T176 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 65502 T176 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 65503 T176 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 65503 T176 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 65503 T176 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 65504 T176 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 65505 T177 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f0f9a00[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 65505 T176 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 65506 T180 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36530 collection:collection1 shard:shard1
[junit4] 2> 65506 T102 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 65507 T102 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 65507 T180 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 65514 T180 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 65516 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 65516 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 65516 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 65516 T180 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 65517 T180 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C23 name=collection1 org.apache.solr.core.SolrCore@7c2d1faa url=http://127.0.0.1:36530/collection1 node=127.0.0.1:36530_ C23_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:36530, core=collection1, node_name=127.0.0.1:36530_}
[junit4] 2> 65517 T180 C23 P36530 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:36530/collection1/
[junit4] 2> 65517 T180 C23 P36530 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 65517 T180 C23 P36530 oasc.SyncStrategy.syncToMe http://127.0.0.1:36530/collection1/ has no replicas
[junit4] 2> 65517 T180 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:36530/collection1/ shard1
[junit4] 2> 65518 T180 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 65518 T136 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 65521 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 65523 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 65527 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 65558 T102 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 65559 T102 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 65563 T102 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35894
[junit4] 2> 65564 T102 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 65564 T102 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 65564 T102 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1396030479960
[junit4] 2> 65565 T102 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1396030479960/'
[junit4] 2> 65583 T102 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1396030479960/solr.xml
[junit4] 2> 65612 T102 oasc.CoreContainer.<init> New CoreContainer 1783724414
[junit4] 2> 65612 T102 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1396030479960/]
[junit4] 2> 65613 T102 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 65613 T102 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 65614 T102 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 65614 T102 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 65614 T102 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 65614 T102 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 65614 T102 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 65615 T102 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 65615 T102 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 65616 T102 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 65616 T102 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 65616 T102 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 65616 T102 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50572/solr
[junit4] 2> 65616 T102 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 65617 T102 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 65620 T191 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@aff75ba name:ZooKeeperConnection Watcher:127.0.0.1:50572 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 65620 T102 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 65623 T102 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 65624 T193 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@71c81285 name:ZooKeeperConnection Watcher:127.0.0.1:50572/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 65624 T102 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 65632 T144 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 65632 T135 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 65635 T157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 65632 T175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 65644 T102 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 65674 T180 oasc.ZkController.register We are http://127.0.0.1:36530/collection1/ and leader is http://127.0.0.1:36530/collection1/
[junit4] 2> 65674 T180 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36530
[junit4] 2> 65675 T180 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 65675 T180 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 65675 T180 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 65676 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 65677 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 65677 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 65677 T180 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 65679 T136 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 65680 T136 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:36530",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:36530_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 65683 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 65788 T175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 65788 T157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 65788 T135 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 65788 T193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 65788 T144 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 66649 T102 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35894_
[junit4] 2> 66651 T102 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35894_
[junit4] 2> 66654 T157 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 66654 T144 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 66654 T193 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 66654 T135 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 66654 T175 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 66665 T194 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 66665 T194 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 66667 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66667 T194 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 66667 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66667 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66669 T136 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 66670 T136 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:35894",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:35894_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 66670 T136 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 66670 T136 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 66673 T135 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 66778 T175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 66778 T157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 66778 T135 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 66778 T193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 66778 T144 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 67667 T194 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 67667 T194 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 67668 T194 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 67669 T194 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 67670 T194 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 67670 T194 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1396030479960/collection1/'
[junit4] 2> 67715 T194 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 67737 T194 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 67739 T194 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 67756 T194 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 67978 T194 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 67980 T194 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 67982 T194 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 67982 T194 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 67983 T194 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 67983 T194 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 67983 T194 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Luce
[...truncated too long message...]
lse>>]
[junit4] 2> 74566 T102 oasc.CachingDirectoryFactory.close Closing directory: ./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty2
[junit4] 2> 74567 T102 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty2/index [CachedDir<<refCount=0;path=./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty2/index;done=false>>]
[junit4] 2> 74567 T102 oasc.CachingDirectoryFactory.close Closing directory: ./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty2/index
[junit4] 2> 74567 T175 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 74591 T102 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4] 2> 74642 T102 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 35894
[junit4] 2> 74643 T102 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1783724414
[junit4] 2> 74643 T102 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 74643 T102 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 74669 T102 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4] 2> 74720 T102 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4] 2> 74721 T102 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:50572 50572
[junit4] 2> 75899 T135 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 76992 T193 C29 P35894 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 76069 T175 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 75987 T157 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 84998 T193 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 84998 T193 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@35207b86
[junit4] 2> 84999 T193 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=5,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=1,cumulative_deletesByQuery=1,cumulative_errors=0,transaction_logs_total_size=354,transaction_logs_total_number=4}
[junit4] 2> 84999 T193 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 85000 T193 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 85000 T114 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:50572 50572
[junit4] 2> 85000 T193 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 85002 T193 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 85002 T193 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 85003 T193 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty3/index [CachedDir<<refCount=0;path=./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty3/index;done=false>>]
[junit4] 2> 85003 T193 oasc.CachingDirectoryFactory.close Closing directory: ./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty3/index
[junit4] 2> 85003 T193 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty3 [CachedDir<<refCount=0;path=./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty3;done=false>>]
[junit4] 2> 85003 T193 oasc.CachingDirectoryFactory.close Closing directory: ./solrtest-CloudSolrServerTest-1396030451530/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396030473159/jetty3
[junit4] 2> 85003 T193 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 85003 T193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 85003 T193 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 85004 T193 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CloudSolrServerTest -Dtests.method=testDistribSearch -Dtests.seed=506D80A227C6F06E -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_IE -Dtests.timezone=Pacific/Niue -Dtests.file.encoding=UTF-8
[junit4] FAILURE 26.4s J0 | CloudSolrServerTest.testDistribSearch <<<
[junit4] > Throwable #1: java.lang.AssertionError
[junit4] > at __randomizedtesting.SeedInfo.seed([506D80A227C6F06E:D18B0EBA50999052]:0)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServerTest.doTest(CloudSolrServerTest.java:256)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
[junit4] > at java.lang.Thread.run(Thread.java:744)
[junit4] 2> 85054 T102 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: test params are: codec=Lucene46: {timestamp=Pulsing41(freqCutoff=9 minBlockSize=81 maxBlockSize=184), range_facet_si=PostingsFormat(name=MockSep), range_facet_l=Pulsing41(freqCutoff=9 minBlockSize=81 maxBlockSize=184), a_t=Pulsing41(freqCutoff=9 minBlockSize=81 maxBlockSize=184), text=PostingsFormat(name=Asserting), intDefault=Pulsing41(freqCutoff=9 minBlockSize=81 maxBlockSize=184), _version_=Pulsing41(freqCutoff=9 minBlockSize=81 maxBlockSize=184), range_facet_sl=PostingsFormat(name=Asserting), multiDefault=PostingsFormat(name=MockSep), id=Pulsing41(freqCutoff=13 minBlockSize=81 maxBlockSize=184)}, docValues:{}, sim=DefaultSimilarity, locale=en_IE, timezone=Pacific/Niue
[junit4] 2> NOTE: Linux 3.8.0-37-generic amd64/Oracle Corporation 1.7.0_60-ea (64-bit)/cpus=8,threads=1,free=62009776,total=126418944
[junit4] 2> NOTE: All tests run in this JVM: [SolrParamTest, SolrPingTest, DocumentAnalysisResponseTest, TestXMLEscaping, ClientUtilsTest, LargeVolumeBinaryJettyTest, SolrExampleEmbeddedTest, TestUpdateRequestCodec, TestJavaBinCodec, TestDocumentObjectBinder, SolrExampleStreamingBinaryTest, ModifiableSolrParamsTest, CloudSolrServerTest]
[junit4] Completed on J0 in 48.12s, 2 tests, 1 failure <<< FAILURES!
[...truncated 76 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:202: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:490: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1275: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:907: There were test failures: 49 suites, 284 tests, 1 failure
Total time: 65 minutes 45 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_60-ea-b10 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
Re: [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_51) -
Build # 9937 - Still Failing!
Posted by Mark Miller <ma...@gmail.com>.
Something recently added to this test around routing is flakey - I’ve seen it fail locally a few times too.
--Â
Mark Miller
about.me/markrmiller
On March 29, 2014 at 4:23:10 AM, Policeman Jenkins Server (jenkins@thetaphi.de) wrote:
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/9937/
Java: 64bit/jdk1.7.0_51 -XX:-UseCompressedOops -XX:+UseParallelGC -XX:-UseSuperWord
1 tests failed.
REGRESSION: org.apache.solr.client.solrj.impl.CloudSolrServerTest.testDistribSearch
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([1C8B4D9C793D0BA6:9D6DC3840E626B9A]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.client.solrj.impl.CloudSolrServerTest.doTest(CloudSolrServerTest.java:256)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at java.lang.Thread.run(Thread.java:744)
Build Log:
[...truncated 12122 lines...]
[junit4] Suite: org.apache.solr.client.solrj.impl.CloudSolrServerTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186
[junit4] 2> 32659 T62 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
[junit4] 2> 32660 T62 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 32662 T62 oasc.AbstractZkTestCase.<clinit> WARN TEST_HOME() does not exist - solrj test?
[junit4] 2> 32666 T62 oas.SolrTestCaseJ4.setUp ###Starting testShutdown
[junit4] 2> 32668 T62 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 32670 T63 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 32770 T62 oasc.ZkTestServer.run start zk server on port:40393
[junit4] 2> 32802 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 32864 T69 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3db4fb73 name:ZooKeeperConnection Watcher:127.0.0.1:40393 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 32864 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 32865 T62 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 32887 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 32890 T71 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1dd6ba8d name:ZooKeeperConnection Watcher:127.0.0.1:40393/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 32891 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 32896 T62 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 32904 T62 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 32910 T62 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 32914 T62 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 32921 T62 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 32934 T62 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 32944 T62 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 32945 T62 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 32952 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml because it doesn't exist
[junit4] 2> 32953 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/stopwords.txt because it doesn't exist
[junit4] 2> 32953 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/protwords.txt because it doesn't exist
[junit4] 2> 32954 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/currency.xml because it doesn't exist
[junit4] 2> 32955 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/enumsConfig.xml because it doesn't exist
[junit4] 2> 32955 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/open-exchange-rates.json because it doesn't exist
[junit4] 2> 32956 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/mapping-ISOLatin1Accent.txt because it doesn't exist
[junit4] 2> 32956 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/old_synonyms.txt because it doesn't exist
[junit4] 2> 32957 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/synonyms.txt because it doesn't exist
[junit4] 2> 32966 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 32968 T73 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5ea4f27a name:ZooKeeperConnection Watcher:127.0.0.1:40393/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 32969 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 33007 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 33009 T74 oaz.ClientCnxnSocketNIO.connect ERROR Unable to open socket to ff01::114/ff01:0:0:0:0:0:0:114:33332
[junit4] 2> 33010 T74 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.SocketException: Network is unreachable
[junit4] 2> at sun.nio.ch.Net.connect0(Native Method)
[junit4] 2> at sun.nio.ch.Net.connect(Net.java:465)
[junit4] 2> at sun.nio.ch.Net.connect(Net.java:457)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:277)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:287)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:967)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
[junit4] 2>
[junit4] 2> 34113 T74 oaz.ClientCnxnSocketNIO.connect ERROR Unable to open socket to ff01::114/ff01:0:0:0:0:0:0:114:33332
[junit4] 2> 34217 T62 oas.SolrTestCaseJ4.tearDown ###Ending testShutdown
[junit4] 2> 34220 T62 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:40393 40393
[junit4] 2> 34342 T63 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:40393 40393
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 34356 T62 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 34357 T62 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 34358 T76 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 34458 T62 oasc.ZkTestServer.run start zk server on port:35494
[junit4] 2> 34459 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 34464 T82 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@29869b75 name:ZooKeeperConnection Watcher:127.0.0.1:35494 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 34464 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 34464 T62 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 34472 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 34475 T84 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@216b4956 name:ZooKeeperConnection Watcher:127.0.0.1:35494/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 34475 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 34476 T62 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 34486 T62 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 34494 T62 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 34500 T62 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 34508 T62 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 34509 T62 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 34521 T62 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 34521 T62 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 34529 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml because it doesn't exist
[junit4] 2> 34530 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/stopwords.txt because it doesn't exist
[junit4] 2> 34530 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/protwords.txt because it doesn't exist
[junit4] 2> 34531 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/currency.xml because it doesn't exist
[junit4] 2> 34531 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/enumsConfig.xml because it doesn't exist
[junit4] 2> 34531 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/open-exchange-rates.json because it doesn't exist
[junit4] 2> 34532 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/mapping-ISOLatin1Accent.txt because it doesn't exist
[junit4] 2> 34532 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/old_synonyms.txt because it doesn't exist
[junit4] 2> 34533 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/synonyms.txt because it doesn't exist
[junit4] 2> 34536 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 34539 T86 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b73a116 name:ZooKeeperConnection Watcher:127.0.0.1:35494/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 34539 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 34632 T62 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 34772 T62 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 34776 T62 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:51168
[junit4] 2> 34779 T62 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 34779 T62 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 34779 T62 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396081271071
[junit4] 2> 34779 T62 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396081271071/'
[junit4] 2> 34795 T62 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396081271071/solr.xml
[junit4] 2> 34861 T62 oasc.CoreContainer.<init> New CoreContainer 1368701073
[junit4] 2> 34861 T62 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396081271071/]
[junit4] 2> 34862 T62 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 34863 T62 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 34863 T62 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 34863 T62 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 34863 T62 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 34864 T62 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 34864 T62 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 34864 T62 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 34864 T62 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 34868 T62 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 34868 T62 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 34869 T62 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 34869 T62 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35494/solr
[junit4] 2> 34878 T62 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 34878 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 34881 T97 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@afb290b name:ZooKeeperConnection Watcher:127.0.0.1:35494 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 34882 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 34890 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 34893 T99 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@55f38218 name:ZooKeeperConnection Watcher:127.0.0.1:35494/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 34893 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 34903 T62 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 34916 T62 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 34927 T62 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 34937 T62 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 34946 T62 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 34966 T62 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 34971 T62 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51168_
[junit4] 2> 34976 T62 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51168_
[junit4] 2> 34987 T62 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 34996 T62 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 35015 T62 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:51168_
[junit4] 2> 35016 T62 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 35023 T62 oasc.Overseer.start Overseer (id=91493582168915972-127.0.0.1:51168_-n_0000000000) starting
[junit4] 2> 35041 T62 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 35090 T101 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 35091 T62 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 35094 T101 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 35098 T62 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 35101 T62 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 35112 T100 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 35125 T102 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 35125 T102 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 35130 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 35130 T102 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 35136 T100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 35139 T100 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:51168",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51168_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 35139 T100 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 35152 T100 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 35160 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 35165 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 36131 T102 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 36131 T102 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 36133 T102 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 36134 T102 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 36137 T102 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 36137 T102 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396081271071/collection1/'
[junit4] 2> 36189 T102 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 36227 T102 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 36231 T102 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 36279 T102 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 36324 T102 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableIntField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 36331 T102 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableLongField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 36337 T102 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableFloatField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 36344 T102 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableDoubleField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 36682 T102 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 36684 T102 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 36686 T102 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 36686 T102 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 36689 T102 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 36689 T102 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 36690 T102 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396081271071/collection1/, dataDir=./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/control/data/
[junit4] 2> 36690 T102 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 36691 T102 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/control/data
[junit4] 2> 36691 T102 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/control/data/index/
[junit4] 2> 36691 T102 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 36692 T102 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/control/data/index
[junit4] 2> 36693 T102 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@444fc7e5 lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 36693 T102 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 36695 T102 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 36696 T102 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 36696 T102 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 36696 T102 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 36699 T102 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 36700 T102 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 36700 T102 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 36700 T102 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 36702 T102 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 36705 T102 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 36705 T102 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 36706 T102 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@444fc7e5 lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 36706 T102 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 36706 T102 oass.SolrIndexSearcher.<init> Opening Searcher@7814efb9[collection1] main
[junit4] 2> 36706 T102 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 36708 T102 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 36708 T102 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 36712 T102 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 36712 T102 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 36713 T102 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 36714 T102 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 36715 T102 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 36715 T102 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 36715 T102 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 36718 T103 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7814efb9[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 36718 T102 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 36720 T106 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:51168 collection:control_collection shard:shard1
[junit4] 2> 36721 T62 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 36721 T62 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 36730 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 36733 T108 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@207644dc name:ZooKeeperConnection Watcher:127.0.0.1:35494/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 36733 T106 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 36733 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 36737 T62 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 36747 T62 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 36753 T106 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 36759 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 36761 T106 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 36762 T106 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 36764 T100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C6 name=collection1 org.apache.solr.core.SolrCore@32736560 url=https://127.0.0.1:51168/collection1 node=127.0.0.1:51168_ C6_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:51168, core=collection1, node_name=127.0.0.1:51168_}
[junit4] 2> 36765 T106 C6 P51168 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:51168/collection1/
[junit4] 2> 36766 T106 C6 P51168 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 36766 T106 C6 P51168 oasc.SyncStrategy.syncToMe https://127.0.0.1:51168/collection1/ has no replicas
[junit4] 2> 36766 T106 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:51168/collection1/ shard1
[junit4] 2> 36770 T106 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 36772 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 36775 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 36776 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 36793 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 36797 T100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 36801 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 36821 T62 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 36821 T62 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 36827 T62 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 36830 T62 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:56117
[junit4] 2> 36834 T62 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 36834 T62 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 36835 T62 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396081273274
[junit4] 2> 36835 T62 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396081273274/'
[junit4] 2> 36850 T62 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396081273274/solr.xml
[junit4] 2> 36900 T62 oasc.CoreContainer.<init> New CoreContainer 1865015365
[junit4] 2> 36900 T62 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396081273274/]
[junit4] 2> 36902 T62 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 36902 T62 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 36902 T62 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 36902 T62 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 36903 T62 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 36903 T62 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 36903 T62 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 36903 T62 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 36904 T62 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 36905 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 36905 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 36908 T62 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 36908 T62 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 36908 T62 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 36909 T62 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35494/solr
[junit4] 2> 36909 T62 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 36910 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 36913 T119 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a4f4a6c name:ZooKeeperConnection Watcher:127.0.0.1:35494 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 36913 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 36918 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 36919 T121 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6573cc name:ZooKeeperConnection Watcher:127.0.0.1:35494/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 36919 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 36929 T62 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 36945 T106 oasc.ZkController.register We are https://127.0.0.1:51168/collection1/ and leader is https://127.0.0.1:51168/collection1/
[junit4] 2> 36946 T106 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:51168
[junit4] 2> 36946 T106 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 36946 T106 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 36946 T106 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 36949 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 36950 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 36950 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 36950 T106 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 36952 T100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 36954 T100 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:51168",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51168_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 36960 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 37065 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 37065 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 37065 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 37934 T62 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56117_
[junit4] 2> 37938 T62 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56117_
[junit4] 2> 37944 T108 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 37944 T99 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 37944 T121 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 37966 T122 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 37967 T122 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 37969 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 37970 T122 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 37970 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 37970 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 37974 T100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 37977 T100 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:56117",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56117_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 37977 T100 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 37977 T100 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 37984 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 38090 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 38090 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 38090 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 38970 T122 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 38970 T122 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 38972 T122 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 38972 T122 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 38975 T122 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 38976 T122 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396081273274/collection1/'
[junit4] 2> 39016 T122 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 39059 T122 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 39061 T122 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 39116 T122 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 39454 T122 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 39456 T122 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 39459 T122 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 39459 T122 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 39460 T122 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 39460 T122 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 39460 T122 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396081273274/collection1/, dataDir=./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty1/
[junit4] 2> 39460 T122 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 39461 T122 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty1
[junit4] 2> 39461 T122 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty1/index/
[junit4] 2> 39461 T122 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 39462 T122 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty1/index
[junit4] 2> 39463 T122 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7028eae9 lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 39463 T122 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 39464 T122 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 39464 T122 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 39464 T122 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 39464 T122 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 39464 T122 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 39465 T122 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 39465 T122 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 39465 T122 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 39467 T122 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 39469 T122 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 39470 T122 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 39470 T122 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7028eae9 lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 39470 T122 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 39471 T122 oass.SolrIndexSearcher.<init> Opening Searcher@1526c1c8[collection1] main
[junit4] 2> 39471 T122 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 39472 T122 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 39472 T122 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 39473 T122 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 39474 T122 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 39474 T122 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 39475 T122 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 39475 T122 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 39475 T122 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 39475 T122 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 39476 T123 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1526c1c8[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 39476 T122 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 39477 T126 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:56117 collection:collection1 shard:shard2
[junit4] 2> 39477 T62 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 39478 T62 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 39478 T126 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 39491 T126 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 39495 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 39496 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 39496 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 39497 T126 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 39497 T126 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C7 name=collection1 org.apache.solr.core.SolrCore@27948bae url=https://127.0.0.1:56117/collection1 node=127.0.0.1:56117_ C7_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:56117, core=collection1, node_name=127.0.0.1:56117_}
[junit4] 2> 39497 T126 C7 P56117 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:56117/collection1/
[junit4] 2> 39498 T126 C7 P56117 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 39498 T126 C7 P56117 oasc.SyncStrategy.syncToMe https://127.0.0.1:56117/collection1/ has no replicas
[junit4] 2> 39498 T126 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:56117/collection1/ shard2
[junit4] 2> 39499 T126 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 39499 T100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 39509 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 39548 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 39552 T62 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 39553 T62 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 39554 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 39563 T62 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 39568 T62 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:38146
[junit4] 2> 39572 T62 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 39573 T62 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 39573 T62 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396081276006
[junit4] 2> 39573 T62 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396081276006/'
[junit4] 2> 39585 T62 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396081276006/solr.xml
[junit4] 2> 39637 T62 oasc.CoreContainer.<init> New CoreContainer 523137250
[junit4] 2> 39638 T62 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396081276006/]
[junit4] 2> 39639 T62 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 39639 T62 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 39639 T62 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 39639 T62 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 39639 T62 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 39640 T62 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 39640 T62 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 39640 T62 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 39640 T62 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 39644 T62 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 39644 T62 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 39644 T62 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 39644 T62 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35494/solr
[junit4] 2> 39644 T62 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 39645 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 39648 T137 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@57957aab name:ZooKeeperConnection Watcher:127.0.0.1:35494 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 39648 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 39652 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 39654 T139 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@28df0c98 name:ZooKeeperConnection Watcher:127.0.0.1:35494/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 39654 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 39657 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 39657 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 39657 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 39667 T62 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 39699 T126 oasc.ZkController.register We are https://127.0.0.1:56117/collection1/ and leader is https://127.0.0.1:56117/collection1/
[junit4] 2> 39699 T126 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:56117
[junit4] 2> 39700 T126 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 39700 T126 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 39700 T126 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 39703 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 39703 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 39703 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 39705 T126 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 39707 T100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 39711 T100 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:56117",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56117_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 39718 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 39822 T139 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 39822 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 39822 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 39822 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 40675 T62 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38146_
[junit4] 2> 40738 T62 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38146_
[junit4] 2> 40742 T139 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 40742 T99 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 40742 T121 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 40742 T108 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 40752 T140 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 40752 T140 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 40753 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 40754 T140 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 40754 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 40754 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 40756 T100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 40757 T100 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:38146",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:38146_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 40758 T100 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 40758 T100 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 40761 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 40866 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 40867 T139 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 40867 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 40866 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 41754 T140 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 41754 T140 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 41756 T140 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 41756 T140 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 41759 T140 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 41759 T140 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396081276006/collection1/'
[junit4] 2> 41802 T140 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 41837 T140 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 41840 T140 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 41881 T140 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 42207 T140 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 42210 T140 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 42212 T140 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 42212 T140 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 42213 T140 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 42213 T140 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 42213 T140 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396081276006/collection1/, dataDir=./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty2/
[junit4] 2> 42214 T140 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 42214 T140 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty2
[junit4] 2> 42215 T140 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty2/index/
[junit4] 2> 42215 T140 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 42215 T140 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty2/index
[junit4] 2> 42216 T140 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@385bbe lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 42216 T140 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 42217 T140 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 42218 T140 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 42218 T140 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 42218 T140 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 42218 T140 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 42218 T140 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 42218 T140 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 42219 T140 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 42221 T140 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 42223 T140 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 42223 T140 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 42224 T140 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@385bbe lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 42224 T140 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 42225 T140 oass.SolrIndexSearcher.<init> Opening Searcher@780f0cb9[collection1] main
[junit4] 2> 42225 T140 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 42227 T140 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 42227 T140 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 42228 T140 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 42228 T140 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 42228 T140 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 42229 T140 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 42229 T140 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 42229 T140 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 42229 T140 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 42230 T141 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@780f0cb9[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 42230 T140 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 42231 T144 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:38146 collection:collection1 shard:shard1
[junit4] 2> 42231 T62 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 42231 T62 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 42232 T144 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 42240 T144 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 42243 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 42243 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 42243 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 42244 T144 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 42244 T144 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C8 name=collection1 org.apache.solr.core.SolrCore@6e758cca url=https://127.0.0.1:38146/collection1 node=127.0.0.1:38146_ C8_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:38146, core=collection1, node_name=127.0.0.1:38146_}
[junit4] 2> 42244 T144 C8 P38146 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:38146/collection1/
[junit4] 2> 42244 T144 C8 P38146 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 42244 T144 C8 P38146 oasc.SyncStrategy.syncToMe https://127.0.0.1:38146/collection1/ has no replicas
[junit4] 2> 42244 T144 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:38146/collection1/ shard1
[junit4] 2> 42245 T144 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 42246 T100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 42250 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 42253 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 42281 T62 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 42281 T62 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 42286 T62 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 42291 T62 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:53527
[junit4] 2> 42293 T62 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 42294 T62 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 42294 T62 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1396081278760
[junit4] 2> 42294 T62 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1396081278760/'
[junit4] 2> 42305 T62 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1396081278760/solr.xml
[junit4] 2> 42341 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 42355 T62 oasc.CoreContainer.<init> New CoreContainer 68424785
[junit4] 2> 42355 T62 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1396081278760/]
[junit4] 2> 42357 T62 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 42357 T62 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 42357 T62 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 42358 T62 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 42358 T62 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 42358 T62 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 42359 T62 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 42359 T62 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 42359 T62 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 42364 T62 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 42364 T62 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 42365 T62 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 42365 T62 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35494/solr
[junit4] 2> 42365 T62 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 42366 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 42370 T155 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@56657875 name:ZooKeeperConnection Watcher:127.0.0.1:35494 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 42370 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 42373 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 42375 T157 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6bf51604 name:ZooKeeperConnection Watcher:127.0.0.1:35494/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 42376 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 42386 T62 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 42444 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 42444 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 42445 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 42444 T139 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 42445 T157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 42454 T144 oasc.ZkController.register We are https://127.0.0.1:38146/collection1/ and leader is https://127.0.0.1:38146/collection1/
[junit4] 2> 42454 T144 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:38146
[junit4] 2> 42455 T144 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 42455 T144 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 42455 T144 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 42456 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 42457 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 42457 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 42458 T144 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 42459 T100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 42461 T100 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:38146",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:38146_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 42465 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 42570 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 42570 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 42570 T139 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 42570 T157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 42570 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 43390 T62 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53527_
[junit4] 2> 43392 T62 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53527_
[junit4] 2> 43396 T121 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 43396 T108 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 43396 T157 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 43396 T139 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 43397 T99 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 43410 T158 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 43411 T158 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 43413 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 43413 T158 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 43413 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 43414 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 43415 T100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 43417 T100 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:53527",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:53527_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 43417 T100 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 43417 T100 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 43421 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 43525 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 43525 T139 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 4352
[...truncated too long message...]
[junit4] 2> 53281 T62 oasc.CachingDirectoryFactory.close Closing directory: ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty2/index
[junit4] 2> 53282 T62 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty2 [CachedDir<<refCount=0;path=./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty2;done=false>>]
[junit4] 2> 53282 T62 oasc.CachingDirectoryFactory.close Closing directory: ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty2
[junit4] 2> 53282 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:38146",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:38146_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 53308 T62 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4] 2> 53359 T62 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 53527
[junit4] 2> 53359 T62 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=68424785
[junit4] 2> 53359 T62 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 53360 T62 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 53385 T62 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4] 2> 53438 T62 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4] 2> 53439 T62 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:35494 35494
[junit4] 2> 53516 T76 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:35494 35494
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CloudSolrServerTest -Dtests.method=testDistribSearch -Dtests.seed=1C8B4D9C793D0BA6 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=uk_UA -Dtests.timezone=Indian/Mahe -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 19.2s J0 | CloudSolrServerTest.testDistribSearch <<<
[junit4] > Throwable #1: java.lang.AssertionError
[junit4] > at __randomizedtesting.SeedInfo.seed([1C8B4D9C793D0BA6:9D6DC3840E626B9A]:0)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServerTest.doTest(CloudSolrServerTest.java:256)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
[junit4] > at java.lang.Thread.run(Thread.java:744)
[junit4] 2> 53567 T62 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 54608 T99 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 54697 T121 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 54786 T139 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 55701 T157 C9 P53527 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 55708 T157 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 55708 T157 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@1e3991b7
[junit4] 2> 55709 T157 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=5,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=1,cumulative_deletesByQuery=1,cumulative_errors=0,transaction_logs_total_size=354,transaction_logs_total_number=4}
[junit4] 2> 55709 T157 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 55710 T157 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 55710 T157 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 55712 T157 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 55713 T157 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 55713 T157 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty3 [CachedDir<<refCount=0;path=./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty3;done=false>>]
[junit4] 2> 55713 T157 oasc.CachingDirectoryFactory.close Closing directory: ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty3
[junit4] 2> 55713 T157 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty3/index [CachedDir<<refCount=0;path=./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty3/index;done=false>>]
[junit4] 2> 55714 T157 oasc.CachingDirectoryFactory.close Closing directory: ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty3/index
[junit4] 2> 55714 T157 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 55714 T157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 55715 T157 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 55715 T157 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> NOTE: test params are: codec=Lucene46: {range_facet_si=MockVariableIntBlock(baseBlockSize=54), multiDefault=MockVariableIntBlock(baseBlockSize=54), range_facet_sl=PostingsFormat(name=FSTOrdPulsing41), a_t=MockVariableIntBlock(baseBlockSize=54), _version_=FSTOrd41, timestamp=MockVariableIntBlock(baseBlockSize=54), id=PostingsFormat(name=FSTOrdPulsing41), text=PostingsFormat(name=FSTPulsing41), range_facet_l=MockVariableIntBlock(baseBlockSize=54), intDefault=FSTOrd41}, docValues:{}, sim=DefaultSimilarity, locale=uk_UA, timezone=Indian/Mahe
[junit4] 2> NOTE: Linux 3.8.0-37-generic amd64/Oracle Corporation 1.7.0_51 (64-bit)/cpus=8,threads=1,free=119349104,total=259522560
[junit4] 2> NOTE: All tests run in this JVM: [SolrExampleXMLTest, TestXMLEscaping, SolrExampleStreamingBinaryTest, CloudSolrServerTest]
[junit4] Completed on J0 in 24.03s, 2 tests, 1 failure <<< FAILURES!
[...truncated 109 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:202: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1275: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:907: There were test failures: 49 suites, 284 tests, 1 failure
Total time: 53 minutes 4 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_51 -XX:-UseCompressedOops -XX:+UseParallelGC -XX:-UseSuperWord
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_51) - Build #
9937 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/9937/
Java: 64bit/jdk1.7.0_51 -XX:-UseCompressedOops -XX:+UseParallelGC -XX:-UseSuperWord
1 tests failed.
REGRESSION: org.apache.solr.client.solrj.impl.CloudSolrServerTest.testDistribSearch
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([1C8B4D9C793D0BA6:9D6DC3840E626B9A]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.client.solrj.impl.CloudSolrServerTest.doTest(CloudSolrServerTest.java:256)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at java.lang.Thread.run(Thread.java:744)
Build Log:
[...truncated 12122 lines...]
[junit4] Suite: org.apache.solr.client.solrj.impl.CloudSolrServerTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186
[junit4] 2> 32659 T62 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
[junit4] 2> 32660 T62 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 32662 T62 oasc.AbstractZkTestCase.<clinit> WARN TEST_HOME() does not exist - solrj test?
[junit4] 2> 32666 T62 oas.SolrTestCaseJ4.setUp ###Starting testShutdown
[junit4] 2> 32668 T62 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 32670 T63 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 32770 T62 oasc.ZkTestServer.run start zk server on port:40393
[junit4] 2> 32802 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 32864 T69 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3db4fb73 name:ZooKeeperConnection Watcher:127.0.0.1:40393 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 32864 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 32865 T62 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 32887 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 32890 T71 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1dd6ba8d name:ZooKeeperConnection Watcher:127.0.0.1:40393/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 32891 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 32896 T62 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 32904 T62 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 32910 T62 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 32914 T62 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 32921 T62 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 32934 T62 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 32944 T62 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 32945 T62 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 32952 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml because it doesn't exist
[junit4] 2> 32953 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/stopwords.txt because it doesn't exist
[junit4] 2> 32953 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/protwords.txt because it doesn't exist
[junit4] 2> 32954 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/currency.xml because it doesn't exist
[junit4] 2> 32955 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/enumsConfig.xml because it doesn't exist
[junit4] 2> 32955 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/open-exchange-rates.json because it doesn't exist
[junit4] 2> 32956 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/mapping-ISOLatin1Accent.txt because it doesn't exist
[junit4] 2> 32956 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/old_synonyms.txt because it doesn't exist
[junit4] 2> 32957 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/synonyms.txt because it doesn't exist
[junit4] 2> 32966 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 32968 T73 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5ea4f27a name:ZooKeeperConnection Watcher:127.0.0.1:40393/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 32969 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 33007 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 33009 T74 oaz.ClientCnxnSocketNIO.connect ERROR Unable to open socket to ff01::114/ff01:0:0:0:0:0:0:114:33332
[junit4] 2> 33010 T74 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.SocketException: Network is unreachable
[junit4] 2> at sun.nio.ch.Net.connect0(Native Method)
[junit4] 2> at sun.nio.ch.Net.connect(Net.java:465)
[junit4] 2> at sun.nio.ch.Net.connect(Net.java:457)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:277)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:287)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:967)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
[junit4] 2>
[junit4] 2> 34113 T74 oaz.ClientCnxnSocketNIO.connect ERROR Unable to open socket to ff01::114/ff01:0:0:0:0:0:0:114:33332
[junit4] 2> 34217 T62 oas.SolrTestCaseJ4.tearDown ###Ending testShutdown
[junit4] 2> 34220 T62 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:40393 40393
[junit4] 2> 34342 T63 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:40393 40393
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 34356 T62 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 34357 T62 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 34358 T76 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 34458 T62 oasc.ZkTestServer.run start zk server on port:35494
[junit4] 2> 34459 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 34464 T82 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@29869b75 name:ZooKeeperConnection Watcher:127.0.0.1:35494 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 34464 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 34464 T62 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 34472 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 34475 T84 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@216b4956 name:ZooKeeperConnection Watcher:127.0.0.1:35494/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 34475 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 34476 T62 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 34486 T62 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 34494 T62 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 34500 T62 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 34508 T62 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 34509 T62 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 34521 T62 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 34521 T62 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 34529 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml because it doesn't exist
[junit4] 2> 34530 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/stopwords.txt because it doesn't exist
[junit4] 2> 34530 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/protwords.txt because it doesn't exist
[junit4] 2> 34531 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/currency.xml because it doesn't exist
[junit4] 2> 34531 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/enumsConfig.xml because it doesn't exist
[junit4] 2> 34531 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/open-exchange-rates.json because it doesn't exist
[junit4] 2> 34532 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/mapping-ISOLatin1Accent.txt because it doesn't exist
[junit4] 2> 34532 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/old_synonyms.txt because it doesn't exist
[junit4] 2> 34533 T62 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/synonyms.txt because it doesn't exist
[junit4] 2> 34536 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 34539 T86 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b73a116 name:ZooKeeperConnection Watcher:127.0.0.1:35494/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 34539 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 34632 T62 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 34772 T62 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 34776 T62 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:51168
[junit4] 2> 34779 T62 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 34779 T62 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 34779 T62 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396081271071
[junit4] 2> 34779 T62 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396081271071/'
[junit4] 2> 34795 T62 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396081271071/solr.xml
[junit4] 2> 34861 T62 oasc.CoreContainer.<init> New CoreContainer 1368701073
[junit4] 2> 34861 T62 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396081271071/]
[junit4] 2> 34862 T62 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 34863 T62 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 34863 T62 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 34863 T62 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 34863 T62 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 34864 T62 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 34864 T62 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 34864 T62 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 34864 T62 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 34868 T62 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 34868 T62 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 34869 T62 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 34869 T62 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35494/solr
[junit4] 2> 34878 T62 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 34878 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 34881 T97 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@afb290b name:ZooKeeperConnection Watcher:127.0.0.1:35494 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 34882 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 34890 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 34893 T99 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@55f38218 name:ZooKeeperConnection Watcher:127.0.0.1:35494/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 34893 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 34903 T62 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 34916 T62 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 34927 T62 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 34937 T62 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 34946 T62 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 34966 T62 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 34971 T62 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51168_
[junit4] 2> 34976 T62 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51168_
[junit4] 2> 34987 T62 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 34996 T62 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 35015 T62 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:51168_
[junit4] 2> 35016 T62 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 35023 T62 oasc.Overseer.start Overseer (id=91493582168915972-127.0.0.1:51168_-n_0000000000) starting
[junit4] 2> 35041 T62 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 35090 T101 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 35091 T62 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 35094 T101 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 35098 T62 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 35101 T62 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 35112 T100 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 35125 T102 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 35125 T102 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 35130 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 35130 T102 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 35136 T100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 35139 T100 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:51168",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51168_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 35139 T100 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 35152 T100 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 35160 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 35165 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 36131 T102 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 36131 T102 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 36133 T102 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 36134 T102 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 36137 T102 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 36137 T102 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396081271071/collection1/'
[junit4] 2> 36189 T102 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 36227 T102 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 36231 T102 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 36279 T102 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 36324 T102 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableIntField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 36331 T102 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableLongField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 36337 T102 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableFloatField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 36344 T102 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableDoubleField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 36682 T102 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 36684 T102 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 36686 T102 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 36686 T102 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 36689 T102 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 36689 T102 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 36690 T102 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396081271071/collection1/, dataDir=./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/control/data/
[junit4] 2> 36690 T102 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 36691 T102 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/control/data
[junit4] 2> 36691 T102 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/control/data/index/
[junit4] 2> 36691 T102 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 36692 T102 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/control/data/index
[junit4] 2> 36693 T102 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@444fc7e5 lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 36693 T102 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 36695 T102 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 36696 T102 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 36696 T102 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 36696 T102 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 36699 T102 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 36700 T102 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 36700 T102 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 36700 T102 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 36702 T102 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 36705 T102 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 36705 T102 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 36706 T102 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@444fc7e5 lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 36706 T102 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 36706 T102 oass.SolrIndexSearcher.<init> Opening Searcher@7814efb9[collection1] main
[junit4] 2> 36706 T102 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 36708 T102 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 36708 T102 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 36712 T102 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 36712 T102 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 36713 T102 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 36714 T102 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 36715 T102 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 36715 T102 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 36715 T102 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 36718 T103 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7814efb9[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 36718 T102 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 36720 T106 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:51168 collection:control_collection shard:shard1
[junit4] 2> 36721 T62 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 36721 T62 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 36730 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 36733 T108 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@207644dc name:ZooKeeperConnection Watcher:127.0.0.1:35494/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 36733 T106 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 36733 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 36737 T62 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 36747 T62 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 36753 T106 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 36759 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 36761 T106 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 36762 T106 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 36764 T100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C6 name=collection1 org.apache.solr.core.SolrCore@32736560 url=https://127.0.0.1:51168/collection1 node=127.0.0.1:51168_ C6_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:51168, core=collection1, node_name=127.0.0.1:51168_}
[junit4] 2> 36765 T106 C6 P51168 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:51168/collection1/
[junit4] 2> 36766 T106 C6 P51168 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 36766 T106 C6 P51168 oasc.SyncStrategy.syncToMe https://127.0.0.1:51168/collection1/ has no replicas
[junit4] 2> 36766 T106 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:51168/collection1/ shard1
[junit4] 2> 36770 T106 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 36772 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 36775 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 36776 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 36793 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 36797 T100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 36801 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 36821 T62 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 36821 T62 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 36827 T62 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 36830 T62 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:56117
[junit4] 2> 36834 T62 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 36834 T62 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 36835 T62 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396081273274
[junit4] 2> 36835 T62 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396081273274/'
[junit4] 2> 36850 T62 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396081273274/solr.xml
[junit4] 2> 36900 T62 oasc.CoreContainer.<init> New CoreContainer 1865015365
[junit4] 2> 36900 T62 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396081273274/]
[junit4] 2> 36902 T62 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 36902 T62 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 36902 T62 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 36902 T62 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 36903 T62 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 36903 T62 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 36903 T62 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 36903 T62 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 36904 T62 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 36905 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 36905 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 36908 T62 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 36908 T62 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 36908 T62 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 36909 T62 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35494/solr
[junit4] 2> 36909 T62 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 36910 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 36913 T119 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a4f4a6c name:ZooKeeperConnection Watcher:127.0.0.1:35494 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 36913 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 36918 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 36919 T121 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6573cc name:ZooKeeperConnection Watcher:127.0.0.1:35494/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 36919 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 36929 T62 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 36945 T106 oasc.ZkController.register We are https://127.0.0.1:51168/collection1/ and leader is https://127.0.0.1:51168/collection1/
[junit4] 2> 36946 T106 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:51168
[junit4] 2> 36946 T106 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 36946 T106 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 36946 T106 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 36949 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 36950 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 36950 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 36950 T106 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 36952 T100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 36954 T100 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:51168",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51168_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 36960 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 37065 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 37065 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 37065 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 37934 T62 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56117_
[junit4] 2> 37938 T62 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56117_
[junit4] 2> 37944 T108 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 37944 T99 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 37944 T121 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 37966 T122 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 37967 T122 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 37969 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 37970 T122 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 37970 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 37970 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 37974 T100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 37977 T100 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:56117",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56117_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 37977 T100 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 37977 T100 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 37984 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 38090 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 38090 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 38090 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 38970 T122 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 38970 T122 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 38972 T122 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 38972 T122 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 38975 T122 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 38976 T122 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396081273274/collection1/'
[junit4] 2> 39016 T122 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 39059 T122 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 39061 T122 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 39116 T122 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 39454 T122 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 39456 T122 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 39459 T122 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 39459 T122 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 39460 T122 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 39460 T122 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 39460 T122 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396081273274/collection1/, dataDir=./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty1/
[junit4] 2> 39460 T122 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 39461 T122 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty1
[junit4] 2> 39461 T122 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty1/index/
[junit4] 2> 39461 T122 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 39462 T122 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty1/index
[junit4] 2> 39463 T122 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7028eae9 lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 39463 T122 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 39464 T122 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 39464 T122 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 39464 T122 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 39464 T122 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 39464 T122 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 39465 T122 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 39465 T122 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 39465 T122 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 39467 T122 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 39469 T122 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 39470 T122 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 39470 T122 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7028eae9 lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 39470 T122 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 39471 T122 oass.SolrIndexSearcher.<init> Opening Searcher@1526c1c8[collection1] main
[junit4] 2> 39471 T122 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 39472 T122 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 39472 T122 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 39473 T122 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 39474 T122 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 39474 T122 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 39475 T122 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 39475 T122 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 39475 T122 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 39475 T122 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 39476 T123 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1526c1c8[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 39476 T122 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 39477 T126 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:56117 collection:collection1 shard:shard2
[junit4] 2> 39477 T62 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 39478 T62 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 39478 T126 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 39491 T126 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 39495 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 39496 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 39496 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 39497 T126 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 39497 T126 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C7 name=collection1 org.apache.solr.core.SolrCore@27948bae url=https://127.0.0.1:56117/collection1 node=127.0.0.1:56117_ C7_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:56117, core=collection1, node_name=127.0.0.1:56117_}
[junit4] 2> 39497 T126 C7 P56117 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:56117/collection1/
[junit4] 2> 39498 T126 C7 P56117 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 39498 T126 C7 P56117 oasc.SyncStrategy.syncToMe https://127.0.0.1:56117/collection1/ has no replicas
[junit4] 2> 39498 T126 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:56117/collection1/ shard2
[junit4] 2> 39499 T126 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 39499 T100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 39509 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 39548 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 39552 T62 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 39553 T62 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 39554 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 39563 T62 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 39568 T62 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:38146
[junit4] 2> 39572 T62 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 39573 T62 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 39573 T62 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396081276006
[junit4] 2> 39573 T62 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396081276006/'
[junit4] 2> 39585 T62 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396081276006/solr.xml
[junit4] 2> 39637 T62 oasc.CoreContainer.<init> New CoreContainer 523137250
[junit4] 2> 39638 T62 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396081276006/]
[junit4] 2> 39639 T62 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 39639 T62 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 39639 T62 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 39639 T62 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 39639 T62 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 39640 T62 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 39640 T62 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 39640 T62 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 39640 T62 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 39644 T62 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 39644 T62 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 39644 T62 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 39644 T62 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35494/solr
[junit4] 2> 39644 T62 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 39645 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 39648 T137 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@57957aab name:ZooKeeperConnection Watcher:127.0.0.1:35494 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 39648 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 39652 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 39654 T139 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@28df0c98 name:ZooKeeperConnection Watcher:127.0.0.1:35494/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 39654 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 39657 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 39657 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 39657 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 39667 T62 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 39699 T126 oasc.ZkController.register We are https://127.0.0.1:56117/collection1/ and leader is https://127.0.0.1:56117/collection1/
[junit4] 2> 39699 T126 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:56117
[junit4] 2> 39700 T126 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 39700 T126 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 39700 T126 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 39703 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 39703 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 39703 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 39705 T126 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 39707 T100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 39711 T100 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:56117",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56117_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 39718 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 39822 T139 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 39822 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 39822 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 39822 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 40675 T62 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38146_
[junit4] 2> 40738 T62 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38146_
[junit4] 2> 40742 T139 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 40742 T99 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 40742 T121 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 40742 T108 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 40752 T140 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 40752 T140 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 40753 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 40754 T140 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 40754 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 40754 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 40756 T100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 40757 T100 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:38146",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:38146_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 40758 T100 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 40758 T100 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 40761 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 40866 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 40867 T139 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 40867 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 40866 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 41754 T140 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 41754 T140 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 41756 T140 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 41756 T140 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 41759 T140 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 41759 T140 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396081276006/collection1/'
[junit4] 2> 41802 T140 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 41837 T140 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 41840 T140 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 41881 T140 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 42207 T140 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 42210 T140 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 42212 T140 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 42212 T140 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 42213 T140 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 42213 T140 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 42213 T140 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396081276006/collection1/, dataDir=./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty2/
[junit4] 2> 42214 T140 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 42214 T140 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty2
[junit4] 2> 42215 T140 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty2/index/
[junit4] 2> 42215 T140 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 42215 T140 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty2/index
[junit4] 2> 42216 T140 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@385bbe lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 42216 T140 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 42217 T140 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 42218 T140 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 42218 T140 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 42218 T140 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 42218 T140 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 42218 T140 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 42218 T140 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 42219 T140 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 42221 T140 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 42223 T140 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 42223 T140 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 42224 T140 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@385bbe lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 42224 T140 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 42225 T140 oass.SolrIndexSearcher.<init> Opening Searcher@780f0cb9[collection1] main
[junit4] 2> 42225 T140 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 42227 T140 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 42227 T140 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 42228 T140 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 42228 T140 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 42228 T140 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 42229 T140 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 42229 T140 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 42229 T140 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 42229 T140 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 42230 T141 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@780f0cb9[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 42230 T140 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 42231 T144 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:38146 collection:collection1 shard:shard1
[junit4] 2> 42231 T62 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 42231 T62 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 42232 T144 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 42240 T144 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 42243 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 42243 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 42243 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 42244 T144 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 42244 T144 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C8 name=collection1 org.apache.solr.core.SolrCore@6e758cca url=https://127.0.0.1:38146/collection1 node=127.0.0.1:38146_ C8_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:38146, core=collection1, node_name=127.0.0.1:38146_}
[junit4] 2> 42244 T144 C8 P38146 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:38146/collection1/
[junit4] 2> 42244 T144 C8 P38146 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 42244 T144 C8 P38146 oasc.SyncStrategy.syncToMe https://127.0.0.1:38146/collection1/ has no replicas
[junit4] 2> 42244 T144 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:38146/collection1/ shard1
[junit4] 2> 42245 T144 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 42246 T100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 42250 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 42253 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 42281 T62 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 42281 T62 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 42286 T62 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 42291 T62 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:53527
[junit4] 2> 42293 T62 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 42294 T62 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 42294 T62 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1396081278760
[junit4] 2> 42294 T62 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1396081278760/'
[junit4] 2> 42305 T62 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1396081278760/solr.xml
[junit4] 2> 42341 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 42355 T62 oasc.CoreContainer.<init> New CoreContainer 68424785
[junit4] 2> 42355 T62 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1396081278760/]
[junit4] 2> 42357 T62 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 42357 T62 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 42357 T62 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 42358 T62 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 42358 T62 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 42358 T62 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 42359 T62 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 42359 T62 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 42359 T62 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 42364 T62 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 42364 T62 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 42365 T62 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 42365 T62 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35494/solr
[junit4] 2> 42365 T62 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 42366 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 42370 T155 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@56657875 name:ZooKeeperConnection Watcher:127.0.0.1:35494 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 42370 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 42373 T62 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 42375 T157 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6bf51604 name:ZooKeeperConnection Watcher:127.0.0.1:35494/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 42376 T62 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 42386 T62 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 42444 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 42444 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 42445 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 42444 T139 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 42445 T157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 42454 T144 oasc.ZkController.register We are https://127.0.0.1:38146/collection1/ and leader is https://127.0.0.1:38146/collection1/
[junit4] 2> 42454 T144 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:38146
[junit4] 2> 42455 T144 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 42455 T144 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 42455 T144 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 42456 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 42457 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 42457 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 42458 T144 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 42459 T100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 42461 T100 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:38146",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:38146_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 42465 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 42570 T108 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 42570 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 42570 T139 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 42570 T157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 42570 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 43390 T62 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53527_
[junit4] 2> 43392 T62 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53527_
[junit4] 2> 43396 T121 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 43396 T108 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 43396 T157 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 43396 T139 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 43397 T99 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 43410 T158 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 43411 T158 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 43413 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 43413 T158 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 43413 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 43414 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 43415 T100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 43417 T100 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:53527",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:53527_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 43417 T100 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 43417 T100 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 43421 T99 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 43525 T99 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 43525 T139 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 4352
[...truncated too long message...]
[junit4] 2> 53281 T62 oasc.CachingDirectoryFactory.close Closing directory: ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty2/index
[junit4] 2> 53282 T62 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty2 [CachedDir<<refCount=0;path=./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty2;done=false>>]
[junit4] 2> 53282 T62 oasc.CachingDirectoryFactory.close Closing directory: ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty2
[junit4] 2> 53282 T175 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:38146",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:38146_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 53308 T62 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4] 2> 53359 T62 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 53527
[junit4] 2> 53359 T62 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=68424785
[junit4] 2> 53359 T62 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 53360 T62 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 53385 T62 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4] 2> 53438 T62 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4] 2> 53439 T62 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:35494 35494
[junit4] 2> 53516 T76 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:35494 35494
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CloudSolrServerTest -Dtests.method=testDistribSearch -Dtests.seed=1C8B4D9C793D0BA6 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=uk_UA -Dtests.timezone=Indian/Mahe -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 19.2s J0 | CloudSolrServerTest.testDistribSearch <<<
[junit4] > Throwable #1: java.lang.AssertionError
[junit4] > at __randomizedtesting.SeedInfo.seed([1C8B4D9C793D0BA6:9D6DC3840E626B9A]:0)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServerTest.doTest(CloudSolrServerTest.java:256)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
[junit4] > at java.lang.Thread.run(Thread.java:744)
[junit4] 2> 53567 T62 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 54608 T99 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 54697 T121 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 54786 T139 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 55701 T157 C9 P53527 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 55708 T157 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 55708 T157 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@1e3991b7
[junit4] 2> 55709 T157 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=5,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=1,cumulative_deletesByQuery=1,cumulative_errors=0,transaction_logs_total_size=354,transaction_logs_total_number=4}
[junit4] 2> 55709 T157 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 55710 T157 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 55710 T157 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 55712 T157 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 55713 T157 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 55713 T157 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty3 [CachedDir<<refCount=0;path=./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty3;done=false>>]
[junit4] 2> 55713 T157 oasc.CachingDirectoryFactory.close Closing directory: ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty3
[junit4] 2> 55713 T157 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty3/index [CachedDir<<refCount=0;path=./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty3/index;done=false>>]
[junit4] 2> 55714 T157 oasc.CachingDirectoryFactory.close Closing directory: ./solrtest-CloudSolrServerTest-1396081269186/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396081270884/jetty3/index
[junit4] 2> 55714 T157 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 55714 T157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 55715 T157 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 55715 T157 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> NOTE: test params are: codec=Lucene46: {range_facet_si=MockVariableIntBlock(baseBlockSize=54), multiDefault=MockVariableIntBlock(baseBlockSize=54), range_facet_sl=PostingsFormat(name=FSTOrdPulsing41), a_t=MockVariableIntBlock(baseBlockSize=54), _version_=FSTOrd41, timestamp=MockVariableIntBlock(baseBlockSize=54), id=PostingsFormat(name=FSTOrdPulsing41), text=PostingsFormat(name=FSTPulsing41), range_facet_l=MockVariableIntBlock(baseBlockSize=54), intDefault=FSTOrd41}, docValues:{}, sim=DefaultSimilarity, locale=uk_UA, timezone=Indian/Mahe
[junit4] 2> NOTE: Linux 3.8.0-37-generic amd64/Oracle Corporation 1.7.0_51 (64-bit)/cpus=8,threads=1,free=119349104,total=259522560
[junit4] 2> NOTE: All tests run in this JVM: [SolrExampleXMLTest, TestXMLEscaping, SolrExampleStreamingBinaryTest, CloudSolrServerTest]
[junit4] Completed on J0 in 24.03s, 2 tests, 1 failure <<< FAILURES!
[...truncated 109 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:202: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1275: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:907: There were test failures: 49 suites, 284 tests, 1 failure
Total time: 53 minutes 4 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_51 -XX:-UseCompressedOops -XX:+UseParallelGC -XX:-UseSuperWord
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_60-ea-b10) -
Build # 9936 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/9936/
Java: 32bit/jdk1.7.0_60-ea-b10 -server -XX:+UseParallelGC
All tests passed
Build Log:
[...truncated 51533 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:406: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:87: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:179: The following files are missing svn:eol-style (or binary svn:mime-type):
* ./lucene/codecs/src/test/org/apache/lucene/codecs/memory/TestFSTOrdPostingsFormat.java
* ./lucene/codecs/src/test/org/apache/lucene/codecs/memory/TestFSTOrdPulsing41PostingsFormat.java
* ./lucene/codecs/src/test/org/apache/lucene/codecs/memory/TestFSTPostingsFormat.java
* ./lucene/codecs/src/test/org/apache/lucene/codecs/memory/TestFSTPulsing41PostingsFormat.java
Total time: 62 minutes 56 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_60-ea-b10 -server -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
Re: [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0) - Build # 9935 - Still Failing!
Posted by Steve Rowe <sa...@gmail.com>.
Thanks Shalin :)
On Mar 29, 2014, at 12:19 AM, Shalin Shekhar Mangar <sh...@gmail.com> wrote:
> I committed a fix.
>
> On Sat, Mar 29, 2014 at 9:44 AM, Policeman Jenkins Server
> <je...@thetaphi.de> wrote:
>> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/9935/
>> Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
>>
>> All tests passed
>>
>> Build Log:
>> [...truncated 31699 lines...]
>> -check-forbidden-all:
>> [forbidden-apis] Reading bundled API signatures: jdk-unsafe-1.7
>> [forbidden-apis] Reading bundled API signatures: jdk-deprecated-1.7
>> [forbidden-apis] Reading bundled API signatures: commons-io-unsafe-2.1
>> [forbidden-apis] Reading API signatures: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/tools/forbiddenApis/base.txt
>> [forbidden-apis] Reading API signatures: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/tools/forbiddenApis/servlet-api.txt
>> [forbidden-apis] Loading classes to check...
>> [forbidden-apis] Scanning for API signatures and dependencies...
>> [forbidden-apis] Forbidden method invocation: java.lang.String#format(java.lang.String,java.lang.Object[]) [Uses default locale]
>> [forbidden-apis] in org.apache.solr.CursorPagingTest (CursorPagingTest.java:969)
>> [forbidden-apis] Scanned 2139 (and 1380 related) class file(s) for forbidden API invocations (in 1.86s), 1 error(s).
>>
>> BUILD FAILED
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:70: The following error occurred while executing this line:
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:271: The following error occurred while executing this line:
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:479: Check for forbidden API calls failed, see log.
>>
>> Total time: 62 minutes 42 seconds
>> Build step 'Invoke Ant' marked build as failure
>> Description set: Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
>> Archiving artifacts
>> Recording test results
>> Email was triggered for: Failure
>> Sending email for trigger: Failure
>>
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>
>
>
> --
> Regards,
> Shalin Shekhar Mangar.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
Re: [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0) - Build # 9935
- Still Failing!
Posted by Shalin Shekhar Mangar <sh...@gmail.com>.
I committed a fix.
On Sat, Mar 29, 2014 at 9:44 AM, Policeman Jenkins Server
<je...@thetaphi.de> wrote:
> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/9935/
> Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
>
> All tests passed
>
> Build Log:
> [...truncated 31699 lines...]
> -check-forbidden-all:
> [forbidden-apis] Reading bundled API signatures: jdk-unsafe-1.7
> [forbidden-apis] Reading bundled API signatures: jdk-deprecated-1.7
> [forbidden-apis] Reading bundled API signatures: commons-io-unsafe-2.1
> [forbidden-apis] Reading API signatures: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/tools/forbiddenApis/base.txt
> [forbidden-apis] Reading API signatures: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/tools/forbiddenApis/servlet-api.txt
> [forbidden-apis] Loading classes to check...
> [forbidden-apis] Scanning for API signatures and dependencies...
> [forbidden-apis] Forbidden method invocation: java.lang.String#format(java.lang.String,java.lang.Object[]) [Uses default locale]
> [forbidden-apis] in org.apache.solr.CursorPagingTest (CursorPagingTest.java:969)
> [forbidden-apis] Scanned 2139 (and 1380 related) class file(s) for forbidden API invocations (in 1.86s), 1 error(s).
>
> BUILD FAILED
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:70: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:271: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:479: Check for forbidden API calls failed, see log.
>
> Total time: 62 minutes 42 seconds
> Build step 'Invoke Ant' marked build as failure
> Description set: Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
--
Regards,
Shalin Shekhar Mangar.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0) - Build # 9935 -
Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/9935/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
All tests passed
Build Log:
[...truncated 31699 lines...]
-check-forbidden-all:
[forbidden-apis] Reading bundled API signatures: jdk-unsafe-1.7
[forbidden-apis] Reading bundled API signatures: jdk-deprecated-1.7
[forbidden-apis] Reading bundled API signatures: commons-io-unsafe-2.1
[forbidden-apis] Reading API signatures: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/tools/forbiddenApis/base.txt
[forbidden-apis] Reading API signatures: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/tools/forbiddenApis/servlet-api.txt
[forbidden-apis] Loading classes to check...
[forbidden-apis] Scanning for API signatures and dependencies...
[forbidden-apis] Forbidden method invocation: java.lang.String#format(java.lang.String,java.lang.Object[]) [Uses default locale]
[forbidden-apis] in org.apache.solr.CursorPagingTest (CursorPagingTest.java:969)
[forbidden-apis] Scanned 2139 (and 1380 related) class file(s) for forbidden API invocations (in 1.86s), 1 error(s).
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:70: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:271: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:479: Check for forbidden API calls failed, see log.
Total time: 62 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_60-ea-b10) -
Build # 9934 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/9934/
Java: 64bit/jdk1.7.0_60-ea-b10 -XX:+UseCompressedOops -XX:+UseSerialGC
All tests passed
Build Log:
[...truncated 31446 lines...]
-check-forbidden-all:
[forbidden-apis] Reading bundled API signatures: jdk-unsafe-1.7
[forbidden-apis] Reading bundled API signatures: jdk-deprecated-1.7
[forbidden-apis] Reading bundled API signatures: commons-io-unsafe-2.1
[forbidden-apis] Reading API signatures: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/tools/forbiddenApis/base.txt
[forbidden-apis] Reading API signatures: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/tools/forbiddenApis/servlet-api.txt
[forbidden-apis] Loading classes to check...
[forbidden-apis] Scanning for API signatures and dependencies...
[forbidden-apis] Forbidden method invocation: java.lang.String#format(java.lang.String,java.lang.Object[]) [Uses default locale]
[forbidden-apis] in org.apache.solr.CursorPagingTest (CursorPagingTest.java:969)
[forbidden-apis] Scanned 2139 (and 1378 related) class file(s) for forbidden API invocations (in 1.27s), 1 error(s).
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:70: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:271: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:479: Check for forbidden API calls failed, see log.
Total time: 62 minutes 56 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_60-ea-b10 -XX:+UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_51) - Build #
9933 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/9933/
Java: 32bit/jdk1.7.0_51 -client -XX:+UseSerialGC
1 tests failed.
FAILED: org.apache.solr.client.solrj.impl.CloudSolrServerTest.testDistribSearch
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([4A66C6D6F41337CD:CB8048CE834C57F1]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.client.solrj.impl.CloudSolrServerTest.doTest(CloudSolrServerTest.java:256)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at java.lang.Thread.run(Thread.java:744)
Build Log:
[...truncated 11653 lines...]
[junit4] Suite: org.apache.solr.client.solrj.impl.CloudSolrServerTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396047044767
[junit4] 2> 45427 T122 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
[junit4] 2> 45427 T122 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /b_jq/wk
[junit4] 2> 45429 T122 oasc.AbstractZkTestCase.<clinit> WARN TEST_HOME() does not exist - solrj test?
[junit4] 2> 45432 T122 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 45435 T122 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 45436 T123 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 45536 T122 oasc.ZkTestServer.run start zk server on port:50131
[junit4] 2> 45598 T122 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 45653 T129 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6bc2a1 name:ZooKeeperConnection Watcher:127.0.0.1:50131 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 45654 T122 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 45655 T122 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 45678 T122 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 45680 T124 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1450ae360d90000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 45683 T131 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12cbe03 name:ZooKeeperConnection Watcher:127.0.0.1:50131/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 45683 T122 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 45688 T122 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 45692 T122 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 45696 T122 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 45699 T122 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 45702 T122 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 45703 T122 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 45711 T122 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 45712 T122 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 45717 T122 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml because it doesn't exist
[junit4] 2> 45717 T122 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/stopwords.txt because it doesn't exist
[junit4] 2> 45718 T122 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/protwords.txt because it doesn't exist
[junit4] 2> 45718 T122 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/currency.xml because it doesn't exist
[junit4] 2> 45719 T122 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/enumsConfig.xml because it doesn't exist
[junit4] 2> 45719 T122 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/open-exchange-rates.json because it doesn't exist
[junit4] 2> 45720 T122 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/mapping-ISOLatin1Accent.txt because it doesn't exist
[junit4] 2> 45720 T122 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/old_synonyms.txt because it doesn't exist
[junit4] 2> 45721 T122 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/synonyms.txt because it doesn't exist
[junit4] 2> 45725 T122 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 45726 T124 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1450ae360d90001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 45728 T133 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10f739d name:ZooKeeperConnection Watcher:127.0.0.1:50131/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 45729 T122 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 45732 T124 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1450ae360d90002, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 45805 T122 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 45922 T122 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 45926 T122 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:33922
[junit4] 2> 45927 T122 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 45928 T122 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 45928 T122 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396047045075
[junit4] 2> 45929 T122 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396047045075/'
[junit4] 2> 45941 T122 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396047045075/solr.xml
[junit4] 2> 45998 T122 oasc.CoreContainer.<init> New CoreContainer 7367183
[junit4] 2> 45999 T122 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396047045075/]
[junit4] 2> 46001 T122 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 46001 T122 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 46001 T122 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 46001 T122 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 46002 T122 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 46002 T122 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 46002 T122 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 46003 T122 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 46003 T122 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 46006 T122 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 46007 T122 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 46007 T122 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 46008 T122 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50131/solr
[junit4] 2> 46017 T122 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 46018 T122 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 46020 T144 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a88f61 name:ZooKeeperConnection Watcher:127.0.0.1:50131 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 46020 T122 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 46026 T122 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 46027 T146 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6336bf name:ZooKeeperConnection Watcher:127.0.0.1:50131/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 46027 T122 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 46034 T122 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 46039 T122 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 46047 T122 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 46051 T122 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 46055 T122 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 46066 T122 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 46068 T122 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33922_b_jq%2Fwk
[junit4] 2> 46071 T122 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33922_b_jq%2Fwk
[junit4] 2> 46075 T122 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 46079 T122 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 46088 T122 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:33922_b_jq%2Fwk
[junit4] 2> 46088 T122 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 46091 T122 oasc.Overseer.start Overseer (id=91491339129651204-127.0.0.1:33922_b_jq%2Fwk-n_0000000000) starting
[junit4] 2> 46100 T122 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 46128 T148 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 46128 T122 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 46130 T148 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 46131 T122 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 46133 T122 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 46139 T147 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 46148 T149 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 46149 T149 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 46152 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 46152 T149 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 46156 T147 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 46158 T147 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:33922/b_jq/wk",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:33922_b_jq%2Fwk",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 46159 T147 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 46173 T147 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 46178 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 46185 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 47153 T149 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 47153 T149 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 47155 T149 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 47155 T149 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 47157 T149 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 47158 T149 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396047045075/collection1/'
[junit4] 2> 47207 T149 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 47258 T149 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 47259 T149 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 47268 T149 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 47333 T149 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableIntField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 47339 T149 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableLongField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 47346 T149 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableFloatField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 47352 T149 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableDoubleField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 47794 T149 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 47797 T149 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 47799 T149 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 47800 T149 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 47803 T149 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 47803 T149 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 47803 T149 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1396047045075/collection1/, dataDir=./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/control/data/
[junit4] 2> 47803 T149 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 47804 T149 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/control/data
[junit4] 2> 47804 T149 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/control/data/index/
[junit4] 2> 47804 T149 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 47805 T149 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/control/data/index
[junit4] 2> 47806 T149 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@87d0a5 lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 47806 T149 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 47808 T149 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 47808 T149 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 47808 T149 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 47808 T149 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 47809 T149 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 47809 T149 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 47809 T149 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 47810 T149 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 47812 T149 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 47816 T149 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 47816 T149 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 47817 T149 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@87d0a5 lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 47817 T149 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 47817 T149 oass.SolrIndexSearcher.<init> Opening Searcher@5cd73c[collection1] main
[junit4] 2> 47818 T149 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 47819 T149 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 47820 T149 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 47823 T149 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 47824 T149 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 47824 T149 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 47825 T149 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 47825 T149 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 47825 T149 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 47826 T149 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 47827 T150 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5cd73c[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 47827 T149 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 47828 T153 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:33922/b_jq/wk collection:control_collection shard:shard1
[junit4] 2> 47828 T122 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 47829 T122 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 47835 T153 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 47837 T122 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 47840 T155 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@dbfc51 name:ZooKeeperConnection Watcher:127.0.0.1:50131/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 47840 T122 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 47842 T122 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 47845 T153 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 47847 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 47847 T122 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 47847 T153 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 47848 T153 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 47848 T147 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C80 name=collection1 org.apache.solr.core.SolrCore@40363c url=https://127.0.0.1:33922/b_jq/wk/collection1 node=127.0.0.1:33922_b_jq%2Fwk C80_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:33922/b_jq/wk, core=collection1, node_name=127.0.0.1:33922_b_jq%2Fwk}
[junit4] 2> 47849 T153 C80 P33922 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:33922/b_jq/wk/collection1/
[junit4] 2> 47849 T153 C80 P33922 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 47850 T153 C80 P33922 oasc.SyncStrategy.syncToMe https://127.0.0.1:33922/b_jq/wk/collection1/ has no replicas
[junit4] 2> 47850 T153 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:33922/b_jq/wk/collection1/ shard1
[junit4] 2> 47852 T153 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 47855 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 47857 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 47857 T155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 47867 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 47869 T147 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 47871 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 47906 T122 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 47913 T122 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 47917 T122 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 47919 T122 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:41897
[junit4] 2> 47921 T122 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 47922 T122 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 47922 T122 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396047047189
[junit4] 2> 47923 T122 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396047047189/'
[junit4] 2> 47936 T122 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396047047189/solr.xml
[junit4] 2> 47973 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 47973 T155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 47998 T122 oasc.CoreContainer.<init> New CoreContainer 11907902
[junit4] 2> 47999 T122 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396047047189/]
[junit4] 2> 48000 T122 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 48000 T122 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 48001 T122 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 48001 T122 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 48001 T122 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 48002 T122 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 48002 T122 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 48002 T122 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 48002 T122 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 48005 T122 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 48005 T122 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 48006 T122 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 48006 T122 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50131/solr
[junit4] 2> 48007 T122 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 48008 T122 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 48010 T166 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@768c93 name:ZooKeeperConnection Watcher:127.0.0.1:50131 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 48010 T122 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 48014 T122 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 48015 T168 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19de19a name:ZooKeeperConnection Watcher:127.0.0.1:50131/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 48015 T122 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 48018 T153 oasc.ZkController.register We are https://127.0.0.1:33922/b_jq/wk/collection1/ and leader is https://127.0.0.1:33922/b_jq/wk/collection1/
[junit4] 2> 48018 T153 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:33922/b_jq/wk
[junit4] 2> 48018 T153 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 48019 T153 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 48019 T153 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 48021 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 48021 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 48021 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 48022 T153 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 48023 T147 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 48024 T147 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:33922/b_jq/wk",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:33922_b_jq%2Fwk",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 48027 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 48028 T122 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 48134 T168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 48134 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 48134 T155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 49031 T122 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41897_b_jq%2Fwk
[junit4] 2> 49033 T122 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41897_b_jq%2Fwk
[junit4] 2> 49038 T146 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 49038 T155 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 49039 T168 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 49056 T169 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 49056 T169 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 49058 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 49058 T169 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 49058 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 49059 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 49062 T147 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 49063 T147 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:41897/b_jq/wk",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:41897_b_jq%2Fwk",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 49063 T147 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 49064 T147 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 49069 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 49172 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 49172 T168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 49172 T155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 50059 T169 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 50059 T169 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 50061 T169 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 50061 T169 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 50063 T169 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 50063 T169 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396047047189/collection1/'
[junit4] 2> 50144 T169 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 50220 T169 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 50222 T169 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 50230 T169 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 50678 T169 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 50682 T169 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 50684 T169 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 50685 T169 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 50685 T169 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 50685 T169 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 50686 T169 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1396047047189/collection1/, dataDir=./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/jetty1/
[junit4] 2> 50686 T169 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 50687 T169 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/jetty1
[junit4] 2> 50687 T169 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/jetty1/index/
[junit4] 2> 50688 T169 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 50688 T169 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/jetty1/index
[junit4] 2> 50689 T169 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@14dc4dc lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 50690 T169 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 50691 T169 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 50691 T169 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 50692 T169 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 50692 T169 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 50692 T169 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 50693 T169 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 50693 T169 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 50693 T169 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 50696 T169 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 50701 T169 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 50701 T169 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 50702 T169 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@14dc4dc lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 50703 T169 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 50704 T169 oass.SolrIndexSearcher.<init> Opening Searcher@a775ed[collection1] main
[junit4] 2> 50704 T169 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 50705 T169 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 50705 T169 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 50707 T169 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 50707 T169 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 50707 T169 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 50709 T169 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 50709 T169 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 50710 T169 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 50710 T169 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 50713 T170 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@a775ed[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 50713 T169 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 50715 T173 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:41897/b_jq/wk collection:collection1 shard:shard2
[junit4] 2> 50716 T122 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 50716 T122 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 50717 T173 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 50729 T173 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 50733 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 50734 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 50734 T173 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 50734 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 50735 T173 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C81 name=collection1 org.apache.solr.core.SolrCore@79c31b url=https://127.0.0.1:41897/b_jq/wk/collection1 node=127.0.0.1:41897_b_jq%2Fwk C81_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:41897/b_jq/wk, core=collection1, node_name=127.0.0.1:41897_b_jq%2Fwk}
[junit4] 2> 50736 T173 C81 P41897 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:41897/b_jq/wk/collection1/
[junit4] 2> 50736 T147 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 50737 T173 C81 P41897 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 50737 T173 C81 P41897 oasc.SyncStrategy.syncToMe https://127.0.0.1:41897/b_jq/wk/collection1/ has no replicas
[junit4] 2> 50738 T173 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:41897/b_jq/wk/collection1/ shard2
[junit4] 2> 50738 T173 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 50743 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 50745 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 50745 T168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 50745 T155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 50757 T147 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 50763 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 50809 T122 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 50810 T122 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 50822 T122 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 50825 T122 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:49592
[junit4] 2> 50829 T122 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 50830 T122 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 50831 T122 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396047050062
[junit4] 2> 50831 T122 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396047050062/'
[junit4] 2> 50849 T122 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396047050062/solr.xml
[junit4] 2> 50870 T155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 50870 T168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 50870 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 50906 T173 oasc.ZkController.register We are https://127.0.0.1:41897/b_jq/wk/collection1/ and leader is https://127.0.0.1:41897/b_jq/wk/collection1/
[junit4] 2> 50907 T173 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:41897/b_jq/wk
[junit4] 2> 50907 T173 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 50907 T173 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 50907 T173 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 50908 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 50909 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 50909 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 50909 T173 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 50911 T147 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 50912 T147 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:41897/b_jq/wk",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:41897_b_jq%2Fwk",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 50914 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 50915 T122 oasc.CoreContainer.<init> New CoreContainer 31470206
[junit4] 2> 50916 T122 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396047050062/]
[junit4] 2> 50917 T122 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 50917 T122 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 50917 T122 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 50918 T122 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 50918 T122 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 50918 T122 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 50919 T122 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 50919 T122 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 50919 T122 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 50922 T122 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 50922 T122 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 50922 T122 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 50923 T122 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50131/solr
[junit4] 2> 50923 T122 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 50924 T122 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 50925 T184 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e6ac14 name:ZooKeeperConnection Watcher:127.0.0.1:50131 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 50925 T122 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 50933 T122 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 50937 T186 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bb373c name:ZooKeeperConnection Watcher:127.0.0.1:50131/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 50937 T122 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 50945 T122 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 51018 T155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 51018 T168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 51018 T186 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 51018 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 51951 T122 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49592_b_jq%2Fwk
[junit4] 2> 51952 T122 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49592_b_jq%2Fwk
[junit4] 2> 51955 T168 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 51955 T186 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 51955 T146 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 51955 T155 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 51964 T187 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 51964 T187 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 51965 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 51965 T187 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 51965 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 51965 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 51966 T147 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 51967 T147 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:49592/b_jq/wk",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:49592_b_jq%2Fwk",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 51967 T147 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 51967 T147 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 51969 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 52071 T168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 52072 T186 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 52072 T155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 52071 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 52965 T187 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 52966 T187 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 52966 T187 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 52967 T187 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 52968 T187 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 52968 T187 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396047050062/collection1/'
[junit4] 2> 53009 T187 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 53061 T187 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 53062 T187 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 53072 T187 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 53622 T187 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 53624 T187 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 53626 T187 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 53627 T187 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 53627 T187 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 53628 T187 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 53628 T187 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1396047050062/collection1/, dataDir=./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/jetty2/
[junit4] 2> 53628 T187 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 53629 T187 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/jetty2
[junit4] 2> 53629 T187 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/jetty2/index/
[junit4] 2> 53629 T187 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 53630 T187 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/jetty2/index
[junit4] 2> 53631 T187 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@206c9a lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 53632 T187 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 53633 T187 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 53633 T187 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 53633 T187 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 53633 T187 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 53634 T187 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 53634 T187 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 53634 T187 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 53635 T187 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 53637 T187 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 53639 T187 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 53640 T187 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 53641 T187 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@206c9a lockFactory=NativeFSLockFactory@./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 53641 T187 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 53641 T187 oass.SolrIndexSearcher.<init> Opening Searcher@ece2f6[collection1] main
[junit4] 2> 53641 T187 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 53642 T187 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 53643 T187 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 53643 T187 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 53643 T187 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 53643 T187 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 53644 T187 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 53645 T187 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 53645 T187 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 53645 T187 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 53646 T188 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ece2f6[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 53646 T187 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 53647 T191 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:49592/b_jq/wk collection:collection1 shard:shard1
[junit4] 2> 53647 T122 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 53647 T122 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 53648 T191 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 53657 T191 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 53658 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 53659 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 53659 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 53660 T147 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 53660 T191 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 53660 T191 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C82 name=collection1 org.apache.solr.core.SolrCore@1d1b746 url=https://127.0.0.1:49592/b_jq/wk/collection1 node=127.0.0.1:49592_b_jq%2Fwk C82_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:49592/b_jq/wk, core=collection1, node_name=127.0.0.1:49592_b_jq%2Fwk}
[junit4] 2> 53661 T191 C82 P49592 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:49592/b_jq/wk/collection1/
[junit4] 2> 53661 T191 C82 P49592 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 53662 T191 C82 P49592 oasc.SyncStrategy.syncToMe https://127.0.0.1:49592/b_jq/wk/collection1/ has no replicas
[junit4] 2> 53662 T191 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:49592/b_jq/wk/collection1/ shard1
[junit4] 2> 53663 T191 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 53663 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 53664 T168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 53664 T186 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 53664 T155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 53664 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 53673 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 53675 T147 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 53678 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 53709 T122 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 53710 T122 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 53716 T122 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 53719 T122 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:55805
[junit4] 2> 53721 T122 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 53721 T122 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 53722 T122 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1396047052991
[junit4] 2> 53722 T122 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1396047052991/'
[junit4] 2> 53742 T122 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1396047052991/solr.xml
[junit4] 2> 53783 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 53783 T186 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 53783 T168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 53783 T155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 53799 T122 oasc.CoreContainer.<init> New CoreContainer 31486053
[junit4] 2> 53800 T122 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1396047052991/]
[junit4] 2> 53802 T122 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 53802 T122 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 53802 T122 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 53803 T122 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 53803 T122 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 53803 T122 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 53804 T122 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 53804 T122 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 53804 T122 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 53807 T122 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 53808 T122 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 53808 T122 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 53809 T122 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50131/solr
[junit4] 2> 53809 T122 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 53810 T122 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 53811 T202 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@94d8a5 name:ZooKeeperConnection Watcher:127.0.0.1:50131 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 53812 T122 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 53814 T122 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 53815 T204 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d4bfee name:ZooKeeperConnection Watcher:127.0.0.1:50131/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 53815 T122 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 53820 T122 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 53829 T191 oasc.ZkController.register We are https://127.0.0.1:49592/b_jq/wk/collection1/ and leader is https://127.0.0.1:49592/b_jq/wk/collection1/
[junit4] 2> 53829 T191 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:49592/b_jq/wk
[junit4] 2> 53829 T191 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 53829 T191 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 53829 T191 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 53831 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 53831 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 53832 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 53832 T191 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 53834 T147 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 53834 T147 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:49592/b_jq/wk",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:49592_b_jq%2Fwk",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 53837 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 53939 T168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 53939 T155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 53939 T186 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 53939 T204 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 53939 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 54823 T122 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55805_b_jq%2Fwk
[junit4] 2> 54824 T122 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55805_b_jq%2Fwk
[junit4] 2> 54826 T168 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 54827 T146 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 54826 T204 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 54827 T186 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 54827 T155 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 54834 T205 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 54834 T205 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 54836 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 54836 T205 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 54836 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 54836 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 54837 T147 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 54838 T147 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:55805/b_jq/wk",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55805_b_jq%2Fwk",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 54838 T147 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 54838 T147 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 54840 T146 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 54942 T204 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 54942 T146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 54942 T186 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 54942 T155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 54942 T168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 55836 T205 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 55837 T205 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 55837 T205 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 55838 T205 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 55838 T205 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 55839 T205 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1396047052991/collection1/'
[junit4] 2> 55879 T205 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 55927 T205 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 55928 T205 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 55938 T205 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 56359 T205 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 56362 T205 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 56366 T205 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 56367 T205 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 56367 T205 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 56368 T205 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 56368 T205 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1396047052991/collection1/, dataDir=./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/jetty3/
[junit4] 2> 56368 T205 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 56369 T205 oasc.CachingDirectoryFactory.get return new directory for ./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/jetty3
[junit4] 2> 56369 T205 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/jetty3/index/
[junit4] 2> 56369 T205 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solrtest-CloudSolrServerTest-1396047044767/org.apache.solr.client.solrj.impl.CloudSolrServerTest-1396047044774/jetty3/index' doesn't exist. Creating ne
[...truncated too long message...]
lr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CloudSolrServerTest -Dtests.method=testDistribSearch -Dtests.seed=4A66C6D6F41337CD -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ja -Dtests.timezone=Europe/Belfast -Dtests.file.encoding=UTF-8
[junit4] FAILURE 24.6s J0 | CloudSolrServerTest.testDistribSearch <<<
[junit4] > Throwable #1: java.lang.AssertionError
[junit4] > at __randomizedtesting.SeedInfo.seed([4A66C6D6F41337CD:CB8048CE834C57F1]:0)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServerTest.doTest(CloudSolrServerTest.java:256)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
[junit4] > at java.lang.Thread.run(Thread.java:744)
[junit4] 2> 70027 T122 oas.SolrTestCaseJ4.setUp ###Starting testShutdown
[junit4] 2> 70028 T122 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 70028 T227 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 70128 T122 oasc.ZkTestServer.run start zk server on port:52135
[junit4] 2> 70130 T122 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 70133 T233 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@116d383 name:ZooKeeperConnection Watcher:127.0.0.1:52135 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 70134 T122 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 70135 T122 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 70140 T122 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 70142 T235 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14cdeaf name:ZooKeeperConnection Watcher:127.0.0.1:52135/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 70143 T122 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 70143 T122 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 70148 T122 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 70153 T122 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 70156 T122 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 70162 T122 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 70164 T122 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 70170 T122 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 70171 T122 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 70175 T122 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml because it doesn't exist
[junit4] 2> 70176 T122 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/stopwords.txt because it doesn't exist
[junit4] 2> 70177 T122 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/protwords.txt because it doesn't exist
[junit4] 2> 70177 T122 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/currency.xml because it doesn't exist
[junit4] 2> 70178 T122 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/enumsConfig.xml because it doesn't exist
[junit4] 2> 70179 T122 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/open-exchange-rates.json because it doesn't exist
[junit4] 2> 70179 T122 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/mapping-ISOLatin1Accent.txt because it doesn't exist
[junit4] 2> 70180 T122 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/old_synonyms.txt because it doesn't exist
[junit4] 2> 70181 T122 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/synonyms.txt because it doesn't exist
[junit4] 2> 70184 T122 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 70186 T237 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c7f191 name:ZooKeeperConnection Watcher:127.0.0.1:52135/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 70186 T122 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 70193 T122 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 70195 T238 oaz.ClientCnxnSocketNIO.connect ERROR Unable to open socket to ff01::114/ff01:0:0:0:0:0:0:114:33332
[junit4] 2> 70196 T238 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.SocketException: Network is unreachable
[junit4] 2> at sun.nio.ch.Net.connect0(Native Method)
[junit4] 2> at sun.nio.ch.Net.connect(Net.java:465)
[junit4] 2> at sun.nio.ch.Net.connect(Net.java:457)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:277)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:287)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:967)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
[junit4] 2>
[junit4] 2> 71299 T238 oaz.ClientCnxnSocketNIO.connect ERROR Unable to open socket to ff01::114/ff01:0:0:0:0:0:0:114:33332
[junit4] 2> 71401 T122 oas.SolrTestCaseJ4.tearDown ###Ending testShutdown
[junit4] 2> 71402 T122 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:52135 52135
[junit4] 2> 76662 T227 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:52135 52135
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 76664 T122 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: test params are: codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=460), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=460)), sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=ja, timezone=Europe/Belfast
[junit4] 2> NOTE: Linux 3.8.0-37-generic i386/Oracle Corporation 1.7.0_51 (32-bit)/cpus=8,threads=1,free=13200392,total=49631232
[junit4] 2> NOTE: All tests run in this JVM: [ClientUtilsTest, TestUpdateRequestCodec, TestCoreAdmin, TestEmbeddedSolrServer, SolrExampleStreamingBinaryTest, SolrExampleXMLTest, SolrExampleEmbeddedTest, SolrExceptionTest, TestDocumentObjectBinder, SolrParamTest, CloudSolrServerTest]
[junit4] Completed on J0 in 31.36s, 2 tests, 1 failure <<< FAILURES!
[...truncated 85 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:202: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:490: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1275: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:907: There were test failures: 49 suites, 284 tests, 1 failure
Total time: 62 minutes 45 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_51 -client -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_51) - Build #
9932 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/9932/
Java: 64bit/jdk1.7.0_51 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC -XX:-UseSuperWord
1 tests failed.
REGRESSION: org.apache.solr.cloud.OverseerTest.testOverseerFailure
Error Message:
Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
Stack Trace:
org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
at __randomizedtesting.SeedInfo.seed([8426D92F86851DF5:802E56DC9420F2D4]:0)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:135)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:156)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:289)
at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:156)
at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:667)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:431)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:428)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:385)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:372)
at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:127)
at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:31)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:122)
... 45 more
Build Log:
[...truncated 10513 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-OverseerTest-1396038069080
[junit4] 2> 681481 T2318 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
[junit4] 2> 681482 T2318 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 681482 T2318 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 681485 T2318 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignmentBigger
[junit4] 2> 681485 T2318 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 681486 T2319 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 681586 T2318 oasc.ZkTestServer.run start zk server on port:53731
[junit4] 2> 681587 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684414 T2322 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 2825ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 684416 T2325 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fd24271 name:ZooKeeperConnection Watcher:127.0.0.1:53731 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684417 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684421 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684423 T2327 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5f7520b1 name:ZooKeeperConnection Watcher:127.0.0.1:53731 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684423 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684424 T2318 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 684431 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684433 T2329 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4ede6216 name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684433 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684434 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 684437 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684439 T2331 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2caaf6f6 name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684440 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684441 T2318 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 684444 T2318 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 684450 T2318 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:53731_solr
[junit4] 2> 684450 T2318 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 684453 T2318 oasc.Overseer.start Overseer (id=91490750895685635-127.0.0.1:53731_solr-n_0000000000) starting
[junit4] 2> 684457 T2318 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 684461 T2318 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 684466 T2318 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 684470 T2318 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 684474 T2318 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 684480 T2318 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 684488 T2333 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 684488 T2318 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 684489 T2333 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 684489 T2332 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 684493 T2318 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 684495 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684500 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684502 T2335 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2f4387e5 name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684502 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684504 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684506 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node0
[junit4] 2> 684509 T2329 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 684509 T2335 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 684510 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684511 T2337 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6ff3b5af name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684511 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684512 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684514 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 684517 T2329 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 684517 T2337 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 684518 T2335 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 684518 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684520 T2339 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3745ed1d name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684520 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684521 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684523 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 684524 T2337 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 684525 T2335 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 684525 T2329 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 684526 T2339 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 684526 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684527 T2341 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7860cf08 name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684527 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684528 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684530 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node3
[junit4] 2> 684532 T2339 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 684532 T2335 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 684532 T2329 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 684532 T2337 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 684532 T2341 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 684532 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684534 T2343 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@121c0401 name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684534 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684537 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684538 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node4
[junit4] 2> 684540 T2337 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 684541 T2329 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 684541 T2339 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 684541 T2341 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 684541 T2335 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 684541 T2343 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 684541 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684543 T2345 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2934aac1 name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684543 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684544 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684545 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node5
[junit4] 2> 684547 T2341 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 684547 T2337 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 684548 T2335 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 684548 T2339 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 684548 T2345 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 684548 T2343 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 684548 T2329 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 684548 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684550 T2347 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13ab740d name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684550 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684551 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684552 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node6
[junit4] 2> 684554 T2337 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 684554 T2341 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 684554 T2343 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 684555 T2329 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 684555 T2345 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 684555 T2339 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 684554 T2335 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 684555 T2347 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 684556 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684556 T2349 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a504270 name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684557 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684558 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684559 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node7
[junit4] 2> 684561 T2337 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 684561 T2335 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 684561 T2347 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 684562 T2349 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 684561 T2345 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 684561 T2329 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 684561 T2341 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 684562 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684562 T2343 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 684562 T2339 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 684563 T2351 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7b76508c name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684564 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684565 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684566 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node8
[junit4] 2> 684568 T2337 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 684569 T2343 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 684569 T2341 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 684568 T2345 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 684569 T2347 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 684569 T2329 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 684569 T2351 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 684569 T2335 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 684569 T2339 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 684569 T2349 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 684570 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684571 T2353 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@429bfb8e name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684571 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684572 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684574 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node9
[junit4] 2> 684576 T2347 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 684576 T2329 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 684576 T2353 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 684576 T2343 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 684576 T2335 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 684577 T2341 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 684577 T2337 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 684576 T2339 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 684577 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684577 T2349 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 684577 T2351 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 684577 T2345 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 684578 T2355 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b341cc4 name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684579 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684579 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684581 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node10
[junit4] 2> 684583 T2343 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 684583 T2347 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 684583 T2339 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 684583 T2355 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 684583 T2353 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 684583 T2349 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 684583 T2341 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 684583 T2337 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 684583 T2345 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 684584 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684583 T2351 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 684583 T2329 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 684583 T2335 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 684586 T2357 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7182fc16 name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684586 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684587 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684588 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node11
[junit4] 2> 684590 T2349 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 684590 T2353 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 684590 T2343 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 684590 T2351 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 684591 T2335 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 684591 T2357 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 684591 T2329 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 684591 T2347 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 684590 T2337 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 684591 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684591 T2341 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 684591 T2345 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 684591 T2355 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 684591 T2339 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 684593 T2359 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@787dfecf name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684593 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684593 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684595 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node12
[junit4] 2> 684599 T2357 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 684601 T2343 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 684601 T2353 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 684601 T2347 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 684601 T2345 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 684601 T2351 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 684601 T2337 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 684602 T2329 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 684602 T2355 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 684602 T2335 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 684602 T2339 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 684602 T2341 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 684602 T2349 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 684602 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684602 T2359 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 684604 T2361 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@67b470ff name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684604 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684605 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684607 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node13
[junit4] 2> 684610 T2337 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 684610 T2341 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 684610 T2351 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 684610 T2359 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 684610 T2329 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 684610 T2361 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 684610 T2353 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 684610 T2343 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 684610 T2345 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 684611 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684610 T2355 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 684610 T2349 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 684610 T2339 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 684610 T2357 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 684610 T2335 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 684612 T2347 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 684612 T2363 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@151fbc0b name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684613 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684613 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684615 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node14
[junit4] 2> 684617 T2335 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 684617 T2353 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 684617 T2359 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 684617 T2363 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 684618 T2347 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 684618 T2329 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 684618 T2355 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 684618 T2349 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 684618 T2345 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 684618 T2341 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 684618 T2361 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 684618 T2337 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 684618 T2339 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 684618 T2351 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 684618 T2343 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 684619 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684618 T2357 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 684620 T2365 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d405fa6 name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684620 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684621 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684623 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node15
[junit4] 2> 684625 T2337 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 684625 T2343 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 684625 T2329 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 684625 T2341 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 684625 T2347 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 684626 T2345 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 684625 T2357 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 684626 T2355 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 684626 T2349 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 684626 T2365 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 684626 T2361 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 684626 T2359 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 684626 T2363 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 684626 T2351 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 684626 T2353 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 684625 T2335 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 684625 T2339 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 684626 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684628 T2367 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16d75f5 name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684628 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684628 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684630 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node16
[junit4] 2> 684632 T2347 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 684632 T2355 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 684632 T2341 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 684632 T2339 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 684633 T2329 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 684633 T2365 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 684633 T2359 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 684633 T2361 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 684632 T2335 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 684633 T2345 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 684633 T2363 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 684633 T2337 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 684633 T2367 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 684632 T2353 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 684632 T2351 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 684632 T2349 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 684632 T2343 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 684632 T2357 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 684633 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684635 T2369 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7df35bc8 name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684635 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684636 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684638 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node17
[junit4] 2> 684640 T2337 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 684640 T2369 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 684641 T2349 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 684641 T2361 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 684641 T2343 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 684641 T2363 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 684641 T2353 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 684641 T2351 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 684640 T2341 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 684640 T2345 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 684642 T2329 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 684641 T2347 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 684641 T2359 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 684641 T2355 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 684641 T2335 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 684641 T2367 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 684641 T2339 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 684641 T2365 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 684641 T2357 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 684649 T2371 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5115bca8 name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684647 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684649 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684651 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684654 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node18
[junit4] 2> 684658 T2329 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 684658 T2343 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 684658 T2335 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 684658 T2359 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 684658 T2357 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 684658 T2339 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 684659 T2345 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 684658 T2347 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 684659 T2341 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 684659 T2337 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 684659 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684658 T2353 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 684658 T2355 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 684659 T2369 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 684659 T2351 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 684659 T2361 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 684659 T2349 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 684659 T2365 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 684658 T2363 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 684660 T2373 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6882561c name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684658 T2371 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 684658 T2367 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 684661 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684662 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684664 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node19
[junit4] 2> 684667 T2355 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 684667 T2339 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 684667 T2329 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 684668 T2343 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 684668 T2365 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 684668 T2367 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 684668 T2373 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 684668 T2361 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 684668 T2369 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 684668 T2337 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 684668 T2347 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 684668 T2371 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 684669 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684668 T2353 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 684668 T2359 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 684667 T2363 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 684667 T2335 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 684667 T2357 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 684668 T2345 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 684668 T2349 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 684668 T2341 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 684668 T2351 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 684671 T2375 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@858fc77 name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684672 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684673 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684676 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node20
[junit4] 2> 684681 T2341 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 684683 T2345 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 684683 T2339 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 684684 T2343 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 684684 T2329 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 684683 T2349 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 684684 T2355 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 684685 T2351 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 684685 T2353 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 684685 T2369 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 684685 T2347 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 684686 T2373 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 684686 T2367 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 684687 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684689 T2377 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43a28c46 name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684685 T2357 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 684685 T2359 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 684685 T2361 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 684685 T2365 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 684689 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684686 T2371 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 684686 T2363 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 684691 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684686 T2375 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 684686 T2337 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 684686 T2335 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 684693 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node21
[junit4] 2> 684697 T2355 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 684697 T2347 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 684697 T2353 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 684697 T2335 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 684698 T2375 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 684697 T2371 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 684699 T2345 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 684697 T2329 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 684699 T2377 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 684699 T2351 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 684699 T2341 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 684699 T2361 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 684698 T2369 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 684698 T2337 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 684698 T2349 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 684698 T2365 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 684698 T2339 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 684698 T2357 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 684698 T2363 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 684698 T2343 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 684698 T2367 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 684697 T2359 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 684697 T2373 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 684701 T2379 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b5e5184 name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684700 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684704 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684705 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684706 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node22
[junit4] 2> 684710 T2377 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684710 T2341 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684710 T2379 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684710 T2351 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684711 T2339 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684711 T2347 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684711 T2373 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684711 T2365 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684711 T2355 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684711 T2335 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684711 T2369 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684710 T2359 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684710 T2353 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684712 T2343 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684712 T2361 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684712 T2375 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684712 T2363 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684711 T2367 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684711 T2357 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684711 T2345 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684711 T2329 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684711 T2371 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684711 T2337 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684714 T2381 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4365903e name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684711 T2349 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 684712 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684714 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684715 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684716 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node23
[junit4] 2> 684719 T2371 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684719 T2367 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684719 T2335 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684719 T2357 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684719 T2361 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684719 T2355 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684719 T2373 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684720 T2329 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684720 T2359 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684720 T2347 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684720 T2381 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684720 T2337 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684719 T2377 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684719 T2379 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684719 T2345 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684719 T2353 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684719 T2343 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684719 T2341 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684721 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684721 T2375 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684720 T2351 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684720 T2339 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684720 T2363 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684720 T2369 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684722 T2383 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2f1f3bd5 name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684720 T2349 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684720 T2365 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 684722 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684723 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684725 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node24
[junit4] 2> 684727 T2357 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684727 T2335 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684727 T2371 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684727 T2373 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684728 T2363 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684728 T2369 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684728 T2347 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684728 T2339 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684728 T2329 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684729 T2343 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684729 T2381 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684729 T2355 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684728 T2365 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684728 T2361 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684729 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684728 T2341 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684729 T2337 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684729 T2383 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684729 T2375 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684728 T2351 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684728 T2359 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684728 T2379 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684728 T2353 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684728 T2349 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684728 T2377 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684728 T2367 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684728 T2345 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 684731 T2385 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17244eb name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684731 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684734 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684737 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node25
[junit4] 2> 684739 T2345 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684739 T2357 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684739 T2335 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684739 T2349 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684740 T2365 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684740 T2373 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684740 T2369 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684740 T2383 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684739 T2377 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684740 T2375 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684739 T2341 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684739 T2361 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684741 T2343 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684741 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684741 T2371 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684740 T2381 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684740 T2359 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684740 T2339 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684740 T2385 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684740 T2347 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684740 T2329 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684740 T2355 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684740 T2363 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684740 T2337 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684740 T2351 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684739 T2353 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684739 T2367 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684739 T2379 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 684742 T2387 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c847347 name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684743 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684743 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684745 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node26
[junit4] 2> 684747 T2385 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684747 T2363 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684747 T2365 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684747 T2383 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684747 T2351 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684747 T2347 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684747 T2359 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684748 T2367 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684748 T2379 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684748 T2353 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684748 T2377 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684749 T2343 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684748 T2373 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684748 T2355 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684748 T2371 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684749 T2341 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684749 T2387 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684748 T2339 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684748 T2329 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684748 T2335 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684748 T2349 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684748 T2369 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684748 T2337 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684750 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684749 T2361 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684749 T2375 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684749 T2357 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684749 T2381 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684749 T2345 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 684751 T2389 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d20570c name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684751 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684752 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684753 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node27
[junit4] 2> 684756 T2369 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684756 T2339 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684756 T2359 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684756 T2385 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684756 T2365 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684757 T2363 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684757 T2361 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684757 T2367 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684757 T2335 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684756 T2377 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684756 T2329 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684756 T2383 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684757 T2381 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684758 T2379 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684756 T2351 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684756 T2347 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684756 T2349 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684756 T2337 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684758 T2345 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684758 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684759 T2391 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@511654ba name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684758 T2389 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684757 T2343 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684757 T2375 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684757 T2373 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684757 T2371 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684757 T2353 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684757 T2357 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684757 T2387 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684757 T2341 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684757 T2355 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 684759 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684761 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684763 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node28
[junit4] 2> 684765 T2351 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684765 T2339 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684766 T2383 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684766 T2377 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684766 T2363 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684766 T2347 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684766 T2365 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684767 T2353 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684767 T2389 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684767 T2381 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684767 T2343 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684767 T2361 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684766 T2385 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684767 T2379 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684767 T2387 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684768 T2357 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684766 T2369 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684766 T2337 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684765 T2349 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684768 T2391 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684767 T2359 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684767 T2367 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684767 T2373 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684767 T2335 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684767 T2355 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684767 T2371 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684766 T2375 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684766 T2345 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684766 T2341 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684766 T2329 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 684769 T2393 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68a59b60 name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684768 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684770 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684771 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684772 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node29
[junit4] 2> 684775 T2355 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684775 T2353 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684775 T2367 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684776 T2357 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684776 T2389 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684776 T2381 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684776 T2341 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684776 T2361 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684776 T2377 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684776 T2343 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684775 T2373 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684777 T2339 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684775 T2371 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684777 T2369 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684777 T2365 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684777 T2351 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684777 T2375 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684777 T2359 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684777 T2385 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684777 T2393 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684777 T2363 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684776 T2347 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684776 T2383 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684776 T2379 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684776 T2329 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684776 T2391 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684776 T2345 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684776 T2335 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684776 T2387 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684779 T2395 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@58f71fb2 name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684778 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684777 T2337 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684777 T2349 oascc.ZkStateReader$3.process Updating live nodes... (30)
[junit4] 2> 684780 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684780 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684782 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node30
[junit4] 2> 684786 T2349 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684786 T2369 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684786 T2339 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684786 T2385 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684786 T2351 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684786 T2363 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684787 T2387 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684787 T2371 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684786 T2377 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684787 T2379 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684787 T2381 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684786 T2365 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684786 T2347 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684788 T2367 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684788 T2343 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684786 T2329 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684786 T2391 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684789 T2353 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684786 T2383 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684786 T2359 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684786 T2337 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684788 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684788 T2395 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684788 T2357 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684788 T2373 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684788 T2393 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684787 T2335 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684787 T2345 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684787 T2355 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684787 T2389 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684787 T2341 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684787 T2375 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684786 T2361 oascc.ZkStateReader$3.process Updating live nodes... (31)
[junit4] 2> 684794 T2397 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7af6d05a name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684795 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684796 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684797 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node31
[junit4] 2> 684801 T2385 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684801 T2347 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684801 T2359 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684802 T2365 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684802 T2375 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684802 T2351 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684802 T2349 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684801 T2383 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684801 T2391 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684802 T2369 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684802 T2373 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684802 T2337 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684802 T2335 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684802 T2339 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684803 T2387 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684802 T2393 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684803 T2389 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684802 T2363 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684804 T2361 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684802 T2329 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684804 T2379 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684804 T2397 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684804 T2381 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684804 T2341 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684803 T2343 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684803 T2345 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684805 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684803 T2353 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684803 T2367 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684803 T2377 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684803 T2357 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684803 T2371 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684803 T2355 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684805 T2395 oascc.ZkStateReader$3.process Updating live nodes... (32)
[junit4] 2> 684807 T2399 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5f255635 name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684807 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684808 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684809 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node32
[junit4] 2> 684814 T2377 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684814 T2379 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684814 T2397 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684814 T2395 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684814 T2361 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684814 T2381 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684815 T2355 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684814 T2345 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684815 T2371 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684815 T2373 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684815 T2353 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684816 T2357 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684815 T2341 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684816 T2389 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684816 T2367 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684816 T2337 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684816 T2387 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684816 T2343 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684816 T2369 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684817 T2391 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684816 T2349 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684817 T2399 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684817 T2385 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684818 T2335 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684818 T2363 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684818 T2347 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684818 T2329 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684818 T2375 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684818 T2393 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684819 T2351 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684818 T2383 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684818 T2365 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684819 T2359 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684819 T2339 oascc.ZkStateReader$3.process Updating live nodes... (33)
[junit4] 2> 684819 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684820 T2401 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b65be50 name:ZooKeeperConnection Watcher:127.0.0.1:53731/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 684821 T2318 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 684821 T2318 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 684823 T2318 oascc.SolrZkClient.makePath makePath: /live_nodes/node33
[junit4] 2> 684827 T2357 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684827 T2371 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684827 T2355 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684827 T2389 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684827 T2387 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684827 T2395 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684827 T2343 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684828 T2345 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684827 T2373 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684828 T2365 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684828 T2397 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684828 T2381 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684829 T2363 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684829 T2329 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684828 T2393 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684828 T2377 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684828 T2379 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684829 T2337 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684829 T2351 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684828 T2341 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684828 T2353 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684828 T2361 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684827 T2335 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684827 T2367 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684830 T2318 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 684830 T2401 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684830 T2349 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684829 T2339 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684829 T2359 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684829 T2399 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684829 T2369 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684829 T2385 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684829 T2347 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684829 T2391 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684828 T2383 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684828 T2375 oascc.ZkStateReader$3.process Updating live nodes... (34)
[junit4] 2> 684831 T2403 oascc.Connecti
[...truncated too long message...]
kePath: /collections/collection2/leaders/shard1
[junit4] 2> 821538 T2859 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 821538 T2859 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 821538 T2859 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 821539 T2859 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 821539 T2860 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 821541 T2860 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core2",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection2",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 821541 T2860 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 821542 T2860 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 821543 T2859 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 821646 T2863 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 821646 T2857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 822039 T2318 oascc.SolrZkClient.makePath makePath: /collections/collection2/leader_elect/shard3/election
[junit4] 2> 822048 T2318 oascc.SolrZkClient.makePath makePath: /collections/collection2/leaders/shard3
[junit4] 2> 822053 T2859 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 822054 T2859 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 822054 T2859 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 822055 T2859 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 822056 T2860 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 822060 T2860 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core3",
[junit4] 2> "core_node_name":"node3",
[junit4] 2> "collection":"collection2",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 822060 T2860 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 822061 T2860 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 822063 T2859 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 822167 T2857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 822167 T2863 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 822555 T2318 oascc.SolrZkClient.makePath makePath: /collections/collection2/leader_elect/shard2/election
[junit4] 2> 822565 T2318 oascc.SolrZkClient.makePath makePath: /collections/collection2/leaders/shard2
[junit4] 2> 822570 T2859 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 822570 T2859 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 822571 T2859 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 822572 T2860 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 822576 T2859 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 822678 T2857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 822678 T2863 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 822723 T2863 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 822726 T2318 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:41967 41967
[junit4] 2> 827956 T2847 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:41967 41967
[junit4] 2> 827958 T2318 oas.SolrTestCaseJ4.tearDown ###Ending testBadQueueItem
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 827960 T2318 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 827960 T2318 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 830961 T2318 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: test params are: codec=Asserting, sim=DefaultSimilarity, locale=es_AR, timezone=America/Maceio
[junit4] 2> NOTE: Linux 3.8.0-37-generic amd64/Oracle Corporation 1.7.0_51 (64-bit)/cpus=8,threads=1,free=86435360,total=207712256
[junit4] 2> NOTE: All tests run in this JVM: [FastVectorHighlighterTest, SliceStateUpdateTest, TestSolrQueryParserResource, TestSchemaNameResource, TestRecoveryHdfs, DistributedSpellCheckComponentTest, ConnectionManagerTest, DOMUtilTest, TestBM25SimilarityFactory, TestMaxScoreQueryParser, TestDocBasedVersionConstraints, TestSolrXmlPersistence, MoreLikeThisHandlerTest, RecoveryZkTest, CircularListTest, SearchHandlerTest, TestElisionMultitermQuery, UpdateParamsTest, BadCopyFieldTest, DistributedTermsComponentTest, TestBadConfig, SoftAutoCommitTest, TestQueryUtils, TestStressUserVersions, CacheHeaderTest, TestSimpleQParserPlugin, AssignTest, TestSurroundQueryParser, QueryParsingTest, SampleTest, PeerSyncTest, ZkControllerTest, TestDynamicFieldResource, TestSolrQueryParser, TestSearchPerf, TestShardHandlerFactory, LoggingHandlerTest, FieldFacetExtrasTest, HdfsCollectionsAPIDistributedZkTest, DocValuesTest, BJQParserTest, TestWriterPerf, TestStressVersions, TestCloudManagedSchema, SolrIndexSplitterTest, TestCoreContainer, TestValueSourceCache, TestConfig, HdfsRecoveryZkTest, ChangedSchemaMergeTest, LeaderElectionTest, TestExtendedDismaxParser, TestGroupingSearch, ShardRoutingTest, ResourceLoaderTest, ScriptEngineTest, TestFieldCollectionResource, TestPerFieldSimilarity, ParsingFieldUpdateProcessorsTest, TestSort, ExternalFileFieldSortTest, TestPHPSerializedResponseWriter, TestDistributedMissingSort, ModifyConfFileTest, SuggesterTest, AutoCommitTest, PreAnalyzedUpdateProcessorTest, TestFaceting, HdfsLockFactoryTest, ReturnFieldsTest, DeleteReplicaTest, ResponseLogComponentTest, BinaryUpdateRequestHandlerTest, DateMathParserTest, BasicDistributedZkTest, QueryFacetTest, TestDocSet, OverseerTest]
[junit4] Completed on J0 in 149.50s, 9 tests, 1 error <<< FAILURES!
[...truncated 694 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:490: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1275: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:907: There were test failures: 394 suites, 1653 tests, 1 error, 49 ignored (28 assumptions)
Total time: 62 minutes 4 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_51 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC -XX:-UseSuperWord
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure