You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/03/08 07:15:40 UTC
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0-fcs-b132) - Build
# 9714 - Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/9714/
Java: 64bit/jdk1.8.0-fcs-b132 -XX:+UseCompressedOops -XX:+UseG1GC
1 tests failed.
FAILED: org.apache.solr.client.solrj.impl.CloudSolrServerTest.testShutdown
Error Message:
java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:60479 within 45000 ms
Stack Trace:
org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:60479 within 45000 ms
at __randomizedtesting.SeedInfo.seed([871F84DD27CE2D4E:64698D48C0B4B83C]:0)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:91)
at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:89)
at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:83)
at org.apache.solr.cloud.AbstractDistribZkTestBase.setUp(AbstractDistribZkTestBase.java:70)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.setUp(AbstractFullDistribZkTestBase.java:200)
at org.apache.solr.client.solrj.impl.CloudSolrServerTest.setUp(CloudSolrServerTest.java:78)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:771)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:60479 within 45000 ms
at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
... 46 more
Build Log:
[...truncated 11578 lines...]
[junit4] Suite: org.apache.solr.client.solrj.impl.CloudSolrServerTest
[junit4] 2> 730 T17 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
[junit4] 2> 742 T17 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 745 T17 oasc.AbstractZkTestCase.<clinit> WARN TEST_HOME() does not exist - solrj test?
[junit4] 2> 752 T17 oas.SolrTestCaseJ4.setUp ###Starting testShutdown
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1394259181153
[junit4] 2> 759 T17 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 763 T18 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 862 T17 oasc.ZkTestServer.run start zk server on port:60479
[junit4] 2> 904 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 931 T19 oazs.NIOServerCnxn.doIO WARN Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
[junit4] 2> 98848 T21 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 95816ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 98850 T17 oas.SolrTestCaseJ4.tearDown ###Ending testShutdown
[junit4] 2> 98865 T19 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144a052beb60000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 98867 T17 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:60479 60479
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CloudSolrServerTest -Dtests.method=testShutdown -Dtests.seed=871F84DD27CE2D4E -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_NZ -Dtests.timezone=Antarctica/McMurdo -Dtests.file.encoding=UTF-8
[junit4] ERROR 98.3s J0 | CloudSolrServerTest.testShutdown <<<
[junit4] > Throwable #1: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:60479 within 45000 ms
[junit4] > at __randomizedtesting.SeedInfo.seed([871F84DD27CE2D4E:64698D48C0B4B83C]:0)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:91)
[junit4] > at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:89)
[junit4] > at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:83)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.setUp(AbstractDistribZkTestBase.java:70)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.setUp(AbstractFullDistribZkTestBase.java:200)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServerTest.setUp(CloudSolrServerTest.java:78)
[junit4] > at java.lang.Thread.run(Thread.java:744)
[junit4] > Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:60479 within 45000 ms
[junit4] > at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
[junit4] > ... 46 more
[junit4] 2> 99072 T17 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1394259279472
[junit4] 2> 99073 T17 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 99074 T25 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 99174 T17 oasc.ZkTestServer.run start zk server on port:55541
[junit4] 2> 99175 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 99230 T31 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3b437918 name:ZooKeeperConnection Watcher:127.0.0.1:55541 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 99231 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 99232 T17 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 99266 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 99271 T33 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d2b19ee name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 99272 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 99277 T17 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 99283 T17 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 99288 T17 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 99293 T17 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 99302 T17 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 99310 T17 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 99325 T17 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 99326 T17 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 99381 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml because it doesn't exist
[junit4] 2> 99381 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/stopwords.txt because it doesn't exist
[junit4] 2> 99382 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/protwords.txt because it doesn't exist
[junit4] 2> 99383 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/currency.xml because it doesn't exist
[junit4] 2> 99383 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/enumsConfig.xml because it doesn't exist
[junit4] 2> 99384 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/open-exchange-rates.json because it doesn't exist
[junit4] 2> 99385 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/mapping-ISOLatin1Accent.txt because it doesn't exist
[junit4] 2> 99385 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/old_synonyms.txt because it doesn't exist
[junit4] 2> 99386 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/synonyms.txt because it doesn't exist
[junit4] 2> 99759 T17 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 99960 T17 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55573
[junit4] 2> 100042 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 100043 T17 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 100044 T17 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794
[junit4] 2> 100044 T17 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/'
[junit4] 2> 100070 T17 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/solr.xml
[junit4] 2> 100228 T17 oasc.CoreContainer.<init> New CoreContainer 697646028
[junit4] 2> 100229 T17 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/]
[junit4] 2> 100254 T17 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 100255 T17 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 100263 T17 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 100264 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 100265 T17 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 100265 T17 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 100266 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 100267 T17 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 100267 T17 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 100493 T17 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 100495 T17 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 100498 T17 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 100499 T17 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55541/solr
[junit4] 2> 100517 T17 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 100518 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 100526 T45 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4594e282 name:ZooKeeperConnection Watcher:127.0.0.1:55541 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 100527 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 100538 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 100542 T47 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@22c8c3fc name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 100543 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 100612 T17 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 100632 T17 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 100658 T17 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 100662 T17 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55573_
[junit4] 2> 100666 T17 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55573_
[junit4] 2> 100675 T17 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 100680 T17 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 100695 T17 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:55573_
[junit4] 2> 100696 T17 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 100706 T17 oasc.Overseer.start Overseer (id=91374176139739139-127.0.0.1:55573_-n_0000000000) starting
[junit4] 2> 100725 T17 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 100861 T49 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 100862 T17 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 100876 T49 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 100876 T17 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 100882 T17 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 100898 T48 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 101025 T50 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 101026 T50 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 101030 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 101032 T50 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 101037 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 101040 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:55573",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55573_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 101040 T48 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 101054 T48 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 101061 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 101066 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 102032 T50 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 102033 T50 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/collection1
[junit4] 2> 102033 T50 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 102036 T50 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 102037 T50 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 102039 T50 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 102039 T50 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/collection1/'
[junit4] 2> 102131 T50 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 102251 T50 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 102265 T50 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 102378 T50 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 102537 T50 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableIntField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 102551 T50 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableLongField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 102558 T50 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableFloatField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 102567 T50 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableDoubleField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 102920 T50 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 102921 T50 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 102928 T50 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 102928 T50 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 102966 T50 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 102974 T50 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/
[junit4] 2> 102976 T50 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 103012 T50 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data
[junit4] 2> 103012 T50 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/index/
[junit4] 2> 103013 T50 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 103023 T50 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/index
[junit4] 2> 103065 T50 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@79964587 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 103067 T50 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 103211 T50 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 103223 T50 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 103224 T50 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 103225 T50 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 103232 T50 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 103238 T50 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 103240 T50 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 103243 T50 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 103267 T50 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 103288 T50 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 103289 T50 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 103291 T50 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@79964587 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 103291 T50 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 103309 T50 oass.SolrIndexSearcher.<init> Opening Searcher@727b1191[collection1] main
[junit4] 2> 103340 T50 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 103340 T51 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@727b1191[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 103346 T17 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 103346 T54 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55573 collection:control_collection shard:shard1
[junit4] 2> 103346 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 103353 T54 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 103359 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 103362 T54 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 103363 T56 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6470051 name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 103363 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 103365 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103365 T17 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 103366 T54 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 103366 T54 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 103367 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 103370 T17 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> ASYNC NEW_CORE C0 name=collection1 org.apache.solr.core.SolrCore@6efa0529 url=http://127.0.0.1:55573/collection1 node=127.0.0.1:55573_ C0_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:55573, core=collection1, node_name=127.0.0.1:55573_}
[junit4] 2> 103370 T54 C0 P55573 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55573/collection1/
[junit4] 2> 103375 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103375 T54 C0 P55573 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 103376 T54 C0 P55573 oasc.SyncStrategy.syncToMe http://127.0.0.1:55573/collection1/ has no replicas
[junit4] 2> 103376 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103376 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103376 T54 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55573/collection1/ shard1
[junit4] 2> 103379 T54 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 103389 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103391 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 103395 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103405 T17 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 103407 T17 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 103410 T17 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59672
[junit4] 2> 103411 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 103411 T17 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 103411 T17 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770
[junit4] 2> 103412 T17 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/'
[junit4] 2> 103430 T17 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/solr.xml
[junit4] 2> 103451 T17 oasc.CoreContainer.<init> New CoreContainer 1363939353
[junit4] 2> 103452 T17 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/]
[junit4] 2> 103452 T17 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 103453 T17 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 103453 T17 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 103454 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 103454 T17 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 103454 T17 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 103455 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 103456 T17 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 103456 T17 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 103460 T17 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 103460 T17 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 103461 T17 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 103461 T17 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55541/solr
[junit4] 2> 103462 T17 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 103463 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 103465 T67 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@42bf1637 name:ZooKeeperConnection Watcher:127.0.0.1:55541 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 103465 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 103472 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 103474 T69 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a52fa52 name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 103474 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 103479 T17 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 103497 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103497 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103497 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103541 T54 oasc.ZkController.register We are http://127.0.0.1:55573/collection1/ and leader is http://127.0.0.1:55573/collection1/
[junit4] 2> 103542 T54 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55573
[junit4] 2> 103542 T54 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 103543 T54 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 103543 T54 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 103545 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103545 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103545 T54 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 103545 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103547 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 103548 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:55573",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55573_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 103552 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103656 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103656 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103656 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 104482 T17 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59672_
[junit4] 2> 104485 T17 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59672_
[junit4] 2> 104489 T56 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 104489 T69 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 104489 T47 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 104496 T70 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 104497 T70 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 104498 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 104498 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 104499 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 104498 T70 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 104500 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 104501 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:59672",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:59672_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 104502 T48 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 104502 T48 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 104505 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 104609 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 104609 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 104610 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 105502 T70 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 105503 T70 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/collection1
[junit4] 2> 105503 T70 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 105505 T70 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 105505 T70 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 105506 T70 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 105507 T70 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/collection1/'
[junit4] 2> 105541 T70 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 105558 T70 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 105560 T70 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 105636 T70 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 105966 T70 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 105968 T70 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 105971 T70 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 105973 T70 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 105975 T70 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 105975 T70 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/
[junit4] 2> 105975 T70 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 105980 T70 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1
[junit4] 2> 105981 T70 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/index/
[junit4] 2> 105981 T70 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 105982 T70 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/index
[junit4] 2> 105989 T70 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7200e69f lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 105990 T70 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 105991 T70 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 105991 T70 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 105992 T70 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 105992 T70 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 105992 T70 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 105993 T70 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 105993 T70 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 105993 T70 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 105996 T70 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 106000 T70 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 106000 T70 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 106003 T70 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7200e69f lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 106003 T70 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 106008 T70 oass.SolrIndexSearcher.<init> Opening Searcher@7b787bc1[collection1] main
[junit4] 2> 106010 T71 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7b787bc1[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 106010 T70 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 106012 T17 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 106012 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 106012 T74 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59672 collection:collection1 shard:shard2
[junit4] 2> 106019 T74 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 106032 T74 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 106042 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106042 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106042 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106042 T74 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 106043 T74 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 106045 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C1 name=collection1 org.apache.solr.core.SolrCore@5debe52b url=http://127.0.0.1:59672/collection1 node=127.0.0.1:59672_ C1_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:59672, core=collection1, node_name=127.0.0.1:59672_}
[junit4] 2> 106043 T74 C1 P59672 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59672/collection1/
[junit4] 2> 106060 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106061 T74 C1 P59672 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 106061 T17 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 106061 T74 C1 P59672 oasc.SyncStrategy.syncToMe http://127.0.0.1:59672/collection1/ has no replicas
[junit4] 2> 106062 T74 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59672/collection1/ shard2
[junit4] 2> 106062 T17 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 106062 T74 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 106071 T17 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:40121
[junit4] 2> 106075 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 106081 T17 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 106082 T17 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412
[junit4] 2> 106083 T17 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/'
[junit4] 2> 106091 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106101 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106129 T17 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/solr.xml
[junit4] 2> 106152 T17 oasc.CoreContainer.<init> New CoreContainer 1520964013
[junit4] 2> 106153 T17 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/]
[junit4] 2> 106157 T17 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 106158 T17 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 106168 T17 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 106169 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 106169 T17 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 106170 T17 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 106170 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 106171 T17 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 106172 T17 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 106186 T17 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 106187 T17 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 106187 T17 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 106188 T17 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55541/solr
[junit4] 2> 106189 T17 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 106191 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 106194 T85 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@23c61723 name:ZooKeeperConnection Watcher:127.0.0.1:55541 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 106194 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 106207 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 106263 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106263 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106263 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106266 T87 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7126b030 name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 106269 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 106275 T17 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 106294 T74 oasc.ZkController.register We are http://127.0.0.1:59672/collection1/ and leader is http://127.0.0.1:59672/collection1/
[junit4] 2> 106294 T74 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59672
[junit4] 2> 106294 T74 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 106295 T74 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 106295 T74 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 106301 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106302 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106302 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106303 T74 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 106306 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 106308 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:59672",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:59672_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 106320 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106427 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106427 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106427 T87 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106427 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 107283 T17 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40121_
[junit4] 2> 107285 T17 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40121_
[junit4] 2> 107287 T47 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 107289 T56 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 107289 T87 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 107289 T69 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 107297 T88 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 107298 T88 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 107300 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 107300 T88 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 107300 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 107301 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 107302 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 107303 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40121",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:40121_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 107303 T48 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 107304 T48 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 107307 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 107488 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 107488 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 107488 T87 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 107488 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108301 T88 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 108302 T88 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/collection1
[junit4] 2> 108302 T88 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 108304 T88 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 108304 T88 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 108306 T88 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 108306 T88 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/collection1/'
[junit4] 2> 108340 T88 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 108360 T88 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 108362 T88 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 108390 T88 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 108531 T88 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 108533 T88 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 108534 T88 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 108535 T88 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 108536 T88 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 108537 T88 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/
[junit4] 2> 108537 T88 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 108538 T88 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2
[junit4] 2> 108538 T88 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/index/
[junit4] 2> 108538 T88 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 108539 T88 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/index
[junit4] 2> 108541 T88 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@2a9faac lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 108541 T88 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 108543 T88 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 108544 T88 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 108544 T88 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 108544 T88 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 108551 T88 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 108552 T88 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 108553 T88 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 108553 T88 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 108555 T88 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 108557 T88 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 108557 T88 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 108559 T88 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@2a9faac lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 108560 T88 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 108560 T88 oass.SolrIndexSearcher.<init> Opening Searcher@2fdd91d0[collection1] main
[junit4] 2> 108561 T89 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2fdd91d0[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 108561 T88 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 108562 T17 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 108563 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 108562 T92 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40121 collection:collection1 shard:shard1
[junit4] 2> 108565 T92 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 108571 T92 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 108574 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108574 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108574 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108574 T92 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 108575 T92 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2 name=collection1 org.apache.solr.core.SolrCore@5452a467 url=http://127.0.0.1:40121/collection1 node=127.0.0.1:40121_ C2_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:40121, core=collection1, node_name=127.0.0.1:40121_}
[junit4] 2> 108575 T92 C2 P40121 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40121/collection1/
[junit4] 2> 108575 T92 C2 P40121 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 108575 T92 C2 P40121 oasc.SyncStrategy.syncToMe http://127.0.0.1:40121/collection1/ has no replicas
[junit4] 2> 108576 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 108576 T92 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40121/collection1/ shard1
[junit4] 2> 108576 T92 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 108581 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108584 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108587 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108599 T17 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 108600 T17 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 108603 T17 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59111
[junit4] 2> 108605 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 108605 T17 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 108605 T17 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964
[junit4] 2> 108606 T17 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/'
[junit4] 2> 108622 T17 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/solr.xml
[junit4] 2> 108634 T17 oasc.CoreContainer.<init> New CoreContainer 1243096640
[junit4] 2> 108635 T17 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/]
[junit4] 2> 108636 T17 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 108636 T17 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 108637 T17 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 108637 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 108637 T17 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 108638 T17 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 108638 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 108639 T17 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 108639 T17 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 108642 T17 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 108643 T17 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 108643 T17 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 108643 T17 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55541/solr
[junit4] 2> 108644 T17 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 108644 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 108647 T103 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d53b855 name:ZooKeeperConnection Watcher:127.0.0.1:55541 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 108648 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 108651 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 108653 T105 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3bfa44b1 name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 108653 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 108658 T17 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 108691 T87 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108692 T105 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108691 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108691 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108693 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108735 T92 oasc.ZkController.register We are http://127.0.0.1:40121/collection1/ and leader is http://127.0.0.1:40121/collection1/
[junit4] 2> 108736 T92 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40121
[junit4] 2> 108736 T92 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 108736 T92 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 108737 T92 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 108738 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108738 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108738 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108738 T92 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 108740 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 108741 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:40121",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:40121_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 108744 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108847 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108847 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108847 T105 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108848 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108848 T87 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 109662 T17 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59111_
[junit4] 2> 109664 T17 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59111_
[junit4] 2> 109666 T56 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 109666 T105 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 109666 T69 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 109666 T87 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 109667 T47 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 109676 T106 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 109676 T106 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 109677 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 109677 T106 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 109677 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 109678 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 109679 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 109680 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:59111",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:59111_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 109680 T48 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 109680 T48 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 109682 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 109785 T105 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 109785 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 109785 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 109785 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 109785 T87 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 110678 T106 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 110678 T106 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/collection1
[junit4] 2> 110679 T106 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 110680 T106 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 110680 T106 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 110681 T106 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 110681 T106 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/collection1/'
[junit4] 2> 110708 T106 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 110717 T106 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 110719 T106 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 110742 T106 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 110881 T106 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 110882 T106 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 110884 T106 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 110885 T106 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 110886 T106 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 110887 T106 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/
[junit4] 2> 110887 T106 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 110888 T106 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3
[junit4] 2> 110888 T106 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index/
[junit4] 2> 110889 T106 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index' doesn't exist. Creating new index...
[junit4] 2> 110889 T106 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index
[junit4] 2> 110891 T106 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@76327f71 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index),segFN=segments_1,generation=1}
[junit4] 2> 110891 T106 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 110893 T106 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 110893 T106 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 110894 T106 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 110894 T106 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 110894 T106 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 110894 T106 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 110895 T106 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 110895 T106 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 110896 T106 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 110898 T106 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 110898 T106 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 110899 T106 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@76327f71 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index),segFN=segments_1,generation=1}
[junit4] 2> 110899 T106 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 110900 T106 oass.SolrIndexSearcher.<init> Opening Searcher@60156be5[collection1] main
[junit4] 2> 110900 T107 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@60156be5[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 110900 T106 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 110901 T17 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 110902 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 110901 T110 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59111 collection:collection1 shard:shard2
[junit4] 2> 110907 T110 oasc.ZkController.register We are http://127.0.0.1:59111/collection1/ and leader is http://127.0.0.1:59672/collection1/
[junit4] 2> 110908 T110 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59111
[junit4] 2> 110908 T110 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4] 2> 110908 T110 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> ASYNC NEW_CORE C3 name=collection1 org.apache.solr.core.SolrCore@f4e8e20 url=http://127.0.0.1:59111/collection1 node=127.0.0.1:59111_ C3_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:59111, core=collection1, node_name=127.0.0.1:59111_}
[junit4] 2> 110913 T111 C3 P59111 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4] 2> 110914 T110 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 110915 T111 C3 P59111 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 110916 T111 C3 P59111 oas
[...truncated too long message...]
t4] 2> 121034 T17 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 121841 T47 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 121841 T47 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 121934 T69 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 121934 T69 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 122940 T105 C12 P59111 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 122947 T105 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 122948 T105 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@f4e8e20
[junit4] 2> 122948 T105 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=1,cumulative_deletesByQuery=2,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=5}
[junit4] 2> 122949 T105 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 122949 T105 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 122949 T105 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 122952 T105 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 122952 T105 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 122952 T105 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3 [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3;done=false>>]
[junit4] 2> 122953 T105 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3
[junit4] 2> 122953 T105 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index;done=false>>]
[junit4] 2> 122953 T105 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index
[junit4] 2> 122954 T105 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 122954 T105 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 122955 T105 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 122955 T105 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 123029 T124 C10 P46922 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 123030 T124 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 123030 T124 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@ee9ae71
[junit4] 2> 123032 T124 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=1,cumulative_deletesByQuery=2,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=5}
[junit4] 2> 123032 T124 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 123032 T124 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 123033 T124 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 123035 T124 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 123036 T124 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 123036 T124 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4;done=false>>]
[junit4] 2> 123037 T124 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4
[junit4] 2> 123037 T124 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4/index;done=false>>]
[junit4] 2> 123037 T124 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4/index
[junit4] 2> 123038 T124 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 123039 T124 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=en_NZ, timezone=Antarctica/McMurdo
[junit4] 2> NOTE: Linux 3.8.0-36-generic amd64/Oracle Corporation 1.8.0 (64-bit)/cpus=8,threads=1,free=87751480,total=155189248
[junit4] 2> NOTE: All tests run in this JVM: [TestJavaBinCodec, ContentStreamTest, CloudSolrServerTest]
[junit4] Completed on J0 in 123.58s, 2 tests, 1 error <<< FAILURES!
[...truncated 112 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:465: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:445: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:202: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:490: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1274: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:907: There were test failures: 49 suites, 281 tests, 1 error
Total time: 47 minutes 27 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0-fcs-b132 -XX:+UseCompressedOops -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
Re: [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0-fcs-b132)
- Build # 9713 - Failure!
Posted by Mark Miller <ma...@gmail.com>.
This only seems to happen on the policeman jenkins. Never used to happen, simple code, lots of tests use it. Not sure what is going on here. It’s on my list of like a million things to try and figure out.
- Mark
http://about.me/markrmiller
On Mar 8, 2014, 1:15:40 AM, Policeman Jenkins Server <je...@thetaphi.de> wrote: Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/9714/
Java: 64bit/jdk1.8.0-fcs-b132 -XX:+UseCompressedOops -XX:+UseG1GC
1 tests failed.
FAILED: org.apache.solr.client.solrj.impl.CloudSolrServerTest.testShutdown
Error Message:
java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:60479 within 45000 ms
Stack Trace:
org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:60479 within 45000 ms
at __randomizedtesting.SeedInfo.seed([871F84DD27CE2D4E:64698D48C0B4B83C]:0)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:91)
at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:89)
at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:83)
at org.apache.solr.cloud.AbstractDistribZkTestBase.setUp(AbstractDistribZkTestBase.java:70)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.setUp(AbstractFullDistribZkTestBase.java:200)
at org.apache.solr.client.solrj.impl.CloudSolrServerTest.setUp(CloudSolrServerTest.java:78)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:771)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:60479 within 45000 ms
at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
... 46 more
Build Log:
[...truncated 11578 lines...]
[junit4] Suite: org.apache.solr.client.solrj.impl.CloudSolrServerTest
[junit4] 2> 730 T17 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
[junit4] 2> 742 T17 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 745 T17 oasc.AbstractZkTestCase.<clinit> WARN TEST_HOME() does not exist - solrj test?
[junit4] 2> 752 T17 oas.SolrTestCaseJ4.setUp ###Starting testShutdown
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1394259181153
[junit4] 2> 759 T17 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 763 T18 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 862 T17 oasc.ZkTestServer.run start zk server on port:60479
[junit4] 2> 904 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 931 T19 oazs.NIOServerCnxn.doIO WARN Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
[junit4] 2> 98848 T21 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 95816ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 98850 T17 oas.SolrTestCaseJ4.tearDown ###Ending testShutdown
[junit4] 2> 98865 T19 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144a052beb60000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 98867 T17 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:60479 60479
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CloudSolrServerTest -Dtests.method=testShutdown -Dtests.seed=871F84DD27CE2D4E -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_NZ -Dtests.timezone=Antarctica/McMurdo -Dtests.file.encoding=UTF-8
[junit4] ERROR 98.3s J0 | CloudSolrServerTest.testShutdown <<<
[junit4] > Throwable #1: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:60479 within 45000 ms
[junit4] > at __randomizedtesting.SeedInfo.seed([871F84DD27CE2D4E:64698D48C0B4B83C]:0)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:91)
[junit4] > at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:89)
[junit4] > at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:83)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.setUp(AbstractDistribZkTestBase.java:70)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.setUp(AbstractFullDistribZkTestBase.java:200)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServerTest.setUp(CloudSolrServerTest.java:78)
[junit4] > at java.lang.Thread.run(Thread.java:744)
[junit4] > Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:60479 within 45000 ms
[junit4] > at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
[junit4] > ... 46 more
[junit4] 2> 99072 T17 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1394259279472
[junit4] 2> 99073 T17 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 99074 T25 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 99174 T17 oasc.ZkTestServer.run start zk server on port:55541
[junit4] 2> 99175 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 99230 T31 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3b437918 name:ZooKeeperConnection Watcher:127.0.0.1:55541 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 99231 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 99232 T17 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 99266 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 99271 T33 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d2b19ee name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 99272 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 99277 T17 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 99283 T17 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 99288 T17 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 99293 T17 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 99302 T17 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 99310 T17 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 99325 T17 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 99326 T17 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 99381 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml because it doesn't exist
[junit4] 2> 99381 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/stopwords.txt because it doesn't exist
[junit4] 2> 99382 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/protwords.txt because it doesn't exist
[junit4] 2> 99383 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/currency.xml because it doesn't exist
[junit4] 2> 99383 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/enumsConfig.xml because it doesn't exist
[junit4] 2> 99384 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/open-exchange-rates.json because it doesn't exist
[junit4] 2> 99385 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/mapping-ISOLatin1Accent.txt because it doesn't exist
[junit4] 2> 99385 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/old_synonyms.txt because it doesn't exist
[junit4] 2> 99386 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/synonyms.txt because it doesn't exist
[junit4] 2> 99759 T17 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 99960 T17 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55573
[junit4] 2> 100042 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 100043 T17 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 100044 T17 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794
[junit4] 2> 100044 T17 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/'
[junit4] 2> 100070 T17 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/solr.xml
[junit4] 2> 100228 T17 oasc.CoreContainer.<init> New CoreContainer 697646028
[junit4] 2> 100229 T17 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/]
[junit4] 2> 100254 T17 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 100255 T17 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 100263 T17 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 100264 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 100265 T17 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 100265 T17 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 100266 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 100267 T17 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 100267 T17 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 100493 T17 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 100495 T17 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 100498 T17 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 100499 T17 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55541/solr
[junit4] 2> 100517 T17 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 100518 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 100526 T45 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4594e282 name:ZooKeeperConnection Watcher:127.0.0.1:55541 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 100527 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 100538 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 100542 T47 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@22c8c3fc name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 100543 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 100612 T17 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 100632 T17 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 100658 T17 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 100662 T17 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55573_
[junit4] 2> 100666 T17 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55573_
[junit4] 2> 100675 T17 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 100680 T17 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 100695 T17 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:55573_
[junit4] 2> 100696 T17 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 100706 T17 oasc.Overseer.start Overseer (id=91374176139739139-127.0.0.1:55573_-n_0000000000) starting
[junit4] 2> 100725 T17 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 100861 T49 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 100862 T17 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 100876 T49 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 100876 T17 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 100882 T17 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 100898 T48 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 101025 T50 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 101026 T50 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 101030 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 101032 T50 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 101037 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 101040 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:55573",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55573_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 101040 T48 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 101054 T48 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 101061 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 101066 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 102032 T50 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 102033 T50 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/collection1
[junit4] 2> 102033 T50 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 102036 T50 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 102037 T50 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 102039 T50 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 102039 T50 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/collection1/'
[junit4] 2> 102131 T50 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 102251 T50 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 102265 T50 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 102378 T50 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 102537 T50 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableIntField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 102551 T50 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableLongField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 102558 T50 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableFloatField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 102567 T50 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableDoubleField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 102920 T50 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 102921 T50 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 102928 T50 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 102928 T50 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 102966 T50 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 102974 T50 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/
[junit4] 2> 102976 T50 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 103012 T50 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data
[junit4] 2> 103012 T50 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/index/
[junit4] 2> 103013 T50 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 103023 T50 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/index
[junit4] 2> 103065 T50 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@79964587 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 103067 T50 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 103211 T50 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 103223 T50 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 103224 T50 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 103225 T50 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 103232 T50 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 103238 T50 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 103240 T50 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 103243 T50 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 103267 T50 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 103288 T50 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 103289 T50 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 103291 T50 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@79964587 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 103291 T50 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 103309 T50 oass.SolrIndexSearcher.<init> Opening Searcher@727b1191[collection1] main
[junit4] 2> 103340 T50 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 103340 T51 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@727b1191[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 103346 T17 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 103346 T54 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55573 collection:control_collection shard:shard1
[junit4] 2> 103346 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 103353 T54 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 103359 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 103362 T54 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 103363 T56 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6470051 name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 103363 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 103365 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103365 T17 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 103366 T54 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 103366 T54 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 103367 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 103370 T17 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> ASYNC NEW_CORE C0 name=collection1 org.apache.solr.core.SolrCore@6efa0529 url=http://127.0.0.1:55573/collection1 node=127.0.0.1:55573_ C0_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:55573, core=collection1, node_name=127.0.0.1:55573_}
[junit4] 2> 103370 T54 C0 P55573 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55573/collection1/
[junit4] 2> 103375 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103375 T54 C0 P55573 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 103376 T54 C0 P55573 oasc.SyncStrategy.syncToMe http://127.0.0.1:55573/collection1/ has no replicas
[junit4] 2> 103376 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103376 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103376 T54 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55573/collection1/ shard1
[junit4] 2> 103379 T54 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 103389 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103391 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 103395 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103405 T17 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 103407 T17 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 103410 T17 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59672
[junit4] 2> 103411 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 103411 T17 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 103411 T17 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770
[junit4] 2> 103412 T17 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/'
[junit4] 2> 103430 T17 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/solr.xml
[junit4] 2> 103451 T17 oasc.CoreContainer.<init> New CoreContainer 1363939353
[junit4] 2> 103452 T17 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/]
[junit4] 2> 103452 T17 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 103453 T17 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 103453 T17 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 103454 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 103454 T17 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 103454 T17 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 103455 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 103456 T17 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 103456 T17 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 103460 T17 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 103460 T17 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 103461 T17 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 103461 T17 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55541/solr
[junit4] 2> 103462 T17 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 103463 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 103465 T67 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@42bf1637 name:ZooKeeperConnection Watcher:127.0.0.1:55541 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 103465 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 103472 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 103474 T69 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a52fa52 name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 103474 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 103479 T17 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 103497 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103497 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103497 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103541 T54 oasc.ZkController.register We are http://127.0.0.1:55573/collection1/ and leader is http://127.0.0.1:55573/collection1/
[junit4] 2> 103542 T54 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55573
[junit4] 2> 103542 T54 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 103543 T54 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 103543 T54 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 103545 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103545 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103545 T54 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 103545 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103547 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 103548 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:55573",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55573_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 103552 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103656 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103656 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103656 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 104482 T17 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59672_
[junit4] 2> 104485 T17 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59672_
[junit4] 2> 104489 T56 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 104489 T69 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 104489 T47 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 104496 T70 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 104497 T70 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 104498 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 104498 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 104499 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 104498 T70 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 104500 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 104501 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:59672",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:59672_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 104502 T48 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 104502 T48 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 104505 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 104609 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 104609 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 104610 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 105502 T70 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 105503 T70 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/collection1
[junit4] 2> 105503 T70 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 105505 T70 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 105505 T70 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 105506 T70 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 105507 T70 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/collection1/'
[junit4] 2> 105541 T70 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 105558 T70 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 105560 T70 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 105636 T70 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 105966 T70 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 105968 T70 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 105971 T70 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 105973 T70 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 105975 T70 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 105975 T70 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/
[junit4] 2> 105975 T70 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 105980 T70 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1
[junit4] 2> 105981 T70 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/index/
[junit4] 2> 105981 T70 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 105982 T70 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/index
[junit4] 2> 105989 T70 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7200e69f lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 105990 T70 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 105991 T70 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 105991 T70 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 105992 T70 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 105992 T70 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 105992 T70 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 105993 T70 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 105993 T70 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 105993 T70 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 105996 T70 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 106000 T70 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 106000 T70 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 106003 T70 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7200e69f lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 106003 T70 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 106008 T70 oass.SolrIndexSearcher.<init> Opening Searcher@7b787bc1[collection1] main
[junit4] 2> 106010 T71 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7b787bc1[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 106010 T70 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 106012 T17 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 106012 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 106012 T74 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59672 collection:collection1 shard:shard2
[junit4] 2> 106019 T74 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 106032 T74 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 106042 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106042 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106042 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106042 T74 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 106043 T74 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 106045 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C1 name=collection1 org.apache.solr.core.SolrCore@5debe52b url=http://127.0.0.1:59672/collection1 node=127.0.0.1:59672_ C1_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:59672, core=collection1, node_name=127.0.0.1:59672_}
[junit4] 2> 106043 T74 C1 P59672 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59672/collection1/
[junit4] 2> 106060 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106061 T74 C1 P59672 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 106061 T17 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 106061 T74 C1 P59672 oasc.SyncStrategy.syncToMe http://127.0.0.1:59672/collection1/ has no replicas
[junit4] 2> 106062 T74 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59672/collection1/ shard2
[junit4] 2> 106062 T17 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 106062 T74 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 106071 T17 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:40121
[junit4] 2> 106075 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 106081 T17 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 106082 T17 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412
[junit4] 2> 106083 T17 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/'
[junit4] 2> 106091 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106101 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106129 T17 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/solr.xml
[junit4] 2> 106152 T17 oasc.CoreContainer.<init> New CoreContainer 1520964013
[junit4] 2> 106153 T17 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/]
[junit4] 2> 106157 T17 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 106158 T17 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 106168 T17 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 106169 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 106169 T17 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 106170 T17 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 106170 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 106171 T17 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 106172 T17 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 106186 T17 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 106187 T17 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 106187 T17 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 106188 T17 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55541/solr
[junit4] 2> 106189 T17 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 106191 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 106194 T85 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@23c61723 name:ZooKeeperConnection Watcher:127.0.0.1:55541 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 106194 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 106207 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 106263 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106263 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106263 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106266 T87 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7126b030 name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 106269 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 106275 T17 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 106294 T74 oasc.ZkController.register We are http://127.0.0.1:59672/collection1/ and leader is http://127.0.0.1:59672/collection1/
[junit4] 2> 106294 T74 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59672
[junit4] 2> 106294 T74 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 106295 T74 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 106295 T74 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 106301 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106302 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106302 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106303 T74 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 106306 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 106308 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:59672",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:59672_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 106320 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106427 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106427 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106427 T87 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106427 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 107283 T17 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40121_
[junit4] 2> 107285 T17 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40121_
[junit4] 2> 107287 T47 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 107289 T56 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 107289 T87 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 107289 T69 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 107297 T88 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 107298 T88 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 107300 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 107300 T88 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 107300 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 107301 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 107302 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 107303 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40121",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:40121_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 107303 T48 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 107304 T48 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 107307 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 107488 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 107488 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 107488 T87 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 107488 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108301 T88 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 108302 T88 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/collection1
[junit4] 2> 108302 T88 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 108304 T88 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 108304 T88 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 108306 T88 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 108306 T88 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/collection1/'
[junit4] 2> 108340 T88 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 108360 T88 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 108362 T88 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 108390 T88 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 108531 T88 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 108533 T88 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 108534 T88 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 108535 T88 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 108536 T88 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 108537 T88 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/
[junit4] 2> 108537 T88 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 108538 T88 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2
[junit4] 2> 108538 T88 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/index/
[junit4] 2> 108538 T88 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 108539 T88 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/index
[junit4] 2> 108541 T88 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@2a9faac lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 108541 T88 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 108543 T88 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 108544 T88 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 108544 T88 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 108544 T88 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 108551 T88 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 108552 T88 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 108553 T88 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 108553 T88 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 108555 T88 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 108557 T88 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 108557 T88 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 108559 T88 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@2a9faac lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 108560 T88 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 108560 T88 oass.SolrIndexSearcher.<init> Opening Searcher@2fdd91d0[collection1] main
[junit4] 2> 108561 T89 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2fdd91d0[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 108561 T88 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 108562 T17 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 108563 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 108562 T92 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40121 collection:collection1 shard:shard1
[junit4] 2> 108565 T92 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 108571 T92 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 108574 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108574 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108574 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108574 T92 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 108575 T92 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2 name=collection1 org.apache.solr.core.SolrCore@5452a467 url=http://127.0.0.1:40121/collection1 node=127.0.0.1:40121_ C2_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:40121, core=collection1, node_name=127.0.0.1:40121_}
[junit4] 2> 108575 T92 C2 P40121 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40121/collection1/
[junit4] 2> 108575 T92 C2 P40121 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 108575 T92 C2 P40121 oasc.SyncStrategy.syncToMe http://127.0.0.1:40121/collection1/ has no replicas
[junit4] 2> 108576 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 108576 T92 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40121/collection1/ shard1
[junit4] 2> 108576 T92 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 108581 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108584 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108587 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108599 T17 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 108600 T17 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 108603 T17 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59111
[junit4] 2> 108605 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 108605 T17 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 108605 T17 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964
[junit4] 2> 108606 T17 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/'
[junit4] 2> 108622 T17 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/solr.xml
[junit4] 2> 108634 T17 oasc.CoreContainer.<init> New CoreContainer 1243096640
[junit4] 2> 108635 T17 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/]
[junit4] 2> 108636 T17 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 108636 T17 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 108637 T17 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 108637 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 108637 T17 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 108638 T17 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 108638 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 108639 T17 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 108639 T17 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 108642 T17 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 108643 T17 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 108643 T17 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 108643 T17 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55541/solr
[junit4] 2> 108644 T17 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 108644 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 108647 T103 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d53b855 name:ZooKeeperConnection Watcher:127.0.0.1:55541 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 108648 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 108651 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 108653 T105 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3bfa44b1 name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 108653 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 108658 T17 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 108691 T87 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108692 T105 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108691 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108691 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108693 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108735 T92 oasc.ZkController.register We are http://127.0.0.1:40121/collection1/ and leader is http://127.0.0.1:40121/collection1/
[junit4] 2> 108736 T92 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40121
[junit4] 2> 108736 T92 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 108736 T92 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 108737 T92 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 108738 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108738 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108738 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108738 T92 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 108740 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 108741 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:40121",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:40121_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 108744 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108847 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108847 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108847 T105 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108848 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108848 T87 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 109662 T17 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59111_
[junit4] 2> 109664 T17 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59111_
[junit4] 2> 109666 T56 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 109666 T105 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 109666 T69 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 109666 T87 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 109667 T47 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 109676 T106 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 109676 T106 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 109677 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 109677 T106 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 109677 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 109678 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 109679 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 109680 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:59111",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:59111_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 109680 T48 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 109680 T48 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 109682 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 109785 T105 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 109785 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 109785 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 109785 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 109785 T87 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 110678 T106 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 110678 T106 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/collection1
[junit4] 2> 110679 T106 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 110680 T106 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 110680 T106 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 110681 T106 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 110681 T106 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/collection1/'
[junit4] 2> 110708 T106 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 110717 T106 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 110719 T106 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 110742 T106 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 110881 T106 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 110882 T106 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 110884 T106 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 110885 T106 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 110886 T106 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 110887 T106 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/
[junit4] 2> 110887 T106 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 110888 T106 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3
[junit4] 2> 110888 T106 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index/
[junit4] 2> 110889 T106 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index' doesn't exist. Creating new index...
[junit4] 2> 110889 T106 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index
[junit4] 2> 110891 T106 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@76327f71 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index),segFN=segments_1,generation=1}
[junit4] 2> 110891 T106 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 110893 T106 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 110893 T106 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 110894 T106 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 110894 T106 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 110894 T106 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 110894 T106 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 110895 T106 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 110895 T106 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 110896 T106 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 110898 T106 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 110898 T106 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 110899 T106 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@76327f71 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index),segFN=segments_1,generation=1}
[junit4] 2> 110899 T106 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 110900 T106 oass.SolrIndexSearcher.<init> Opening Searcher@60156be5[collection1] main
[junit4] 2> 110900 T107 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@60156be5[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 110900 T106 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 110901 T17 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 110902 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 110901 T110 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59111 collection:collection1 shard:shard2
[junit4] 2> 110907 T110 oasc.ZkController.register We are http://127.0.0.1:59111/collection1/ and leader is http://127.0.0.1:59672/collection1/
[junit4] 2> 110908 T110 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59111
[junit4] 2> 110908 T110 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4] 2> 110908 T110 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> ASYNC NEW_CORE C3 name=collection1 org.apache.solr.core.SolrCore@f4e8e20 url=http://127.0.0.1:59111/collection1 node=127.0.0.1:59111_ C3_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:59111, core=collection1, node_name=127.0.0.1:59111_}
[junit4] 2> 110913 T111 C3 P59111 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4] 2> 110914 T110 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 110915 T111 C3 P59111 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 110916 T111 C3 P59111 oas
[...truncated too long message...]
t4] 2> 121034 T17 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 121841 T47 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 121841 T47 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 121934 T69 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 121934 T69 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 122940 T105 C12 P59111 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 122947 T105 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 122948 T105 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@f4e8e20
[junit4] 2> 122948 T105 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=1,cumulative_deletesByQuery=2,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=5}
[junit4] 2> 122949 T105 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 122949 T105 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 122949 T105 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 122952 T105 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 122952 T105 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 122952 T105 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3 [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3;done=false>>]
[junit4] 2> 122953 T105 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3
[junit4] 2> 122953 T105 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index;done=false>>]
[junit4] 2> 122953 T105 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index
[junit4] 2> 122954 T105 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 122954 T105 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 122955 T105 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 122955 T105 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 123029 T124 C10 P46922 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 123030 T124 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 123030 T124 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@ee9ae71
[junit4] 2> 123032 T124 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=1,cumulative_deletesByQuery=2,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=5}
[junit4] 2> 123032 T124 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 123032 T124 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 123033 T124 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 123035 T124 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 123036 T124 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 123036 T124 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4;done=false>>]
[junit4] 2> 123037 T124 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4
[junit4] 2> 123037 T124 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4/index;done=false>>]
[junit4] 2> 123037 T124 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4/index
[junit4] 2> 123038 T124 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 123039 T124 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=en_NZ, timezone=Antarctica/McMurdo
[junit4] 2> NOTE: Linux 3.8.0-36-generic amd64/Oracle Corporation 1.8.0 (64-bit)/cpus=8,threads=1,free=87751480,total=155189248
[junit4] 2> NOTE: All tests run in this JVM: [TestJavaBinCodec, ContentStreamTest, CloudSolrServerTest]
[junit4] Completed on J0 in 123.58s, 2 tests, 1 error <<< FAILURES!
[...truncated 112 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:465: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:445: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:202: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:490: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1274: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:907: There were test failures: 49 suites, 281 tests, 1 error
Total time: 47 minutes 27 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0-fcs-b132 -XX:+UseCompressedOops -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure