You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/03/08 16:45:25 UTC
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0-fcs-b132) - Build
# 9719 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/9719/
Java: 32bit/jdk1.8.0-fcs-b132 -server -XX:+UseG1GC
1 tests failed.
REGRESSION: org.apache.solr.client.solrj.impl.CloudSolrServerTest.testShutdown
Error Message:
java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:34138 within 45000 ms
Stack Trace:
org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:34138 within 45000 ms
at __randomizedtesting.SeedInfo.seed([CB36A4686569DE38:2840ADFD82134B4A]:0)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:91)
at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:89)
at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:83)
at org.apache.solr.cloud.AbstractDistribZkTestBase.setUp(AbstractDistribZkTestBase.java:70)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.setUp(AbstractFullDistribZkTestBase.java:200)
at org.apache.solr.client.solrj.impl.CloudSolrServerTest.setUp(CloudSolrServerTest.java:78)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:771)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:34138 within 45000 ms
at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
... 46 more
Build Log:
[...truncated 11750 lines...]
[junit4] Suite: org.apache.solr.client.solrj.impl.CloudSolrServerTest
[junit4] 2> 15441 T98 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
[junit4] 2> 15441 T98 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 15443 T98 oasc.AbstractZkTestCase.<clinit> WARN TEST_HOME() does not exist - solrj test?
[junit4] 2> 15447 T98 oas.SolrTestCaseJ4.setUp ###Starting testShutdown
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1394293378644
[junit4] 2> 15450 T98 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 15452 T99 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 15552 T98 oasc.ZkTestServer.run start zk server on port:34138
[junit4] 2> 15596 T98 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 85566 T102 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 69955ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 85567 T98 oas.SolrTestCaseJ4.tearDown ###Ending testShutdown
[junit4] 2> 85589 T100 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144a25c8e940000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 85590 T98 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:34138 34138
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CloudSolrServerTest -Dtests.method=testShutdown -Dtests.seed=CB36A4686569DE38 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sk_SK -Dtests.timezone=America/Resolute -Dtests.file.encoding=UTF-8
[junit4] ERROR 70.3s J0 | CloudSolrServerTest.testShutdown <<<
[junit4] > Throwable #1: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:34138 within 45000 ms
[junit4] > at __randomizedtesting.SeedInfo.seed([CB36A4686569DE38:2840ADFD82134B4A]:0)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:91)
[junit4] > at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:89)
[junit4] > at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:83)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.setUp(AbstractDistribZkTestBase.java:70)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.setUp(AbstractFullDistribZkTestBase.java:200)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServerTest.setUp(CloudSolrServerTest.java:78)
[junit4] > at java.lang.Thread.run(Thread.java:744)
[junit4] > Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:34138 within 45000 ms
[junit4] > at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
[junit4] > ... 46 more
[junit4] 2> 85727 T98 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1394293448923
[junit4] 2> 85728 T98 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 85728 T106 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 85828 T98 oasc.ZkTestServer.run start zk server on port:43080
[junit4] 2> 85830 T98 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 85878 T112 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@134249a name:ZooKeeperConnection Watcher:127.0.0.1:43080 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 85878 T98 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 85880 T98 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 85903 T107 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144a25da0de0000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 85903 T98 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 85908 T114 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ad42f0 name:ZooKeeperConnection Watcher:127.0.0.1:43080/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 85908 T98 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 85914 T98 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 85919 T98 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 85922 T98 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 85924 T98 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 85927 T98 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 85934 T98 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 85939 T98 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 85940 T98 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 85944 T98 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml because it doesn't exist
[junit4] 2> 85944 T98 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/stopwords.txt because it doesn't exist
[junit4] 2> 85945 T98 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/protwords.txt because it doesn't exist
[junit4] 2> 85945 T98 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/currency.xml because it doesn't exist
[junit4] 2> 85945 T98 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/enumsConfig.xml because it doesn't exist
[junit4] 2> 85945 T98 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/open-exchange-rates.json because it doesn't exist
[junit4] 2> 85946 T98 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/mapping-ISOLatin1Accent.txt because it doesn't exist
[junit4] 2> 85946 T98 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/old_synonyms.txt because it doesn't exist
[junit4] 2> 85946 T98 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/synonyms.txt because it doesn't exist
[junit4] 2> 85950 T98 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 85952 T116 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c4ba4c name:ZooKeeperConnection Watcher:127.0.0.1:43080/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 85952 T98 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 85996 T98 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 85999 T98 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 86006 T98 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:55735
[junit4] 2> 86008 T98 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 86008 T98 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 86008 T98 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394293449151
[junit4] 2> 86009 T98 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394293449151/'
[junit4] 2> 86020 T98 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394293449151/solr.xml
[junit4] 2> 86031 T98 oasc.CoreContainer.<init> New CoreContainer 6112921
[junit4] 2> 86031 T98 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394293449151/]
[junit4] 2> 86032 T98 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 86032 T98 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 86033 T98 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 86033 T98 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 86033 T98 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 86033 T98 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 86034 T98 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 86034 T98 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 86034 T98 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 86038 T98 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 86039 T98 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 86040 T98 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 86040 T98 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43080/solr
[junit4] 2> 86050 T98 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 86051 T98 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 86054 T127 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5ea374 name:ZooKeeperConnection Watcher:127.0.0.1:43080 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 86055 T98 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 86061 T98 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 86065 T129 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fbca6e name:ZooKeeperConnection Watcher:127.0.0.1:43080/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 86065 T98 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 86073 T98 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 86080 T98 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 86102 T98 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 86105 T98 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55735_
[junit4] 2> 86108 T98 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55735_
[junit4] 2> 86113 T98 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 86115 T98 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 86126 T98 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:55735_
[junit4] 2> 86126 T98 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 86129 T98 oasc.Overseer.start Overseer (id=91376415468814340-127.0.0.1:55735_-n_0000000000) starting
[junit4] 2> 86139 T98 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 86158 T131 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 86159 T98 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 86162 T131 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 86165 T98 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 86172 T98 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 86185 T130 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 86190 T132 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 86191 T132 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 86194 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 86194 T132 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 86197 T130 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 86199 T130 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:55735",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55735_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 86199 T130 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 86210 T130 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 86215 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 86220 T129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 87195 T132 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 87195 T132 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394293449151/collection1
[junit4] 2> 87196 T132 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 87200 T132 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 87200 T132 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 87204 T132 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 87204 T132 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394293449151/collection1/'
[junit4] 2> 87265 T132 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 87275 T132 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 87288 T132 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 87300 T132 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 87327 T132 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableIntField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 87363 T132 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableLongField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 87369 T132 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableFloatField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 87376 T132 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableDoubleField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 87637 T132 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 87640 T132 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 87642 T132 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 87642 T132 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 87646 T132 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 87647 T132 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394293449151/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/control/data/
[junit4] 2> 87647 T132 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 87648 T132 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/control/data
[junit4] 2> 87648 T132 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/control/data/index/
[junit4] 2> 87648 T132 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 87649 T132 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/control/data/index
[junit4] 2> 87651 T132 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@e9b6d lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 87651 T132 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 87652 T132 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 87653 T132 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 87653 T132 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 87653 T132 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 87653 T132 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 87654 T132 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 87654 T132 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 87654 T132 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 87657 T132 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 87660 T132 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 87660 T132 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 87662 T132 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@e9b6d lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 87662 T132 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 87662 T132 oass.SolrIndexSearcher.<init> Opening Searcher@da4d5b[collection1] main
[junit4] 2> 87664 T132 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 87664 T133 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@da4d5b[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 87665 T98 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 87665 T98 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 87665 T136 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:55735 collection:control_collection shard:shard1
[junit4] 2> 87682 T136 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 87690 T98 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 87692 T138 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@193e29b name:ZooKeeperConnection Watcher:127.0.0.1:43080/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 87695 T98 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 87697 T98 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 87703 T136 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 87705 T98 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 87707 T136 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 87706 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 87709 T136 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C7 name=collection1 org.apache.solr.core.SolrCore@182e599 url=https://127.0.0.1:55735/collection1 node=127.0.0.1:55735_ C7_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:55735, core=collection1, node_name=127.0.0.1:55735_}
[junit4] 2> 87711 T136 C7 P55735 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:55735/collection1/
[junit4] 2> 87711 T130 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 87712 T136 C7 P55735 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 87712 T136 C7 P55735 oasc.SyncStrategy.syncToMe https://127.0.0.1:55735/collection1/ has no replicas
[junit4] 2> 87713 T136 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:55735/collection1/ shard1
[junit4] 2> 87716 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 87717 T138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 87717 T129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 87723 T136 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 87738 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 87740 T130 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 87745 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 87776 T98 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 87784 T98 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 87816 T98 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 87823 T98 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:55562
[junit4] 2> 87825 T98 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 87828 T98 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 87829 T98 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394293450911
[junit4] 2> 87830 T98 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394293450911/'
[junit4] 2> 87848 T138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 87848 T129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 87865 T98 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394293450911/solr.xml
[junit4] 2> 87879 T98 oasc.CoreContainer.<init> New CoreContainer 25020238
[junit4] 2> 87879 T98 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394293450911/]
[junit4] 2> 87880 T98 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 87880 T98 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 87880 T98 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 87881 T98 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 87881 T98 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 87881 T98 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 87882 T98 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 87882 T98 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 87882 T98 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 87887 T98 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 87887 T98 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 87888 T98 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 87888 T98 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43080/solr
[junit4] 2> 87889 T98 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 87890 T136 oasc.ZkController.register We are https://127.0.0.1:55735/collection1/ and leader is https://127.0.0.1:55735/collection1/
[junit4] 2> 87891 T136 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:55735
[junit4] 2> 87891 T136 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 87891 T136 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 87891 T136 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 87892 T98 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 87893 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 87893 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 87894 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 87894 T149 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c48807 name:ZooKeeperConnection Watcher:127.0.0.1:43080 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 87894 T98 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 87894 T136 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 87900 T98 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 87902 T151 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ce2501 name:ZooKeeperConnection Watcher:127.0.0.1:43080/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 87902 T130 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 87902 T98 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 87903 T130 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:55735",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55735_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 87907 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 87911 T98 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 88009 T151 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 88009 T138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 88015 T129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 88915 T98 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55562_
[junit4] 2> 88917 T98 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55562_
[junit4] 2> 88921 T138 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 88921 T151 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 88921 T129 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 88930 T152 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 88930 T152 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 88931 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 88931 T152 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 88931 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 88931 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 88932 T130 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 88933 T130 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:55562",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55562_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 88933 T130 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 88933 T130 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 89019 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 89121 T151 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 89121 T138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 89121 T129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 89931 T152 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 89932 T152 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394293450911/collection1
[junit4] 2> 89932 T152 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 89933 T152 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 89933 T152 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 89934 T152 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 89934 T152 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394293450911/collection1/'
[junit4] 2> 89968 T152 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 89981 T152 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 89983 T152 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 89992 T152 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 90105 T152 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 90107 T152 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 90109 T152 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 90109 T152 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 90110 T152 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 90110 T152 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394293450911/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty1/
[junit4] 2> 90110 T152 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 90111 T152 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty1
[junit4] 2> 90111 T152 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty1/index/
[junit4] 2> 90111 T152 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 90112 T152 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty1/index
[junit4] 2> 90113 T152 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1ab8770 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 90114 T152 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 90115 T152 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 90116 T152 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 90116 T152 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 90116 T152 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 90116 T152 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 90117 T152 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 90117 T152 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 90117 T152 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 90119 T152 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 90121 T152 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 90121 T152 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 90124 T152 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1ab8770 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 90124 T152 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 90125 T152 oass.SolrIndexSearcher.<init> Opening Searcher@1cf8bd9[collection1] main
[junit4] 2> 90126 T152 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 90126 T153 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1cf8bd9[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 90126 T98 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 90127 T98 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 90126 T156 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:55562 collection:collection1 shard:shard2
[junit4] 2> 90130 T156 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 90139 T156 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 90145 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 90145 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 90146 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 90146 T156 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 90147 T156 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 90148 T130 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C8 name=collection1 org.apache.solr.core.SolrCore@1cbe901 url=https://127.0.0.1:55562/collection1 node=127.0.0.1:55562_ C8_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:55562, core=collection1, node_name=127.0.0.1:55562_}
[junit4] 2> 90148 T156 C8 P55562 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:55562/collection1/
[junit4] 2> 90149 T156 C8 P55562 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 90150 T156 C8 P55562 oasc.SyncStrategy.syncToMe https://127.0.0.1:55562/collection1/ has no replicas
[junit4] 2> 90150 T156 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:55562/collection1/ shard2
[junit4] 2> 90150 T156 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 90151 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 90165 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 90174 T98 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 90176 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 90176 T98 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 90180 T98 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 90181 T98 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:38800
[junit4] 2> 90185 T98 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 90185 T98 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 90186 T98 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394293453324
[junit4] 2> 90186 T98 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394293453324/'
[junit4] 2> 90202 T98 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394293453324/solr.xml
[junit4] 2> 90213 T98 oasc.CoreContainer.<init> New CoreContainer 17454914
[junit4] 2> 90213 T98 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394293453324/]
[junit4] 2> 90214 T98 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 90214 T98 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 90214 T98 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 90215 T98 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 90215 T98 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 90215 T98 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 90215 T98 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 90216 T98 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 90216 T98 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 90220 T98 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 90220 T98 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 90221 T98 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 90221 T98 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43080/solr
[junit4] 2> 90222 T98 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 90225 T98 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 90231 T167 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ccac3e name:ZooKeeperConnection Watcher:127.0.0.1:43080 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 90231 T98 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 90236 T98 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 90243 T169 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f6965d name:ZooKeeperConnection Watcher:127.0.0.1:43080/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 90244 T98 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 90249 T98 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 90280 T151 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 90280 T129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 90280 T138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 90280 T169 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 90324 T156 oasc.ZkController.register We are https://127.0.0.1:55562/collection1/ and leader is https://127.0.0.1:55562/collection1/
[junit4] 2> 90325 T156 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:55562
[junit4] 2> 90325 T156 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 90325 T156 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 90325 T156 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 90327 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 90327 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 90327 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 90328 T156 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 90329 T130 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 90330 T130 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:55562",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55562_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 90332 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 90438 T151 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 90438 T138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 90438 T169 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 90438 T129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 91254 T98 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38800_
[junit4] 2> 91257 T98 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38800_
[junit4] 2> 91262 T151 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 91262 T138 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 91262 T169 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 91262 T129 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 91275 T170 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 91275 T170 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 91277 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 91277 T170 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 91278 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 91278 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 91281 T130 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 91282 T130 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:38800",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:38800_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 91282 T130 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 91283 T130 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 91288 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 91391 T151 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 91391 T129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 91391 T138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 91391 T169 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 92278 T170 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 92279 T170 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394293453324/collection1
[junit4] 2> 92279 T170 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 92280 T170 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 92280 T170 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 92281 T170 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 92281 T170 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394293453324/collection1/'
[junit4] 2> 92303 T170 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 92320 T170 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 92322 T170 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 92332 T170 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 92457 T170 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 92459 T170 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 92460 T170 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 92461 T170 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 92461 T170 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 92462 T170 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394293453324/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty2/
[junit4] 2> 92462 T170 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 92463 T170 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty2
[junit4] 2> 92463 T170 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty2/index/
[junit4] 2> 92463 T170 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 92464 T170 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty2/index
[junit4] 2> 92465 T170 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@e6e981 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 92466 T170 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 92467 T170 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 92467 T170 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 92467 T170 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 92468 T170 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 92468 T170 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 92468 T170 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 92469 T170 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 92469 T170 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 92471 T170 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 92472 T170 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 92473 T170 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 92473 T170 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@e6e981 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 92473 T170 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 92474 T170 oass.SolrIndexSearcher.<init> Opening Searcher@c3c26b[collection1] main
[junit4] 2> 92475 T170 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 92475 T171 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c3c26b[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 92475 T98 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 92476 T98 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 92477 T174 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:38800 collection:collection1 shard:shard1
[junit4] 2> 92479 T174 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 92486 T174 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 92489 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 92489 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 92489 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 92489 T174 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 92491 T174 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 92491 T130 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C9 name=collection1 org.apache.solr.core.SolrCore@1eff9d1 url=https://127.0.0.1:38800/collection1 node=127.0.0.1:38800_ C9_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:38800, core=collection1, node_name=127.0.0.1:38800_}
[junit4] 2> 92491 T174 C9 P38800 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:38800/collection1/
[junit4] 2> 92492 T174 C9 P38800 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 92492 T174 C9 P38800 oasc.SyncStrategy.syncToMe https://127.0.0.1:38800/collection1/ has no replicas
[junit4] 2> 92493 T174 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:38800/collection1/ shard1
[junit4] 2> 92494 T174 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 92494 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 92501 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 92504 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 92519 T98 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 92520 T98 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 92524 T98 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 92527 T98 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:54197
[junit4] 2> 92533 T98 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 92533 T98 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 92534 T98 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394293455674
[junit4] 2> 92534 T98 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394293455674/'
[junit4] 2> 92549 T98 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394293455674/solr.xml
[junit4] 2> 92561 T98 oasc.CoreContainer.<init> New CoreContainer 1156498
[junit4] 2> 92561 T98 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394293455674/]
[junit4] 2> 92562 T98 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 92562 T98 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 92562 T98 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 92563 T98 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 92563 T98 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 92563 T98 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 92563 T98 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 92564 T98 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 92564 T98 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 92568 T98 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 92569 T98 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 92569 T98 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 92569 T98 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43080/solr
[junit4] 2> 92570 T98 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 92570 T98 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 92574 T185 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f7fc7b name:ZooKeeperConnection Watcher:127.0.0.1:43080 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 92575 T98 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 92579 T107 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144a25da0de000a, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 92580 T98 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 92583 T187 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@498416 name:ZooKeeperConnection Watcher:127.0.0.1:43080/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 92583 T98 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 92590 T98 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 92609 T169 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 92610 T187 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 92609 T129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 92609 T151 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 92609 T138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 92653 T174 oasc.ZkController.register We are https://127.0.0.1:38800/collection1/ and leader is https://127.0.0.1:38800/collection1/
[junit4] 2> 92653 T174 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:38800
[junit4] 2> 92654 T174 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 92654 T174 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 92654 T174 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 92656 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 92657 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 92657 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 92657 T174 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 92664 T130 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 92665 T130 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:38800",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:38800_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 92668 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 92770 T151 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 92770 T138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 92770 T169 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 92771 T187 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 92771 T129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 93594 T98 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54197_
[junit4] 2> 93596 T98 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54197_
[junit4] 2> 93599 T138 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 93599 T187 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 93599 T129 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 93599 T151 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 93599 T169 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 93607 T188 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 93608 T188 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 93609 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 93609 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 93609 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 93611 T130 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 93611 T188 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 93612 T130 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:54197",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:54197_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 93626 T130 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 93626 T130 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 93630 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 93733 T151 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 93733 T138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 93733 T169 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 93733 T187 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 93733 T129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 94612 T188 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 94612 T188 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394293455674/collection1
[junit4] 2> 94613 T188 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 94614 T188 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 94614 T188 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 94616 T188 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 94617 T188 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394293455674/collection1/'
[junit4] 2> 94648 T188 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 94656 T188 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 94657 T188 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 94663 T188 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 94778 T188 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 94779 T188 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 94780 T188 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 94781 T188 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 94781 T188 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 94781 T188 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394293455674/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty3/
[junit4] 2> 94782 T188 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 94782 T188 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty3
[junit4] 2> 94782 T188 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty3/index/
[junit4] 2> 94783 T188 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty3/index' doesn't exist. Creating new index...
[junit4] 2> 94783 T188 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty3/index
[junit4] 2> 94784 T188 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1ae1870 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty3/index),segFN=segments_1,generation=1}
[junit4] 2> 94784 T188 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 94785 T188 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 94785 T188 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 94786 T188 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 94786 T188 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 94786 T188 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 94786 T188 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 94786 T188 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 94787 T188 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 94788 T188 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 94789 T188 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 94789 T188 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 94790 T188 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1ae1870 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty3/index),segFN=segments_1,generation=1}
[junit4] 2> 94790 T188 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 94791 T188 oass.SolrIndexSearcher.<init> Opening Searcher@1aeff62[collection1] main
[junit4] 2> 94791 T189 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1aeff62[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 94791 T188 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 94792 T98 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 94793 T98 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 94792 T192 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:54197 collection:collection1 shard:shard2
[junit4] 2> 94796 T192 oasc.ZkController.register We are https://127.0.0.1:54197/collection1/ and leader is https://127.0.0.1:55562/collection1/
[junit4] 2> 94796 T192 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:54197
[junit4] 2> 94797 T192 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4] 2> 94797 T192 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> ASYNC NEW_CORE C10 name=collection1 org.apache.solr.core.SolrCore@e7238f url=https://127.0.0.1:54197/collection1 node=127.0.0.1:54197_ C10_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:54197, core=collection1, node_name=127.0.0.1:54197_}
[junit4] 2> 94803 T193 C10 P54197 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4] 2> 94803 T192 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 94804 T193 C10 P54197 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 94805 T193 C10 P54197 oasc.ZkController.publish publishing core=collection1 state=recovering collection=collection1
[junit4] 2> 94805 T193 C10 P54197 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 94807 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 94807 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 94807 T129 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 94808 T130 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 94809 T130 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "base_url":"https://127.0.0.1:54197",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:54197_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":
[...truncated too long message...]
watch triggered, but Solr cannot talk to ZK
[junit4] 2> 107058 T169 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 107971 T187 C19 P54197 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 107977 T187 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 107977 T187 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@e7238f
[junit4] 2> 107978 T187 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=1,cumulative_deletesByQuery=2,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=5}
[junit4] 2> 107978 T187 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 107979 T187 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 107979 T187 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 107981 T187 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 107981 T187 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 107982 T187 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty3 [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty3;done=false>>]
[junit4] 2> 107982 T187 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty3
[junit4] 2> 107982 T187 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty3/index [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty3/index;done=false>>]
[junit4] 2> 107982 T187 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty3/index
[junit4] 2> 107983 T187 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 107983 T187 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 107983 T187 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 107983 T187 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 108061 T206 C17 P48324 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 108062 T206 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 108062 T206 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@14c8f1e
[junit4] 2> 108063 T206 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=1,cumulative_deletesByQuery=2,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=5}
[junit4] 2> 108063 T206 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 108063 T206 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 108063 T206 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 108065 T206 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 108065 T206 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 108065 T206 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty4/index;done=false>>]
[junit4] 2> 108065 T206 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty4/index
[junit4] 2> 108065 T206 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty4;done=false>>]
[junit4] 2> 108066 T206 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394293448923/jetty4
[junit4] 2> 108066 T206 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 108066 T206 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=105), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=105)), sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=sk_SK, timezone=America/Resolute
[junit4] 2> NOTE: Linux 3.8.0-36-generic i386/Oracle Corporation 1.8.0 (32-bit)/cpus=8,threads=1,free=38273344,total=92274688
[junit4] 2> NOTE: All tests run in this JVM: [TermsResponseTest, SolrParamTest, TestEmbeddedSolrServer, LargeVolumeBinaryJettyTest, AnlysisResponseBaseTest, ModifiableSolrParamsTest, JettyWebappTest, ContentStreamTest, NoOpResponseParserTest, CloudSolrServerTest]
[junit4] Completed on J0 in 93.46s, 2 tests, 1 error <<< FAILURES!
[...truncated 115 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:465: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:445: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:202: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:490: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1274: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:907: There were test failures: 49 suites, 281 tests, 1 error
Total time: 54 minutes 52 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-fcs-b132 -server -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0-fcs-b132) - Build
# 9720 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/9720/
Java: 64bit/jdk1.8.0-fcs-b132 -XX:-UseCompressedOops -XX:+UseG1GC
1 tests failed.
FAILED: org.apache.solr.client.solrj.impl.CloudSolrServerTest.testShutdown
Error Message:
java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:36003 within 45000 ms
Stack Trace:
org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:36003 within 45000 ms
at __randomizedtesting.SeedInfo.seed([4F2702587CA6D6D:E78479B060B0F81F]:0)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:91)
at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:89)
at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:83)
at org.apache.solr.cloud.AbstractDistribZkTestBase.setUp(AbstractDistribZkTestBase.java:70)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.setUp(AbstractFullDistribZkTestBase.java:200)
at org.apache.solr.client.solrj.impl.CloudSolrServerTest.setUp(CloudSolrServerTest.java:78)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:771)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:36003 within 45000 ms
at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
... 46 more
Build Log:
[...truncated 11620 lines...]
[junit4] Suite: org.apache.solr.client.solrj.impl.CloudSolrServerTest
[junit4] 2> log4j:WARN No such property [conversionPattern] in org.apache.solr.util.SolrLogLayout.
[junit4] 2> 1223 T13 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
[junit4] 2> 1264 T13 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /bth/
[junit4] 2> 1268 T13 oasc.AbstractZkTestCase.<clinit> WARN TEST_HOME() does not exist - solrj test?
[junit4] 2> 1297 T13 oas.SolrTestCaseJ4.setUp ###Starting testShutdown
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1394299905416
[junit4] 2> 1314 T13 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1323 T14 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1422 T13 oasc.ZkTestServer.run start zk server on port:36003
[junit4] 2> 1465 T13 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 58277 T17 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 56590ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 58289 T15 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144a2c026010000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 58295 T15 oazs.NIOServerCnxnFactory.run WARN Ignoring unexpected runtime exception java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.readyOps(SelectionKeyImpl.java:87)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:187)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 58297 T15 oazs.NIOServerCnxnFactory.run WARN Ignoring unexpected runtime exception java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.readyOps(SelectionKeyImpl.java:87)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:187)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 58315 T13 oas.SolrTestCaseJ4.tearDown ###Ending testShutdown
[junit4] 2> 58317 T13 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:36003 36003
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CloudSolrServerTest -Dtests.method=testShutdown -Dtests.seed=4F2702587CA6D6D -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en -Dtests.timezone=Asia/Thimbu -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 62.4s J0 | CloudSolrServerTest.testShutdown <<<
[junit4] > Throwable #1: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:36003 within 45000 ms
[junit4] > at __randomizedtesting.SeedInfo.seed([4F2702587CA6D6D:E78479B060B0F81F]:0)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:91)
[junit4] > at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:89)
[junit4] > at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:83)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.setUp(AbstractDistribZkTestBase.java:70)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.setUp(AbstractFullDistribZkTestBase.java:200)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServerTest.setUp(CloudSolrServerTest.java:78)
[junit4] > at java.lang.Thread.run(Thread.java:744)
[junit4] > Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:36003 within 45000 ms
[junit4] > at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
[junit4] > ... 46 more
[junit4] 2> 63634 T13 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1394299967740
[junit4] 2> 63635 T13 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 63637 T21 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 63737 T13 oasc.ZkTestServer.run start zk server on port:41411
[junit4] 2> 63738 T13 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 63851 T27 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@39c9691e name:ZooKeeperConnection Watcher:127.0.0.1:41411 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 63852 T13 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 63853 T13 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 63879 T13 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 63885 T29 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43f5f1d5 name:ZooKeeperConnection Watcher:127.0.0.1:41411/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 63886 T13 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 63892 T13 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 63900 T13 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 63906 T13 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 63910 T13 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 63916 T13 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 63933 T13 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 63941 T13 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 63942 T13 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 63947 T13 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml because it doesn't exist
[junit4] 2> 63948 T13 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/stopwords.txt because it doesn't exist
[junit4] 2> 63948 T13 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/protwords.txt because it doesn't exist
[junit4] 2> 63949 T13 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/currency.xml because it doesn't exist
[junit4] 2> 63950 T13 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/enumsConfig.xml because it doesn't exist
[junit4] 2> 63950 T13 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/open-exchange-rates.json because it doesn't exist
[junit4] 2> 63951 T13 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/mapping-ISOLatin1Accent.txt because it doesn't exist
[junit4] 2> 63952 T13 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/old_synonyms.txt because it doesn't exist
[junit4] 2> 63953 T13 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/synonyms.txt because it doesn't exist
[junit4] 2> 63959 T13 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 63962 T31 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@141f234 name:ZooKeeperConnection Watcher:127.0.0.1:41411/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 63962 T13 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 64218 T13 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 64497 T13 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 64513 T13 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:54062
[junit4] 2> 64661 T13 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 64666 T13 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 64666 T13 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394299968071
[junit4] 2> 64667 T13 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394299968071/'
[junit4] 2> 64784 T13 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394299968071/solr.xml
[junit4] 2> 64902 T13 oasc.CoreContainer.<init> New CoreContainer 1557975341
[junit4] 2> 64903 T13 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394299968071/]
[junit4] 2> 64978 T13 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 64979 T13 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 64984 T13 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 64984 T13 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 64985 T13 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 64985 T13 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 64986 T13 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 64986 T13 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 64987 T13 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 65020 T13 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 65022 T13 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 65024 T13 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 65025 T13 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41411/solr
[junit4] 2> 65034 T13 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 65035 T13 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 65040 T43 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@44071fd9 name:ZooKeeperConnection Watcher:127.0.0.1:41411 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 65041 T13 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 65049 T13 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 65053 T45 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@205111f3 name:ZooKeeperConnection Watcher:127.0.0.1:41411/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 65054 T13 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 65060 T13 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 65066 T13 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 65082 T13 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 65086 T13 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54062_bth
[junit4] 2> 65089 T13 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54062_bth
[junit4] 2> 65094 T13 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 65096 T13 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 65104 T13 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:54062_bth
[junit4] 2> 65105 T13 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 65108 T13 oasc.Overseer.start Overseer (id=91376842686136324-127.0.0.1:54062_bth-n_0000000000) starting
[junit4] 2> 65118 T13 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 65146 T47 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 65146 T13 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 65148 T47 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 65150 T13 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 65153 T13 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 65161 T46 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 65247 T48 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 65248 T48 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 65251 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 65251 T48 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 65254 T46 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 65255 T46 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:54062/bth",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:54062_bth",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 65256 T46 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 65262 T46 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 65266 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 65270 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 66253 T48 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 66254 T48 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394299968071/collection1
[junit4] 2> 66255 T48 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 66256 T48 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 66256 T48 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 66258 T48 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 66258 T48 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394299968071/collection1/'
[junit4] 2> 66319 T48 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 66374 T48 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 66382 T48 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 66478 T48 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 66572 T48 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableIntField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 66579 T48 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableLongField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 66585 T48 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableFloatField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 66591 T48 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableDoubleField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 66949 T48 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 66952 T48 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 66958 T48 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 66958 T48 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 67003 T48 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 67012 T48 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394299968071/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/control/data/
[junit4] 2> 67013 T48 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 67039 T48 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/control/data
[junit4] 2> 67040 T48 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/control/data/index/
[junit4] 2> 67040 T48 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 67051 T48 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/control/data/index
[junit4] 2> 67103 T48 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@19abe191 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 67104 T48 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 67269 T48 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 67283 T48 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 67284 T48 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 67285 T48 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 67288 T48 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 67295 T48 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 67296 T48 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 67301 T48 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 67325 T48 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 67349 T48 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 67350 T48 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 67352 T48 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@19abe191 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 67352 T48 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 67364 T48 oass.SolrIndexSearcher.<init> Opening Searcher@1a2b24e3[collection1] main
[junit4] 2> 67409 T49 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a2b24e3[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 67409 T48 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 67412 T13 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 67412 T52 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:54062/bth collection:control_collection shard:shard1
[junit4] 2> 67413 T13 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 67421 T52 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 67431 T52 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 67432 T13 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 67435 T54 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ba5613b name:ZooKeeperConnection Watcher:127.0.0.1:41411/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 67435 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 67435 T13 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 67436 T52 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 67437 T52 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 67438 T46 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C0 name=collection1 org.apache.solr.core.SolrCore@21b36c0d url=https://127.0.0.1:54062/bth/collection1 node=127.0.0.1:54062_bth C0_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:54062/bth, core=collection1, node_name=127.0.0.1:54062_bth}
[junit4] 2> 67440 T52 C0 P54062 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:54062/bth/collection1/
[junit4] 2> 67441 T13 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 67442 T52 C0 P54062 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 67443 T52 C0 P54062 oasc.SyncStrategy.syncToMe https://127.0.0.1:54062/bth/collection1/ has no replicas
[junit4] 2> 67443 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 67446 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 67447 T54 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 67447 T52 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:54062/bth/collection1/ shard1
[junit4] 2> 67456 T52 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 67458 T13 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 67470 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 67472 T46 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 67478 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 67500 T13 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 67501 T13 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 67510 T13 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 67514 T13 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:54927
[junit4] 2> 67518 T13 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 67518 T13 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 67519 T13 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394299971564
[junit4] 2> 67520 T13 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394299971564/'
[junit4] 2> 67542 T13 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394299971564/solr.xml
[junit4] 2> 67565 T13 oasc.CoreContainer.<init> New CoreContainer 1485192789
[junit4] 2> 67565 T13 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394299971564/]
[junit4] 2> 67566 T13 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 67567 T13 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 67567 T13 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 67568 T13 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 67568 T13 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 67569 T13 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 67569 T13 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 67570 T13 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 67570 T13 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 67578 T13 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 67578 T13 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 67579 T13 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 67581 T13 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41411/solr
[junit4] 2> 67581 T13 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 67582 T54 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 67582 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 67586 T13 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 67592 T65 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5809b19c name:ZooKeeperConnection Watcher:127.0.0.1:41411 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 67592 T13 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 67595 T13 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 67598 T67 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@138ee5ee name:ZooKeeperConnection Watcher:127.0.0.1:41411/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 67599 T13 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 67608 T13 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 67621 T52 oasc.ZkController.register We are https://127.0.0.1:54062/bth/collection1/ and leader is https://127.0.0.1:54062/bth/collection1/
[junit4] 2> 67623 T52 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:54062/bth
[junit4] 2> 67623 T52 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 67624 T52 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 67624 T52 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 67626 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 67626 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 67627 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 67627 T52 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 67629 T46 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 67630 T46 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:54062/bth",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:54062_bth",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 67634 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 67737 T54 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 67737 T67 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 67737 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 68613 T13 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54927_bth
[junit4] 2> 68615 T13 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54927_bth
[junit4] 2> 68618 T45 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 68618 T54 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 68618 T67 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 68629 T68 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 68629 T68 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 68631 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 68631 T68 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 68631 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 68632 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 68633 T46 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 68635 T46 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:54927/bth",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:54927_bth",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 68635 T46 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 68636 T46 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 68642 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 68746 T54 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 68746 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 68746 T67 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 69631 T68 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 69632 T68 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394299971564/collection1
[junit4] 2> 69632 T68 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 69633 T68 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 69634 T68 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 69635 T68 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 69635 T68 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394299971564/collection1/'
[junit4] 2> 69668 T68 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 69689 T68 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 69692 T68 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 69742 T68 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 69902 T68 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 69904 T68 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 69907 T68 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 69908 T68 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 69909 T68 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 69910 T68 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394299971564/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty1/
[junit4] 2> 69910 T68 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 69911 T68 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty1
[junit4] 2> 69912 T68 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty1/index/
[junit4] 2> 69912 T68 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 69912 T68 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty1/index
[junit4] 2> 69916 T68 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@3eda79b9 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 69916 T68 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 69918 T68 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 69919 T68 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 69919 T68 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 69920 T68 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 69920 T68 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 69920 T68 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 69921 T68 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 69921 T68 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 69932 T68 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 69934 T68 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 69935 T68 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 69936 T68 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@3eda79b9 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 69937 T68 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 69937 T68 oass.SolrIndexSearcher.<init> Opening Searcher@45280366[collection1] main
[junit4] 2> 69939 T69 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@45280366[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 69939 T68 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 69941 T13 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 69941 T13 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 69941 T72 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:54927/bth collection:collection1 shard:shard2
[junit4] 2> 69946 T72 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 69958 T72 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 69962 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 69962 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 69962 T72 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 69962 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 69964 T46 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 69963 T72 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1 name=collection1 org.apache.solr.core.SolrCore@f5369b url=https://127.0.0.1:54927/bth/collection1 node=127.0.0.1:54927_bth C1_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:54927/bth, core=collection1, node_name=127.0.0.1:54927_bth}
[junit4] 2> 69966 T72 C1 P54927 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:54927/bth/collection1/
[junit4] 2> 69967 T72 C1 P54927 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 69967 T72 C1 P54927 oasc.SyncStrategy.syncToMe https://127.0.0.1:54927/bth/collection1/ has no replicas
[junit4] 2> 69968 T72 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:54927/bth/collection1/ shard2
[junit4] 2> 69968 T72 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 69972 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 69978 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 69983 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 69991 T13 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 69992 T13 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 70000 T13 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 70004 T13 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:60154
[junit4] 2> 70006 T13 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 70006 T13 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 70007 T13 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394299974049
[junit4] 2> 70007 T13 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394299974049/'
[junit4] 2> 70019 T13 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394299974049/solr.xml
[junit4] 2> 70032 T13 oasc.CoreContainer.<init> New CoreContainer 239298460
[junit4] 2> 70033 T13 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394299974049/]
[junit4] 2> 70033 T13 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 70034 T13 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 70034 T13 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 70034 T13 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 70035 T13 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 70035 T13 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 70035 T13 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 70036 T13 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 70036 T13 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 70041 T13 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 70042 T13 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 70042 T13 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 70042 T13 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41411/solr
[junit4] 2> 70043 T13 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 70043 T13 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 70046 T83 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2e43e962 name:ZooKeeperConnection Watcher:127.0.0.1:41411 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 70047 T13 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 70050 T13 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 70052 T85 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@74e9f696 name:ZooKeeperConnection Watcher:127.0.0.1:41411/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 70052 T13 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 70057 T13 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 70088 T67 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 70089 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 70089 T85 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 70088 T54 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 70133 T72 oasc.ZkController.register We are https://127.0.0.1:54927/bth/collection1/ and leader is https://127.0.0.1:54927/bth/collection1/
[junit4] 2> 70134 T72 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:54927/bth
[junit4] 2> 70134 T72 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 70134 T72 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 70134 T72 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 70136 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 70137 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 70137 T72 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 70137 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 70139 T46 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 70140 T46 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:54927/bth",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:54927_bth",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 70143 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 70246 T67 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 70246 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 70246 T54 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 70246 T85 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 71065 T13 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60154_bth
[junit4] 2> 71067 T13 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60154_bth
[junit4] 2> 71070 T45 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 71070 T85 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 71070 T54 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 71070 T67 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 71077 T86 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 71077 T86 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 71079 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 71080 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 71080 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 71080 T86 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 71083 T46 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 71084 T46 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:60154/bth",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:60154_bth",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 71085 T46 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 71085 T46 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 71089 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 71193 T85 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 71194 T67 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 71194 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 71193 T54 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 72081 T86 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 72082 T86 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394299974049/collection1
[junit4] 2> 72082 T86 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 72083 T86 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 72083 T86 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 72084 T86 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 72085 T86 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394299974049/collection1/'
[junit4] 2> 72107 T86 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 72120 T86 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 72121 T86 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 72145 T86 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 72274 T86 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 72277 T86 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 72279 T86 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 72280 T86 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 72282 T86 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 72282 T86 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394299974049/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty2/
[junit4] 2> 72283 T86 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 72290 T86 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty2
[junit4] 2> 72290 T86 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty2/index/
[junit4] 2> 72292 T86 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 72296 T86 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty2/index
[junit4] 2> 72299 T86 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6ad941a5 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 72299 T86 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 72301 T86 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 72301 T86 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 72302 T86 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 72302 T86 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 72302 T86 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 72303 T86 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 72303 T86 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 72305 T86 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 72308 T86 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 72310 T86 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 72310 T86 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 72312 T86 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6ad941a5 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 72313 T86 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 72313 T86 oass.SolrIndexSearcher.<init> Opening Searcher@c97f41d[collection1] main
[junit4] 2> 72315 T87 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c97f41d[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 72315 T86 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 72316 T13 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 72316 T13 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 72316 T90 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:60154/bth collection:collection1 shard:shard1
[junit4] 2> 72319 T90 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 72345 T90 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 72348 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 72348 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 72348 T90 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 72349 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 72349 T90 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2 name=collection1 org.apache.solr.core.SolrCore@58f058e6 url=https://127.0.0.1:60154/bth/collection1 node=127.0.0.1:60154_bth C2_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:60154/bth, core=collection1, node_name=127.0.0.1:60154_bth}
[junit4] 2> 72349 T90 C2 P60154 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:60154/bth/collection1/
[junit4] 2> 72350 T90 C2 P60154 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 72350 T46 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 72350 T90 C2 P60154 oasc.SyncStrategy.syncToMe https://127.0.0.1:60154/bth/collection1/ has no replicas
[junit4] 2> 72351 T90 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:60154/bth/collection1/ shard1
[junit4] 2> 72351 T90 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 72355 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 72360 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 72365 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 72374 T13 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 72375 T13 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 72391 T13 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 72395 T13 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:56008
[junit4] 2> 72398 T13 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 72398 T13 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 72399 T13 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394299976430
[junit4] 2> 72399 T13 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394299976430/'
[junit4] 2> 72415 T13 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394299976430/solr.xml
[junit4] 2> 72431 T13 oasc.CoreContainer.<init> New CoreContainer 424806349
[junit4] 2> 72432 T13 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394299976430/]
[junit4] 2> 72432 T13 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 72433 T13 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 72433 T13 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 72433 T13 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 72433 T13 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 72434 T13 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 72434 T13 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 72434 T13 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 72435 T13 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 72440 T13 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 72441 T13 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 72441 T13 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 72442 T13 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41411/solr
[junit4] 2> 72442 T13 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 72443 T13 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 72445 T101 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@560d23a3 name:ZooKeeperConnection Watcher:127.0.0.1:41411 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 72446 T13 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 72449 T13 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 72451 T103 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5316f0dc name:ZooKeeperConnection Watcher:127.0.0.1:41411/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 72451 T13 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 72456 T13 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 72469 T85 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 72469 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 72469 T54 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 72469 T103 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 72469 T67 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 72511 T90 oasc.ZkController.register We are https://127.0.0.1:60154/bth/collection1/ and leader is https://127.0.0.1:60154/bth/collection1/
[junit4] 2> 72512 T90 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:60154/bth
[junit4] 2> 72512 T90 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 72512 T90 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 72512 T90 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 72514 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 72514 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 72514 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 72515 T90 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 72516 T46 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 72517 T46 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:60154/bth",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:60154_bth",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 72521 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 72624 T85 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 72624 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 72624 T103 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 72624 T67 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 72624 T54 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 73460 T13 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56008_bth
[junit4] 2> 73461 T13 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56008_bth
[junit4] 2> 73464 T67 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 73464 T45 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 73464 T85 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 73464 T54 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 73464 T103 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 73470 T104 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 73471 T104 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 73473 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 73473 T104 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 73473 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 73473 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 73474 T46 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 73475 T46 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:56008/bth",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56008_bth",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 73475 T46 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 73476 T46 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 73478 T45 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 73580 T85 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 73581 T54 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 73581 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 73581 T103 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 73580 T67 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 74473 T104 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 74474 T104 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394299976430/collection1
[junit4] 2> 74474 T104 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 74475 T104 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 74475 T104 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 74476 T104 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 74477 T104 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394299976430/collection1/'
[junit4] 2> 74496 T104 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 74506 T104 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 74508 T104 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 74552 T104 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 74715 T104 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 74717 T104 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 74720 T104 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 74720 T104 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 74722 T104 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 74722 T104 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394299976430/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty3/
[junit4] 2> 74723 T104 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 74724 T104 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty3
[junit4] 2> 74724 T104 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty3/index/
[junit4] 2> 74724 T104 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty3/index' doesn't exist. Creating new index...
[junit4] 2> 74724 T104 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty3/index
[junit4] 2> 74726 T104 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1dce5677 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty3/index),segFN=segments_1,generation=1}
[junit4] 2> 74727 T104 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 74728 T104 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 74728 T104 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 74729 T104 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 74729 T104 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 74729 T104 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 74729 T104 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 74729 T104 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 74730 T104 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 74732 T104 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 74733 T104 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 74733 T104 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 74734 T104 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1dce5677 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty3/index),segFN=segments_1,generation=1}
[junit4] 2> 74734 T104 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 74735 T104 oass.SolrIndexSearcher.<init> Opening Searcher@3e07b3ac[collection1] main
[junit4] 2> 74736 T105 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3e07b3ac[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 74736 T104 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 74738 T13 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 74739 T13 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 74738 T108 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:56008/bth collection:collection1 shard:shard2
[junit4] 2> 74742 T108 oasc.ZkController.register We are https://127.0.0.1:56008/bth/collection1/ and leader is https://127.0.0.1:54927/bth/collection1/
[junit4] 2> 74742 T108 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:56008/bth
[junit4] 2> 74743 T108 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4] 2> 74743 T108 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> 74747 T108 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C3 name=collection1 org.apache.solr.core.SolrCore@4d541e9b url=https://127.0.0.1:56008/bth/collection1 node=127.0.0.1:56008_bth C3_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:5
[...truncated too long message...]
o 127.0.0.1:41411 41411
[junit4] 2> 86926 T45 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 88211 T122 C9 P47158 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 88077 T103 C11 P56008 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 87205 T85 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 87058 T67 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 91179 T67 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 91185 T122 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 91185 T103 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 91186 T103 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@4d541e9b
[junit4] 2> 91185 T122 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@14534711
[junit4] 2> 91186 T122 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=1,cumulative_deletesByQuery=2,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=5}
[junit4] 2> 91186 T103 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=1,cumulative_deletesByQuery=2,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=5}
[junit4] 2> 91187 T103 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 91188 T103 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 91188 T103 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 91190 T13 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 91187 T122 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 91191 T122 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 91191 T122 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 91196 T103 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 91196 T122 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 91197 T103 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 91199 T103 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty3 [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty3;done=false>>]
[junit4] 2> 91199 T103 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty3
[junit4] 2> 91199 T103 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty3/index [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty3/index;done=false>>]
[junit4] 2> 91200 T103 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty3/index
[junit4] 2> 91200 T103 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 91200 T103 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 91201 T103 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 91201 T122 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 91202 T122 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty4/index;done=false>>]
[junit4] 2> 91202 T122 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty4/index
[junit4] 2> 91202 T122 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty4;done=false>>]
[junit4] 2> 91202 T103 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 91203 T122 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394299967739/jetty4
[junit4] 2> 91204 T122 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 91205 T122 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=DefaultSimilarity, locale=en, timezone=Asia/Thimbu
[junit4] 2> NOTE: Linux 3.8.0-36-generic amd64/Oracle Corporation 1.8.0 (64-bit)/cpus=8,threads=1,free=173305256,total=255852544
[junit4] 2> NOTE: All tests run in this JVM: [CloudSolrServerTest]
[junit4] Completed on J0 in 92.35s, 2 tests, 1 error <<< FAILURES!
[...truncated 118 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:465: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:445: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:202: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:490: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1274: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:907: There were test failures: 49 suites, 281 tests, 1 error
Total time: 51 minutes 27 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0-fcs-b132 -XX:-UseCompressedOops -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure