You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/09/27 00:22:11 UTC
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_67) - Build #
11335 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11335/
Java: 32bit/jdk1.7.0_67 -client -XX:+UseSerialGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.HttpPartitionTest.testDistribSearch
Error Message:
Send doc 2 to old leader core_node1 should have failed! ClusterState: DocCollection(c8n_1x2_leader_session_loss)={ "router":{"name":"compositeId"}, "autoAddReplicas":"false", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node1":{ "base_url":"http://127.0.0.1:39631/nsudd/uz", "node_name":"127.0.0.1:39631_nsudd%2Fuz", "state":"down", "core":"c8n_1x2_leader_session_loss_shard1_replica1"}, "core_node2":{ "base_url":"http://127.0.0.1:58129/nsudd/uz", "node_name":"127.0.0.1:58129_nsudd%2Fuz", "state":"active", "core":"c8n_1x2_leader_session_loss_shard1_replica2", "leader":"true"}}}}, "replicationFactor":"2", "maxShardsPerNode":"1"}
Stack Trace:
java.lang.AssertionError: Send doc 2 to old leader core_node1 should have failed! ClusterState: DocCollection(c8n_1x2_leader_session_loss)={
"router":{"name":"compositeId"},
"autoAddReplicas":"false",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node1":{
"base_url":"http://127.0.0.1:39631/nsudd/uz",
"node_name":"127.0.0.1:39631_nsudd%2Fuz",
"state":"down",
"core":"c8n_1x2_leader_session_loss_shard1_replica1"},
"core_node2":{
"base_url":"http://127.0.0.1:58129/nsudd/uz",
"node_name":"127.0.0.1:58129_nsudd%2Fuz",
"state":"active",
"core":"c8n_1x2_leader_session_loss_shard1_replica2",
"leader":"true"}}}},
"replicationFactor":"2",
"maxShardsPerNode":"1"}
at __randomizedtesting.SeedInfo.seed([7A8432D898021CF4:FB62BCC0EF5D7CC8]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.HttpPartitionTest.testLeaderZkSessionLoss(HttpPartitionTest.java:329)
at org.apache.solr.cloud.HttpPartitionTest.doTest(HttpPartitionTest.java:119)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11915 lines...]
[junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/init-core-data-001
[junit4] 2> 2120725 T6224 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /nsudd/uz
[junit4] 2> 2120727 T6224 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 2120728 T6224 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2120728 T6225 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2120828 T6224 oasc.ZkTestServer.run start zk server on port:36346
[junit4] 2> 2120829 T6224 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2120830 T6224 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2120831 T6231 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@83d10e name:ZooKeeperConnection Watcher:127.0.0.1:36346 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2120832 T6224 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2120832 T6224 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2120832 T6224 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2120834 T6224 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2120835 T6224 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2120836 T6233 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7a982c name:ZooKeeperConnection Watcher:127.0.0.1:36346/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2120837 T6224 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2120837 T6224 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2120837 T6224 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 2120839 T6224 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 2120840 T6224 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 2120841 T6224 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 2120842 T6224 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 2120843 T6224 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 2120845 T6224 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 2120845 T6224 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 2120847 T6224 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2120847 T6224 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2120848 T6224 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 2120849 T6224 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 2120850 T6224 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 2120851 T6224 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 2120852 T6224 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 2120852 T6224 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 2120854 T6224 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 2120854 T6224 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 2120856 T6224 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2120856 T6224 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 2120857 T6224 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2120858 T6224 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2120859 T6224 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 2120860 T6224 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 2120861 T6224 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 2120862 T6224 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 2121131 T6224 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2121133 T6224 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53673
[junit4] 2> 2121134 T6224 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2121134 T6224 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2121135 T6224 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-002
[junit4] 2> 2121135 T6224 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-002/'
[junit4] 2> 2121148 T6224 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-002/solr.xml
[junit4] 2> 2121194 T6224 oasc.CoreContainer.<init> New CoreContainer 460940
[junit4] 2> 2121194 T6224 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-002/]
[junit4] 2> 2121195 T6224 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2121196 T6224 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2121196 T6224 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2121196 T6224 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2121197 T6224 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2121197 T6224 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2121197 T6224 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2121197 T6224 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2121198 T6224 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2121198 T6224 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2121199 T6224 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2121199 T6224 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2121199 T6224 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2121200 T6224 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36346/solr
[junit4] 2> 2121200 T6224 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2121200 T6224 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2121201 T6224 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2121202 T6244 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c259d0 name:ZooKeeperConnection Watcher:127.0.0.1:36346 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2121203 T6224 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2121203 T6224 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2121205 T6224 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2121205 T6246 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8468e6 name:ZooKeeperConnection Watcher:127.0.0.1:36346/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2121206 T6224 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2121207 T6224 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2121208 T6224 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2121210 T6224 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 2121212 T6224 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 2121213 T6224 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 2121215 T6224 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2121216 T6224 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39631_nsudd%2Fuz
[junit4] 2> 2121217 T6224 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39631_nsudd%2Fuz
[junit4] 2> 2121219 T6224 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2121220 T6224 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2121221 T6224 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2121222 T6224 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:39631_nsudd%2Fuz
[junit4] 2> 2121223 T6224 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2121224 T6224 oasc.Overseer.start Overseer (id=92521703649181699-127.0.0.1:39631_nsudd%2Fuz-n_0000000000) starting
[junit4] 2> 2121225 T6224 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2121230 T6224 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 2121231 T6248 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2121232 T6224 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2121233 T6224 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2121234 T6224 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2121237 T6247 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2121240 T6250 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 2121241 T6250 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2121241 T6250 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2121241 T6251 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2121243 T6247 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "shard":null,
[junit4] 2> "base_url":"http://127.0.0.1:39631/nsudd/uz",
[junit4] 2> "operation":"state",
[junit4] 2> "node_name":"127.0.0.1:39631_nsudd%2Fuz",
[junit4] 2> "state":"down",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "core":"collection1"}
[junit4] 2> 2121244 T6247 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 2121244 T6247 oasc.Overseer$ClusterStateUpdater.createCollection state version control_collection 1
[junit4] 2> 2121244 T6247 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2121246 T6251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2122242 T6250 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2122242 T6250 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 2122243 T6250 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2122243 T6250 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 2122244 T6250 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2122244 T6250 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-002/collection1/'
[junit4] 2> 2122245 T6250 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 2122245 T6250 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 2122245 T6250 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 2122274 T6250 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2122302 T6250 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2122303 T6250 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2122317 T6250 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2122829 T6250 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2122834 T6250 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2122836 T6250 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2122845 T6250 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2122847 T6250 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2122850 T6250 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2122850 T6250 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2122851 T6250 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2122851 T6250 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2122851 T6250 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2122852 T6250 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2122852 T6250 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 2122852 T6250 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2122852 T6250 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-001/control/data/
[junit4] 2> 2122853 T6250 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1976643
[junit4] 2> 2122853 T6250 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-001/control/data
[junit4] 2> 2122853 T6250 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-001/control/data/index/
[junit4] 2> 2122853 T6250 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 2122854 T6250 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-001/control/data/index
[junit4] 2> 2122854 T6250 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1128671454, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 2122855 T6250 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-1fcdb0e)),segFN=segments_1,generation=1}
[junit4] 2> 2122855 T6250 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2122857 T6250 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2122857 T6250 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2122858 T6250 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2122858 T6250 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2122858 T6250 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2122858 T6250 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2122858 T6250 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2122859 T6250 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2122859 T6250 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2122859 T6250 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2122860 T6250 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2122860 T6250 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2122860 T6250 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2122861 T6250 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2122861 T6250 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2122861 T6250 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2122861 T6250 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2122862 T6250 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2122862 T6250 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2122862 T6250 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2122865 T6250 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2122866 T6250 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2122867 T6250 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2122868 T6250 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2122870 T6250 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2122870 T6250 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2122871 T6250 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=91.154296875, floorSegmentMB=0.607421875, forceMergeDeletesPctAllowed=22.822579175611196, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6460807395395409
[junit4] 2> 2122871 T6250 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-1fcdb0e)),segFN=segments_1,generation=1}
[junit4] 2> 2122871 T6250 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2122871 T6250 oass.SolrIndexSearcher.<init> Opening Searcher@129a7a1[collection1] main
[junit4] 2> 2122872 T6250 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 2122873 T6250 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2122873 T6250 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2122873 T6250 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2122873 T6250 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 2122874 T6250 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2122874 T6250 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 2122874 T6250 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2122875 T6250 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
[junit4] 2> 2122876 T6250 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
[junit4] 2> 2122876 T6250 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2122876 T6250 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 2122878 T6252 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@129a7a1[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2122880 T6250 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2122881 T6255 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:39631/nsudd/uz collection:control_collection shard:shard1
[junit4] 2> 2122881 T6224 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 2122882 T6224 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2122882 T6255 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 2122885 T6224 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2122885 T6255 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 2122886 T6224 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2122886 T6258 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@77d7fd name:ZooKeeperConnection Watcher:127.0.0.1:36346/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2122887 T6224 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2122887 T6255 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2122887 T6255 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 2122887 T6251 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> ASYNC NEW_CORE C3628 name=collection1 org.apache.solr.core.SolrCore@1a94074 url=http://127.0.0.1:39631/nsudd/uz/collection1 node=127.0.0.1:39631_nsudd%2Fuz C3628_STATE=coll:control_collection core:collection1 props:{base_url=http://127.0.0.1:39631/nsudd/uz, node_name=127.0.0.1:39631_nsudd%2Fuz, state=down, core=collection1}
[junit4] 2> 2122887 T6255 C3628 P39631 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:39631/nsudd/uz/collection1/
[junit4] 2> 2122887 T6224 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2122888 T6255 C3628 P39631 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2122888 T6255 C3628 P39631 oasc.SyncStrategy.syncToMe http://127.0.0.1:39631/nsudd/uz/collection1/ has no replicas
[junit4] 2> 2122889 T6224 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2122889 T6255 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:39631/nsudd/uz/collection1/ shard1
[junit4] 2> 2122890 T6255 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 2122890 T6251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2122891 T6259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2122891 T6224 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 2122893 T6251 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2122997 T6259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2122997 T6251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2123044 T6255 oasc.ZkController.register We are http://127.0.0.1:39631/nsudd/uz/collection1/ and leader is http://127.0.0.1:39631/nsudd/uz/collection1/
[junit4] 2> 2123044 T6255 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:39631/nsudd/uz
[junit4] 2> 2123045 T6255 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2123045 T6255 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 2123045 T6255 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2123046 T6251 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2123049 T6247 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "roles":null,
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "base_url":"http://127.0.0.1:39631/nsudd/uz",
[junit4] 2> "operation":"state",
[junit4] 2> "node_name":"127.0.0.1:39631_nsudd%2Fuz",
[junit4] 2> "state":"active",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "core":"collection1"}
[junit4] 2> 2123151 T6251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2123151 T6259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2123327 T6224 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 2123328 T6224 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2123330 T6224 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:46371
[junit4] 2> 2123331 T6224 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2123332 T6224 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2123332 T6224 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-003
[junit4] 2> 2123333 T6224 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-003/'
[junit4] 2> 2123351 T6224 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-003/solr.xml
[junit4] 2> 2123408 T6224 oasc.CoreContainer.<init> New CoreContainer 31617417
[junit4] 2> 2123408 T6224 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-003/]
[junit4] 2> 2123409 T6224 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2123410 T6224 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2123410 T6224 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2123411 T6224 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2123411 T6224 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2123412 T6224 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2123412 T6224 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2123413 T6224 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2123413 T6224 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2123414 T6224 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2123414 T6224 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2123415 T6224 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2123415 T6224 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2123416 T6224 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36346/solr
[junit4] 2> 2123416 T6224 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2123417 T6224 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2123417 T6224 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2123418 T6270 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18c0672 name:ZooKeeperConnection Watcher:127.0.0.1:36346 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2123419 T6224 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2123420 T6224 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2123421 T6224 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2123422 T6272 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cb6cd8 name:ZooKeeperConnection Watcher:127.0.0.1:36346/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2123422 T6224 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2123425 T6224 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2124427 T6224 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57642_nsudd%2Fuz
[junit4] 2> 2124428 T6224 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57642_nsudd%2Fuz
[junit4] 2> 2124432 T6224 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2124435 T6274 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 2124435 T6274 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2124436 T6251 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2124436 T6274 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2124438 T6247 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":null,
[junit4] 2> "base_url":"http://127.0.0.1:57642/nsudd/uz",
[junit4] 2> "operation":"state",
[junit4] 2> "node_name":"127.0.0.1:57642_nsudd%2Fuz",
[junit4] 2> "state":"down",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"collection1"}
[junit4] 2> 2124438 T6247 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 2124438 T6247 oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 1
[junit4] 2> 2124439 T6247 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2124541 T6259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2124541 T6273 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2124541 T6251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2125437 T6274 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2125437 T6274 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 2125438 T6274 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2125438 T6274 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2125438 T6274 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2125439 T6274 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-003/collection1/'
[junit4] 2> 2125439 T6274 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 2125440 T6274 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 2125440 T6274 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 2125475 T6274 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2125514 T6274 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2125515 T6274 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2125522 T6274 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2125761 T6274 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2125766 T6274 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2125768 T6274 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2125775 T6274 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2125777 T6274 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2125779 T6274 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2125780 T6274 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2125781 T6274 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2125781 T6274 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2125782 T6274 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2125782 T6274 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2125782 T6274 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 2125782 T6274 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2125782 T6274 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-003/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-001/jetty1/
[junit4] 2> 2125783 T6274 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1976643
[junit4] 2> 2125783 T6274 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-001/jetty1
[junit4] 2> 2125783 T6274 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-001/jetty1/index/
[junit4] 2> 2125784 T6274 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 2125784 T6274 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-001/jetty1/index
[junit4] 2> 2125784 T6274 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1128671454, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 2125785 T6274 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-90e48a)),segFN=segments_1,generation=1}
[junit4] 2> 2125785 T6274 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2125793 T6274 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2125793 T6274 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2125793 T6274 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2125794 T6274 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2125794 T6274 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2125794 T6274 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2125794 T6274 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2125794 T6274 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2125795 T6274 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2125795 T6274 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2125796 T6274 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2125796 T6274 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2125797 T6274 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2125797 T6274 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2125797 T6274 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2125798 T6274 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2125798 T6274 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2125798 T6274 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2125799 T6274 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2125799 T6274 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2125802 T6274 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2125803 T6274 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2125804 T6274 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2125805 T6274 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2125807 T6274 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2125807 T6274 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2125807 T6274 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=91.154296875, floorSegmentMB=0.607421875, forceMergeDeletesPctAllowed=22.822579175611196, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6460807395395409
[junit4] 2> 2125808 T6274 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-90e48a)),segFN=segments_1,generation=1}
[junit4] 2> 2125808 T6274 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2125808 T6274 oass.SolrIndexSearcher.<init> Opening Searcher@160a54b[collection1] main
[junit4] 2> 2125809 T6274 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2125809 T6274 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2125810 T6274 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2125810 T6274 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2125810 T6274 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 2125811 T6274 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2125811 T6274 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 2125812 T6274 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2125812 T6274 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 2125812 T6274 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 2125815 T6275 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@160a54b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2125818 T6274 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2125819 T6278 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:57642/nsudd/uz collection:collection1 shard:shard1
[junit4] 2> 2125819 T6224 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 2125819 T6278 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2125819 T6224 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2125822 T6278 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 2125823 T6251 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2125823 T6278 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2125824 T6278 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C3629 name=collection1 org.apache.solr.core.SolrCore@1a909f2 url=http://127.0.0.1:57642/nsudd/uz/collection1 node=127.0.0.1:57642_nsudd%2Fuz C3629_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:57642/nsudd/uz, node_name=127.0.0.1:57642_nsudd%2Fuz, state=down, core=collection1}
[junit4] 2> 2125824 T6278 C3629 P57642 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:57642/nsudd/uz/collection1/
[junit4] 2> 2125824 T6278 C3629 P57642 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2125824 T6278 C3629 P57642 oasc.SyncStrategy.syncToMe http://127.0.0.1:57642/nsudd/uz/collection1/ has no replicas
[junit4] 2> 2125825 T6278 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:57642/nsudd/uz/collection1/ shard1
[junit4] 2> 2125825 T6278 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2125828 T6251 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2125930 T6251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2125930 T6273 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2125930 T6259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2125978 T6278 oasc.ZkController.register We are http://127.0.0.1:57642/nsudd/uz/collection1/ and leader is http://127.0.0.1:57642/nsudd/uz/collection1/
[junit4] 2> 2125979 T6278 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57642/nsudd/uz
[junit4] 2> 2125979 T6278 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2125979 T6278 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 2125979 T6278 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2125980 T6251 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2125982 T6247 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "roles":null,
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "base_url":"http://127.0.0.1:57642/nsudd/uz",
[junit4] 2> "operation":"state",
[junit4] 2> "node_name":"127.0.0.1:57642_nsudd%2Fuz",
[junit4] 2> "state":"active",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"collection1"}
[junit4] 2> 2126084 T6251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2126084 T6273 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2126084 T6259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2126094 T6224 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 2126094 T6224 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2126096 T6224 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:38823
[junit4] 2> 2126097 T6224 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2126097 T6224 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2126098 T6224 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-004
[junit4] 2> 2126098 T6224 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-004/'
[junit4] 2> 2126110 T6224 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-004/solr.xml
[junit4] 2> 2126139 T6224 oasc.CoreContainer.<init> New CoreContainer 4915013
[junit4] 2> 2126139 T6224 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-004/]
[junit4] 2> 2126140 T6224 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2126140 T6224 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2126141 T6224 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2126141 T6224 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2126141 T6224 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2126141 T6224 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2126151 T6224 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2126152 T6224 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2126152 T6224 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2126152 T6224 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2126153 T6224 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2126153 T6224 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2126153 T6224 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2126154 T6224 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36346/solr
[junit4] 2> 2126154 T6224 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2126154 T6224 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2126155 T6224 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2126156 T6290 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4f93ef name:ZooKeeperConnection Watcher:127.0.0.1:36346 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2126157 T6224 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2126157 T6224 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2126159 T6224 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2126159 T6292 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ea3dd7 name:ZooKeeperConnection Watcher:127.0.0.1:36346/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2126159 T6224 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2126164 T6224 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2127166 T6224 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58129_nsudd%2Fuz
[junit4] 2> 2127167 T6224 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58129_nsudd%2Fuz
[junit4] 2> 2127170 T6224 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2127174 T6294 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 2127175 T6294 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2127175 T6251 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2127175 T6294 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2127177 T6247 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":null,
[junit4] 2> "base_url":"http://127.0.0.1:58129/nsudd/uz",
[junit4] 2> "operation":"state",
[junit4] 2> "node_name":"127.0.0.1:58129_nsudd%2Fuz",
[junit4] 2> "state":"down",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"collection1"}
[junit4] 2> 2127177 T6247 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 2127177 T6247 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 2127279 T6259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2127279 T6293 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2127279 T6251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2127279 T6273 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2128176 T6294 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2128176 T6294 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 2128177 T6294 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2128177 T6294 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2128178 T6294 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2128178 T6294 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-004/collection1/'
[junit4] 2> 2128178 T6294 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 2128179 T6294 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 2128179 T6294 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 2128212 T6294 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2128242 T6294 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2128243 T6294 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2128250 T6294 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2128499 T6294 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2128504 T6294 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2128506 T6294 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2128514 T6294 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2128517 T6294 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2128519 T6294 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2128520 T6294 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2128521 T6294 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2128521 T6294 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2128522 T6294 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2128522 T6294 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2128522 T6294 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 2128522 T6294 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2128522 T6294 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-004/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-001/jetty2/
[junit4] 2> 2128523 T6294 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1976643
[junit4] 2> 2128523 T6294 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-001/jetty2
[junit4] 2> 2128523 T6294 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-001/jetty2/index/
[junit4] 2> 2128524 T6294 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 2128524 T6294 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-001/jetty2/index
[junit4] 2> 2128524 T6294 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1128671454, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 2128525 T6294 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-19cdcad)),segFN=segments_1,generation=1}
[junit4] 2> 2128525 T6294 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2128527 T6294 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2128528 T6294 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2128528 T6294 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2128528 T6294 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2128528 T6294 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2128529 T6294 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2128529 T6294 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2128529 T6294 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2128529 T6294 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2128530 T6294 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2128530 T6294 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2128531 T6294 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2128531 T6294 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2128532 T6294 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2128532 T6294 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2128532 T6294 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2128533 T6294 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2128533 T6294 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2128533 T6294 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2128534 T6294 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2128536 T6294 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2128537 T6294 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2128538 T6294 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2128539 T6294 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2128541 T6294 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2128541 T6294 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2128542 T6294 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=91.154296875, floorSegmentMB=0.607421875, forceMergeDeletesPctAllowed=22.822579175611196, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6460807395395409
[junit4] 2> 2128543 T6294 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-19cdcad)),segFN=segments_1,generation=1}
[junit4] 2> 2128543 T6294 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2128543 T6294 oass.SolrIndexSearcher.<init> Opening Searcher@1b05916[collection1] main
[junit4] 2> 2128543 T6294 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2128544 T6294 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2128544 T6294 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2128545 T6294 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2128545 T6294 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 2128545 T6294 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2128546 T6294 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 2128546 T6294 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2128546 T6294 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 2128546 T6294 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 2128549 T6295 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b05916[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2128552 T6294 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2128553 T6298 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58129/nsudd/uz collection:collection1 shard:shard2
[junit4] 2> 2128553 T6224 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 2128554 T6224 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2128554 T6298 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 2128557 T6298 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 2128558 T6251 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2128558 T6298 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2128559 T6298 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C3630 name=collection1 org.apache.solr.core.SolrCore@ffe407 url=http://127.0.0.1:58129/nsudd/uz/collection1 node=127.0.0.1:58129_nsudd%2Fuz C3630_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:58129/nsudd/uz, node_name=127.0.0.1:58129_nsudd%2Fuz, state=down, core=collection1}
[junit4] 2> 2128559 T6298 C3630 P58129 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:58129/nsudd/uz/collection1/
[junit4] 2> 2128559 T6298 C3630 P58129 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2128559 T6298 C3630 P58129 oasc.SyncStrategy.syncToMe http://127.0.0.1:58129/nsudd/uz/collection1/ has no replicas
[junit4] 2> 2128559 T6298 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:58129/nsudd/uz/collection1/ shard2
[junit4] 2> 2128560 T6298 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 2128562 T6251 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2128665 T6273 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2128665 T6293 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2128665 T6259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2128665 T6251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2128713 T6298 oasc.ZkController.register We are http://127.0.0.1:58129/nsudd/uz/collection1/ and leader is http://127.0.0.1:58129/nsudd/uz/collection1/
[junit4] 2> 2128713 T6298 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58129/nsudd/uz
[junit4] 2> 2128713 T6298 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2128714 T6298 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 2128714 T6298 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2128715 T6251 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2128717 T6247 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "roles":null,
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "base_url":"http://127.0.0.1:58129/nsudd/uz",
[junit4] 2> "operation":"state",
[junit4] 2> "node_name":"127.0.0.1:58129_nsudd%2Fuz",
[junit4] 2> "state":"active",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"collection1"}
[junit4] 2> 2128819 T6293 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2128819 T6251 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2128819 T6259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2128819 T6273 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2128833 T6224 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 2128833 T6224 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2128835 T6224 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35756
[junit4] 2> 2128836 T6224 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2128836 T6224 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2128836 T6224 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-005
[junit4] 2> 2128837 T6224 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-005/'
[junit4] 2> 2128849 T6224 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-005/solr.xml
[junit4] 2> 2128878 T6224 oasc.CoreContainer.<init> New CoreContainer 21056089
[junit4] 2> 2128878 T6224 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001/tempDir-005/]
[junit4] 2> 2128879 T6224 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2128879 T6224 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2128880 T6224 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2128880 T6224 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2128880 T6224 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2128880 T6224 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2128881 T6224 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2128881 T6224 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2128881 T6224 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2128882 T6224 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2128882 T6224 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2128882 T6224 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2128883 T6224 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2128883 T6224 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36346/solr
[junit4] 2> 2128883 T6224 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2128884 T6224 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2128885 T6224 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2128886 T6310 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1782916 name:ZooKeeperConnection Watcher:127.0.0.1:36346 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2128887 T6224 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2128887 T6224 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2128889 T6224 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2128889 T6312 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1078098 name:ZooKeeperConnection Watcher:127.0.0.1:36346/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2128890 T6224 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2128893 T6224 oascc.
[...truncated too long message...]
live_nodes
[junit4] 2> 4 /solr/overseer/collection-queue-work
[junit4] 2> 4 /solr/overseer/queue
[junit4] 2>
[junit4] 2> 2226240 T6224 oasc.SocketProxy.close WARN Closing 0 connections to: http://127.0.0.1:58129/nsudd/uz
[junit4] 2> 2226241 T6224 oasc.SocketProxy.close WARN Closing 0 connections to: http://127.0.0.1:57642/nsudd/uz
[junit4] 2> 2226241 T6224 oasc.SocketProxy.close WARN Closing 0 connections to: http://127.0.0.1:39631/nsudd/uz
[junit4] 2> 2226241 T6224 oasc.SocketProxy.close WARN Closing 0 connections to: http://127.0.0.1:41919/nsudd/uz
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=HttpPartitionTest -Dtests.method=testDistribSearch -Dtests.seed=7A8432D898021CF4 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=de_LU -Dtests.timezone=Pacific/Midway -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 106s J1 | HttpPartitionTest.testDistribSearch <<<
[junit4] > Throwable #1: java.lang.AssertionError: Send doc 2 to old leader core_node1 should have failed! ClusterState: DocCollection(c8n_1x2_leader_session_loss)={
[junit4] > "router":{"name":"compositeId"},
[junit4] > "autoAddReplicas":"false",
[junit4] > "shards":{"shard1":{
[junit4] > "range":"80000000-7fffffff",
[junit4] > "state":"active",
[junit4] > "replicas":{
[junit4] > "core_node1":{
[junit4] > "base_url":"http://127.0.0.1:39631/nsudd/uz",
[junit4] > "node_name":"127.0.0.1:39631_nsudd%2Fuz",
[junit4] > "state":"down",
[junit4] > "core":"c8n_1x2_leader_session_loss_shard1_replica1"},
[junit4] > "core_node2":{
[junit4] > "base_url":"http://127.0.0.1:58129/nsudd/uz",
[junit4] > "node_name":"127.0.0.1:58129_nsudd%2Fuz",
[junit4] > "state":"active",
[junit4] > "core":"c8n_1x2_leader_session_loss_shard1_replica2",
[junit4] > "leader":"true"}}}},
[junit4] > "replicationFactor":"2",
[junit4] > "maxShardsPerNode":"1"}
[junit4] > at __randomizedtesting.SeedInfo.seed([7A8432D898021CF4:FB62BCC0EF5D7CC8]:0)
[junit4] > at org.apache.solr.cloud.HttpPartitionTest.testLeaderZkSessionLoss(HttpPartitionTest.java:329)
[junit4] > at org.apache.solr.cloud.HttpPartitionTest.doTest(HttpPartitionTest.java:119)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 2226256 T6224 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-7A8432D898021CF4-001
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=DefaultSimilarity, locale=de_LU, timezone=Pacific/Midway
[junit4] 2> NOTE: Linux 3.13.0-36-generic i386/Oracle Corporation 1.7.0_67 (32-bit)/cpus=8,threads=1,free=51644056,total=202301440
[junit4] 2> NOTE: All tests run in this JVM: [TestOmitPositions, HdfsRecoveryZkTest, TestMissingGroups, TestMaxScoreQueryParser, ChangedSchemaMergeTest, TestIBSimilarityFactory, QueryElevationComponentTest, SoftAutoCommitTest, CursorMarkTest, TestManagedSchemaFieldTypeResource, MultiTermTest, DistributedQueryElevationComponentTest, FullSolrCloudDistribCmdsTest, MergeStrategyTest, PreAnalyzedUpdateProcessorTest, CurrencyFieldXmlFileTest, TestUtils, TestLFUCache, BasicDistributedZk2Test, TestDefaultSearchFieldResource, DocValuesTest, TestQuerySenderNoQuery, TestWriterPerf, ModifyConfFileTest, FieldAnalysisRequestHandlerTest, TestSweetSpotSimilarityFactory, OutputWriterTest, HdfsDirectoryTest, LukeRequestHandlerTest, HdfsCollectionsAPIDistributedZkTest, TestFieldTypeCollectionResource, PrimUtilsTest, SampleTest, DocValuesMissingTest, ReplicationFactorTest, TestGroupingSearch, EnumFieldTest, TestHighlightDedupGrouping, TestReRankQParserPlugin, TestIndexingPerformance, ClusterStateTest, TestReversedWildcardFilterFactory, UUIDFieldTest, TestLazyCores, TestNoOpRegenerator, TestManagedResourceStorage, TestSchemaNameResource, SharedFSAutoReplicaFailoverUtilsTest, DistributedDebugComponentTest, TestIndexSearcher, LoggingHandlerTest, SSLMigrationTest, CollectionsAPIDistributedZkTest, DateFieldTest, AnalyticsMergeStrategyTest, TestInitParams, TestCharFilters, DateMathParserTest, TestJmxMonitoredMap, TestImplicitCoreProperties, FileBasedSpellCheckerTest, TestReloadAndDeleteDocs, TestSolrQueryParser, TermVectorComponentDistributedTest, TestPostingsSolrHighlighter, SOLR749Test, TestRestManager, TestSolrXmlPersistence, PolyFieldTest, SortByFunctionTest, TestFieldCollectionResource, DistanceFunctionTest, DefaultValueUpdateProcessorTest, TestPHPSerializedResponseWriter, TestFieldSortValues, TestPerFieldSimilarity, ZkSolrClientTest, TestXIncludeConfig, BadCopyFieldTest, OverriddenZkACLAndCredentialsProvidersTest, HdfsUnloadDistributedZkTest, TestExceedMaxTermLength, SolrRequestParserTest, TestFieldResource, DeleteInactiveReplicaTest, ExitableDirectoryReaderTest, TestRandomFaceting, DistributedQueryComponentCustomSortTest, TestCSVResponseWriter, ChaosMonkeySafeLeaderTest, DocExpirationUpdateProcessorFactoryTest, DeleteShardTest, TestRandomMergePolicy, OpenCloseCoreStressTest, TestComplexPhraseQParserPlugin, SimplePostToolTest, LeaderElectionIntegrationTest, InfoHandlerTest, TestRecovery, AutoCommitTest, DistributedTermsComponentTest, NumericFieldsTest, CSVRequestHandlerTest, TestDynamicFieldResource, BasicZkTest, ClusterStateUpdateTest, TestZkChroot, TestRandomDVFaceting, ZkCLITest, ShardRoutingCustomTest, TestDistributedGrouping, TestRealTimeGet, TestStressReorder, TestJoin, TestMultiCoreConfBootstrap, TestReload, HardAutoCommitTest, TestRangeQuery, TestCoreContainer, SolrCoreTest, StatsComponentTest, SpellCheckComponentTest, SolrCmdDistributorTest, PeerSyncTest, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, TestFiltering, TestFunctionQuery, TestBadConfig, ShowFileRequestHandlerTest, CurrencyFieldOpenExchangeTest, AnalysisAfterCoreReloadTest, SignatureUpdateProcessorFactoryTest, TestExtendedDismaxParser, SuggesterFSTTest, CoreAdminHandlerTest, TestFoldingMultitermQuery, SuggesterTest, TestStressLucene, TestTrie, SpatialFilterTest, TestCSVLoader, SchemaVersionSpecificBehaviorTest, SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, TestUpdate, TestAtomicUpdateErrorCases, DirectUpdateHandlerOptimizeTest, TestRemoteStreaming, SolrInfoMBeanTest, DebugComponentTest, CacheHeaderTest, IndexBasedSpellCheckerTest, TestQueryUtils, DocumentAnalysisRequestHandlerTest, TestQueryTypes, RequestHandlersTest, TestValueSourceCache, TermVectorComponentTest, MoreLikeThisHandlerTest, RequiredFieldsTest, IndexSchemaRuntimeFieldTest, RegexBoostProcessorTest, SolrPluginUtilsTest, TestCollationField, UpdateRequestProcessorFactoryTest, QueryParsingTest, TestAnalyzedSuggestions, UniqFieldsUpdateProcessorFactoryTest, JsonLoaderTest, BinaryUpdateRequestHandlerTest, TestPartialUpdateDeduplication, SearchHandlerTest, CoreContainerCoreInitFailuresTest, TestBinaryResponseWriter, TestQuerySenderListener, UpdateParamsTest, AlternateDirectoryTest, TestSolrIndexConfig, CopyFieldTest, SolrIndexConfigTest, BadComponentTest, TestStressRecovery, TestMergePolicyConfig, TestSolrDeletionPolicy2, TestBinaryField, TestSearchPerf, MinimalSchemaTest, TestElisionMultitermQuery, TestConfig, ExternalFileFieldSortTest, TestSolrCoreProperties, DirectSolrConnectionTest, NotRequiredUniqueKeyTest, TestPhraseSuggestions, SpellPossibilityIteratorTest, SynonymTokenizerTest, EchoParamsTest, TestDFRSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestBM25SimilarityFactory, TestDefaultSimilarityFactory, LegacyHTMLStripCharFilterTest, ResourceLoaderTest, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, TestFastLRUCache, PreAnalyzedFieldTest, TestSystemIdResolver, TestSuggestSpellingConverter, SpellingQueryConverterTest, DOMUtilTest, RAMDirectoryFactoryTest, TestSolrJ, TestDocumentBuilder, ZkNodePropsTest, SliceStateTest, SystemInfoHandlerTest, FileUtilsTest, CircularListTest, DistributedIntervalFacetingTest, TestDistributedMissingSort, TestTolerantSearch, AssignTest, AsyncMigrateRouteKeyTest, CloudExitableDirectoryReaderTest, CollectionsAPIAsyncDistributedZkTest, ConnectionManagerTest, CustomCollectionTest, HttpPartitionTest]
[junit4] Completed on J1 in 105.58s, 1 test, 1 failure <<< FAILURES!
[...truncated 260 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:524: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:472: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:61: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1359: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:961: There were test failures: 432 suites, 1778 tests, 1 failure, 44 ignored (22 assumptions)
Total time: 105 minutes 1 second
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.7.0_67 -client -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_20) - Build #
11337 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11337/
Java: 32bit/jdk1.8.0_20 -client -XX:+UseConcMarkSweepGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.DeleteReplicaTest.testDistribSearch
Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:57733/pen/l, https://127.0.0.1:49888/pen/l, https://127.0.0.1:59609/pen/l, https://127.0.0.1:33771/pen/l, https://127.0.0.1:42739/pen/l]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:57733/pen/l, https://127.0.0.1:49888/pen/l, https://127.0.0.1:59609/pen/l, https://127.0.0.1:33771/pen/l, https://127.0.0.1:42739/pen/l]
at __randomizedtesting.SeedInfo.seed([4DA691945356920A:CC401F8C2409F236]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:322)
at org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:880)
at org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:658)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:601)
at org.apache.solr.cloud.DeleteReplicaTest.removeAndWaitForReplicaGone(DeleteReplicaTest.java:171)
at org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest(DeleteReplicaTest.java:144)
at org.apache.solr.cloud.DeleteReplicaTest.doTest(DeleteReplicaTest.java:88)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not remove replica : delLiveColl/shard1/core_node2
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:570)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:343)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:304)
... 47 more
Build Log:
[...truncated 11340 lines...]
[junit4] Suite: org.apache.solr.cloud.DeleteReplicaTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/init-core-data-001
[junit4] 2> 1384344 T2881 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
[junit4] 2> 1384345 T2881 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /pen/l
[junit4] 2> 1384349 T2881 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 1384350 T2881 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1384350 T2882 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1384450 T2881 oasc.ZkTestServer.run start zk server on port:46803
[junit4] 2> 1384451 T2881 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1384452 T2881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1384455 T2888 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15935e name:ZooKeeperConnection Watcher:127.0.0.1:46803 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1384455 T2881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1384456 T2881 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1384456 T2881 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1384462 T2881 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1384462 T2883 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x148b5e935a60000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1384463 T2881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1384466 T2890 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@794c13 name:ZooKeeperConnection Watcher:127.0.0.1:46803/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1384466 T2881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1384466 T2881 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1384467 T2881 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1384470 T2881 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1384473 T2881 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1384475 T2881 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1384478 T2881 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1384478 T2881 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1384482 T2881 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1384483 T2881 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1384486 T2881 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1384486 T2881 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1384489 T2881 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1384490 T2881 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1384492 T2881 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1384493 T2881 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1384496 T2881 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1384496 T2881 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1384499 T2881 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1384499 T2881 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1384502 T2881 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1384503 T2881 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1384506 T2881 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1384507 T2881 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1384511 T2881 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1384512 T2881 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1384516 T2881 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1384517 T2881 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1384521 T2881 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1384523 T2881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1384524 T2892 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c70c03 name:ZooKeeperConnection Watcher:127.0.0.1:46803/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1384524 T2881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1384525 T2881 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1385010 T2881 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1385017 T2881 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1385023 T2881 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:33771
[junit4] 2> 1385025 T2881 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1385026 T2881 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1385027 T2881 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-002
[junit4] 2> 1385028 T2881 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-002/'
[junit4] 2> 1385052 T2881 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-002/solr.xml
[junit4] 2> 1385063 T2881 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-002
[junit4] 2> 1385064 T2881 oasc.CoreContainer.<init> New CoreContainer 10925001
[junit4] 2> 1385065 T2881 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-002/]
[junit4] 2> 1385066 T2881 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1385066 T2881 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1385067 T2881 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1385067 T2881 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1385068 T2881 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1385068 T2881 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1385069 T2881 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1385069 T2881 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1385070 T2881 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1385072 T2881 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 1385074 T2881 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1385074 T2881 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1385075 T2881 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1385075 T2881 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:46803/solr
[junit4] 2> 1385076 T2881 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1385076 T2881 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1385078 T2881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1385079 T2903 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@81f806 name:ZooKeeperConnection Watcher:127.0.0.1:46803 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1385080 T2881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1385080 T2881 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1385083 T2881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1385085 T2905 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14c6467 name:ZooKeeperConnection Watcher:127.0.0.1:46803/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1385085 T2881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1385087 T2881 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1385091 T2881 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1385095 T2881 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 1385099 T2881 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 1385102 T2881 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 1385106 T2881 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1385107 T2881 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33771_pen%2Fl
[junit4] 2> 1385108 T2881 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33771_pen%2Fl
[junit4] 2> 1385112 T2881 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1385114 T2881 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1385116 T2881 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1385119 T2881 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:33771_pen%2Fl
[junit4] 2> 1385119 T2881 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1385122 T2881 oasc.Overseer.start Overseer (id=92523805593174020-127.0.0.1:33771_pen%2Fl-n_0000000000) starting
[junit4] 2> 1385125 T2881 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1385135 T2881 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1385136 T2907 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1385136 T2881 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1385139 T2881 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1385140 T2881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1385144 T2906 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1385146 T2881 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-002
[junit4] 2> 1385156 T2881 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-002/conf/
[junit4] 2> 1385337 T2881 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1385339 T2881 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 1385340 T2881 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1385342 T2881 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1385343 T2881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1385345 T2911 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fe1ba1 name:ZooKeeperConnection Watcher:127.0.0.1:46803/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1385345 T2881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1385345 T2881 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1385347 T2881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1385351 T2881 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1385351 T2881 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
[junit4] 2> 1385352 T2881 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1385353 T2881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1385354 T2913 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a0176 name:ZooKeeperConnection Watcher:127.0.0.1:46803/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1385355 T2881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1385355 T2881 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1385358 T2914 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1385362 T2906 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: collection1
[junit4] 2> 1385362 T2906 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 1385363 T2906 oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 2
[junit4] 2> 1385365 T2906 oasc.Overseer$ClusterStateUpdater.updateZkStates going to create_collection /collections/collection1/state.json
[junit4] 2> 1385366 T2914 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1385367 T2915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1385654 T2881 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 1385655 T2881 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1385659 T2881 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1385661 T2881 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:49888
[junit4] 2> 1385664 T2881 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1385664 T2881 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1385665 T2881 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-003
[junit4] 2> 1385665 T2881 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-003/'
[junit4] 2> 1385682 T2881 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-003/solr.xml
[junit4] 2> 1385713 T2881 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-003
[junit4] 2> 1385714 T2881 oasc.CoreContainer.<init> New CoreContainer 18250923
[junit4] 2> 1385714 T2881 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-003/]
[junit4] 2> 1385715 T2881 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1385715 T2881 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1385716 T2881 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1385716 T2881 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1385716 T2881 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1385717 T2881 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1385717 T2881 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1385717 T2881 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1385718 T2881 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1385720 T2881 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 1385721 T2881 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1385721 T2881 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1385722 T2881 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1385722 T2881 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:46803/solr
[junit4] 2> 1385722 T2881 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1385723 T2881 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1385724 T2881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1385726 T2926 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f400fc name:ZooKeeperConnection Watcher:127.0.0.1:46803 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1385727 T2881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1385727 T2881 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1385730 T2881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1385731 T2928 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19c1739 name:ZooKeeperConnection Watcher:127.0.0.1:46803/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1385732 T2881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1385739 T2881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1386744 T2881 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49888_pen%2Fl
[junit4] 2> 1386745 T2881 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49888_pen%2Fl
[junit4] 2> 1386749 T2881 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1386754 T2881 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-003
[junit4] 2> 1386764 T2881 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-003/conf/
[junit4] 2> 1386965 T2881 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1386967 T2881 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 1386968 T2881 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1387364 T2881 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 1387366 T2881 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1387370 T2881 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1387372 T2881 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:57733
[junit4] 2> 1387375 T2881 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1387375 T2881 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1387376 T2881 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-004
[junit4] 2> 1387376 T2881 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-004/'
[junit4] 2> 1387394 T2881 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-004/solr.xml
[junit4] 2> 1387410 T2881 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-004
[junit4] 2> 1387411 T2881 oasc.CoreContainer.<init> New CoreContainer 30067600
[junit4] 2> 1387411 T2881 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-004/]
[junit4] 2> 1387412 T2881 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1387412 T2881 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1387413 T2881 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1387413 T2881 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1387413 T2881 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1387414 T2881 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1387414 T2881 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1387414 T2881 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1387415 T2881 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1387416 T2881 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 1387418 T2881 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1387418 T2881 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1387418 T2881 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1387419 T2881 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:46803/solr
[junit4] 2> 1387419 T2881 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1387419 T2881 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1387420 T2881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1387422 T2941 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@907fc name:ZooKeeperConnection Watcher:127.0.0.1:46803 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1387423 T2881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1387424 T2881 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1387426 T2881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1387428 T2943 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b8d9dc name:ZooKeeperConnection Watcher:127.0.0.1:46803/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1387429 T2881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1387437 T2881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1388444 T2881 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57733_pen%2Fl
[junit4] 2> 1388445 T2881 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57733_pen%2Fl
[junit4] 2> 1388452 T2881 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1388457 T2881 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-004
[junit4] 2> 1388470 T2881 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-004/conf/
[junit4] 2> 1388648 T2881 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1388649 T2881 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 1388650 T2881 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1388930 T2881 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 1388931 T2881 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1388935 T2881 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1388936 T2881 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:59609
[junit4] 2> 1388939 T2881 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1388939 T2881 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1388940 T2881 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-005
[junit4] 2> 1388940 T2881 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-005/'
[junit4] 2> 1388961 T2881 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-005/solr.xml
[junit4] 2> 1388978 T2881 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-005
[junit4] 2> 1388979 T2881 oasc.CoreContainer.<init> New CoreContainer 3165067
[junit4] 2> 1388979 T2881 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-005/]
[junit4] 2> 1388980 T2881 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1388981 T2881 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1388981 T2881 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1388982 T2881 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1388982 T2881 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1388983 T2881 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1388983 T2881 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1388984 T2881 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1388984 T2881 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1388986 T2881 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 1388988 T2881 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1388989 T2881 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1388989 T2881 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1388990 T2881 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:46803/solr
[junit4] 2> 1388990 T2881 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1388991 T2881 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1388999 T2956 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12040b7 name:ZooKeeperConnection Watcher:127.0.0.1:46803 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1388992 T2881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1389003 T2881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1389003 T2881 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1389006 T2881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1389013 T2958 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11b0a8a name:ZooKeeperConnection Watcher:127.0.0.1:46803/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1389013 T2881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1389028 T2881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1390034 T2881 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59609_pen%2Fl
[junit4] 2> 1390035 T2881 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59609_pen%2Fl
[junit4] 2> 1390039 T2881 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1390044 T2881 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-005
[junit4] 2> 1390056 T2881 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-005/conf/
[junit4] 2> 1390291 T2881 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1390297 T2881 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 1390298 T2881 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1390577 T2881 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
[junit4] 2> 1390578 T2881 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1390582 T2881 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1390584 T2881 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:42739
[junit4] 2> 1390587 T2881 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1390587 T2881 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1390587 T2881 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-006
[junit4] 2> 1390588 T2881 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-006/'
[junit4] 2> 1390604 T2881 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-006/solr.xml
[junit4] 2> 1390615 T2881 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-006
[junit4] 2> 1390615 T2881 oasc.CoreContainer.<init> New CoreContainer 15135100
[junit4] 2> 1390616 T2881 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-006/]
[junit4] 2> 1390616 T2881 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1390617 T2881 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1390617 T2881 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1390617 T2881 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1390618 T2881 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1390618 T2881 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1390618 T2881 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1390619 T2881 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1390619 T2881 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1390620 T2881 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 1390622 T2881 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1390622 T2881 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1390622 T2881 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1390623 T2881 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:46803/solr
[junit4] 2> 1390623 T2881 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1390623 T2881 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1390625 T2881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1390626 T2971 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f9b0cd name:ZooKeeperConnection Watcher:127.0.0.1:46803 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1390627 T2881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1390627 T2881 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1390630 T2881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1390632 T2973 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5bc63c name:ZooKeeperConnection Watcher:127.0.0.1:46803/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1390632 T2881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1390639 T2881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1391645 T2881 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42739_pen%2Fl
[junit4] 2> 1391646 T2881 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:42739_pen%2Fl
[junit4] 2> 1391651 T2881 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1391655 T2881 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-006
[junit4] 2> 1391663 T2881 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-006/conf/
[junit4] 2> 1391871 T2881 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1391873 T2881 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 1391873 T2881 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1391879 T2881 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1391880 T2881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1391882 T2977 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@80d302 name:ZooKeeperConnection Watcher:127.0.0.1:46803/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1391883 T2881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1391883 T2881 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1391885 T2881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1391888 T2881 oasc.AbstractFullDistribZkTestBase.createCollection Creating collection with stateFormat=2: delLiveColl
[junit4] 2> 1391889 T2881 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1391890 T2881 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1391892 T2979 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@163cbb0 name:ZooKeeperConnection Watcher:127.0.0.1:46803/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1391892 T2881 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1391893 T2881 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1391895 T2881 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1392013 T2922 oasha.CollectionsHandler.handleCreateAction Creating Collection : replicationFactor=2&maxShardsPerNode=2&name=delLiveColl&action=CREATE&numShards=2&stateFormat=2&wt=javabin&version=2
[junit4] 2> 1392015 T2914 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1392017 T2907 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"create",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"delLiveColl",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "stateFormat":"2"}
[junit4] 2> 1392019 T2980 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : create , {
[junit4] 2> "operation":"create",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"delLiveColl",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "stateFormat":"2"}
[junit4] 2> 1392021 T2980 oasc.OverseerCollectionProcessor.createConfNode Only one config set found in zk - using it:conf1
[junit4] 2> 1392021 T2980 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/delLiveColl
[junit4] 2> 1392022 T2980 oascc.SolrZkClient.makePath makePath: /collections/delLiveColl
[junit4] 2> 1392027 T2914 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1392031 T2906 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: delLiveColl
[junit4] 2> 1392032 T2906 oasc.Overseer$ClusterStateUpdater.createCollection Create collection delLiveColl with shards [shard1, shard2]
[junit4] 2> 1392032 T2906 oasc.Overseer$ClusterStateUpdater.createCollection state version delLiveColl 2
[junit4] 2> 1392035 T2906 oasc.Overseer$ClusterStateUpdater.updateZkStates going to create_collection /collections/delLiveColl/state.json
[junit4] 2> 1392036 T2981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1392037 T2982 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1392042 T2944 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1392042 T2914 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1392042 T2929 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1392042 T2974 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1392037 T2915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1392043 T2959 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1392128 T2980 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection delLiveColl, shardNames [shard1, shard2] , replicationFactor : 2
[junit4] 2> 1392128 T2980 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard1_replica1 as part of slice shard1 of collection delLiveColl on 127.0.0.1:59609_pen%2Fl
[junit4] 2> 1392129 T2980 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard1_replica2 as part of slice shard1 of collection delLiveColl on 127.0.0.1:33771_pen%2Fl
[junit4] 2> 1392131 T2980 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard2_replica1 as part of slice shard2 of collection delLiveColl on 127.0.0.1:42739_pen%2Fl
[junit4] 2> 1392132 T2980 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard2_replica2 as part of slice shard2 of collection delLiveColl on 127.0.0.1:49888_pen%2Fl
[junit4] 2> 1392308 T2924 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=delLiveColl_shard2_replica2&action=CREATE&numShards=2&collection=delLiveColl&shard=shard2&wt=javabin&version=2
[junit4] 2> 1392311 T2924 oasc.ZkController.publish publishing core=delLiveColl_shard2_replica2 state=down collection=delLiveColl
[junit4] 2> 1392313 T2924 oasc.ZkController.preRegister Registering watch for external collection delLiveColl
[junit4] 2> 1392314 T2924 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl
[junit4] 2> 1392315 T2924 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper...
[junit4] 2> 1392315 T2914 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1392316 T2924 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 0
[junit4] 2> 1392316 T2924 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1392320 T2906 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "core":"delLiveColl_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:49888/pen/l",
[junit4] 2> "node_name":"127.0.0.1:49888_pen%2Fl",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "operation":"state"}
[junit4] 2> 1392328 T2906 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/delLiveColl/state.json
[junit4] 2> 1392341 T2929 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 1392343 T2929 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 1
[junit4] 2> 1392344 T2900 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=delLiveColl_shard1_replica2&action=CREATE&numShards=2&collection=delLiveColl&shard=shard1&wt=javabin&version=2
[junit4] 2> 1392347 T2900 oasc.ZkController.publish publishing core=delLiveColl_shard1_replica2 state=down collection=delLiveColl
[junit4] 2> 1392349 T2914 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1392350 T2900 oasc.ZkController.preRegister Registering watch for external collection delLiveColl
[junit4] 2> 1392352 T2906 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "core":"delLiveColl_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:33771/pen/l",
[junit4] 2> "node_name":"127.0.0.1:33771_pen%2Fl",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "operation":"state"}
[junit4] 2> 1392364 T2906 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/delLiveColl/state.json
[junit4] 2> 1392364 T2967 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=delLiveColl_shard2_replica1&action=CREATE&numShards=2&collection=delLiveColl&shard=shard2&wt=javabin&version=2
[junit4] 2> 1392365 T2929 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 1392366 T2929 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2
[junit4] 2> 1392367 T2900 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl
[junit4] 2> 1392367 T2967 oasc.ZkController.publish publishing core=delLiveColl_shard2_replica1 state=down collection=delLiveColl
[junit4] 2> 1392368 T2900 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper...
[junit4] 2> 1392369 T2914 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1392370 T2967 oasc.ZkController.preRegister Registering watch for external collection delLiveColl
[junit4] 2> 1392370 T2967 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl
[junit4] 2> 1392371 T2967 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper...
[junit4] 2> 1392371 T2900 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2
[junit4] 2> 1392372 T2900 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1392372 T2900 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard1_replica2
[junit4] 2> 1392373 T2967 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2
[junit4] 2> 1392375 T2967 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1392374 T2900 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
[junit4] 2> 1392377 T2906 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2
[junit4] 2> 1392378 T2906 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "core":"delLiveColl_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:42739/pen/l",
[junit4] 2> "node_name":"127.0.0.1:42739_pen%2Fl",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "operation":"state"}
[junit4] 2> 1392381 T2900 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1392382 T2900 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl
[junit4] 2> 1392385 T2953 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=delLiveColl_shard1_replica1&action=CREATE&numShards=2&collection=delLiveColl&shard=shard1&wt=javabin&version=2
[junit4] 2> 1392386 T2906 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/delLiveColl/state.json
[junit4] 2> 1392387 T2974 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 1392388 T2900 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1392388 T2953 oasc.ZkController.publish publishing core=delLiveColl_shard1_replica1 state=down collection=delLiveColl
[junit4] 2> 1392388 T2900 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-002/delLiveColl_shard1_replica2/'
[junit4] 2> 1392388 T2974 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 3
[junit4] 2> 1392387 T2929 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 1392387 T2914 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 1392391 T2929 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 3
[junit4] 2> 1392391 T2953 oasc.ZkController.preRegister Registering watch for external collection delLiveColl
[junit4] 2> 1392392 T2953 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl
[junit4] 2> 1392393 T2953 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper...
[junit4] 2> 1392393 T2914 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 3
[junit4] 2> 1392395 T2953 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 3
[junit4] 2> 1392396 T2953 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1392400 T2906 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 3
[junit4] 2> 1392401 T2906 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "core":"delLiveColl_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:59609/pen/l",
[junit4] 2> "node_name":"127.0.0.1:59609_pen%2Fl",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "operation":"state"}
[junit4] 2> 1392403 T2914 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1392404 T2906 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/delLiveColl/state.json
[junit4] 2> 1392405 T2914 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 1392405 T2929 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 1392405 T2974 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 1392405 T2959 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 1392406 T2929 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 4
[junit4] 2> 1392406 T2974 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 4
[junit4] 2> 1392407 T2959 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 4
[junit4] 2> 1392408 T2914 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 4
[junit4] 2> 1392493 T2900 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1392519 T2900 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1392520 T2900 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1392587 T2900 oass.IndexSchema.readSchema [delLiveColl_shard1_replica2] Schema name=test
[junit4] 2> 1392747 T2900 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1392758 T2900 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1392761 T2900 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1392778 T2900 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1392782 T2900 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1392785 T2900 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1392786 T2900 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1392788 T2900 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1392789 T2900 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1392790 T2900 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1392790 T2900 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1392790 T2900 oasc.CoreContainer.create Creating SolrCore 'delLiveColl_shard1_replica2' using configuration from collection delLiveColl
[junit4] 2> 1392791 T2900 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1392791 T2900 oasc.SolrCore.<init> [delLiveColl_shard1_replica2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-002/delLiveColl_shard1_replica2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-002/delLiveColl_shard1_replica2/data/
[junit4] 2> 1392792 T2900 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@13fbe6a
[junit4] 2> 1392793 T2900 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-002/delLiveColl_shard1_replica2/data
[junit4] 2> 1392793 T2900 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-002/delLiveColl_shard1_replica2/data/index/
[junit4] 2> 1392794 T2900 oasc.SolrCore.initIndex WARN [delLiveColl_shard1_replica2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-002/delLiveColl_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 1392794 T2900 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-002/delLiveColl_shard1_replica2/data/index
[junit4] 2> 1392795 T2900 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=14, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.29574978028713317]
[junit4] 2> 1392796 T2900 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-195b910)),segFN=segments_1,generation=1}
[junit4] 2> 1392796 T2900 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1392802 T2900 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1392803 T2900 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1392803 T2900 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1392804 T2900 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1392804 T2900 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1392804 T2900 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1392805 T2900 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1392806 T2900 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1392806 T2900 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1392807 T2900 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 1392808 T2900 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 1392809 T2900 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 1392810 T2900 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1392811 T2900 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1392811 T2900 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1392812 T2900 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1392812 T2900 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1392813 T2900 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1392814 T2900 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1392815 T2900 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 1392818 T2900 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1392820 T2900 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1392821 T2900 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1392823 T2900 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1392825 T2900 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1392826 T2900 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1392827 T2900 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=11, maxMergeAtOnceExplicit=22, maxMergedSegmentMB=54.849609375, floorSegmentMB=2.1416015625, forceMergeDeletesPctAllowed=14.647838511593289, segmentsPerTier=45.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.23041622398743408
[junit4] 2> 1392828 T2900 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-195b910)),segFN=segments_1,generation=1}
[junit4] 2> 1392828 T2900 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1392829 T2900 oass.SolrIndexSearcher.<init> Opening Searcher@b8ab87[delLiveColl_shard1_replica2] main
[junit4] 2> 1392830 T2900 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl
[junit4] 2> 1392830 T2900 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1392831 T2900 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1392831 T2900 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1392832 T2900 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1392832 T2900 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1392833 T2900 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1392833 T2900 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1392834 T2900 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
[junit4] 2> 1392836 T2900 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
[junit4] 2> 1392837 T2900 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1392837 T2900 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1392841 T2987 oasc.SolrCore.registerSearcher [delLiveColl_shard1_replica2] Registered new searcher Searcher@b8ab87[delLiveColl_shard1_replica2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1392845 T2900 oasc.CoreContainer.registerCore registering core: delLiveColl_shard1_replica2
[junit4] 2> 1392845 T2900 oasc.ZkController.register Register replica - core:delLiveColl_shard1_replica2 address:https://127.0.0.1:33771/pen/l collection:delLiveColl shard:shard1
[junit4] 2> 1392847 T2900 oascc.SolrZkClient.makePath makePath: /collections/delLiveColl/leader_elect/shard1/election
[junit4] 2> 1392852 T2900 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1392853 T2914 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1392853 T2900 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=1.38571835E14ms
[junit4] 2> 1392856 T2906 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 4
[junit4] 2> 1392858 T2906 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/delLiveColl/state.json
[junit4] 2> 1392859 T2914 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 1392859 T2959 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 1392859 T2929 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 1392859 T2974 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating...
[junit4] 2> 1392862 T2959 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 5
[junit4] 2> 1392862 T2974 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 5
[junit4] 2> 1392863 T2929 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 5
[junit4] 2> 1392864 T2914 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 5
[junit4] 2> 1393317 T2924 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard2_replica2
[junit4] 2> 1393317 T2924 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
[junit4] 2> 1393318 T2924 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1393319 T2924 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl
[junit4] 2> 1393319 T2924 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1393320 T2924 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-003/delLiveColl_shard2_replica2/'
[junit4] 2> 1393362 T2924 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1393375 T2967 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard2_replica1
[junit4] 2> 1393376 T2967 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
[junit4] 2> 1393376 T2967 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1393377 T2967 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl
[junit4] 2> 1393378 T2967 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1393378 T2967 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-006/delLiveColl_shard2_replica1/'
[junit4] 2> 1393380 T2924 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1393384 T2924 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1393396 T2953 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard1_replica1
[junit4] 2> 1393397 T2953 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
[junit4] 2> 1393397 T2924 oass.IndexSchema.readSchema [delLiveColl_shard2_replica2] Schema name=test
[junit4] 2> 1393398 T2953 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1393398 T2953 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl
[junit4] 2> 1393399 T2953 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1393400 T2953 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-005/delLiveColl_shard1_replica1/'
[junit4] 2> 1393440 T2967 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1393455 T2953 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1393458 T2967 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1393461 T2967 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1393472 T2953 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1393474 T2953 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1393480 T2967 oass.IndexSchema.readSchema [delLiveColl_shard2_replica1] Schema name=test
[junit4] 2> 1393500 T2953 oass.IndexSchema.readSchema [delLiveColl_shard1_replica1] Schema name=test
[junit4] 2> 1393578 T2924 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1393584 T2924 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1393586 T2924 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1393605 T2924 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1393608 T2924 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1393611 T2924 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1393612 T2924 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1393613 T2924 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1393614 T2924 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1393615 T2924 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1393615 T2924 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1393615 T2924 oasc.CoreContainer.create Creating SolrCore 'delLiveColl_shard2_replica2' using configuration from collection delLiveColl
[junit4] 2> 1393616 T2924 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1393616 T2924 oasc.SolrCore.<init> [delLiveColl_shard2_replica2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-003/delLiveColl_shard2_replica2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-003/delLiveColl_shard2_replica2/data/
[junit4] 2> 1393617 T2924 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@13fbe6a
[junit4] 2> 1393618 T2924 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-003/delLiveColl_shard2_replica2/data
[junit4] 2> 1393618 T2924 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-003/delLiveColl_shard2_replica2/data/index/
[junit4] 2> 1393619 T2924 oasc.SolrCore.initIndex WARN [delLiveColl_shard2_replica2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-003/delLiveColl_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 1393620 T2924 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-003/delLiveColl_shard2_replica2/data/index
[junit4] 2> 1393621 T2924 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=14, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.29574978028713317]
[junit4] 2> 1393636 T2924 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-16b2841)),segFN=segments_1,generation=1}
[junit4] 2> 1393636 T2924 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1393643 T2924 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1393644 T2924 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1393644 T2924 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1393645 T2924 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1393645 T2924 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1393646 T2924 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1393647 T2924 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-impli
[...truncated too long message...]
<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-006/delLiveColl_shard2_replica1/data;done=false>>]
[junit4] 2> 1598384 T2881 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-006/delLiveColl_shard2_replica1/data
[junit4] 2> 1598384 T2881 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-006/delLiveColl_shard2_replica1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-006/delLiveColl_shard2_replica1/data/index;done=false>>]
[junit4] 2> 1598385 T2881 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001/tempDir-006/delLiveColl_shard2_replica1/data/index
[junit4] 2> 1598385 T2881 oasc.Overseer.close Overseer (id=92523805593174030-127.0.0.1:42739_pen%2Fl-n_0000000004) closing
[junit4] 2> 1598386 T3035 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:42739_pen%2Fl
[junit4] 2> 1599888 T3024 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1599911 T2881 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/pen/l,null}
[junit4] 2> 1604901 T2881 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4] 2> 1604903 T2881 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:46803 46803
[junit4] 2> 1605343 T2882 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:46803 46803
[junit4] 2> 1605345 T2882 oasc.ZkTestServer$ZKServerMain.runFromConfig WARN Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 8 /solr/aliases.json
[junit4] 2> 8 /solr/clusterstate.json
[junit4] 2> 4 /solr/collections/delLiveColl/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 8 /solr/live_nodes
[junit4] 2> 5 /solr/overseer/queue
[junit4] 2> 5 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=DeleteReplicaTest -Dtests.method=testDistribSearch -Dtests.seed=4DA691945356920A -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=et -Dtests.timezone=Africa/Banjul -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 221s J0 | DeleteReplicaTest.testDistribSearch <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:57733/pen/l, https://127.0.0.1:49888/pen/l, https://127.0.0.1:59609/pen/l, https://127.0.0.1:33771/pen/l, https://127.0.0.1:42739/pen/l]
[junit4] > at __randomizedtesting.SeedInfo.seed([4DA691945356920A:CC401F8C2409F236]:0)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:322)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:880)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:658)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:601)
[junit4] > at org.apache.solr.cloud.DeleteReplicaTest.removeAndWaitForReplicaGone(DeleteReplicaTest.java:171)
[junit4] > at org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest(DeleteReplicaTest.java:144)
[junit4] > at org.apache.solr.cloud.DeleteReplicaTest.doTest(DeleteReplicaTest.java:88)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not remove replica : delLiveColl/shard1/core_node2
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:570)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:343)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:304)
[junit4] > ... 47 more
[junit4] 2> 1605362 T2881 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4DA691945356920A-001
[junit4] 2> 221023 T2880 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=205), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=205)), sim=DefaultSimilarity, locale=et, timezone=Africa/Banjul
[junit4] 2> NOTE: Linux 3.13.0-36-generic i386/Oracle Corporation 1.8.0_20 (32-bit)/cpus=8,threads=1,free=178093360,total=436883456
[junit4] 2> NOTE: All tests run in this JVM: [HdfsCollectionsAPIDistributedZkTest, ReturnFieldsTest, MultiThreadedOCPTest, DistributedQueryComponentCustomSortTest, ChangedSchemaMergeTest, BasicDistributedZkTest, JSONWriterTest, DistribCursorPagingTest, TestRandomMergePolicy, PluginInfoTest, DocValuesMultiTest, TestReRankQParserPlugin, FieldMutatingUpdateProcessorTest, HdfsBasicDistributedZk2Test, TestLuceneMatchVersion, ModifyConfFileTest, DistribDocExpirationUpdateProcessorTest, StatelessScriptUpdateProcessorFactoryTest, PrimitiveFieldTypeTest, TestJmxIntegration, TestSystemIdResolver, NoCacheHeaderTest, UpdateParamsTest, TestExceedMaxTermLength, ShowFileRequestHandlerTest, TestSolrQueryParserResource, TestFastLRUCache, DistributedFacetPivotSmallTest, SuggesterWFSTTest, TestCustomSort, OpenExchangeRatesOrgProviderTest, FileUtilsTest, BadCopyFieldTest, TestBinaryResponseWriter, TestConfigSets, BlockCacheTest, NotRequiredUniqueKeyTest, TestSurroundQueryParser, TestFastOutputStream, PathHierarchyTokenizerFactoryTest, TestStressRecovery, TestFieldTypeResource, ZkNodePropsTest, EchoParamsTest, AtomicUpdatesTest, TestSolrQueryParserDefaultOperatorResource, TestManagedSchemaFieldResource, DocumentAnalysisRequestHandlerTest, SystemInfoHandlerTest, TestSolr4Spatial, TestRemoteStreaming, TestLMJelinekMercerSimilarityFactory, PingRequestHandlerTest, XmlUpdateRequestHandlerTest, TestWordDelimiterFilterFactory, RegexBoostProcessorTest, TestIntervalFaceting, TestDistributedMissingSort, TestShardHandlerFactory, MigrateRouteKeyTest, CoreAdminHandlerTest, OutOfBoxZkACLAndCredentialsProvidersTest, ConnectionManagerTest, TestRTGBase, DocValuesMissingTest, DisMaxRequestHandlerTest, ZkCLITest, HighlighterConfigTest, ExternalCollectionsTest, PeerSyncTest, SolrCmdDistributorTest, SignatureUpdateProcessorFactoryTest, TestTrie, TestDocBasedVersionConstraints, TestLMDirichletSimilarityFactory, PreAnalyzedUpdateProcessorTest, TestMiniSolrCloudCluster, ZkControllerTest, WordBreakSolrSpellCheckerTest, CursorPagingTest, TestRangeQuery, TestFieldResource, TestSolrIndexConfig, TestSchemaResource, DeleteReplicaTest]
[junit4] Completed on J0 in 221.31s, 1 test, 1 error <<< FAILURES!
[...truncated 759 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:524: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:472: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:61: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1359: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:961: There were test failures: 432 suites, 1778 tests, 1 error, 44 ignored (22 assumptions)
Total time: 119 minutes 47 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_20 -client -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_67) - Build #
11336 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11336/
Java: 64bit/jdk1.7.0_67 -XX:+UseCompressedOops -XX:+UseG1GC
1 tests failed.
REGRESSION: org.apache.solr.cloud.CloudExitableDirectoryReaderTest.testDistribSearch
Error Message:
no exception matching expected: 400: Request took too long during query expansion. Terminating request.
Stack Trace:
java.lang.AssertionError: no exception matching expected: 400: Request took too long during query expansion. Terminating request.
at __randomizedtesting.SeedInfo.seed([E2F3200ABF553931:6315AE12C80A590D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.CloudExitableDirectoryReaderTest.assertFail(CloudExitableDirectoryReaderTest.java:101)
at org.apache.solr.cloud.CloudExitableDirectoryReaderTest.doTimeoutTests(CloudExitableDirectoryReaderTest.java:75)
at org.apache.solr.cloud.CloudExitableDirectoryReaderTest.doTest(CloudExitableDirectoryReaderTest.java:54)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11737 lines...]
[junit4] Suite: org.apache.solr.cloud.CloudExitableDirectoryReaderTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/init-core-data-001
[junit4] 2> 2278123 T6414 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
[junit4] 2> 2278124 T6414 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 2278127 T6414 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 2278127 T6414 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2278128 T6415 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2278228 T6414 oasc.ZkTestServer.run start zk server on port:45815
[junit4] 2> 2278228 T6414 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2278229 T6414 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2278231 T6421 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@311573bc name:ZooKeeperConnection Watcher:127.0.0.1:45815 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2278232 T6414 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2278232 T6414 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2278232 T6414 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2278235 T6414 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2278236 T6414 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2278237 T6423 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@345c6946 name:ZooKeeperConnection Watcher:127.0.0.1:45815/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2278237 T6414 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2278237 T6414 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2278237 T6414 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 2278239 T6414 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 2278241 T6414 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 2278242 T6414 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 2278243 T6414 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 2278244 T6414 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 2278246 T6414 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 2278246 T6414 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 2278247 T6414 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2278248 T6414 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2278249 T6414 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 2278249 T6414 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 2278250 T6414 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 2278250 T6414 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 2278251 T6414 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 2278252 T6414 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 2278253 T6414 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 2278253 T6414 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 2278254 T6414 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2278254 T6414 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 2278255 T6414 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2278256 T6414 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2278257 T6414 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 2278257 T6414 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 2278258 T6414 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 2278258 T6414 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 2278499 T6414 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2278503 T6414 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56523
[junit4] 2> 2278503 T6414 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2278504 T6414 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2278504 T6414 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-002
[junit4] 2> 2278504 T6414 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-002/'
[junit4] 2> 2278517 T6414 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-002/solr.xml
[junit4] 2> 2278541 T6414 oasc.CoreContainer.<init> New CoreContainer 819246662
[junit4] 2> 2278542 T6414 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-002/]
[junit4] 2> 2278542 T6414 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2278543 T6414 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2278543 T6414 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2278543 T6414 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2278543 T6414 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2278543 T6414 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2278544 T6414 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2278544 T6414 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2278544 T6414 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2278545 T6414 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2278545 T6414 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2278545 T6414 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2278545 T6414 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2278546 T6414 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45815/solr
[junit4] 2> 2278546 T6414 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2278546 T6414 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2278547 T6414 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2278548 T6434 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5d0ac6b5 name:ZooKeeperConnection Watcher:127.0.0.1:45815 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2278548 T6414 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2278548 T6414 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2278551 T6414 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2278552 T6436 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9e004f name:ZooKeeperConnection Watcher:127.0.0.1:45815/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2278552 T6414 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2278553 T6414 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2278555 T6414 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2278557 T6414 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 2278558 T6414 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 2278560 T6414 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 2278561 T6414 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2278562 T6414 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56523_
[junit4] 2> 2278563 T6414 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56523_
[junit4] 2> 2278564 T6414 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2278565 T6414 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2278566 T6414 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2278567 T6414 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:56523_
[junit4] 2> 2278567 T6414 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2278568 T6414 oasc.Overseer.start Overseer (id=92522493328818179-127.0.0.1:56523_-n_0000000000) starting
[junit4] 2> 2278569 T6414 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2278573 T6414 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 2278573 T6438 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2278574 T6414 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2278576 T6414 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2278576 T6414 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2278578 T6437 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2278581 T6440 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 2278581 T6440 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2278582 T6440 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2278582 T6441 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2278583 T6437 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "node_name":"127.0.0.1:56523_",
[junit4] 2> "base_url":"http://127.0.0.1:56523",
[junit4] 2> "state":"down",
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null}
[junit4] 2> 2278584 T6437 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 2278584 T6437 oasc.Overseer$ClusterStateUpdater.createCollection state version control_collection 1
[junit4] 2> 2278584 T6437 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2278586 T6441 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2279582 T6440 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2279582 T6440 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 2279583 T6440 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2279583 T6440 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 2279584 T6440 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2279584 T6440 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-002/collection1/'
[junit4] 2> 2279585 T6440 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 2279585 T6440 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 2279585 T6440 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 2279625 T6440 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2279695 T6440 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2279696 T6440 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2279705 T6440 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2279932 T6440 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2279939 T6440 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2279941 T6440 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2279950 T6440 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2279953 T6440 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2279955 T6440 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2279955 T6440 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2279956 T6440 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2279956 T6440 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2279956 T6440 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2279957 T6440 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2279957 T6440 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 2279957 T6440 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2279957 T6440 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-001/control/data/
[junit4] 2> 2279957 T6440 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d40e14
[junit4] 2> 2279958 T6440 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-001/control/data
[junit4] 2> 2279958 T6440 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-001/control/data/index/
[junit4] 2> 2279958 T6440 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 2279958 T6440 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-001/control/data/index
[junit4] 2> 2279959 T6440 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=4.61328125, floorSegmentMB=1.5400390625, forceMergeDeletesPctAllowed=6.2568579836891525, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3293970128012136
[junit4] 2> 2279959 T6440 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-269748f6)),segFN=segments_1,generation=1}
[junit4] 2> 2279959 T6440 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2279961 T6440 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2279962 T6440 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2279962 T6440 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2279962 T6440 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2279962 T6440 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2279962 T6440 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2279963 T6440 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2279963 T6440 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2279963 T6440 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2279963 T6440 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2279964 T6440 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2279964 T6440 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2279964 T6440 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2279965 T6440 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2279965 T6440 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2279965 T6440 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2279965 T6440 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2279965 T6440 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2279966 T6440 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2279966 T6440 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2279968 T6440 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2279969 T6440 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2279970 T6440 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2279971 T6440 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2279973 T6440 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2279973 T6440 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2279973 T6440 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=45, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 2279974 T6440 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-269748f6)),segFN=segments_1,generation=1}
[junit4] 2> 2279974 T6440 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2279974 T6440 oass.SolrIndexSearcher.<init> Opening Searcher@2bda04ab[collection1] main
[junit4] 2> 2279974 T6440 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 2279975 T6440 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2279975 T6440 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2279975 T6440 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2279976 T6440 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 2279976 T6440 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2279976 T6440 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 2279976 T6440 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2279977 T6440 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
[junit4] 2> 2279978 T6440 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
[junit4] 2> 2279978 T6440 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2279979 T6440 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 2279980 T6442 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2bda04ab[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2279981 T6440 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2279982 T6445 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56523 collection:control_collection shard:shard1
[junit4] 2> 2279982 T6414 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 2279982 T6414 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2279982 T6445 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 2279983 T6414 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2279983 T6414 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2279984 T6447 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18169b0f name:ZooKeeperConnection Watcher:127.0.0.1:45815/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2279984 T6414 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2279985 T6414 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2279986 T6414 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2279986 T6445 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 2279987 T6441 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2279987 T6445 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2279988 T6445 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 2279988 T6414 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> ASYNC NEW_CORE C1083 name=collection1 org.apache.solr.core.SolrCore@3804b791 url=http://127.0.0.1:56523/collection1 node=127.0.0.1:56523_ C1083_STATE=coll:control_collection core:collection1 props:{core=collection1, node_name=127.0.0.1:56523_, base_url=http://127.0.0.1:56523, state=down}
[junit4] 2> 2279988 T6445 C1083 P56523 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56523/collection1/
[junit4] 2> 2279988 T6414 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
[junit4] 2> 2279988 T6445 C1083 P56523 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2279988 T6414 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2279989 T6445 C1083 P56523 oasc.SyncStrategy.syncToMe http://127.0.0.1:56523/collection1/ has no replicas
[junit4] 2> 2279989 T6445 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56523/collection1/ shard1
[junit4] 2> 2279989 T6445 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 2279990 T6414 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2279990 T6449 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61bb1686 name:ZooKeeperConnection Watcher:127.0.0.1:45815/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2279990 T6414 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2279991 T6414 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2279992 T6441 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2279993 T6437 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: collection1
[junit4] 2> 2279993 T6437 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 2279994 T6437 oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 2
[junit4] 2> 2279995 T6437 oasc.Overseer$ClusterStateUpdater.updateZkStates going to create_collection /collections/collection1/state.json
[junit4] 2> 2279996 T6441 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2279996 T6450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2280000 T6441 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2280001 T6450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2280001 T6441 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2280044 T6445 oasc.ZkController.register We are http://127.0.0.1:56523/collection1/ and leader is http://127.0.0.1:56523/collection1/
[junit4] 2> 2280044 T6445 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56523
[junit4] 2> 2280044 T6445 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2280044 T6445 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 2280044 T6445 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2280045 T6441 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2280047 T6437 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "node_name":"127.0.0.1:56523_",
[junit4] 2> "base_url":"http://127.0.0.1:56523",
[junit4] 2> "state":"active",
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null}
[junit4] 2> 2280149 T6450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2280149 T6441 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2280247 T6414 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 2280248 T6414 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2280250 T6414 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50359
[junit4] 2> 2280251 T6414 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2280251 T6414 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2280251 T6414 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-003
[junit4] 2> 2280252 T6414 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-003/'
[junit4] 2> 2280265 T6414 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-003/solr.xml
[junit4] 2> 2280314 T6414 oasc.CoreContainer.<init> New CoreContainer 1661595630
[junit4] 2> 2280315 T6414 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-003/]
[junit4] 2> 2280316 T6414 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2280316 T6414 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2280316 T6414 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2280316 T6414 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2280316 T6414 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2280317 T6414 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2280317 T6414 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2280317 T6414 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2280317 T6414 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2280318 T6414 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2280318 T6414 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2280318 T6414 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2280318 T6414 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2280319 T6414 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45815/solr
[junit4] 2> 2280319 T6414 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2280319 T6414 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2280320 T6414 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2280321 T6461 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2167250e name:ZooKeeperConnection Watcher:127.0.0.1:45815 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2280321 T6414 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2280321 T6414 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2280324 T6414 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2280325 T6463 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24c707b5 name:ZooKeeperConnection Watcher:127.0.0.1:45815/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2280325 T6414 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2280329 T6414 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2281333 T6414 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50359_
[junit4] 2> 2281334 T6414 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50359_
[junit4] 2> 2281339 T6414 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2281345 T6465 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 2281345 T6465 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2281346 T6441 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2281346 T6465 oasc.ZkController.preRegister Registering watch for external collection collection1
[junit4] 2> 2281347 T6465 oascc.ZkStateReader.addZkWatch addZkWatch collection1
[junit4] 2> 2281348 T6465 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper...
[junit4] 2> 2281348 T6437 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:50359_",
[junit4] 2> "base_url":"http://127.0.0.1:50359",
[junit4] 2> "state":"down",
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null}
[junit4] 2> 2281348 T6465 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 0
[junit4] 2> 2281349 T6465 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2281350 T6437 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 2281351 T6437 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 2281353 T6437 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
[junit4] 2> 2281353 T6464 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2281354 T6464 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 1
[junit4] 2> 2282349 T6465 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2282349 T6465 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 2282350 T6465 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2282350 T6465 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2282351 T6465 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2282351 T6465 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-003/collection1/'
[junit4] 2> 2282352 T6465 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 2282352 T6465 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 2282352 T6465 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 2282381 T6465 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2282405 T6465 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2282406 T6465 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2282412 T6465 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2282589 T6465 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2282593 T6465 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2282619 T6465 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2282627 T6465 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2282629 T6465 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2282631 T6465 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2282632 T6465 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2282632 T6465 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2282632 T6465 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2282633 T6465 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2282633 T6465 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2282633 T6465 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 2282633 T6465 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2282633 T6465 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-003/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-001/jetty1/
[junit4] 2> 2282634 T6465 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d40e14
[junit4] 2> 2282634 T6465 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-001/jetty1
[junit4] 2> 2282634 T6465 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-001/jetty1/index/
[junit4] 2> 2282634 T6465 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 2282635 T6465 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-001/jetty1/index
[junit4] 2> 2282635 T6465 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=4.61328125, floorSegmentMB=1.5400390625, forceMergeDeletesPctAllowed=6.2568579836891525, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3293970128012136
[junit4] 2> 2282636 T6465 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-71512cbd)),segFN=segments_1,generation=1}
[junit4] 2> 2282636 T6465 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2282638 T6465 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2282638 T6465 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2282638 T6465 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2282639 T6465 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2282639 T6465 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2282639 T6465 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2282639 T6465 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2282640 T6465 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2282640 T6465 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2282640 T6465 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2282640 T6465 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2282641 T6465 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2282641 T6465 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2282641 T6465 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2282642 T6465 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2282642 T6465 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2282642 T6465 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2282642 T6465 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2282643 T6465 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2282643 T6465 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2282645 T6465 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2282646 T6465 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2282647 T6465 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2282648 T6465 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2282650 T6465 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2282650 T6465 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2282650 T6465 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=45, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 2282651 T6465 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-71512cbd)),segFN=segments_1,generation=1}
[junit4] 2> 2282651 T6465 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2282651 T6465 oass.SolrIndexSearcher.<init> Opening Searcher@385638e8[collection1] main
[junit4] 2> 2282651 T6465 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2282652 T6465 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2282652 T6465 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2282652 T6465 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2282652 T6465 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 2282653 T6465 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2282653 T6465 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 2282653 T6465 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2282654 T6465 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 2282654 T6465 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 2282656 T6466 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@385638e8[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2282657 T6465 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2282658 T6469 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50359 collection:collection1 shard:shard2
[junit4] 2> 2282658 T6414 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 2282658 T6414 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2282659 T6469 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 2282661 T6469 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 2282662 T6441 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2282663 T6469 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2282663 T6469 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1084 name=collection1 org.apache.solr.core.SolrCore@4542bab2 url=http://127.0.0.1:50359/collection1 node=127.0.0.1:50359_ C1084_STATE=coll:collection1 core:collection1 props:{core=collection1, node_name=127.0.0.1:50359_, base_url=http://127.0.0.1:50359, state=down}
[junit4] 2> 2282663 T6469 C1084 P50359 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50359/collection1/
[junit4] 2> 2282663 T6469 C1084 P50359 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2282663 T6469 C1084 P50359 oasc.SyncStrategy.syncToMe http://127.0.0.1:50359/collection1/ has no replicas
[junit4] 2> 2282663 T6469 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50359/collection1/ shard2
[junit4] 2> 2282664 T6469 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 2282666 T6437 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
[junit4] 2> 2282667 T6464 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2282667 T6464 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 2
[junit4] 2> 2282670 T6441 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2282671 T6437 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
[junit4] 2> 2282671 T6464 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2282672 T6464 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3
[junit4] 2> 2282717 T6469 oasc.ZkController.register We are http://127.0.0.1:50359/collection1/ and leader is http://127.0.0.1:50359/collection1/
[junit4] 2> 2282717 T6469 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50359
[junit4] 2> 2282718 T6469 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2282718 T6469 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 2282718 T6469 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2282719 T6441 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2282721 T6469 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3
[junit4] 2> 2282721 T6437 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:50359_",
[junit4] 2> "base_url":"http://127.0.0.1:50359",
[junit4] 2> "state":"active",
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null}
[junit4] 2> 2282724 T6437 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
[junit4] 2> 2282725 T6464 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2282725 T6464 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4
[junit4] 2> 2282905 T6414 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 2282906 T6414 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2282907 T6414 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52642
[junit4] 2> 2282908 T6414 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2282909 T6414 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2282909 T6414 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-004
[junit4] 2> 2282909 T6414 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-004/'
[junit4] 2> 2282922 T6414 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-004/solr.xml
[junit4] 2> 2282946 T6414 oasc.CoreContainer.<init> New CoreContainer 1588494230
[junit4] 2> 2282946 T6414 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-004/]
[junit4] 2> 2282947 T6414 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2282947 T6414 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2282947 T6414 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2282948 T6414 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2282948 T6414 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2282948 T6414 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2282948 T6414 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2282949 T6414 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2282949 T6414 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2282949 T6414 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2282949 T6414 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2282950 T6414 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2282950 T6414 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2282950 T6414 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45815/solr
[junit4] 2> 2282950 T6414 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2282951 T6414 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2282951 T6414 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2282952 T6480 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@123a816a name:ZooKeeperConnection Watcher:127.0.0.1:45815 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2282953 T6414 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2282953 T6414 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2282955 T6414 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2282956 T6482 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7fad6443 name:ZooKeeperConnection Watcher:127.0.0.1:45815/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2282956 T6414 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2282960 T6414 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2283962 T6414 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52642_
[junit4] 2> 2283963 T6414 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52642_
[junit4] 2> 2283967 T6414 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2283973 T6484 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 2283973 T6484 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2283974 T6441 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2283975 T6484 oasc.ZkController.preRegister Registering watch for external collection collection1
[junit4] 2> 2283975 T6484 oascc.ZkStateReader.addZkWatch addZkWatch collection1
[junit4] 2> 2283975 T6484 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper...
[junit4] 2> 2283976 T6437 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:52642_",
[junit4] 2> "base_url":"http://127.0.0.1:52642",
[junit4] 2> "state":"down",
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null}
[junit4] 2> 2283976 T6484 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4
[junit4] 2> 2283976 T6484 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2283977 T6437 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 2283978 T6437 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2283980 T6437 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
[junit4] 2> 2283980 T6483 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2283980 T6464 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2283981 T6483 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5
[junit4] 2> 2283981 T6464 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5
[junit4] 2> 2284976 T6484 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2284977 T6484 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 2284977 T6484 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2284977 T6484 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2284978 T6484 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2284978 T6484 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-004/collection1/'
[junit4] 2> 2284979 T6484 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 2284979 T6484 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 2284979 T6484 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 2285005 T6484 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2285029 T6484 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2285030 T6484 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2285036 T6484 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2285240 T6484 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2285245 T6484 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2285246 T6484 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2285254 T6484 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2285256 T6484 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2285259 T6484 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2285259 T6484 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2285259 T6484 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2285260 T6484 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2285260 T6484 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2285260 T6484 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2285261 T6484 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 2285261 T6484 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2285261 T6484 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-004/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-001/jetty2/
[junit4] 2> 2285261 T6484 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d40e14
[junit4] 2> 2285262 T6484 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-001/jetty2
[junit4] 2> 2285262 T6484 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-001/jetty2/index/
[junit4] 2> 2285262 T6484 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 2285262 T6484 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-001/jetty2/index
[junit4] 2> 2285263 T6484 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=4.61328125, floorSegmentMB=1.5400390625, forceMergeDeletesPctAllowed=6.2568579836891525, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3293970128012136
[junit4] 2> 2285263 T6484 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-1c3f953f)),segFN=segments_1,generation=1}
[junit4] 2> 2285263 T6484 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2285266 T6484 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2285266 T6484 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2285266 T6484 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2285266 T6484 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2285266 T6484 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2285266 T6484 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2285267 T6484 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2285267 T6484 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2285267 T6484 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2285268 T6484 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2285268 T6484 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2285268 T6484 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2285269 T6484 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2285269 T6484 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2285269 T6484 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2285269 T6484 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2285270 T6484 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2285270 T6484 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2285270 T6484 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2285271 T6484 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2285273 T6484 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2285274 T6484 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2285275 T6484 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2285276 T6484 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2285277 T6484 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2285277 T6484 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2285278 T6484 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=45, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 2285278 T6484 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-1c3f953f)),segFN=segments_1,generation=1}
[junit4] 2> 2285278 T6484 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2285279 T6484 oass.SolrIndexSearcher.<init> Opening Searcher@67bede2c[collection1] main
[junit4] 2> 2285279 T6484 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2285280 T6484 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2285280 T6484 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2285280 T6484 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2285280 T6484 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 2285280 T6484 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2285281 T6484 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 2285281 T6484 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2285281 T6484 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 2285282 T6484 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 2285283 T6485 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@67bede2c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2285285 T6484 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2285286 T6488 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52642 collection:collection1 shard:shard1
[junit4] 2> 2285286 T6414 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 2285286 T6414 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2285286 T6488 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2285289 T6488 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 2285290 T6441 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2285291 T6488 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2285291 T6488 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1085 name=collection1 org.apache.solr.core.SolrCore@73b50f5d url=http://127.0.0.1:52642/collection1 node=127.0.0.1:52642_ C1085_STATE=coll:collection1 core:collection1 props:{core=collection1, node_name=127.0.0.1:52642_, base_url=http://127.0.0.1:52642, state=down}
[junit4] 2> 2285291 T6488 C1085 P52642 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52642/collection1/
[junit4] 2> 2285291 T6488 C1085 P52642 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2285292 T6488 C1085 P52642 oasc.SyncStrategy.syncToMe http://127.0.0.1:52642/collection1/ has no replicas
[junit4] 2> 2285292 T6488 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52642/collection1/ shard1
[junit4] 2> 2285292 T6488 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2285294 T6437 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
[junit4] 2> 2285295 T6483 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2285295 T6464 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2285295 T6464 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 6
[junit4] 2> 2285295 T6483 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 6
[junit4] 2> 2285299 T6441 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2285300 T6437 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
[junit4] 2> 2285300 T6483 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2285300 T6464 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2285301 T6483 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 7
[junit4] 2> 2285301 T6464 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 7
[junit4] 2> 2285346 T6488 oasc.ZkController.register We are http://127.0.0.1:52642/collection1/ and leader is http://127.0.0.1:52642/collection1/
[junit4] 2> 2285346 T6488 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52642
[junit4] 2> 2285346 T6488 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2285347 T6488 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 2285347 T6488 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2285348 T6441 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2285349 T6488 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 7
[junit4] 2> 2285350 T6437 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:52642_",
[junit4] 2> "base_url":"http://127.0.0.1:52642",
[junit4] 2> "state":"active",
[junit4] 2> "operation":"state",
[junit4] 2> "roles":null}
[junit4] 2> 2285353 T6437 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
[junit4] 2> 2285354 T6483 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2285354 T6464 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2285354 T6483 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 8
[junit4] 2> 2285354 T6464 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 8
[junit4] 2> 2285532 T6414 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 2285532 T6414 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2285534 T6414 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50281
[junit4] 2> 2285535 T6414 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2285535 T6414 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2285535 T6414 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-005
[junit4] 2> 2285536 T6414 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-005/'
[junit4] 2> 2285549 T6414 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-005/solr.xml
[junit4] 2> 2285573 T6414 oasc.CoreContainer.<init> New CoreContainer 418495167
[junit4] 2> 2285574 T6414 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-005/]
[junit4] 2> 2285574 T6414 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2285575 T6414 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2285575 T6414 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2285575 T6414 oashc.HttpShardHandlerFact
[...truncated too long message...]
cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-001/jetty4 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-001/jetty4;done=false>>]
[junit4] 2> 2354778 T6414 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-001/jetty4
[junit4] 2> 2354779 T6414 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-001/jetty4/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-001/jetty4/index;done=false>>]
[junit4] 2> 2354779 T6414 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001/tempDir-001/jetty4/index
[junit4] 2> 2354779 T6414 oasc.Overseer.close Overseer (id=92522493328818189-127.0.0.1:54783_-n_0000000004) closing
[junit4] 2> 2354780 T6558 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:54783_
[junit4] 2> 2356283 T6523 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2356307 T6414 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4] 2> 2361296 T6414 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4] 2> 2361298 T6414 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:45815 45815
[junit4] 2> 2361851 T6415 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:45815 45815
[junit4] 2> 2361853 T6415 oasc.ZkTestServer$ZKServerMain.runFromConfig WARN Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/aliases.json
[junit4] 2> 6 /solr/clusterstate.json
[junit4] 2> 4 /solr/collections/collection1/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/live_nodes
[junit4] 2> 5 /solr/overseer/queue
[junit4] 2> 5 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CloudExitableDirectoryReaderTest -Dtests.method=testDistribSearch -Dtests.seed=E2F3200ABF553931 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_SA -Dtests.timezone=SystemV/PST8PDT -Dtests.file.encoding=ISO-8859-1
[junit4] FAILURE 83.7s J1 | CloudExitableDirectoryReaderTest.testDistribSearch <<<
[junit4] > Throwable #1: java.lang.AssertionError: no exception matching expected: 400: Request took too long during query expansion. Terminating request.
[junit4] > at __randomizedtesting.SeedInfo.seed([E2F3200ABF553931:6315AE12C80A590D]:0)
[junit4] > at org.apache.solr.cloud.CloudExitableDirectoryReaderTest.assertFail(CloudExitableDirectoryReaderTest.java:101)
[junit4] > at org.apache.solr.cloud.CloudExitableDirectoryReaderTest.doTimeoutTests(CloudExitableDirectoryReaderTest.java:75)
[junit4] > at org.apache.solr.cloud.CloudExitableDirectoryReaderTest.doTest(CloudExitableDirectoryReaderTest.java:54)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 2361869 T6414 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-E2F3200ABF553931-001
[junit4] 2> 83749 T6413 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=267), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=267)), sim=DefaultSimilarity, locale=ar_SA, timezone=SystemV/PST8PDT
[junit4] 2> NOTE: Linux 3.13.0-36-generic amd64/Oracle Corporation 1.7.0_67 (64-bit)/cpus=8,threads=1,free=189541256,total=498073600
[junit4] 2> NOTE: All tests run in this JVM: [PrimUtilsTest, DirectSolrConnectionTest, CollectionsAPIDistributedZkTest, TestGroupingSearch, VMParamsZkACLAndCredentialsProvidersTest, SearchHandlerTest, TestManagedSchemaDynamicFieldResource, TestPHPSerializedResponseWriter, SortByFunctionTest, TestIndexSearcher, TestFieldResource, TestChildDocTransformer, DocValuesMissingTest, BadCopyFieldTest, CopyFieldTest, SolrInfoMBeanTest, OutputWriterTest, CircularListTest, HdfsUnloadDistributedZkTest, ConvertedLegacyTest, ResourceLoaderTest, TestDefaultSearchFieldResource, TestRecovery, TestDynamicFieldResource, TestRequestStatusCollectionAPI, InfoHandlerTest, TestXIncludeConfig, SynonymTokenizerTest, SuggestComponentTest, DocExpirationUpdateProcessorFactoryTest, HdfsCollectionsAPIDistributedZkTest, BasicZkTest, DirectUpdateHandlerOptimizeTest, FieldAnalysisRequestHandlerTest, TestCSVResponseWriter, TestManagedResource, SoftAutoCommitTest, QueryElevationComponentTest, CacheHeaderTest, TestCollationField, DistributedDebugComponentTest, TestQueryUtils, SampleTest, LeaderElectionIntegrationTest, ZkSolrClientTest, TestCollapseQParserPlugin, PreAnalyzedFieldTest, TestBM25SimilarityFactory, ReplicationFactorTest, DefaultValueUpdateProcessorTest, ScriptEngineTest, MergeStrategyTest, TestReversedWildcardFilterFactory, TestSchemaNameResource, TestPerFieldSimilarity, SolrXmlInZkTest, DocValuesTest, TestLazyCores, SharedFSAutoReplicaFailoverUtilsTest, HdfsDirectoryTest, SpatialFilterTest, DistributedQueryElevationComponentTest, SolrRequestParserTest, ModifyConfFileTest, TestQueryTypes, TestUpdate, FullSolrCloudDistribCmdsTest, DebugComponentTest, SimplePostToolTest, DateMathParserTest, TestElisionMultitermQuery, TestManagedResourceStorage, TestOmitPositions, AutoCommitTest, URLClassifyProcessorTest, TestSolrXmlPersistence, TestIndexingPerformance, DeleteInactiveReplicaTest, DistanceFunctionTest, TestSolrQueryParser, RequestHandlersTest, TestNonNRTOpen, TestFiltering, TestDistributedGrouping, TestTolerantSearch, SOLR749Test, TestExtendedDismaxParser, TestShortCircuitedRequests, LoggingHandlerTest, OpenCloseCoreStressTest, LegacyHTMLStripCharFilterTest, TestLFUCache, UpdateRequestProcessorFactoryTest, CustomCollectionTest, CurrencyFieldXmlFileTest, AnalyticsMergeStrategyTest, SolrPluginUtilsTest, CoreMergeIndexesAdminHandlerTest, TestCSVLoader, TestMissingGroups, HdfsRecoveryZkTest, TestStressLucene, TestCharFilters, SharedFSAutoReplicaFailoverTest, HdfsBasicDistributedZk2Test, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, RecoveryZkTest, TestReplicationHandler, ClusterStateUpdateTest, TestRandomFaceting, TestZkChroot, ShardRoutingCustomTest, TestDistributedSearch, TestHashPartitioner, TermVectorComponentDistributedTest, TestJoin, DistributedTermsComponentTest, PeerSyncTest, TestBadConfig, HighlighterTest, TestCoreDiscovery, SignatureUpdateProcessorFactoryTest, SuggesterFSTTest, SuggesterTest, TestTrie, SuggesterWFSTTest, PolyFieldTest, NoCacheHeaderTest, TestWordDelimiterFilterFactory, QueryEqualityTest, XsltUpdateRequestHandlerTest, LukeRequestHandlerTest, PrimitiveFieldTypeTest, TermsComponentTest, DocumentBuilderTest, TermVectorComponentTest, IndexSchemaRuntimeFieldTest, RegexBoostProcessorTest, QueryParsingTest, JsonLoaderTest, CSVRequestHandlerTest, TestBinaryResponseWriter, UpdateParamsTest, TestSolrIndexConfig, SolrIndexConfigTest, TestSolrDeletionPolicy2, TestBinaryField, TestSweetSpotSimilarityFactory, TimeZoneUtilsTest, TestFastOutputStream, TestSuggestSpellingConverter, DateFieldTest, SpellingQueryConverterTest, RAMDirectoryFactoryTest, ClusterStateTest, TestUtils, SliceStateTest, UUIDFieldTest, FileUtilsTest, TestRTGBase, CursorPagingTest, DistributedIntervalFacetingTest, AliasIntegrationTest, CloudExitableDirectoryReaderTest]
[junit4] Completed on J1 in 84.02s, 1 test, 1 failure <<< FAILURES!
[...truncated 285 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:524: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:472: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:61: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1359: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:961: There were test failures: 432 suites, 1778 tests, 1 failure, 44 ignored (22 assumptions)
Total time: 95 minutes 18 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.7.0_67 -XX:+UseCompressedOops -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any