You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/09/05 03:40:40 UTC
[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.8.0_40-ea-b04) - Build
# 11046 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/11046/
Java: 64bit/jdk1.8.0_40-ea-b04 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:49711
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:49711
at __randomizedtesting.SeedInfo.seed([4071E0B5B8CE1EF1:C1976EADCF917ECD]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:532)
at org.apache.solr.cloud.ShardSplitTest.incompleteOrOverlappingCustomRangeTest(ShardSplitTest.java:151)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:103)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:871)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:170)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:448)
... 47 more
Build Log:
[...truncated 12020 lines...]
[junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/init-core-data-001
[junit4] 2> 2094722 T5958 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 2094725 T5958 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 2094726 T5958 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2094726 T5959 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2094826 T5958 oasc.ZkTestServer.run start zk server on port:59573
[junit4] 2> 2094827 T5958 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2094828 T5958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2094830 T5965 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4f3e0520 name:ZooKeeperConnection Watcher:127.0.0.1:59573 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2094831 T5958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2094831 T5958 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2094831 T5958 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2094834 T5958 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2094835 T5958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2094835 T5967 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@612790c4 name:ZooKeeperConnection Watcher:127.0.0.1:59573/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2094836 T5958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2094836 T5958 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2094837 T5958 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 2094839 T5958 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 2094840 T5958 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 2094841 T5958 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 2094842 T5958 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 2094842 T5958 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 2094844 T5958 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 2094844 T5958 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 2094846 T5958 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2094846 T5958 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2094847 T5958 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 2094847 T5958 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 2094848 T5958 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 2094849 T5958 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 2094850 T5958 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 2094850 T5958 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 2094851 T5958 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 2094851 T5958 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 2094852 T5958 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2094852 T5958 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 2094853 T5958 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2094854 T5958 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2094855 T5958 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 2094855 T5958 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 2094856 T5958 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 2094856 T5958 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 2095106 T5958 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2095108 T5958 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:39355
[junit4] 2> 2095109 T5958 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2095109 T5958 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2095110 T5958 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-002
[junit4] 2> 2095110 T5958 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-002/'
[junit4] 2> 2095121 T5958 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-002/solr.xml
[junit4] 2> 2095130 T5958 oasc.CoreContainer.<init> New CoreContainer 1360702594
[junit4] 2> 2095130 T5958 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-002/]
[junit4] 2> 2095131 T5958 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2095131 T5958 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2095131 T5958 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2095132 T5958 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2095132 T5958 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2095132 T5958 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2095132 T5958 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2095133 T5958 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2095133 T5958 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2095133 T5958 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2095134 T5958 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2095134 T5958 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2095134 T5958 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2095135 T5958 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59573/solr
[junit4] 2> 2095136 T5958 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2095136 T5958 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2095137 T5958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2095138 T5978 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@59b7c6b6 name:ZooKeeperConnection Watcher:127.0.0.1:59573 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2095138 T5958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2095139 T5958 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2095143 T5958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2095144 T5980 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2527cabd name:ZooKeeperConnection Watcher:127.0.0.1:59573/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2095144 T5958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2095145 T5958 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2095146 T5958 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2095149 T5958 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 2095152 T5958 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 2095153 T5958 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 2095154 T5958 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2095155 T5958 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39355_
[junit4] 2> 2095155 T5958 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39355_
[junit4] 2> 2095157 T5958 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2095157 T5958 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2095158 T5958 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2095159 T5958 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:39355_
[junit4] 2> 2095159 T5958 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2095160 T5958 oasc.Overseer.start Overseer (id=92397941564506115-127.0.0.1:39355_-n_0000000000) starting
[junit4] 2> 2095161 T5958 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2095165 T5958 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 2095166 T5982 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2095166 T5958 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2095168 T5958 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2095169 T5958 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2095170 T5981 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2095172 T5984 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 2095172 T5984 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2095173 T5984 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2095173 T5985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2095174 T5981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:39355",
[junit4] 2> "node_name":"127.0.0.1:39355_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 2095174 T5981 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 2095174 T5981 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2095175 T5985 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2096173 T5984 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2096174 T5984 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 2096174 T5984 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2096175 T5984 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 2096175 T5984 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2096176 T5984 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-002/collection1/'
[junit4] 2> 2096176 T5984 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 2096176 T5984 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 2096177 T5984 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 2096194 T5984 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
[junit4] 2> 2096214 T5984 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2096216 T5984 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2096222 T5984 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2096315 T5984 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2096317 T5984 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2096317 T5984 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2096320 T5984 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2096331 T5984 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 2096331 T5984 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2096331 T5984 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-001/control/data/
[junit4] 2> 2096331 T5984 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@18917b9a
[junit4] 2> 2096332 T5984 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-001/control/data
[junit4] 2> 2096332 T5984 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-001/control/data/index/
[junit4] 2> 2096332 T5984 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 2096332 T5984 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-001/control/data/index
[junit4] 2> 2096333 T5984 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=41, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 2096333 T5984 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@566d0b07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@314f8350),segFN=segments_1,generation=1}
[junit4] 2> 2096333 T5984 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2096335 T5984 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2096336 T5984 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2096336 T5984 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2096336 T5984 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2096337 T5984 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2096337 T5984 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2096337 T5984 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2096337 T5984 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2096338 T5984 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2096338 T5984 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2096339 T5984 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2096339 T5984 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2096340 T5984 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2096340 T5984 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2096341 T5984 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2096341 T5984 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2096341 T5984 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2096342 T5984 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2096342 T5984 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2096343 T5984 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2096343 T5984 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2096346 T5984 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2096347 T5984 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2096349 T5984 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2096350 T5984 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2096351 T5984 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2096354 T5984 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2096354 T5984 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2096355 T5984 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=50, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 2096355 T5984 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@566d0b07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@314f8350),segFN=segments_1,generation=1}
[junit4] 2> 2096355 T5984 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2096355 T5984 oass.SolrIndexSearcher.<init> Opening Searcher@6dd1af0a[collection1] main
[junit4] 2> 2096356 T5984 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 2096356 T5984 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2096357 T5984 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2096357 T5984 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2096357 T5984 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 2096357 T5984 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2096358 T5984 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 2096358 T5984 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2096359 T5984 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
[junit4] 2> 2096361 T5984 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
[junit4] 2> 2096361 T5984 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2096361 T5984 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 2096362 T5986 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6dd1af0a[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 2096363 T5984 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2096364 T5989 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:39355 collection:control_collection shard:shard1
[junit4] 2> 2096365 T5958 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 2096365 T5958 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2096365 T5989 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 2096366 T5958 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2096367 T5958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2096368 T5991 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@77df4bfc name:ZooKeeperConnection Watcher:127.0.0.1:59573/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2096368 T5958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2096368 T5958 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2096369 T5958 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2096369 T5989 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 2096370 T5958 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 2096370 T5985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2096370 T5989 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2096371 T5989 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C4173 name=collection1 org.apache.solr.core.SolrCore@7f3b3b66 url=http://127.0.0.1:39355/collection1 node=127.0.0.1:39355_ C4173_STATE=coll:control_collection core:collection1 props:{core=collection1, base_url=http://127.0.0.1:39355, node_name=127.0.0.1:39355_, state=down}
[junit4] 2> 2096371 T5989 C4173 P39355 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:39355/collection1/
[junit4] 2> 2096371 T5989 C4173 P39355 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2096371 T5989 C4173 P39355 oasc.SyncStrategy.syncToMe http://127.0.0.1:39355/collection1/ has no replicas
[junit4] 2> 2096371 T5989 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:39355/collection1/ shard1
[junit4] 2> 2096371 T5989 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 2096373 T5985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2096475 T5985 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2096475 T5992 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2096524 T5989 oasc.ZkController.register We are http://127.0.0.1:39355/collection1/ and leader is http://127.0.0.1:39355/collection1/
[junit4] 2> 2096524 T5989 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:39355
[junit4] 2> 2096524 T5989 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2096524 T5989 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 2096524 T5989 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2096525 T5985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2096527 T5981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:39355",
[junit4] 2> "node_name":"127.0.0.1:39355_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 2096604 T5958 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 2096605 T5958 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2096607 T5958 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:47663
[junit4] 2> 2096608 T5958 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2096608 T5958 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2096608 T5958 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-003
[junit4] 2> 2096608 T5958 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-003/'
[junit4] 2> 2096620 T5958 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-003/solr.xml
[junit4] 2> 2096631 T5992 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2096632 T5985 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2096636 T5958 oasc.CoreContainer.<init> New CoreContainer 1752288309
[junit4] 2> 2096637 T5958 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-003/]
[junit4] 2> 2096637 T5958 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2096637 T5958 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2096638 T5958 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2096638 T5958 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2096638 T5958 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2096639 T5958 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2096639 T5958 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2096639 T5958 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2096640 T5958 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2096640 T5958 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2096641 T5958 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2096641 T5958 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2096641 T5958 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2096642 T5958 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59573/solr
[junit4] 2> 2096642 T5958 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2096643 T5958 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2096644 T5958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2096644 T6003 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2145ef name:ZooKeeperConnection Watcher:127.0.0.1:59573 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2096645 T5958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2096645 T5958 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2096646 T5958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2096647 T6005 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@312eb20d name:ZooKeeperConnection Watcher:127.0.0.1:59573/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2096647 T5958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2096650 T5958 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2097652 T5958 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47663_
[junit4] 2> 2097653 T5958 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47663_
[junit4] 2> 2097655 T5958 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2097657 T6007 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 2097657 T6007 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2097658 T5985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2097658 T6007 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2097659 T5981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:47663",
[junit4] 2> "node_name":"127.0.0.1:47663_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 2097659 T5981 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 2097659 T5981 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 2097762 T5985 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2097762 T5992 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2097762 T6006 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2098658 T6007 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2098659 T6007 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 2098660 T6007 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2098660 T6007 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2098660 T6007 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2098661 T6007 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-003/collection1/'
[junit4] 2> 2098661 T6007 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 2098661 T6007 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 2098661 T6007 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 2098680 T6007 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
[junit4] 2> 2098691 T6007 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2098692 T6007 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2098697 T6007 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2098802 T6007 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2098804 T6007 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2098804 T6007 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2098806 T6007 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2098820 T6007 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 2098820 T6007 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2098821 T6007 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-003/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-001/jetty1/
[junit4] 2> 2098821 T6007 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@18917b9a
[junit4] 2> 2098821 T6007 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-001/jetty1
[junit4] 2> 2098821 T6007 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-001/jetty1/index/
[junit4] 2> 2098821 T6007 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 2098822 T6007 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-001/jetty1/index
[junit4] 2> 2098822 T6007 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=41, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 2098823 T6007 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7a1d38ab lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6783d2c0),segFN=segments_1,generation=1}
[junit4] 2> 2098823 T6007 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2098825 T6007 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2098826 T6007 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2098826 T6007 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2098826 T6007 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2098827 T6007 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2098827 T6007 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2098827 T6007 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2098827 T6007 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2098828 T6007 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2098828 T6007 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2098828 T6007 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2098829 T6007 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2098829 T6007 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2098829 T6007 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2098829 T6007 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2098829 T6007 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2098830 T6007 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2098830 T6007 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2098830 T6007 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2098830 T6007 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2098831 T6007 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2098832 T6007 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2098833 T6007 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2098833 T6007 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2098834 T6007 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2098834 T6007 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2098836 T6007 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2098836 T6007 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2098836 T6007 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=50, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 2098836 T6007 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7a1d38ab lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6783d2c0),segFN=segments_1,generation=1}
[junit4] 2> 2098837 T6007 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2098837 T6007 oass.SolrIndexSearcher.<init> Opening Searcher@5744ba58[collection1] main
[junit4] 2> 2098837 T6007 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2098838 T6007 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2098838 T6007 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2098838 T6007 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2098838 T6007 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 2098838 T6007 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2098839 T6007 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 2098839 T6007 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2098839 T6007 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 2098839 T6007 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 2098841 T6008 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5744ba58[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 2098842 T6007 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2098843 T6011 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:47663 collection:collection1 shard:shard2
[junit4] 2> 2098843 T5958 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 2098843 T5958 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2098843 T6011 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 2098846 T6011 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 2098847 T5985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2098847 T6011 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2098847 T6011 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C4174 name=collection1 org.apache.solr.core.SolrCore@d943c9 url=http://127.0.0.1:47663/collection1 node=127.0.0.1:47663_ C4174_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:47663, node_name=127.0.0.1:47663_, state=down}
[junit4] 2> 2098847 T6011 C4174 P47663 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:47663/collection1/
[junit4] 2> 2098847 T6011 C4174 P47663 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2098848 T6011 C4174 P47663 oasc.SyncStrategy.syncToMe http://127.0.0.1:47663/collection1/ has no replicas
[junit4] 2> 2098848 T6011 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:47663/collection1/ shard2
[junit4] 2> 2098848 T6011 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 2098850 T5985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2098952 T5985 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2098952 T6006 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2098952 T5992 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2099001 T6011 oasc.ZkController.register We are http://127.0.0.1:47663/collection1/ and leader is http://127.0.0.1:47663/collection1/
[junit4] 2> 2099001 T6011 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47663
[junit4] 2> 2099001 T6011 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2099001 T6011 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 2099001 T6011 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2099002 T5985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2099005 T5981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:47663",
[junit4] 2> "node_name":"127.0.0.1:47663_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 2099091 T5958 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 2099092 T5958 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2099093 T5958 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49711
[junit4] 2> 2099094 T5958 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2099095 T5958 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2099095 T5958 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-004
[junit4] 2> 2099095 T5958 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-004/'
[junit4] 2> 2099105 T5958 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-004/solr.xml
[junit4] 2> 2099108 T5992 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2099108 T6006 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2099108 T5985 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2099120 T5958 oasc.CoreContainer.<init> New CoreContainer 991847067
[junit4] 2> 2099120 T5958 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-004/]
[junit4] 2> 2099121 T5958 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2099121 T5958 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2099121 T5958 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2099121 T5958 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2099122 T5958 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2099122 T5958 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2099122 T5958 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2099122 T5958 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2099123 T5958 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2099123 T5958 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2099123 T5958 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2099124 T5958 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2099124 T5958 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2099124 T5958 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59573/solr
[junit4] 2> 2099124 T5958 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2099125 T5958 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2099125 T5958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2099126 T6022 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2268d7ea name:ZooKeeperConnection Watcher:127.0.0.1:59573 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2099127 T5958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2099127 T5958 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2099128 T5958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2099129 T6024 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5f6cd6e name:ZooKeeperConnection Watcher:127.0.0.1:59573/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2099129 T5958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2099133 T5958 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2100135 T5958 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49711_
[junit4] 2> 2100136 T5958 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49711_
[junit4] 2> 2100140 T5958 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2100144 T6026 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 2100144 T6026 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2100145 T5985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2100145 T6026 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2100147 T5981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:49711",
[junit4] 2> "node_name":"127.0.0.1:49711_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 2100147 T5981 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 2100148 T5981 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2100251 T5992 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2100251 T6025 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2100251 T5985 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2100251 T6006 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2101146 T6026 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2101146 T6026 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 2101147 T6026 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2101147 T6026 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2101148 T6026 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2101148 T6026 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-004/collection1/'
[junit4] 2> 2101149 T6026 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 2101150 T6026 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 2101150 T6026 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 2101168 T6026 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
[junit4] 2> 2101177 T6026 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2101178 T6026 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2101182 T6026 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2101283 T6026 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2101285 T6026 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2101286 T6026 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2101288 T6026 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2101300 T6026 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 2101300 T6026 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2101300 T6026 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-004/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-001/jetty2/
[junit4] 2> 2101300 T6026 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@18917b9a
[junit4] 2> 2101301 T6026 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-001/jetty2
[junit4] 2> 2101301 T6026 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-001/jetty2/index/
[junit4] 2> 2101301 T6026 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 2101302 T6026 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-001/jetty2/index
[junit4] 2> 2101302 T6026 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=41, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 2101303 T6026 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@c57e66a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3be68a01),segFN=segments_1,generation=1}
[junit4] 2> 2101303 T6026 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2101305 T6026 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2101305 T6026 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2101305 T6026 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2101306 T6026 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2101306 T6026 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2101306 T6026 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2101306 T6026 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2101307 T6026 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2101307 T6026 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2101307 T6026 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2101307 T6026 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2101308 T6026 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2101308 T6026 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2101308 T6026 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2101309 T6026 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2101309 T6026 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2101309 T6026 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2101310 T6026 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2101310 T6026 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2101310 T6026 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2101310 T6026 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2101312 T6026 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2101313 T6026 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2101314 T6026 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2101315 T6026 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2101315 T6026 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2101316 T6026 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2101317 T6026 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2101317 T6026 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=50, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 2101317 T6026 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@c57e66a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3be68a01),segFN=segments_1,generation=1}
[junit4] 2> 2101318 T6026 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2101318 T6026 oass.SolrIndexSearcher.<init> Opening Searcher@7086575f[collection1] main
[junit4] 2> 2101318 T6026 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2101319 T6026 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2101319 T6026 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2101320 T6026 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2101320 T6026 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 2101320 T6026 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2101321 T6026 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 2101321 T6026 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2101321 T6026 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 2101321 T6026 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 2101324 T6027 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7086575f[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 2101325 T6026 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2101326 T6030 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49711 collection:collection1 shard:shard1
[junit4] 2> 2101326 T5958 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 2101327 T6030 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2101327 T5958 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2101330 T6030 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 2101331 T5985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2101331 T6030 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2101331 T6030 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C4175 name=collection1 org.apache.solr.core.SolrCore@140c6b9c url=http://127.0.0.1:49711/collection1 node=127.0.0.1:49711_ C4175_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:49711, node_name=127.0.0.1:49711_, state=down}
[junit4] 2> 2101331 T6030 C4175 P49711 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49711/collection1/
[junit4] 2> 2101331 T6030 C4175 P49711 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2101332 T6030 C4175 P49711 oasc.SyncStrategy.syncToMe http://127.0.0.1:49711/collection1/ has no replicas
[junit4] 2> 2101332 T6030 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49711/collection1/ shard1
[junit4] 2> 2101332 T6030 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2101334 T5985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2101436 T5992 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2101436 T5985 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2101436 T6025 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2101436 T6006 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2101485 T6030 oasc.ZkController.register We are http://127.0.0.1:49711/collection1/ and leader is http://127.0.0.1:49711/collection1/
[junit4] 2> 2101485 T6030 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49711
[junit4] 2> 2101485 T6030 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2101485 T6030 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 2101485 T6030 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2101486 T5985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2101487 T5981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:49711",
[junit4] 2> "node_name":"127.0.0.1:49711_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 2101587 T5958 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 2101588 T5958 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2101589 T5958 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:37683
[junit4] 2> 2101590 T5985 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2101590 T5958 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2101590 T5992 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2101590 T6025 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2101590 T6006 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2101590 T5958 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2101592 T5958 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-005
[junit4] 2> 2101592 T5958 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-005/'
[junit4] 2> 2101603 T5958 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-005/solr.xml
[junit4] 2> 2101611 T5958 oasc.CoreContainer.<init> New CoreContainer 277185216
[junit4] 2> 2101612 T5958 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001/tempDir-005/]
[junit4] 2> 2101612 T5958 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2101612 T5958 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2101613 T5958 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2101613 T5958 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2101613 T5958 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2101613 T5958 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2101614 T5958 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2101614 T5958 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2101614 T5958 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2101615 T5958 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2101615 T5958 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2101615 T5958 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2101616 T5958 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2101616 T5958 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59573/solr
[junit4] 2> 2101616 T5958 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2101616 T5958 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2101617 T5958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2101618 T6041 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@417c3652 name:ZooKeeperConnection Watcher:127.0.0.1:59573 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2101618 T5958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2101619 T5958 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2101620 T5958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2101620 T6043 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@49e4bcc3 name:ZooKeeperConnection Watcher:127.0.0.1:59573/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2101621 T5958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2101625 T5958 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2102628 T5958 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37683_
[junit4] 2> 2102629 T5958 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37683_
[junit4] 2> 2102633 T5958 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2102636 T6045 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 2102636 T6045 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2102637 T5985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2102637 T6045 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2102638 T5981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message=
[...truncated too long message...]
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:89)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:292)
[junit4] 2>
[junit4] 2> 2440102 T5958 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4] 2> 2445090 T5958 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4] 2> 2445092 T5958 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:59573 59573
[junit4] 2> 2445694 T5959 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:59573 59573
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ShardSplitTest -Dtests.method=testDistribSearch -Dtests.seed=4071E0B5B8CE1EF1 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=hr_HR -Dtests.timezone=Canada/Central -Dtests.file.encoding=US-ASCII
[junit4] ERROR 351s J1 | ShardSplitTest.testDistribSearch <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:49711
[junit4] > at __randomizedtesting.SeedInfo.seed([4071E0B5B8CE1EF1:C1976EADCF917ECD]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:560)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
[junit4] > at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:532)
[junit4] > at org.apache.solr.cloud.ShardSplitTest.incompleteOrOverlappingCustomRangeTest(ShardSplitTest.java:151)
[junit4] > at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:103)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:871)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > Caused by: java.net.SocketTimeoutException: Read timed out
[junit4] > at java.net.SocketInputStream.socketRead0(Native Method)
[junit4] > at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
[junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:170)
[junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:141)
[junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
[junit4] > at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
[junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
[junit4] > at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
[junit4] > at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
[junit4] > at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
[junit4] > at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:448)
[junit4] > ... 47 more
[junit4] 2> 2445713 T5958 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ShardSplitTest-4071E0B5B8CE1EF1-001
[junit4] 2> NOTE: test params are: codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=279), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=279)), sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=hr_HR, timezone=Canada/Central
[junit4] 2> NOTE: Linux 3.13.0-35-generic amd64/Oracle Corporation 1.8.0_40-ea (64-bit)/cpus=8,threads=1,free=71711992,total=439447552
[junit4] 2> NOTE: All tests run in this JVM: [TestRandomFaceting, TestSolrXmlPersistence, HardAutoCommitTest, MultiThreadedOCPTest, LukeRequestHandlerTest, TestRecovery, HdfsLockFactoryTest, TermVectorComponentTest, TestManagedResource, DistributedTermsComponentTest, SampleTest, TestCustomSort, TestDocBasedVersionConstraints, QueryElevationComponentTest, FieldAnalysisRequestHandlerTest, CoreContainerCoreInitFailuresTest, TestBlendedInfixSuggestions, OverriddenZkACLAndCredentialsProvidersTest, HdfsSyncSliceTest, TestCharFilters, AnalyticsQueryTest, TestZkChroot, CopyFieldTest, AnalysisAfterCoreReloadTest, SliceStateTest, MigrateRouteKeyTest, SortByFunctionTest, ChaosMonkeySafeLeaderTest, TestPHPSerializedResponseWriter, BlockCacheTest, TestIndexSearcher, AlternateDirectoryTest, TestSortingResponseWriter, TermVectorComponentDistributedTest, InfoHandlerTest, TestValueSourceCache, LeaderElectionIntegrationTest, TestFastWriter, HdfsUnloadDistributedZkTest, EnumFieldTest, TestQueryTypes, TestIBSimilarityFactory, ConnectionManagerTest, TestRealTimeGet, DistributedDebugComponentTest, TestWriterPerf, IndexSchemaRuntimeFieldTest, CacheHeaderTest, TestIntervalFaceting, TestManagedSchema, CSVRequestHandlerTest, TestRandomMergePolicy, ScriptEngineTest, QueryParsingTest, FullSolrCloudDistribCmdsTest, DOMUtilTest, TriLevelCompositeIdRoutingTest, TestManagedSchemaFieldResource, TestLRUCache, SynonymTokenizerTest, NumericFieldsTest, SuggesterFSTTest, URLClassifyProcessorTest, UpdateRequestProcessorFactoryTest, TestSearcherReuse, TestCSVLoader, TestManagedStopFilterFactory, HdfsChaosMonkeySafeLeaderTest, DocValuesTest, TestCloudManagedSchema, TestParamSet, MultiTermTest, ReplicationFactorTest, LegacyHTMLStripCharFilterTest, ShardRoutingCustomTest, AtomicUpdatesTest, TestNRTOpen, TestSchemaNameResource, SearchHandlerTest, PrimUtilsTest, TestCollapseQParserPlugin, DistanceFunctionTest, TestCloudSchemaless, TestFiltering, TestJoin, TimeZoneUtilsTest, DocValuesMissingTest, TestFileDictionaryLookup, TestFunctionQuery, SolrTestCaseJ4Test, TestXIncludeConfig, AutoCommitTest, TestDistributedGrouping, TestCloudPivotFacet, TestSolrQueryParser, TestSimpleQParserPlugin, SOLR749Test, TestBinaryField, TestSchemaSimilarityResource, CollectionsAPIDistributedZkTest, TestDocumentBuilder, RequestHandlersTest, TestAtomicUpdateErrorCases, TestReversedWildcardFilterFactory, BasicZkTest, TestReplicationHandler, TestUpdate, DirectUpdateHandlerOptimizeTest, TestRemoteStreaming, FileBasedSpellCheckerTest, DocumentBuilderTest, RequiredFieldsTest, FastVectorHighlighterTest, SolrPluginUtilsTest, JSONWriterTest, BinaryUpdateRequestHandlerTest, TestComponentsName, TestLFUCache, TestSolrIndexConfig, ResponseLogComponentTest, BadComponentTest, TestStressRecovery, OpenExchangeRatesOrgProviderTest, TestFastLRUCache, TestSystemIdResolver, TestSuggestSpellingConverter, DateFieldTest, SpellingQueryConverterTest, RAMDirectoryFactoryTest, ClusterStateTest, ZkNodePropsTest, SystemInfoHandlerTest, UUIDFieldTest, CircularListTest, TestRTGBase, CursorPagingTest, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, DeleteInactiveReplicaTest, DeleteShardTest, DistribCursorPagingTest, RemoteQueryErrorTest, SSLMigrationTest, ShardSplitTest]
[junit4] Completed on J1 in 351.02s, 1 test, 1 error <<< FAILURES!
[...truncated 143 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:491: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:471: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:60: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:494: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1341: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:947: There were test failures: 425 suites, 1771 tests, 1 error, 43 ignored (22 assumptions)
Total time: 90 minutes 43 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0_40-ea-b04 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any