You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/11/27 17:42:17 UTC
[JENKINS] Lucene-Solr-5.x-Linux (64bit/jdk1.8.0_20) - Build # 11510
- Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Linux/11510/
Java: 64bit/jdk1.8.0_20 -XX:-UseCompressedOops -XX:+UseG1GC (asserts: true)
1 tests failed.
FAILED: org.apache.solr.cloud.hdfs.StressHdfsTest.testDistribSearch
Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:57454/wa_b
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:57454/wa_b
at __randomizedtesting.SeedInfo.seed([DE49ABD616E94DB1:5FAF25CE61B62D8D]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:581)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
at org.apache.solr.cloud.BasicDistributedZkTest.createCollection(BasicDistributedZkTest.java:612)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1587)
at org.apache.solr.cloud.hdfs.StressHdfsTest.createAndDeleteCollection(StressHdfsTest.java:151)
at org.apache.solr.cloud.hdfs.StressHdfsTest.doTest(StressHdfsTest.java:97)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:150)
at java.net.SocketInputStream.read(SocketInputStream.java:121)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:465)
... 47 more
Build Log:
[...truncated 11216 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.StressHdfsTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/init-core-data-001
[junit4] 2> 652592 T919 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /wa_b/
[junit4] 2> 655616 T919 oahu.NativeCodeLoader.<clinit> WARN Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 660235 T919 oahmi.MetricsConfig.loadFirst WARN Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 661153 T919 oml.Slf4jLog.info Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
[junit4] 2> 661679 T919 oml.Slf4jLog.info jetty-6.1.26
[junit4] 2> 661976 T919 oml.Slf4jLog.info Extract jar:file:/var/lib/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.2.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_localdomain_56600_hdfs____hv4hu7/webapp
[junit4] 2> 662174 T919 oml.Slf4jLog.info NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 663730 T919 oml.Slf4jLog.info Started SelectChannelConnector@localhost.localdomain:56600
[junit4] 2> 667034 T919 oml.Slf4jLog.info jetty-6.1.26
[junit4] 2> 667079 T919 oml.Slf4jLog.info Extract jar:file:/var/lib/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.2.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_localdomain_32918_datanode____.tx79qg/webapp
[junit4] 2> 667796 T919 oml.Slf4jLog.info NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 671560 T919 oml.Slf4jLog.info Started SelectChannelConnector@localhost.localdomain:32918
[junit4] 2> 673810 T919 oml.Slf4jLog.info jetty-6.1.26
[junit4] 2> 673970 T919 oml.Slf4jLog.info Extract jar:file:/var/lib/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.2.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_localdomain_33772_datanode____ws2sqx/webapp
[junit4] 2> 674433 T919 oml.Slf4jLog.info NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 676470 T919 oml.Slf4jLog.info Started SelectChannelConnector@localhost.localdomain:33772
[junit4] 2> 687114 T940 oahhsb.BlockManager.processReport BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-647133339-188.138.97.18-54366-1417103298373, infoPort=33772, ipcPort=47176, storageInfo=lv=-47;cid=testClusterID;nsid=1937133725;c=0), blocks: 0, processing time: 4 msecs
[junit4] 2> 687114 T941 oahhsb.BlockManager.processReport BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-1471454549-188.138.97.18-46118-1417103298373, infoPort=32918, ipcPort=48220, storageInfo=lv=-47;cid=testClusterID;nsid=1937133725;c=0), blocks: 0, processing time: 0 msecs
[junit4] 2> 687258 T919 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 687262 T919 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 687264 T1029 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 687363 T919 oasc.ZkTestServer.run start zk server on port:52980
[junit4] 2> 687364 T919 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 687366 T919 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 687374 T1036 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@557e4c91 name:ZooKeeperConnection Watcher:127.0.0.1:52980 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 687374 T919 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 687374 T919 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 687375 T919 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 687386 T919 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 687387 T919 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 687389 T1039 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@622b191a name:ZooKeeperConnection Watcher:127.0.0.1:52980/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 687389 T919 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 687390 T919 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 687390 T919 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 687392 T919 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 687393 T919 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 687394 T919 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 687397 T919 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 687399 T919 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 687401 T919 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 687402 T919 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 687404 T919 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 687404 T919 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 687406 T919 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 687407 T919 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 687409 T919 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 687409 T919 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 687412 T919 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 687412 T919 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 687414 T919 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 687414 T919 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 687417 T919 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 687418 T919 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 687420 T919 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 687421 T919 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 687423 T919 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 687423 T919 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 687425 T919 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 687426 T919 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 688118 T919 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 688125 T919 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58695
[junit4] 2> 688127 T919 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 688129 T919 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 688130 T919 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/tempDir-003
[junit4] 2> 688130 T919 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/tempDir-003/'
[junit4] 2> 688165 T919 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/tempDir-003/solr.xml
[junit4] 2> 688181 T919 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/tempDir-003
[junit4] 2> 688182 T919 oasc.CoreContainer.<init> New CoreContainer 1134226558
[junit4] 2> 688182 T919 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/tempDir-003/]
[junit4] 2> 688183 T919 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 688183 T919 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 688183 T919 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 688184 T919 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 688184 T919 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 688185 T919 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 688185 T919 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 688185 T919 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 688186 T919 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 688186 T919 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 688187 T919 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 688187 T919 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 688188 T919 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 688188 T919 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 688189 T919 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52980/solr
[junit4] 2> 688189 T919 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 688190 T919 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 688193 T919 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 688195 T1051 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24e8cff6 name:ZooKeeperConnection Watcher:127.0.0.1:52980 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 688196 T919 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 688196 T919 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 688199 T919 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 688209 T1054 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@34f3a443 name:ZooKeeperConnection Watcher:127.0.0.1:52980/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 688210 T919 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 688211 T919 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 688214 T919 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 688215 T919 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 688217 T919 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 688219 T919 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 688220 T919 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 688221 T919 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58695_wa_b
[junit4] 2> 688222 T919 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58695_wa_b
[junit4] 2> 688223 T919 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 688225 T919 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 688226 T919 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 688228 T919 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:58695_wa_b
[junit4] 2> 688228 T919 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 688229 T919 oasc.Overseer.start Overseer (id=92871281836949507-127.0.0.1:58695_wa_b-n_0000000000) starting
[junit4] 2> 688231 T919 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 688240 T919 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 688240 T1056 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 688241 T919 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 688242 T919 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 688243 T919 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 688246 T919 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/tempDir-003
[junit4] 2> 688255 T919 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/tempDir-003/conf/
[junit4] 2> 688262 T1055 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 688412 T919 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 688413 T919 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 688414 T919 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 688415 T919 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 688415 T919 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 688417 T1061 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17a35a4a name:ZooKeeperConnection Watcher:127.0.0.1:52980/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 688417 T919 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 688417 T919 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 688418 T919 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 688420 T919 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 688676 T919 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 688678 T919 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 688690 T919 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:57454
[junit4] 2> 688691 T919 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 688691 T919 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 688692 T919 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/tempDir-004
[junit4] 2> 688693 T919 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/tempDir-004/'
[junit4] 2> 688705 T919 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/tempDir-004/solr.xml
[junit4] 2> 688713 T919 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/tempDir-004
[junit4] 2> 688714 T919 oasc.CoreContainer.<init> New CoreContainer 1435248381
[junit4] 2> 688714 T919 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/tempDir-004/]
[junit4] 2> 688715 T919 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 688715 T919 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 688715 T919 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 688715 T919 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 688715 T919 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 688716 T919 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 688716 T919 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 688716 T919 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 688716 T919 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 688716 T919 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 688717 T919 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 688717 T919 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 688717 T919 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 688718 T919 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 688718 T919 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52980/solr
[junit4] 2> 688718 T919 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 688718 T919 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 688719 T919 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 688722 T1073 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fd0a41c name:ZooKeeperConnection Watcher:127.0.0.1:52980 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 688723 T919 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 688723 T919 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 688725 T919 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 688726 T1076 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@52ee7133 name:ZooKeeperConnection Watcher:127.0.0.1:52980/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 688727 T919 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 688730 T919 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 689732 T919 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57454_wa_b
[junit4] 2> 689733 T919 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57454_wa_b
[junit4] 2> 689735 T919 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 690382 T919 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/tempDir-004
[junit4] 2> 691002 T919 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/tempDir-004/conf/
[junit4] 2> 691213 T919 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 691214 T919 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 691214 T919 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 691665 T919 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 691667 T919 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 691691 T919 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60154
[junit4] 2> 691722 T919 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 691722 T919 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 691723 T919 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/tempDir-005
[junit4] 2> 691723 T919 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/tempDir-005/'
[junit4] 2> 691751 T919 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/tempDir-005/solr.xml
[junit4] 2> 691758 T919 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/tempDir-005
[junit4] 2> 691758 T919 oasc.CoreContainer.<init> New CoreContainer 2026865400
[junit4] 2> 691759 T919 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/tempDir-005/]
[junit4] 2> 691759 T919 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 691759 T919 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 691760 T919 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 691760 T919 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 691760 T919 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 691761 T919 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 691761 T919 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 691761 T919 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 691761 T919 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 691762 T919 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 691762 T919 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 691763 T919 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 691763 T919 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 691764 T919 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 691764 T919 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52980/solr
[junit4] 2> 691764 T919 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 691765 T919 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 691766 T919 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 691767 T1089 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@54b7d92 name:ZooKeeperConnection Watcher:127.0.0.1:52980 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 691768 T919 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 691768 T919 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 691770 T919 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 691771 T1092 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fc2d4b4 name:ZooKeeperConnection Watcher:127.0.0.1:52980/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 691771 T919 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 691775 T919 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 692777 T919 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60154_wa_b
[junit4] 2> 692778 T919 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60154_wa_b
[junit4] 2> 692781 T919 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 692786 T919 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/tempDir-005
[junit4] 2> 692795 T919 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/tempDir-005/conf/
[junit4] 2> 693172 T919 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 693173 T919 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 693173 T919 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 693174 T919 oasc.AbstractFullDistribZkTestBase.randomlyEnableAutoSoftCommit Not turning on auto soft commit
[junit4] 2> 695461 T1068 oasha.CollectionsHandler.handleCreateAction Creating Collection : replicationFactor=2&maxShardsPerNode=1&name=delete_data_dir&action=CREATE&numShards=1&wt=javabin&version=2
[junit4] 2> 695866 T1054 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/collection-queue-work state SyncConnected
[junit4] 2> 695868 T1056 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"create",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"delete_data_dir",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"1",
[junit4] 2> "maxShardsPerNode":"1"}
[junit4] 2> 695870 T1094 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : create , {
[junit4] 2> "operation":"create",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"delete_data_dir",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"1",
[junit4] 2> "maxShardsPerNode":"1"}
[junit4] 2> 695872 T1094 oasc.OverseerCollectionProcessor.createConfNode Only one config set found in zk - using it:conf1
[junit4] 2> 695872 T1094 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/delete_data_dir
[junit4] 2> 695873 T1094 oascc.SolrZkClient.makePath makePath: /collections/delete_data_dir
[junit4] 2> 695876 T1054 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 695880 T1055 oasc.Overseer$ClusterStateUpdater.processMessage processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"delete_data_dir",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"1",
[junit4] 2> "maxShardsPerNode":"1"}
[junit4] 2> 695881 T1055 oasc.Overseer$ClusterStateUpdater.buildCollection Building a new collection: delete_data_dir
[junit4] 2> 695882 T1055 oasc.Overseer$ClusterStateUpdater.createCollection Create collection delete_data_dir with shards [shard1]
[junit4] 2> 695883 T1055 oasc.Overseer$ClusterStateUpdater.createCollection state version delete_data_dir 1
[junit4] 2> 695886 T1092 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 695886 T1054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 695886 T1076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 695887 T1061 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 695976 T1094 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection delete_data_dir, shardNames [shard1] , replicationFactor : 2
[junit4] 2> 695977 T1094 oasc.OverseerCollectionProcessor.createCollection Creating shard delete_data_dir_shard1_replica1 as part of slice shard1 of collection delete_data_dir on 127.0.0.1:60154_wa_b
[junit4] 2> 695981 T1094 oasc.OverseerCollectionProcessor.createCollection Creating shard delete_data_dir_shard1_replica2 as part of slice shard1 of collection delete_data_dir on 127.0.0.1:58695_wa_b
[junit4] 2> 696000 T1047 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=delete_data_dir_shard1_replica2&action=CREATE&numShards=1&collection=delete_data_dir&shard=shard1&wt=javabin&version=2
[junit4] 2> 696000 T1085 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=delete_data_dir_shard1_replica1&action=CREATE&numShards=1&collection=delete_data_dir&shard=shard1&wt=javabin&version=2
[junit4] 2> 696088 T1085 oasc.ZkController.publish publishing core=delete_data_dir_shard1_replica1 state=down collection=delete_data_dir
[junit4] 2> 696088 T1047 oasc.ZkController.publish publishing core=delete_data_dir_shard1_replica2 state=down collection=delete_data_dir
[junit4] 2> 696091 T1054 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 696092 T1047 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 696092 T1085 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 696095 T1055 oasc.Overseer$ClusterStateUpdater.processMessage processMessage: queueSize: 2, message = {
[junit4] 2> "core":"delete_data_dir_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:60154/wa_b",
[junit4] 2> "node_name":"127.0.0.1:60154_wa_b",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"delete_data_dir",
[junit4] 2> "operation":"state"}
[junit4] 2> 696098 T1055 oasc.Overseer$ClusterStateUpdater.processMessage processMessage: queueSize: 1, message = {
[junit4] 2> "core":"delete_data_dir_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:58695/wa_b",
[junit4] 2> "node_name":"127.0.0.1:58695_wa_b",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"delete_data_dir",
[junit4] 2> "operation":"state"}
[junit4] 2> 696100 T1054 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 696102 T1092 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 696102 T1054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 696102 T1061 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 696102 T1076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 697092 T1047 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delete_data_dir_shard1_replica2
[junit4] 2> 697093 T1047 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delete_data_dir
[junit4] 2> 697093 T1085 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delete_data_dir_shard1_replica1
[junit4] 2> 697093 T1047 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 697093 T1047 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delete_data_dir
[junit4] 2> 697094 T1085 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delete_data_dir
[junit4] 2> 697094 T1047 oascc.ZkStateReader.readConfigName path=/collections/delete_data_dir configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 697094 T1085 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 697094 T1047 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/tempDir-003/delete_data_dir_shard1_replica2/'
[junit4] 2> 697095 T1085 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delete_data_dir
[junit4] 2> 697097 T1085 oascc.ZkStateReader.readConfigName path=/collections/delete_data_dir configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 697098 T1085 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001/tempDir-005/delete_data_dir_shard1_replica1/'
[junit4] 2> 697173 T1047 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 697184 T1047 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 697220 T1085 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 697223 T1085 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 697288 T1047 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 697459 T1085 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 697612 T1085 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 697624 T1085 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 697755 T1085 oass.IndexSchema.readSchema [delete_data_dir_shard1_replica1] Schema name=test
[junit4] 2> 697758 T1047 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 697760 T1047 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 697783 T1047 oass.IndexSchema.readSchema [delete_data_dir_shard1_replica2] Schema name=test
[junit4] 2> 713931 T1030 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x149f1f053ba0004, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 716016 T1061 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17a35a4a name:ZooKeeperConnection Watcher:127.0.0.1:52980/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 726905 T1061 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 727399 T1030 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x149f1f053ba0008, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 727506 T1030 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x149f1f053ba0006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 727583 T1030 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x149f1f053ba0003, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 727726 T1054 oasc.ZkController$WatcherImpl.process A node got unwatched for /configs/conf1
[junit4] 2> 732102 T1092 oasc.ZkController$WatcherImpl.process A node got unwatched for /configs/conf1
[junit4] 2> 732667 T1103 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@52ee7133 name:ZooKeeperConnection Watcher:127.0.0.1:52980/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 733723 T1103 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 732975 T1104 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fc2d4b4 name:ZooKeeperConnection Watcher:127.0.0.1:52980/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 733750 T1104 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 732975 T1105 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@34f3a443 name:ZooKeeperConnection Watcher:127.0.0.1:52980/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 733753 T1105 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 758422 T1047 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 758423 T1085 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 760788 T1085 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 760788 T1047 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 761205 T1085 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 761206 T1047 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 766566 T1101 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@34f3a443 name:ZooKeeperConnection Watcher:127.0.0.1:52980/solr got event WatchedEvent state:Expired type:None path:null path:null type:None
[junit4] 2> 766591 T1107 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@52ee7133 name:ZooKeeperConnection Watcher:127.0.0.1:52980/solr got event WatchedEvent state:Expired type:None path:null path:null type:None
[junit4] 2> 766616 T1101 oascc.ConnectionManager.process Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
[junit4] 2> 766591 T1099 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17a35a4a name:ZooKeeperConnection Watcher:127.0.0.1:52980/solr got event WatchedEvent state:Expired type:None path:null path:null type:None
[junit4] 2> 766616 T1099 oascc.ConnectionManager.process Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
[junit4] 2> 766585 T1092 oasc.ZkController$WatcherImpl.process A node got unwatched for /configs/conf1
[junit4] 2> 766578 T1109 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fc2d4b4 name:ZooKeeperConnection Watcher:127.0.0.1:52980/solr got event WatchedEvent state:Expired type:None path:null path:null type:None
[junit4] 2> 766619 T1109 oascc.ConnectionManager.process Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
[junit4] 2> 766571 T1105 oasc.ZkController$WatcherImpl.process A node got unwatched for /configs/conf1
[junit4] 2> 766631 T1101 oasc.Overseer.close Overseer (id=92871281836949507-127.0.0.1:58695_wa_b-n_0000000000) closing
[junit4] 2> 766616 T1107 oascc.ConnectionManager.process Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
[junit4] 2> 766639 T1099 oascc.DefaultConnectionStrategy.reconnect Connection expired - starting a new one...
[junit4] 2> 766654 T1107 oascc.DefaultConnectionStrategy.reconnect Connection expired - starting a new one...
[junit4] 2> 766654 T1109 oascc.DefaultConnectionStrategy.reconnect Connection expired - starting a new one...
[junit4] 2> 766732 T1056 oasc.OverseerCollectionProcessor.amILeader org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:348)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:345)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.amILeader(OverseerCollectionProcessor.java:540)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:298)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 766740 T1055 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:58695_wa_b
[junit4] 2> 766737 T1109 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 766737 T1099 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 766735 T1107 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 766816 T1056 oasc.OverseerCollectionProcessor.amILeader According to ZK I (id=92871281836949507-127.0.0.1:58695_wa_b-n_0000000000) am no longer a leader.
[junit4] 2> 766824 T1119 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:348)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:345)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:430)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:140)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:365)
[junit4] 2>
[junit4] 2> 769618 T1085 oasc.CoreContainer.create ERROR Error creating core [delete_data_dir_shard1_replica1]: Could not load conf for core delete_data_dir_shard1_replica1: java.io.IOException: Error opening /configs/conf1/stopwords.txt org.apache.solr.common.SolrException: Could not load conf for core delete_data_dir_shard1_replica1: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:68)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:507)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:484)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:575)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:199)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:188)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:136)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:733)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:254)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:201)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:137)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:178)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ConfigSetService.createIndexSchema(ConfigSetService.java:90)
[junit4] 2> at org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:62)
[junit4] 2> ... 34 more
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:89)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:263)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:252)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:109)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:677)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:176)
[junit4] 2> ... 38 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:314)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:311)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:791)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:83)
[junit4] 2> ... 43 more
[junit4] 2>
[junit4] 2> 769706 T1118 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@52ee7133 name:ZooKeeperConnection Watcher:127.0.0.1:52980/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 769704 T1117 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fc2d4b4 name:ZooKeeperConnection Watcher:127.0.0.1:52980/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 769701 T1116 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17a35a4a name:ZooKeeperConnection Watcher:127.0.0.1:52980/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 769625 T1047 oasc.CoreContainer.create ERROR Error creating core [delete_data_dir_shard1_replica2]: Could not load conf for core delete_data_dir_shard1_replica2: java.io.IOException: Error opening /configs/conf1/stopwords.txt org.apache.solr.common.SolrException: Could not load conf for core delete_data_dir_shard1_replica2: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:68)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:507)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:484)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:575)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:199)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:188)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:136)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:733)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:254)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:201)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:137)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:178)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ConfigSetService.createIndexSchema(ConfigSetService.java:90)
[junit4] 2> at org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:62)
[junit4] 2> ... 34 more
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:89)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:263)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:252)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:109)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:677)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:176)
[junit4] 2> ... 38 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:314)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:311)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:791)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:83)
[junit4] 2> ... 43 more
[junit4] 2>
[junit4] 2> 769986 T1085 oascc.ZkStateReader.removeZKWatch ERROR Error updating state org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /live_nodes
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:331)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:328)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:328)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.updateClusterState(ZkStateReader.java:509)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.updateClusterState(ZkStateReader.java:255)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.removeZKWatch(ZkStateReader.java:886)
[junit4] 2> at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1216)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:590)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:199)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:188)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:136)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:733)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:254)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:201)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:137)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 769968 T1099 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 769964 T1109 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 770045 T1109 oascc.ConnectionManager$1.update Connection with ZooKeeper reestablished.
[junit4] 2> 769962 T1107 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 770051 T1107 oascc.ConnectionManager$1.update Connection with ZooKeeper reestablished.
[junit4] 2> 770053 T1107 oasc.ZkController$1.command ZooKeeper session re-connected ... refreshing core states after session expiration.
[junit4] 2> 770047 T1109 oasc.ZkController$1.command ZooKeeper session re-connected ... refreshing core states after session expiration.
[junit4] 2> 770043 T1099 oascc.ConnectionManager$1.update Connection with ZooKeeper reestablished.
[junit4] 2> 770020 T1047 oascc.ZkStateReader.removeZKWatch ERROR Error updating state org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /live_nodes
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:331)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:328)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:328)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.updateClusterState(ZkStateReader.java:509)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.updateClusterState(ZkStateReader.java:255)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.removeZKWatch(ZkStateReader.java:886)
[junit4] 2> at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1216)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:590)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:199)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:188)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:136)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:733)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:254)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:201)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:137)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 770085 T1109 oasc.ElectionContext.cancelElection canceling election /overseer_elect/election/92871281836949512-127.0.0.1:60154_wa_b-n_0000000002
[junit4] 2> 770085 T1107 oasc.ElectionContext.cancelElection canceling election /overseer_elect/election/92871281836949510-127.0.0.1:57454_wa_b-n_0000000001
[junit4] 2> 770084 T1099 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 770123 T1047 oasc.SolrException.log ERROR null:org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue/qn-
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$9.execute(SolrZkClient.java:383)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$9.execute(SolrZkClient.java:380)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:380)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.createData(DistributedQueue.java:377)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:361)
[junit4] 2> at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1222)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:590)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:199)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:188)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:136)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:733)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:254)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:201)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:137)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 770167 T1047 oasc.SolrException.log ERROR org.apache.solr.common.SolrException: Error CREATEing SolrCore 'delete_data_dir_shard1_replica2': Unable to create core [delete_data_dir_shard1_replica2] Caused by: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:615)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:199)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:188)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:136)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:733)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:254)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:201)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:137)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.
[...truncated too long message...]
ted
[junit4] 2> 890548 T964 oahhsd.BPServiceActor.run WARN Ending block pool service for: Block pool BP-1530022047-188.138.97.18-1417103269458 (storage id DS-1471454549-188.138.97.18-46118-1417103298373) service to localhost.localdomain/127.0.0.1:54378
[junit4] 2> 890939 T939 oahhsb.DecommissionManager$Monitor.run WARN Monitor interrupted: java.lang.InterruptedException: sleep interrupted
[junit4] 2> 891113 T919 oml.Slf4jLog.info Stopped SelectChannelConnector@localhost.localdomain:0
[junit4] 2> 891261 T919 oahml.MethodMetric$2.snapshot ERROR Error invoking method getBlocksTotal java.lang.reflect.InvocationTargetException
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:483)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MethodMetric$2.snapshot(MethodMetric.java:111)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MethodMetric.snapshot(MethodMetric.java:144)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MetricsRegistry.snapshot(MetricsRegistry.java:387)
[junit4] 2> at org.apache.hadoop.metrics2.lib.MetricsSourceBuilder$1.getMetrics(MetricsSourceBuilder.java:79)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMetrics(MetricsSourceAdapter.java:194)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.updateJmxCache(MetricsSourceAdapter.java:171)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMBeanInfo(MetricsSourceAdapter.java:150)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:226)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:211)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:429)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:202)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:560)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:117)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:734)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1422)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:100)
[junit4] 2> at org.apache.solr.cloud.hdfs.StressHdfsTest.teardownClass(StressHdfsTest.java:70)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:483)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:790)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:159)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:2892)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:4934)
[junit4] 2> ... 53 more
[junit4] 2>
[junit4] 2> 891535 T919 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest-DE49ABD616E94DB1-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50), sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=th_TH, timezone=Australia/Currie
[junit4] 2> NOTE: Linux 3.13.0-39-generic amd64/Oracle Corporation 1.8.0_20 (64-bit)/cpus=8,threads=3,free=402822304,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [EnumFieldTest, TestMultiCoreConfBootstrap, QueryParsingTest, ChaosMonkeySafeLeaderTest, TestMergePolicyConfig, DistributedQueryComponentOptimizationTest, SimplePostToolTest, TestPhraseSuggestions, CoreAdminCreateDiscoverTest, ConvertedLegacyTest, TestExtendedDismaxParser, TestIntervalFaceting, TestSolrQueryParserResource, CircularListTest, SuggesterFSTTest, SoftAutoCommitTest, TestWriterPerf, SolrTestCaseJ4Test, DistributedQueryElevationComponentTest, TestAddFieldRealTimeGet, TestBulkSchemaAPI, CurrencyFieldXmlFileTest, TestDistribDocBasedVersion, ChangedSchemaMergeTest, SSLMigrationTest, TestManagedSynonymFilterFactory, TestShortCircuitedRequests, TestClassNameShortening, TestElisionMultitermQuery, URLClassifyProcessorTest, PrimUtilsTest, TestImplicitCoreProperties, TestOverriddenPrefixQueryForCustomFieldType, TestPseudoReturnFields, SimpleMLTQParserTest, TestRandomFaceting, DeleteShardTest, AtomicUpdatesTest, StressHdfsTest]
[junit4] Completed on J1 in 239.01s, 1 test, 1 error <<< FAILURES!
[...truncated 1199 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:525: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:473: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:61: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/extra-targets.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/common-build.xml:508: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:1363: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:970: There were test failures: 450 suites, 1841 tests, 1 error, 31 ignored (22 assumptions)
Total time: 121 minutes 22 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0_20 -XX:-UseCompressedOops -XX:+UseG1GC (asserts: true)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-5.x-Linux (32bit/jdk1.8.0_20) - Build # 11511
- Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Linux/11511/
Java: 32bit/jdk1.8.0_20 -server -XX:+UseConcMarkSweepGC (asserts: true)
1 tests failed.
FAILED: org.apache.solr.cloud.HttpPartitionTest.testDistribSearch
Error Message:
Doc with id=2 not found in http://127.0.0.1:40166/co_/c8n_1x2_leader_session_loss due to: Path not found: /id; rsp={doc=null}
Stack Trace:
java.lang.AssertionError: Doc with id=2 not found in http://127.0.0.1:40166/co_/c8n_1x2_leader_session_loss due to: Path not found: /id; rsp={doc=null}
at __randomizedtesting.SeedInfo.seed([5D7FD04D0E046B49:DC995E55795B0B75]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:435)
at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:396)
at org.apache.solr.cloud.HttpPartitionTest.testLeaderZkSessionLoss(HttpPartitionTest.java:344)
at org.apache.solr.cloud.HttpPartitionTest.doTest(HttpPartitionTest.java:119)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11164 lines...]
[junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/init-core-data-001
[junit4] 2> 442388 T1555 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /co_/
[junit4] 2> 442391 T1555 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 442391 T1555 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 442393 T1556 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 442493 T1555 oasc.ZkTestServer.run start zk server on port:43597
[junit4] 2> 442494 T1555 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 442495 T1555 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 442496 T1563 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4bb4e0 name:ZooKeeperConnection Watcher:127.0.0.1:43597 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 442496 T1555 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 442497 T1555 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 442497 T1555 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 442499 T1555 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 442500 T1555 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 442501 T1566 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19cdb93 name:ZooKeeperConnection Watcher:127.0.0.1:43597/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 442501 T1555 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 442501 T1555 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 442502 T1555 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 442503 T1555 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 442505 T1555 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 442506 T1555 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 442507 T1555 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 442507 T1555 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 442509 T1555 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 442510 T1555 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 442511 T1555 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 442512 T1555 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 442513 T1555 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 442514 T1555 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 442515 T1555 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 442515 T1555 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 442519 T1555 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 442520 T1555 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 442522 T1555 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 442522 T1555 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 442523 T1555 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 442524 T1555 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 442533 T1555 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 442534 T1555 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 442536 T1555 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 442536 T1555 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 442538 T1555 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 442538 T1555 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 443251 T1555 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 443276 T1555 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51228
[junit4] 2> 443277 T1555 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 443278 T1555 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 443278 T1555 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-002
[junit4] 2> 443278 T1555 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-002/'
[junit4] 2> 443295 T1555 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-002/solr.xml
[junit4] 2> 443313 T1555 oasc.CoreContainer.<init> New CoreContainer 6590857
[junit4] 2> 443314 T1555 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-002/]
[junit4] 2> 443314 T1555 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 443315 T1555 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 443315 T1555 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 443315 T1555 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 443315 T1555 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 443316 T1555 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 443316 T1555 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 443316 T1555 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 443317 T1555 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 443317 T1555 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 443317 T1555 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 443318 T1555 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 443318 T1555 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 443318 T1555 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 443319 T1555 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43597/solr
[junit4] 2> 443319 T1555 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 443319 T1555 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 443321 T1555 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 443321 T1578 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a5060a name:ZooKeeperConnection Watcher:127.0.0.1:43597 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 443322 T1555 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 443322 T1555 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 443324 T1555 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 443324 T1581 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a798aa name:ZooKeeperConnection Watcher:127.0.0.1:43597/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 443325 T1555 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 443325 T1555 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 443327 T1555 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 443329 T1555 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 443330 T1555 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 443332 T1555 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 443334 T1555 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 443335 T1555 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40166_co_
[junit4] 2> 443335 T1555 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40166_co_
[junit4] 2> 443337 T1555 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 443338 T1555 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 443339 T1555 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 443340 T1555 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:40166_co_
[junit4] 2> 443340 T1555 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 443341 T1555 oasc.Overseer.start Overseer (id=92872182156099587-127.0.0.1:40166_co_-n_0000000000) starting
[junit4] 2> 443343 T1555 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 443347 T1555 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 443348 T1583 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 443348 T1555 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 443350 T1555 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 443351 T1555 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 443352 T1582 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 443367 T1585 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 443367 T1585 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 443367 T1581 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 443367 T1585 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 443369 T1582 oasc.Overseer$ClusterStateUpdater.processMessage processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40166/co_",
[junit4] 2> "node_name":"127.0.0.1:40166_co_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 443369 T1582 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 443370 T1582 oasc.Overseer$ClusterStateUpdater.createCollection state version control_collection 1
[junit4] 2> 443370 T1582 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 443371 T1581 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 444368 T1585 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 444368 T1585 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 444369 T1585 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 444369 T1585 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 444370 T1585 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 444370 T1585 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-002/collection1/'
[junit4] 2> 444370 T1585 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 444371 T1585 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 444371 T1585 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 444382 T1585 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 444383 T1585 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 444391 T1585 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 444417 T1585 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 444418 T1585 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 444422 T1585 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 444580 T1585 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 444585 T1585 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 444587 T1585 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 444603 T1585 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 444605 T1585 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 444608 T1585 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 444609 T1585 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 444609 T1585 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 444609 T1585 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 444610 T1585 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 444610 T1585 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 444610 T1585 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 444611 T1585 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 444611 T1585 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-001/control/data/
[junit4] 2> 444611 T1585 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ace5
[junit4] 2> 444612 T1585 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-001/control/data
[junit4] 2> 444612 T1585 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-001/control/data/index/
[junit4] 2> 444612 T1585 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 444613 T1585 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-001/control/data/index
[junit4] 2> 444635 T1585 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=35.0302734375, floorSegmentMB=1.994140625, forceMergeDeletesPctAllowed=13.857657937094771, segmentsPerTier=8.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5305278551027052
[junit4] 2> 444636 T1585 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@20d52c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f52872),segFN=segments_1,generation=1}
[junit4] 2> 444636 T1585 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 444639 T1585 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 444640 T1585 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 444640 T1585 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 444640 T1585 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 444640 T1585 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 444641 T1585 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 444641 T1585 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 444641 T1585 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 444642 T1585 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 444642 T1585 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 444642 T1585 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 444643 T1585 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 444643 T1585 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 444644 T1585 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 444644 T1585 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
[junit4] 2> 444644 T1585 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
[junit4] 2> 444645 T1585 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
[junit4] 2> 444645 T1585 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
[junit4] 2> 444646 T1585 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
[junit4] 2> 444646 T1585 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
[junit4] 2> 444646 T1585 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
[junit4] 2> 444647 T1585 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
[junit4] 2> 444647 T1585 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
[junit4] 2> 444648 T1585 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
[junit4] 2> 444648 T1585 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 444648 T1585 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 444649 T1585 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 444651 T1585 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 444652 T1585 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 444653 T1585 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 444653 T1585 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 444655 T1585 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 444655 T1585 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 444656 T1585 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=31, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=17.78515625, floorSegmentMB=0.861328125, forceMergeDeletesPctAllowed=5.769769471103356, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.41649554193524474
[junit4] 2> 444656 T1585 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@20d52c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f52872),segFN=segments_1,generation=1}
[junit4] 2> 444657 T1585 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 444657 T1585 oass.SolrIndexSearcher.<init> Opening Searcher@c8cd3f[collection1] main
[junit4] 2> 444657 T1585 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 444658 T1585 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 444658 T1585 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 444659 T1585 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 444659 T1585 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 444659 T1585 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 444659 T1585 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 444660 T1585 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 444660 T1585 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
[junit4] 2> 444662 T1585 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
[junit4] 2> 444662 T1585 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 444662 T1585 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 444662 T1585 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 444663 T1586 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c8cd3f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 444663 T1585 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 444664 T1589 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40166/co_ collection:control_collection shard:shard1
[junit4] 2> 444664 T1555 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 444665 T1589 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 444665 T1555 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 444668 T1555 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 444669 T1555 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 444672 T1589 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 444675 T1593 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@74c8b9 name:ZooKeeperConnection Watcher:127.0.0.1:43597/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 444676 T1589 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 444676 T1589 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 444675 T1581 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> ASYNC NEW_CORE C540 name=collection1 org.apache.solr.core.SolrCore@6d3630 url=http://127.0.0.1:40166/co_/collection1 node=127.0.0.1:40166_co_ C540_STATE=coll:control_collection core:collection1 props:{core=collection1, base_url=http://127.0.0.1:40166/co_, node_name=127.0.0.1:40166_co_, state=down}
[junit4] 2> 444676 T1589 C540 P40166 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40166/co_/collection1/
[junit4] 2> 444677 T1589 C540 P40166 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 444677 T1589 C540 P40166 oasc.SyncStrategy.syncToMe http://127.0.0.1:40166/co_/collection1/ has no replicas
[junit4] 2> 444677 T1589 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40166/co_/collection1/ shard1
[junit4] 2> 444676 T1555 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 444677 T1589 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 444678 T1555 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 444679 T1582 oasc.Overseer$ClusterStateUpdater.processMessage processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"}
[junit4] 2> 444680 T1555 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 444682 T1555 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 444683 T1582 oasc.Overseer$ClusterStateUpdater.processMessage processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:40166/co_",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"}
[junit4] 2> 444688 T1581 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 444688 T1581 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 444696 T1593 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 444734 T1589 oasc.ZkController.register We are http://127.0.0.1:40166/co_/collection1/ and leader is http://127.0.0.1:40166/co_/collection1/
[junit4] 2> 444734 T1589 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40166/co_
[junit4] 2> 444734 T1589 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 444734 T1589 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 444734 T1589 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 444735 T1581 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 444737 T1582 oasc.Overseer$ClusterStateUpdater.processMessage processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40166/co_",
[junit4] 2> "node_name":"127.0.0.1:40166_co_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 444839 T1581 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 444839 T1593 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 445009 T1555 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 445010 T1555 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 445011 T1555 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:44305
[junit4] 2> 445012 T1555 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 445012 T1555 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 445013 T1555 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-003
[junit4] 2> 445013 T1555 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-003/'
[junit4] 2> 445024 T1555 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-003/solr.xml
[junit4] 2> 445036 T1555 oasc.CoreContainer.<init> New CoreContainer 11159491
[junit4] 2> 445036 T1555 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-003/]
[junit4] 2> 445037 T1555 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 445037 T1555 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 445037 T1555 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 445037 T1555 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 445038 T1555 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 445038 T1555 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 445038 T1555 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 445039 T1555 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 445039 T1555 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 445039 T1555 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 445040 T1555 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 445040 T1555 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 445040 T1555 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 445041 T1555 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 445041 T1555 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43597/solr
[junit4] 2> 445041 T1555 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 445042 T1555 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 445042 T1555 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 445043 T1605 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@134d820 name:ZooKeeperConnection Watcher:127.0.0.1:43597 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 445044 T1555 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 445044 T1555 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 445046 T1555 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 445047 T1608 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e73ec7 name:ZooKeeperConnection Watcher:127.0.0.1:43597/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 445047 T1555 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 445050 T1555 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 446052 T1555 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42307_co_
[junit4] 2> 446053 T1555 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:42307_co_
[junit4] 2> 446055 T1555 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 446059 T1609 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 446059 T1609 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 446060 T1609 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 446060 T1581 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 446062 T1582 oasc.Overseer$ClusterStateUpdater.processMessage processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:42307/co_",
[junit4] 2> "node_name":"127.0.0.1:42307_co_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 446062 T1582 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 446062 T1582 oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 1
[junit4] 2> 446062 T1582 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 446165 T1581 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 446165 T1608 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 446165 T1593 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 447060 T1609 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 447061 T1609 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 447061 T1609 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 447061 T1609 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 447062 T1609 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 447062 T1609 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-003/collection1/'
[junit4] 2> 447062 T1609 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 447063 T1609 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 447063 T1609 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 447074 T1609 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 447076 T1609 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 447089 T1609 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 447107 T1609 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 447108 T1609 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 447112 T1609 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 447256 T1609 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 447260 T1609 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 447261 T1609 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 447268 T1609 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 447270 T1609 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 447271 T1609 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 447272 T1609 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 447272 T1609 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 447273 T1609 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 447278 T1609 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 447278 T1609 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 447279 T1609 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 447279 T1609 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 447279 T1609 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-003/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-001/jetty1/
[junit4] 2> 447279 T1609 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ace5
[junit4] 2> 447280 T1609 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-001/jetty1
[junit4] 2> 447280 T1609 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-001/jetty1/index/
[junit4] 2> 447281 T1609 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 447281 T1609 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-001/jetty1/index
[junit4] 2> 447281 T1609 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=35.0302734375, floorSegmentMB=1.994140625, forceMergeDeletesPctAllowed=13.857657937094771, segmentsPerTier=8.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5305278551027052
[junit4] 2> 447282 T1609 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@60b2ca lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@d206c4),segFN=segments_1,generation=1}
[junit4] 2> 447282 T1609 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 447286 T1609 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 447287 T1609 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 447287 T1609 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 447287 T1609 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 447288 T1609 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 447288 T1609 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 447288 T1609 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 447289 T1609 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 447289 T1609 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 447289 T1609 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 447292 T1609 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 447293 T1609 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 447293 T1609 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 447294 T1609 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 447295 T1609 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
[junit4] 2> 447295 T1609 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
[junit4] 2> 447296 T1609 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
[junit4] 2> 447297 T1609 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
[junit4] 2> 447297 T1609 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
[junit4] 2> 447298 T1609 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
[junit4] 2> 447298 T1609 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
[junit4] 2> 447299 T1609 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
[junit4] 2> 447299 T1609 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
[junit4] 2> 447300 T1609 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
[junit4] 2> 447304 T1609 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 447305 T1609 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 447305 T1609 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 447307 T1609 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 447308 T1609 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 447309 T1609 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 447310 T1609 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 447324 T1609 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 447325 T1609 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 447325 T1609 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=31, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=17.78515625, floorSegmentMB=0.861328125, forceMergeDeletesPctAllowed=5.769769471103356, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.41649554193524474
[junit4] 2> 447326 T1609 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@60b2ca lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@d206c4),segFN=segments_1,generation=1}
[junit4] 2> 447326 T1609 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 447326 T1609 oass.SolrIndexSearcher.<init> Opening Searcher@12951d[collection1] main
[junit4] 2> 447327 T1609 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 447327 T1609 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 447327 T1609 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 447328 T1609 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 447328 T1609 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 447328 T1609 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 447329 T1609 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 447329 T1609 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 447329 T1609 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 447329 T1609 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 447329 T1609 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 447330 T1610 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@12951d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 447330 T1609 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 447331 T1613 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:42307/co_ collection:collection1 shard:shard2
[junit4] 2> 447331 T1555 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 447332 T1555 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 447334 T1613 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 447337 T1613 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 447344 T1581 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 447345 T1613 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 447345 T1613 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C541 name=collection1 org.apache.solr.core.SolrCore@be09d6 url=http://127.0.0.1:42307/co_/collection1 node=127.0.0.1:42307_co_ C541_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:42307/co_, node_name=127.0.0.1:42307_co_, state=down}
[junit4] 2> 447345 T1613 C541 P42307 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:42307/co_/collection1/
[junit4] 2> 447345 T1613 C541 P42307 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 447346 T1613 C541 P42307 oasc.SyncStrategy.syncToMe http://127.0.0.1:42307/co_/collection1/ has no replicas
[junit4] 2> 447346 T1613 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:42307/co_/collection1/ shard2
[junit4] 2> 447346 T1613 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 447346 T1582 oasc.Overseer$ClusterStateUpdater.processMessage processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1"}
[junit4] 2> 447351 T1581 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 447352 T1582 oasc.Overseer$ClusterStateUpdater.processMessage processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:42307/co_",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"}
[junit4] 2> 447456 T1581 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 447456 T1593 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 447456 T1608 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 447503 T1613 oasc.ZkController.register We are http://127.0.0.1:42307/co_/collection1/ and leader is http://127.0.0.1:42307/co_/collection1/
[junit4] 2> 447503 T1613 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:42307/co_
[junit4] 2> 447503 T1613 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 447503 T1613 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 447503 T1613 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 447504 T1581 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 447506 T1582 oasc.Overseer$ClusterStateUpdater.processMessage processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:42307/co_",
[junit4] 2> "node_name":"127.0.0.1:42307_co_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 447609 T1593 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 447609 T1608 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 447609 T1581 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 447711 T1555 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 447712 T1555 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 447716 T1555 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:39704
[junit4] 2> 447717 T1555 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 447717 T1555 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 447718 T1555 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-004
[junit4] 2> 447718 T1555 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-004/'
[junit4] 2> 447753 T1555 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-004/solr.xml
[junit4] 2> 447770 T1555 oasc.CoreContainer.<init> New CoreContainer 11152253
[junit4] 2> 447771 T1555 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-004/]
[junit4] 2> 447771 T1555 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 447772 T1555 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 447772 T1555 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 447773 T1555 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 447773 T1555 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 447774 T1555 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 447774 T1555 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 447774 T1555 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 447775 T1555 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 447775 T1555 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 447776 T1555 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 447777 T1555 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 447777 T1555 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 447777 T1555 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 447778 T1555 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43597/solr
[junit4] 2> 447778 T1555 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 447779 T1555 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 447780 T1555 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 447781 T1626 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cfc1a9 name:ZooKeeperConnection Watcher:127.0.0.1:43597 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 447781 T1555 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 447782 T1555 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 447783 T1555 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 447784 T1629 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@150afb2 name:ZooKeeperConnection Watcher:127.0.0.1:43597/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 447784 T1555 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 447790 T1555 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 448793 T1555 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49732_co_
[junit4] 2> 448794 T1555 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49732_co_
[junit4] 2> 448797 T1555 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 448800 T1630 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 448800 T1630 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 448801 T1581 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 448801 T1630 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 448802 T1582 oasc.Overseer$ClusterStateUpdater.processMessage processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:49732/co_",
[junit4] 2> "node_name":"127.0.0.1:49732_co_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 448802 T1582 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 448803 T1582 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 448905 T1608 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 448905 T1629 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 448905 T1581 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 448905 T1593 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 449801 T1630 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 449801 T1630 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 449802 T1630 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 449802 T1630 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 449803 T1630 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 449803 T1630 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-004/collection1/'
[junit4] 2> 449804 T1630 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 449804 T1630 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 449804 T1630 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 449819 T1630 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 449821 T1630 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 449835 T1630 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
[junit4] 2> 449851 T1630 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 449852 T1630 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 449856 T1630 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 449958 T1630 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 449962 T1630 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 449963 T1630 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 449970 T1630 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 449972 T1630 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 449974 T1630 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 449974 T1630 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 449975 T1630 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 449975 T1630 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 449976 T1630 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 449976 T1630 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 449976 T1630 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 449976 T1630 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 449976 T1630 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-004/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-001/jetty2/
[junit4] 2> 449977 T1630 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ace5
[junit4] 2> 449977 T1630 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-001/jetty2
[junit4] 2> 449977 T1630 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-001/jetty2/index/
[junit4] 2> 449977 T1630 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 449978 T1630 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-001/jetty2/index
[junit4] 2> 449978 T1630 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=35.0302734375, floorSegmentMB=1.994140625, forceMergeDeletesPctAllowed=13.857657937094771, segmentsPerTier=8.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5305278551027052
[junit4] 2> 449979 T1630 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@529912 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@e2cbd5),segFN=segments_1,generation=1}
[junit4] 2> 449979 T1630 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 449981 T1630 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 449982 T1630 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 449982 T1630 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 449982 T1630 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 449982 T1630 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 449983 T1630 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 449983 T1630 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 449983 T1630 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 449983 T1630 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 449984 T1630 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 449984 T1630 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 449984 T1630 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 449985 T1630 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 449985 T1630 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 449986 T1630 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
[junit4] 2> 449986 T1630 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
[junit4] 2> 449986 T1630 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
[junit4] 2> 449987 T1630 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
[junit4] 2> 449987 T1630 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
[junit4] 2> 449987 T1630 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
[junit4] 2> 449988 T1630 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
[junit4] 2> 449988 T1630 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
[junit4] 2> 449993 T1630 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
[junit4] 2> 449994 T1630 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
[junit4] 2> 449994 T1630 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 449994 T1630 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 449995 T1630 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 449996 T1630 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 449997 T1630 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 449997 T1630 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 449998 T1630 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 449999 T1630 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 449999 T1630 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 450000 T1630 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=31, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=17.78515625, floorSegmentMB=0.861328125, forceMergeDeletesPctAllowed=5.769769471103356, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.41649554193524474
[junit4] 2> 450000 T1630 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@529912 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@e2cbd5),segFN=segments_1,generation=1}
[junit4] 2> 450001 T1630 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 450001 T1630 oass.SolrIndexSearcher.<init> Opening Searcher@1c2d3f0[collection1] main
[junit4] 2> 450001 T1630 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 450002 T1630 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 450002 T1630 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 450003 T1630 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 450003 T1630 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 450003 T1630 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 450004 T1630 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 450004 T1630 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 450004 T1630 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 450004 T1630 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 450004 T1630 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 450005 T1631 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c2d3f0[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 450005 T1630 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 450006 T1634 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49732/co_ collection:collection1 shard:shard1
[junit4] 2> 450006 T1555 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 450007 T1634 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 450007 T1555 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 450009 T1634 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 450010 T1581 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 450011 T1634 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 450011 T1634 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C542 name=collection1 org.apache.solr.core.SolrCore@927c22 url=http://127.0.0.1:49732/co_/collection1 node=127.0.0.1:49732_co_ C542_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:49732/co_, node_name=127.0.0.1:49732_co_, state=down}
[junit4] 2> 450011 T1634 C542 P49732 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49732/co_/collection1/
[junit4] 2> 450011 T1634 C542 P49732 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 450011 T1634 C542 P49732 oasc.SyncStrategy.syncToMe http://127.0.0.1:49732/co_/collection1/ has no replicas
[junit4] 2> 450011 T1634 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49732/co_/collection1/ shard1
[junit4] 2> 450012 T1634 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 450012 T1582 oasc.Overseer$ClusterStateUpdater.processMessage processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1"}
[junit4] 2> 450014 T1581 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 450015 T1582 oasc.Overseer$ClusterStateUpdater.processMessage processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:49732/co_",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"}
[junit4] 2> 450117 T1608 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 450117 T1581 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 450117 T1593 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 450117 T1629 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 450165 T1634 oasc.ZkController.register We are http://127.0.0.1:49732/co_/collection1/ and leader is http://127.0.0.1:49732/co_/collection1/
[junit4] 2> 450165 T1634 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49732/co_
[junit4] 2> 450165 T1634 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 450165 T1634 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 450166 T1634 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 450167 T1581 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 450168 T1582 oasc.Overseer$ClusterStateUpdater.processMessage processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:49732/co_",
[junit4] 2> "node_name":"127.0.0.1:49732_co_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 450270 T1608 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 450271 T1629 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 450270 T1593 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 450271 T1581 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 450382 T1555 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 450383 T1555 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 450395 T1555 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:43488
[junit4] 2> 450397 T1555 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2>
[...truncated too long message...]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 556717 T1555 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 556717 T1555 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-001/jetty3/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-001/jetty3/index;done=false>>]
[junit4] 2> 556718 T1555 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-001/jetty3/index
[junit4] 2> 556718 T1555 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-001/jetty3 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-001/jetty3;done=false>>]
[junit4] 2> 556718 T1555 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001/tempDir-001/jetty3
[junit4] 2> 556719 T1555 oasc.Overseer.close Overseer (id=92872182156099594-127.0.0.1:54512_co_-n_0000000003) closing
[junit4] 2> 556719 T1899 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:54512_co_
[junit4] 2> 558234 T1894 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 558257 T1555 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/co_,null}
[junit4] 2> 563246 T1555 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4] 2> 563247 T1555 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:43597 43597
[junit4] 2> 563942 T1556 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:43597 43597
[junit4] 2> 563944 T1556 oasc.ZkTestServer$ZKServerMain.runFromConfig WARN Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/aliases.json
[junit4] 2> 5 /solr/clusterstate.json
[junit4] 2> 4 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/collections/c8n_1x3/leader_elect/shard1/election/92872182156099590-core_node3-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/live_nodes
[junit4] 2> 4 /solr/overseer/queue
[junit4] 2> 4 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> 563944 T1555 oasc.SocketProxy.close WARN Closing 0 connections to: http://127.0.0.1:54512/co_
[junit4] 2> 563944 T1555 oasc.SocketProxy.close WARN Closing 0 connections to: http://127.0.0.1:49732/co_
[junit4] 2> 563944 T1555 oasc.SocketProxy.close WARN Closing 0 connections to: http://127.0.0.1:40166/co_
[junit4] 2> 563945 T1555 oasc.SocketProxy.close WARN Closing 0 connections to: http://127.0.0.1:42307/co_
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=HttpPartitionTest -Dtests.method=testDistribSearch -Dtests.seed=5D7FD04D0E046B49 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=el -Dtests.timezone=Asia/Macao -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] FAILURE 122s J0 | HttpPartitionTest.testDistribSearch <<<
[junit4] > Throwable #1: java.lang.AssertionError: Doc with id=2 not found in http://127.0.0.1:40166/co_/c8n_1x2_leader_session_loss due to: Path not found: /id; rsp={doc=null}
[junit4] > at __randomizedtesting.SeedInfo.seed([5D7FD04D0E046B49:DC995E55795B0B75]:0)
[junit4] > at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:435)
[junit4] > at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:396)
[junit4] > at org.apache.solr.cloud.HttpPartitionTest.testLeaderZkSessionLoss(HttpPartitionTest.java:344)
[junit4] > at org.apache.solr.cloud.HttpPartitionTest.doTest(HttpPartitionTest.java:119)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 564011 T1555 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-5D7FD04D0E046B49-001
[junit4] 2> 121627 T1554 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {_version_=Lucene50(blocksize=128), multiDefault=PostingsFormat(name=LuceneVarGapFixedInterval), a_t=PostingsFormat(name=LuceneVarGapFixedInterval), intDefault=Lucene50(blocksize=128), id=PostingsFormat(name=Direct), text=PostingsFormat(name=LuceneFixedGap), range_facet_l=PostingsFormat(name=LuceneVarGapFixedInterval), timestamp=PostingsFormat(name=LuceneVarGapFixedInterval)}, docValues:{timestamp=DocValuesFormat(name=Memory)}, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=el, timezone=Asia/Macao
[junit4] 2> NOTE: Linux 3.13.0-39-generic i386/Oracle Corporation 1.8.0_20 (32-bit)/cpus=8,threads=1,free=32823088,total=149676032
[junit4] 2> NOTE: All tests run in this JVM: [DistributedSpellCheckComponentTest, SignatureUpdateProcessorFactoryTest, TestFreeTextSuggestions, OverseerStatusTest, OverseerCollectionProcessorTest, TestRemoteStreaming, TestPartialUpdateDeduplication, TestCloudPivotFacet, FieldMutatingUpdateProcessorTest, StandardRequestHandlerTest, TestFieldTypeResource, ExternalFileFieldSortTest, TestSystemIdResolver, TestFastLRUCache, ShowFileRequestHandlerTest, TestSolrJ, TestCloudInspectUtil, TestRTGBase, TestFieldTypeCollectionResource, TestDefaultSimilarityFactory, TestReRankQParserPlugin, TestSolrConfigHandler, TestSimpleQParserPlugin, BadIndexSchemaTest, TestComponentsName, TestInitQParser, FileUtilsTest, CoreAdminHandlerTest, IndexSchemaTest, MinimalSchemaTest, JSONWriterTest, XsltUpdateRequestHandlerTest, HdfsWriteToMultipleCollectionsTest, DistributedFacetPivotWhiteBoxTest, ZkControllerTest, TestRawResponseWriter, StatelessScriptUpdateProcessorFactoryTest, ZkCLITest, TestTrie, TestRangeQuery, SolrCoreCheckLockOnStartupTest, DocumentBuilderTest, OverseerTest, HttpPartitionTest]
[junit4] Completed on J0 in 121.91s, 1 test, 1 failure <<< FAILURES!
[...truncated 1132 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:525: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:473: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:61: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/extra-targets.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/common-build.xml:508: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:1363: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:970: There were test failures: 450 suites, 1841 tests, 1 failure, 31 ignored (22 assumptions)
Total time: 98 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_20 -server -XX:+UseConcMarkSweepGC (asserts: true)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any