You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/07/11 13:31:47 UTC
[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.6.0_45) - Build # 6437
- Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/6437/
Java: 64bit/jdk1.6.0_45 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
1 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:39240, http://127.0.0.1:56131, http://127.0.0.1:39844, http://127.0.0.1:37304, http://127.0.0.1:35561]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:39240, http://127.0.0.1:56131, http://127.0.0.1:39844, http://127.0.0.1:37304, http://127.0.0.1:35561]
at __randomizedtesting.SeedInfo.seed([B3A3324C57B0D151:3245BC5420EFB16D]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:333)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:318)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1522)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:438)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:146)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:662)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:39844
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:431)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:264)
... 45 more
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:166)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:90)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:281)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:92)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:62)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:254)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:289)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:252)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:191)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:300)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:127)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:717)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:522)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
... 47 more
Build Log:
[...truncated 9143 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> 632021 T1774 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 632026 T1774 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-CollectionsAPIDistributedZkTest-1373541549082
[junit4] 2> 632027 T1774 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 632027 T1775 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 632127 T1774 oasc.ZkTestServer.run start zk server on port:41126
[junit4] 2> 632128 T1774 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 632234 T1781 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2bfa9322 name:ZooKeeperConnection Watcher:127.0.0.1:41126 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 632234 T1774 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 632235 T1774 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 632241 T1774 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 632242 T1783 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@793cf8e8 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 632243 T1774 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 632243 T1774 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 632247 T1774 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 632251 T1774 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 632254 T1774 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 632258 T1774 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 632258 T1774 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 632265 T1774 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 632265 T1774 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 632270 T1774 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 632270 T1774 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 632274 T1774 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 632274 T1774 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 632278 T1774 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 632278 T1774 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 632282 T1774 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 632282 T1774 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 632286 T1774 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 632286 T1774 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 632290 T1774 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 632291 T1774 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 632294 T1774 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 632295 T1774 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 632383 T1774 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 632400 T1774 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:37304
[junit4] 2> 632401 T1774 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 632401 T1774 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 632402 T1774 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354
[junit4] 2> 632402 T1774 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/'
[junit4] 2> 632415 T1774 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/solr.xml
[junit4] 2> 632466 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354
[junit4] 2> 632468 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/collection1
[junit4] 2> 632468 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/collection1/conf
[junit4] 2> 632475 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/collection1/conf/xslt
[junit4] 2> 632498 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/collection1/lib
[junit4] 2> 632499 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/collection1/lib/classes
[junit4] 2> 632501 T1774 oasc.SolrCoreDiscoverer.addCore Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/conf/core.properties, adding to cores
[junit4] 2> 632502 T1774 oasc.CoreContainer.<init> New CoreContainer 549098857
[junit4] 2> 632502 T1774 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/]
[junit4] 2> 632505 T1774 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 632505 T1774 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 632505 T1774 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 632506 T1774 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 632506 T1774 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 632507 T1774 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 632507 T1774 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 632508 T1774 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 632508 T1774 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 632509 T1774 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4] 2> 632513 T1774 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 632513 T1774 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41126/solr
[junit4] 2> 632514 T1774 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 632515 T1774 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 632517 T1794 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@39a73148 name:ZooKeeperConnection Watcher:127.0.0.1:41126 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 632517 T1774 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 632520 T1774 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 632523 T1774 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 632525 T1796 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2ff66404 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 632525 T1774 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 632528 T1774 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 632533 T1774 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 632538 T1774 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 632540 T1774 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37304_
[junit4] 2> 632541 T1774 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37304_
[junit4] 2> 632547 T1774 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 632553 T1774 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 632557 T1774 oasc.Overseer.start Overseer (id=90016418960834563-127.0.0.1:37304_-n_0000000000) starting
[junit4] 2> 632561 T1774 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 632566 T1798 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 632567 T1774 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 632570 T1774 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 632572 T1774 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 632579 T1797 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 632584 T1774 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 632585 T1774 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 632586 T1774 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 632593 T1774 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4] 2> 632594 T1774 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 632596 T1801 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33102dba name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 632596 T1774 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 632598 T1774 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 632601 T1774 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4] 2> 632689 T1774 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 632692 T1774 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56131
[junit4] 2> 632693 T1774 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 632694 T1774 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 632694 T1774 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657
[junit4] 2> 632695 T1774 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/'
[junit4] 2> 632719 T1774 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/solr.xml
[junit4] 2> 632766 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657
[junit4] 2> 632767 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/collection1
[junit4] 2> 632767 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/collection1/conf
[junit4] 2> 632773 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/collection1/conf/xslt
[junit4] 2> 632790 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/collection1/lib
[junit4] 2> 632791 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/collection1/lib/classes
[junit4] 2> 632792 T1774 oasc.SolrCoreDiscoverer.addCore Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/conf/core.properties, adding to cores
[junit4] 2> 632793 T1774 oasc.CoreContainer.<init> New CoreContainer 1323710332
[junit4] 2> 632793 T1774 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/]
[junit4] 2> 632795 T1774 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 632795 T1774 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 632795 T1774 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 632796 T1774 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 632796 T1774 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 632796 T1774 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 632797 T1774 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 632797 T1774 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 632797 T1774 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 632798 T1774 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4] 2> 632801 T1774 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 632801 T1774 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41126/solr
[junit4] 2> 632802 T1774 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 632802 T1774 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 632804 T1812 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6c44d65b name:ZooKeeperConnection Watcher:127.0.0.1:41126 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 632804 T1774 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 632807 T1774 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 632810 T1774 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 632811 T1814 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17691476 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 632811 T1774 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 632817 T1774 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 633822 T1774 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56131_
[junit4] 2> 633824 T1774 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56131_
[junit4] 2> 633830 T1801 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 633831 T1796 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 633831 T1814 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 633839 T1774 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 633839 T1774 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 633840 T1774 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 633915 T1774 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 633918 T1774 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:39844
[junit4] 2> 633919 T1774 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 633919 T1774 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 633919 T1774 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897
[junit4] 2> 633920 T1774 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/'
[junit4] 2> 633932 T1774 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/solr.xml
[junit4] 2> 633971 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897
[junit4] 2> 633972 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/collection1
[junit4] 2> 633973 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/collection1/conf
[junit4] 2> 633977 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/collection1/conf/xslt
[junit4] 2> 633994 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/collection1/lib
[junit4] 2> 633995 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/collection1/lib/classes
[junit4] 2> 633996 T1774 oasc.SolrCoreDiscoverer.addCore Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/conf/core.properties, adding to cores
[junit4] 2> 633997 T1774 oasc.CoreContainer.<init> New CoreContainer 1458021669
[junit4] 2> 633997 T1774 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/]
[junit4] 2> 633999 T1774 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 633999 T1774 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 634000 T1774 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 634000 T1774 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 634000 T1774 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 634001 T1774 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 634001 T1774 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 634001 T1774 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 634002 T1774 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 634002 T1774 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4] 2> 634005 T1774 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 634006 T1774 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41126/solr
[junit4] 2> 634006 T1774 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 634007 T1774 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 634008 T1826 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@20b4cb6 name:ZooKeeperConnection Watcher:127.0.0.1:41126 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 634009 T1774 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 634011 T1774 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 634015 T1774 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 634016 T1828 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68f2efe4 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 634016 T1774 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 634022 T1774 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 635027 T1774 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39844_
[junit4] 2> 635028 T1774 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39844_
[junit4] 2> 635046 T1814 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 635047 T1828 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 635048 T1796 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 635048 T1801 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 635056 T1774 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 635057 T1774 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 635058 T1774 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 635127 T1774 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 635129 T1774 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35561
[junit4] 2> 635130 T1774 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 635130 T1774 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 635131 T1774 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116
[junit4] 2> 635131 T1774 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/'
[junit4] 2> 635143 T1774 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/solr.xml
[junit4] 2> 635184 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116
[junit4] 2> 635185 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/collection1
[junit4] 2> 635185 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/collection1/conf
[junit4] 2> 635190 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/collection1/conf/xslt
[junit4] 2> 635214 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/collection1/lib
[junit4] 2> 635215 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/collection1/lib/classes
[junit4] 2> 635216 T1774 oasc.SolrCoreDiscoverer.addCore Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/conf/core.properties, adding to cores
[junit4] 2> 635217 T1774 oasc.CoreContainer.<init> New CoreContainer 221156872
[junit4] 2> 635217 T1774 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/]
[junit4] 2> 635219 T1774 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 635219 T1774 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 635219 T1774 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 635220 T1774 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 635220 T1774 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 635220 T1774 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 635221 T1774 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 635221 T1774 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 635221 T1774 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 635222 T1774 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4] 2> 635225 T1774 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 635225 T1774 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41126/solr
[junit4] 2> 635226 T1774 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 635227 T1774 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 635229 T1840 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d7bedfa name:ZooKeeperConnection Watcher:127.0.0.1:41126 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 635229 T1774 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 635232 T1774 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 635236 T1774 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 635237 T1842 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d3df0c7 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 635238 T1774 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 635243 T1774 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 636249 T1774 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35561_
[junit4] 2> 636250 T1774 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35561_
[junit4] 2> 636257 T1828 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 636258 T1814 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 636258 T1842 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 636259 T1796 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 636259 T1801 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 636265 T1774 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 636266 T1774 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 636266 T1774 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 636342 T1774 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 636344 T1774 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:39240
[junit4] 2> 636345 T1774 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 636346 T1774 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 636346 T1774 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373541553324
[junit4] 2> 636346 T1774 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373541553324/'
[junit4] 2> 636360 T1774 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373541553324/solr.xml
[junit4] 2> 636412 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373541553324
[junit4] 2> 636413 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373541553324/collection1
[junit4] 2> 636414 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373541553324/collection1/conf
[junit4] 2> 636419 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373541553324/collection1/conf/xslt
[junit4] 2> 636437 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373541553324/collection1/lib
[junit4] 2> 636438 T1774 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373541553324/collection1/lib/classes
[junit4] 2> 636440 T1774 oasc.SolrCoreDiscoverer.addCore Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373541553324/conf/core.properties, adding to cores
[junit4] 2> 636440 T1774 oasc.CoreContainer.<init> New CoreContainer 436495535
[junit4] 2> 636441 T1774 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373541553324/]
[junit4] 2> 636443 T1774 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 636443 T1774 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 636443 T1774 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 636444 T1774 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 636444 T1774 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 636445 T1774 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 636445 T1774 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 636446 T1774 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 636446 T1774 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 636446 T1774 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4] 2> 636451 T1774 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 636451 T1774 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41126/solr
[junit4] 2> 636452 T1774 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 636453 T1774 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 636455 T1854 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@166e2a81 name:ZooKeeperConnection Watcher:127.0.0.1:41126 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 636456 T1774 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 636459 T1774 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 636463 T1774 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 636465 T1856 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ed065b1 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 636465 T1774 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 636471 T1774 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 637477 T1774 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39240_
[junit4] 2> 637479 T1774 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39240_
[junit4] 2> 637486 T1796 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 637487 T1814 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 637487 T1842 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 637488 T1856 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 637489 T1801 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 637489 T1828 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 637497 T1774 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 637497 T1774 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 637498 T1774 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 637501 T1774 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 637506 T1809 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2
[junit4] 2> 637509 T1796 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 637510 T1796 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 637511 T1798 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":null,
[junit4] 2> "createNodeSet":null,
[junit4] 2> "name":"nodes_used_collection",
[junit4] 2> "replicationFactor":"2"}
[junit4] 2> 637512 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica1 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:35561_
[junit4] 2> 637512 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica2 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:56131_
[junit4] 2> 637513 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica1 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:37304_
[junit4] 2> 637513 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica2 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:39844_
[junit4] 2> 637515 T1837 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=down
[junit4] 2> 637515 T1821 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=down
[junit4] 2> 637515 T1808 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=down
[junit4] 2> 637515 T1789 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=down
[junit4] 2> 637518 T1837 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 637519 T1808 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 637519 T1789 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 637519 T1821 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 638594 T1797 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 638596 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for nodes_used_collection, skipping publish state
[junit4] 2> 638596 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:35561_",
[junit4] 2> "base_url":"http://127.0.0.1:35561"}
[junit4] 2> 638597 T1797 oasc.Overseer$ClusterStateUpdater.createCollection Create collection nodes_used_collection with numShards 2
[junit4] 2> 638602 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for nodes_used_collection, skipping publish state
[junit4] 2> 638603 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 638608 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for nodes_used_collection, skipping publish state
[junit4] 2> 638608 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:56131_",
[junit4] 2> "base_url":"http://127.0.0.1:56131"}
[junit4] 2> 638614 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for nodes_used_collection, skipping publish state
[junit4] 2> 638614 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard2_replica1",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:37304_",
[junit4] 2> "base_url":"http://127.0.0.1:37304"}
[junit4] 2> 638619 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 638619 T1842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 638619 T1796 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 638619 T1801 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 638620 T1856 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 638620 T1814 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 639519 T1837 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for nodes_used_collection_shard1_replica1
[junit4] 2> 639520 T1837 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/nodes_used_collection_shard1_replica1
[junit4] 2> 639520 T1837 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4] 2> 639520 T1808 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for nodes_used_collection_shard1_replica2
[junit4] 2> 639520 T1821 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for nodes_used_collection_shard2_replica2
[junit4] 2> 639520 T1789 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for nodes_used_collection_shard2_replica1
[junit4] 2> 639521 T1789 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/nodes_used_collection_shard2_replica1
[junit4] 2> 639522 T1789 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4] 2> 639521 T1837 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4] 2> 639521 T1821 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/nodes_used_collection_shard2_replica2
[junit4] 2> 639523 T1821 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4] 2> 639521 T1808 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/nodes_used_collection_shard1_replica2
[junit4] 2> 639524 T1808 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4] 2> 639523 T1789 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4] 2> 639524 T1789 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 639525 T1808 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4] 2> 639525 T1808 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 639523 T1837 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 639524 T1821 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4] 2> 639526 T1821 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 639529 T1837 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 639530 T1837 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4] 2> 639530 T1821 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 639530 T1789 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 639530 T1808 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 639530 T1821 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4] 2> 639531 T1808 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4] 2> 639531 T1789 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4] 2> 639537 T1789 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4] 2> 639537 T1808 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4] 2> 639538 T1837 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4] 2> 639540 T1821 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4] 2> 639540 T1789 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/nodes_used_collection_shard2_replica1/'
[junit4] 2> 639540 T1808 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/nodes_used_collection_shard1_replica2/'
[junit4] 2> 639542 T1837 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/nodes_used_collection_shard1_replica1/'
[junit4] 2> 639543 T1821 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/nodes_used_collection_shard2_replica2/'
[junit4] 2> 639615 T1837 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 639619 T1789 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 639640 T1808 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 639654 T1821 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 639687 T1837 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 639690 T1837 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 639704 T1837 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica1] Schema name=test
[junit4] 2> 639708 T1789 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 639710 T1789 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 639726 T1789 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica1] Schema name=test
[junit4] 2> 639726 T1808 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 639737 T1808 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 639745 T1808 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica2] Schema name=test
[junit4] 2> 639746 T1821 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 639758 T1821 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 639781 T1821 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica2] Schema name=test
[junit4] 2> 640686 T1837 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 640698 T1837 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 640699 T1837 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 640708 T1837 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 640711 T1837 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 640723 T1789 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 640724 T1789 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 640725 T1789 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 640725 T1808 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 640726 T1808 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 640727 T1808 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 640734 T1808 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 640738 T1808 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 640741 T1789 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 640755 T1789 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 640762 T1837 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 640769 T1837 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 640778 T1837 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 640782 T1837 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 640783 T1837 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 640783 T1837 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 640787 T1837 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 640788 T1837 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 640788 T1837 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 640789 T1837 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/nodes_used_collection_shard1_replica1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/nodes_used_collection_shard1_replica1/data/
[junit4] 2> 640789 T1837 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2820224a
[junit4] 2> 640790 T1837 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/nodes_used_collection_shard1_replica1/data
[junit4] 2> 640791 T1837 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/nodes_used_collection_shard1_replica1/data/index/
[junit4] 2> 640805 T1837 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/nodes_used_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 640806 T1837 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/nodes_used_collection_shard1_replica1/data/index
[junit4] 2> 640809 T1837 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@64a766b8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@47fae43),segFN=segments_1,generation=1}
[junit4] 2> 640809 T1837 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 640814 T1837 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 640815 T1837 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 640816 T1837 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 640817 T1837 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 640818 T1837 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 640818 T1837 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 640819 T1808 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 640821 T1789 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 640819 T1837 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 640823 T1837 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 640823 T1837 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 640826 T1837 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 640828 T1837 oass.SolrIndexSearcher.<init> Opening Searcher@4e18e6f4 main
[junit4] 2> 640828 T1808 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 640828 T1789 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 640829 T1837 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 640829 T1837 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 640835 T1863 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica1] Registered new searcher Searcher@4e18e6f4 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 640848 T1789 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 640848 T1808 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 640849 T1837 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica1
[junit4] 2> 640849 T1837 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica1 address:http://127.0.0.1:35561 collection:nodes_used_collection shard:shard1
[junit4] 2> 640850 T1837 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 640851 T1821 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 640852 T1821 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 640851 T1789 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 640852 T1808 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 640852 T1789 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 640853 T1821 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 640853 T1808 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 640853 T1789 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 640855 T1837 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard1/election
[junit4] 2> 640854 T1808 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 640858 T1789 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 640858 T1789 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 640859 T1808 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 640859 T1789 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 640859 T1808 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 640860 T1789 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/nodes_used_collection_shard2_replica1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/nodes_used_collection_shard2_replica1/data/
[junit4] 2> 640860 T1808 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 640860 T1789 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2820224a
[junit4] 2> 640862 T1808 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/nodes_used_collection_shard1_replica2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/nodes_used_collection_shard1_replica2/data/
[junit4] 2> 640862 T1789 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/nodes_used_collection_shard2_replica1/data
[junit4] 2> 640862 T1808 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2820224a
[junit4] 2> 640863 T1789 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/nodes_used_collection_shard2_replica1/data/index/
[junit4] 2> 640863 T1789 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/nodes_used_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 640864 T1821 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 640864 T1789 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/nodes_used_collection_shard2_replica1/data/index
[junit4] 2> 640864 T1808 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/nodes_used_collection_shard1_replica2/data
[junit4] 2> 640865 T1808 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/nodes_used_collection_shard1_replica2/data/index/
[junit4] 2> 640866 T1808 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/nodes_used_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 640866 T1808 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/nodes_used_collection_shard1_replica2/data/index
[junit4] 2> 640867 T1789 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c0eeb1a lockFactory=org.apache.lucene.store.NativeFSLockFactory@7a91567),segFN=segments_1,generation=1}
[junit4] 2> 640867 T1789 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 640867 T1837 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 640868 T1821 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 640869 T1808 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5a2270da lockFactory=org.apache.lucene.store.NativeFSLockFactory@3af54c62),segFN=segments_1,generation=1}
[junit4] 2> 640869 T1808 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 640872 T1837 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=179999
[junit4] 2> 640872 T1789 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 640873 T1789 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 640874 T1789 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 640874 T1789 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 640875 T1808 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 640875 T1789 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 640875 T1789 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 640875 T1808 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 640876 T1789 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 640877 T1808 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 640877 T1789 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 640878 T1808 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 640878 T1789 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 640878 T1808 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 640879 T1808 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 640879 T1808 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 640880 T1789 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 640880 T1808 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 640881 T1808 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 640882 T1789 oass.SolrIndexSearcher.<init> Opening Searcher@7a7f72e0 main
[junit4] 2> 640883 T1808 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 640883 T1789 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 640883 T1789 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 640886 T1808 oass.SolrIndexSearcher.<init> Opening Searcher@2685334e main
[junit4] 2> 640887 T1808 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 640887 T1808 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 640887 T1864 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica1] Registered new searcher Searcher@7a7f72e0 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 640889 T1789 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica1
[junit4] 2> 640890 T1789 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica1 address:http://127.0.0.1:37304 collection:nodes_used_collection shard:shard2
[junit4] 2> 640890 T1789 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 640903 T1865 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica2] Registered new searcher Searcher@2685334e main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 640904 T1789 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard2/election
[junit4] 2> 640906 T1808 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica2
[junit4] 2> 640907 T1808 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica2 address:http://127.0.0.1:56131 collection:nodes_used_collection shard:shard1
[junit4] 2> 640907 T1808 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 640920 T1821 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 640923 T1789 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 640927 T1789 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=179999
[junit4] 2> 640928 T1821 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 640933 T1821 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 640936 T1821 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 640936 T1821 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 640937 T1821 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 640938 T1821 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 640939 T1821 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 640939 T1821 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 640940 T1821 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/nodes_used_collection_shard2_replica2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/nodes_used_collection_shard2_replica2/data/
[junit4] 2> 640940 T1821 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2820224a
[junit4] 2> 640942 T1821 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/nodes_used_collection_shard2_replica2/data
[junit4] 2> 640942 T1821 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/nodes_used_collection_shard2_replica2/data/index/
[junit4] 2> 640943 T1821 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/nodes_used_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 640943 T1821 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/nodes_used_collection_shard2_replica2/data/index
[junit4] 2> 640946 T1821 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@37d4c436 lockFactory=org.apache.lucene.store.NativeFSLockFactory@73f84a83),segFN=segments_1,generation=1}
[junit4] 2> 640947 T1821 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 640952 T1821 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 640953 T1821 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 640954 T1821 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 640955 T1821 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 640956 T1821 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 640956 T1821 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 640957 T1821 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 640958 T1821 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 640959 T1821 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 640962 T1821 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 640966 T1821 oass.SolrIndexSearcher.<init> Opening Searcher@6088c4d9 main
[junit4] 2> 640968 T1821 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 640968 T1821 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 640973 T1866 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica2] Registered new searcher Searcher@6088c4d9 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 640976 T1821 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica2
[junit4] 2> 640977 T1821 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica2 address:http://127.0.0.1:39844 collection:nodes_used_collection shard:shard2
[junit4] 2> 640977 T1821 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 641373 T1837 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 641374 T1837 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 641374 T1837 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:35561/nodes_used_collection_shard1_replica1/
[junit4] 2> 641374 T1837 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica1 url=http://127.0.0.1:35561 START replicas=[http://127.0.0.1:56131/nodes_used_collection_shard1_replica2/] nUpdates=100
[junit4] 2> 641375 T1837 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica1 url=http://127.0.0.1:35561 DONE. We have no versions. sync failed.
[junit4] 2> 641375 T1837 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 641376 T1837 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 641376 T1837 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:35561/nodes_used_collection_shard1_replica1/ shard1
[junit4] 2> 641377 T1837 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard1
[junit4] 2> ASYNC NEW_CORE C12576 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@15334d42 url=http://127.0.0.1:56131/nodes_used_collection_shard1_replica2 node=127.0.0.1:56131_ C12576_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{state=down, core=nodes_used_collection_shard1_replica2, node_name=127.0.0.1:56131_, base_url=http://127.0.0.1:56131}
[junit4] 2> 641382 T1807 C12576 P56131 oasc.SolrCore.execute [nodes_used_collection_shard1_replica2] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=2
[junit4] 2> 641428 T1789 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 641429 T1789 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 641429 T1789 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:37304/nodes_used_collection_shard2_replica1/
[junit4] 2> 641429 T1789 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica1 url=http://127.0.0.1:37304 START replicas=[http://127.0.0.1:39844/nodes_used_collection_shard2_replica2/] nUpdates=100
[junit4] 2> 641430 T1789 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica1 url=http://127.0.0.1:37304 DONE. We have no versions. sync failed.
[junit4] 2> 641430 T1789 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 641431 T1789 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 641431 T1789 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:37304/nodes_used_collection_shard2_replica1/ shard2
[junit4] 2> 641432 T1789 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard2
[junit4] 2> ASYNC NEW_CORE C12577 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@1953bcfd url=http://127.0.0.1:39844/nodes_used_collection_shard2_replica2 node=127.0.0.1:39844_ C12577_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{state=down, core=nodes_used_collection_shard2_replica2, node_name=127.0.0.1:39844_, base_url=http://127.0.0.1:39844}
[junit4] 2> 641438 T1823 C12577 P39844 oasc.SolrCore.execute [nodes_used_collection_shard2_replica2] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4] 2> 641642 T1797 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 641675 T1796 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 641675 T1856 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 641675 T1801 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 641676 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 641676 T1842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 641676 T1814 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 641690 T1837 oasc.ZkController.register We are http://127.0.0.1:35561/nodes_used_collection_shard1_replica1/ and leader is http://127.0.0.1:35561/nodes_used_collection_shard1_replica1/
[junit4] 2> 641691 T1837 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica1 baseURL=http://127.0.0.1:35561
[junit4] 2> 641691 T1837 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 641691 T1837 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=active
[junit4] 2> 641697 T1837 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 641699 T1837 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=4184
[junit4] 2> 641746 T1789 oasc.ZkController.register We are http://127.0.0.1:37304/nodes_used_collection_shard2_replica1/ and leader is http://127.0.0.1:37304/nodes_used_collection_shard2_replica1/
[junit4] 2> 641747 T1789 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica1 baseURL=http://127.0.0.1:37304
[junit4] 2> 641747 T1789 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 641747 T1789 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=active
[junit4] 2> 641750 T1789 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 641751 T1789 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=4236
[junit4] 2> 641924 T1808 oasc.ZkController.register We are http://127.0.0.1:56131/nodes_used_collection_shard1_replica2/ and leader is http://127.0.0.1:35561/nodes_used_collection_shard1_replica1/
[junit4] 2> 641925 T1808 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica2 baseURL=http://127.0.0.1:56131
[junit4] 2> 641925 T1808 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard1_replica2
[junit4] 2> 641925 T1808 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> ASYNC NEW_CORE C12578 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@15334d42 url=http://127.0.0.1:56131/nodes_used_collection_shard1_replica2 node=127.0.0.1:56131_ C12578_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{state=down, core=nodes_used_collection_shard1_replica2, node_name=127.0.0.1:56131_, base_url=http://127.0.0.1:56131}
[junit4] 2> 641926 T1869 C12578 P56131 oasc.RecoveryStrategy.run Starting recovery process. core=nodes_used_collection_shard1_replica2 recoveringAfterStartup=true
[junit4] 2> 641927 T1869 C12578 P56131 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 641927 T1869 C12578 P56131 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=recovering
[junit4] 2> 641927 T1808 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 641928 T1869 C12578 P56131 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 641929 T1808 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=4414
[junit4] 2> 641932 T1836 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 641987 T1821 oasc.ZkController.register We are http://127.0.0.1:39844/nodes_used_collection_shard2_replica2/ and leader is http://127.0.0.1:37304/nodes_used_collection_shard2_replica1/
[junit4] 2> 641987 T1821 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica2 baseURL=http://127.0.0.1:39844
[junit4] 2> 641988 T1821 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard2_replica2
[junit4] 2> 641988 T1821 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> ASYNC NEW_CORE C12579 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@1953bcfd url=http://127.0.0.1:39844/nodes_used_collection_shard2_replica2 node=127.0.0.1:39844_ C12579_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{state=down, core=nodes_used_collection_shard2_replica2, node_name=127.0.0.1:39844_, base_url=http://127.0.0.1:39844}
[junit4] 2> 641988 T1870 C12579 P39844 oasc.RecoveryStrategy.run Starting recovery process. core=nodes_used_collection_shard2_replica2 recoveringAfterStartup=true
[junit4] 2> 641989 T1870 C12579 P39844 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 641989 T1870 C12579 P39844 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=recovering
[junit4] 2> 641989 T1821 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 641990 T1870 C12579 P39844 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 641991 T1821 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=4476
[junit4] 2> 641991 T1798 oasc.OverseerCollectionProcessor.createCollection Finished create command on all shards for collection: nodes_used_collection
[junit4] 2> 641994 T1792 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 641994 T1814 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work/qnr-0000000000 state: SyncConnected type NodeDataChanged
[junit4] 2> 641997 T1798 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000000 complete, response:{success={null={responseHeader={status=0,QTime=4184},core=nodes_used_collection_shard1_replica1},null={responseHeader={status=0,QTime=4236},core=nodes_used_collection_shard2_replica1},null={responseHeader={status=0,QTime=4414},core=nodes_used_collection_shard1_replica2},null={responseHeader={status=0,QTime=4476},core=nodes_used_collection_shard2_replica2}}}
[junit4] 2> 641998 T1809 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2} status=0 QTime=4492
[junit4] 2> 641999 T1774 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4] 2> 642000 T1774 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 642001 T1872 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c657254 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 642001 T1774 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 642005 T1774 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 642009 T1774 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4] 2> 642010 T1774 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 642011 T1874 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5eecb8c1 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 642012 T1774 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 642013 T1774 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 642019 T1850 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=5&maxShardsPerNode=6&name=awholynewcollection_0&replicationFactor=5&action=CREATE&wt=javabin&version=2
[junit4] 2> 642021 T1796 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 642022 T1796 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 642023 T1798 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000002 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "numShards":"5",
[junit4] 2> "maxShardsPerNode":"6",
[junit4] 2> "createNodeSet":null,
[junit4] 2> "name":"awholynewcollection_0",
[junit4] 2> "replicationFactor":"5"}
[junit4] 2> 642023 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica1 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:39240_
[junit4] 2> 642024 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica2 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:35561_
[junit4] 2> 642024 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica3 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:39844_
[junit4] 2> 642024 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica4 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:56131_
[junit4] 2> 642024 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica5 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:37304_
[junit4] 2> 642024 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica1 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:39240_
[junit4] 2> 642024 T1851 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica1 state=down
[junit4] 2> 642025 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica2 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:35561_
[junit4] 2> 642026 T1824 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica3 state=down
[junit4] 2> 642026 T1807 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica4 state=down
[junit4] 2> 642026 T1838 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica2 state=down
[junit4] 2> 642027 T1851 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642026 T1791 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica5 state=down
[junit4] 2> 642026 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica3 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:39844_
[junit4] 2> 642026 T1852 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica1 state=down
[junit4] 2> 642028 T1838 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642028 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica4 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:56131_
[junit4] 2> 642029 T1791 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642028 T1807 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642027 T1834 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica2 state=down
[junit4] 2> 642027 T1824 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642030 T1852 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642030 T1808 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica4 state=down
[junit4] 2> 642029 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica5 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:37304_
[junit4] 2> 642029 T1822 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica3 state=down
[junit4] 2> 642031 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica1 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:39240_
[junit4] 2> 642031 T1834 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642032 T1808 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642032 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica2 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:35561_
[junit4] 2> 642033 T1822 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642033 T1849 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica1 state=down
[junit4] 2> 642033 T1789 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica5 state=down
[junit4] 2> 642034 T1837 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica2 state=down
[junit4] 2> 642033 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica3 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:39844_
[junit4] 2> 642035 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica4 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:56131_
[junit4] 2> 642035 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica5 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:37304_
[junit4] 2> 642035 T1849 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642036 T1823 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica3 state=down
[junit4] 2> 642036 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica1 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:39240_
[junit4] 2> 642036 T1789 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642036 T1810 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica4 state=down
[junit4] 2> 642037 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica2 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:35561_
[junit4] 2> 642037 T1837 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642038 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica3 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:39844_
[junit4] 2> 642036 T1790 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica5 state=down
[junit4] 2> 642038 T1810 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642038 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica4 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:56131_
[junit4] 2> 642038 T1823 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642039 T1821 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica3 state=down
[junit4] 2> 642037 T1887 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica1 state=down
[junit4] 2> 642040 T1809 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica4 state=down
[junit4] 2> 642039 T1790 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642039 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica5 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:37304_
[junit4] 2> 642041 T1821 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642039 T1890 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica2 state=down
[junit4] 2> 642041 T1887 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642041 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard5_replica1 as part of slice shard5 of collection awholynewcollection_0 on 127.0.0.1:39240_
[junit4] 2> 642042 T1893 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica5 state=down
[junit4] 2> 642041 T1809 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642042 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard5_replica2 as part of slice shard5 of collection awholynewcollection_0 on 127.0.0.1:35561_
[junit4] 2> 642042 T1890 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642043 T1895 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica1 state=down
[junit4] 2> 642043 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard5_replica3 as part of slice shard5 of collection awholynewcollection_0 on 127.0.0.1:39844_
[junit4] 2> 642044 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard5_replica4 as part of slice shard5 of collection awholynewcollection_0 on 127.0.0.1:56131_
[junit4] 2> 642044 T1893 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642044 T1798 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard5_replica5 as part of slice shard5 of collection awholynewcollection_0 on 127.0.0.1:37304_
[junit4] 2> 642044 T1897 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica2 state=down
[junit4] 2> 642045 T1895 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642045 T1900 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica3 state=down
[junit4] 2> 642045 T1901 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica4 state=down
[junit4] 2> 642046 T1903 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica5 state=down
[junit4] 2> 642046 T1897 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642048 T1901 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642048 T1900 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 642048 T1903 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 643207 T1797 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 643209 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:35561_",
[junit4] 2> "base_url":"http://127.0.0.1:35561"}
[junit4] 2> 643216 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard2_replica1",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:37304_",
[junit4] 2> "base_url":"http://127.0.0.1:37304"}
[junit4] 2> 643223 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:56131_",
[junit4] 2> "base_url":"http://127.0.0.1:56131"}
[junit4] 2> 643230 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 643238 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643238 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39240_",
[junit4] 2> "base_url":"http://127.0.0.1:39240"}
[junit4] 2> 643238 T1797 oasc.Overseer$ClusterStateUpdater.createCollection Create collection awholynewcollection_0 with numShards 5
[junit4] 2> 643245 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643245 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 643254 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643255 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:56131_",
[junit4] 2> "base_url":"http://127.0.0.1:56131"}
[junit4] 2> 643262 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643262 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:35561_",
[junit4] 2> "base_url":"http://127.0.0.1:35561"}
[junit4] 2> 643269 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643269 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node5",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:37304_",
[junit4] 2> "base_url":"http://127.0.0.1:37304"}
[junit4] 2> 643276 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643276 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node6",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39240_",
[junit4] 2> "base_url":"http://127.0.0.1:39240"}
[junit4] 2> 643283 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643284 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node7",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:35561_",
[junit4] 2> "base_url":"http://127.0.0.1:35561"}
[junit4] 2> 643291 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643291 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node8",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:56131_",
[junit4] 2> "base_url":"http://127.0.0.1:56131"}
[junit4] 2> 643327 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643328 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node9",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 643335 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643335 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node10",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39240_",
[junit4] 2> "base_url":"http://127.0.0.1:39240"}
[junit4] 2> 643341 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643342 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node11",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:37304_",
[junit4] 2> "base_url":"http://127.0.0.1:37304"}
[junit4] 2> 643347 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643348 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node12",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:35561_",
[junit4] 2> "base_url":"http://127.0.0.1:35561"}
[junit4] 2> 643360 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643360 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node13",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 643368 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643368 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node14",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:56131_",
[junit4] 2> "base_url":"http://127.0.0.1:56131"}
[junit4] 2> 643376 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643376 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node15",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:37304_",
[junit4] 2> "base_url":"http://127.0.0.1:37304"}
[junit4] 2> 643384 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643384 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node16",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 643392 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643392 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node17",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39240_",
[junit4] 2> "base_url":"http://127.0.0.1:39240"}
[junit4] 2> 643400 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643401 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node18",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:56131_",
[junit4] 2> "base_url":"http://127.0.0.1:56131"}
[junit4] 2> 643406 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643407 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node19",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:35561_",
[junit4] 2> "base_url":"http://127.0.0.1:35561"}
[junit4] 2> 643412 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643412 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node20",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:37304_",
[junit4] 2> "base_url":"http://127.0.0.1:37304"}
[junit4] 2> 643419 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643420 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node21",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica1",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39240_",
[junit4] 2> "base_url":"http://127.0.0.1:39240"}
[junit4] 2> 643427 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643428 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node22",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica2",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:35561_",
[junit4] 2> "base_url":"http://127.0.0.1:35561"}
[junit4] 2> 643436 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643436 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node23",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 643444 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643444 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node24",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica4",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:56131_",
[junit4] 2> "base_url":"http://127.0.0.1:56131"}
[junit4] 2> 643451 T1797 oasc.Overseer$ClusterStateUpdater.updateState WARN Could not find collection node for awholynewcollection_0, skipping publish state
[junit4] 2> 643451 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node25",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:37304_",
[junit4] 2> "base_url":"http://127.0.0.1:37304"}
[junit4] 2> 643458 T1874 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 643458 T1842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 643459 T1801 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 643458 T1856 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 643459 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 643460 T1796 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 643460 T1814 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 643459 T1872 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 643932 T1836 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4] 2> 643933 T1836 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node3&state=recovering&nodeName=127.0.0.1:56131_&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard1_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2001
[junit4] 2> 643995 T1792 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4] 2> 643995 T1792 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node2&state=recovering&nodeName=127.0.0.1:39844_&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard2_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2001
[junit4] 2> 644027 T1851 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard1_replica1
[junit4] 2> 644028 T1851 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373541553324/awholynewcollection_0_shard1_replica1
[junit4] 2> 644028 T1851 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644029 T1838 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard1_replica2
[junit4] 2> 644029 T1791 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard1_replica5
[junit4] 2> 644029 T1851 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4] 2> 644029 T1838 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/awholynewcollection_0_shard1_replica2
[junit4] 2> 644030 T1824 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard1_replica3
[junit4] 2> 644030 T1851 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 644030 T1807 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard1_replica4
[junit4] 2> 644030 T1791 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica5' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard1_replica5
[junit4] 2> 644031 T1807 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica4' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/awholynewcollection_0_shard1_replica4
[junit4] 2> 644032 T1807 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644031 T1852 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard2_replica1
[junit4] 2> 644031 T1824 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard1_replica3
[junit4] 2> 644033 T1824 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644030 T1838 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644034 T1822 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard2_replica3
[junit4] 2> 644033 T1807 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4] 2> 644033 T1808 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard2_replica4
[junit4] 2> 644033 T1852 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373541553324/awholynewcollection_0_shard2_replica1
[junit4] 2> 644033 T1851 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 644032 T1834 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard2_replica2
[junit4] 2> 644036 T1834 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/awholynewcollection_0_shard2_replica2
[junit4] 2> 644037 T1789 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard2_replica5
[junit4] 2> 644032 T1791 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644037 T1789 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica5' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard2_replica5
[junit4] 2> 644038 T1837 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard3_replica2
[junit4] 2> 644037 T1834 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644039 T1810 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard3_replica4
[junit4] 2> 644036 T1851 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4] 2> 644036 T1849 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard3_replica1
[junit4] 2> 644036 T1852 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644035 T1808 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica4' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/awholynewcollection_0_shard2_replica4
[junit4] 2> 644040 T1808 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644035 T1838 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4] 2> 644041 T1838 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 644041 T1852 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4] 2> 644035 T1807 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 644035 T1824 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4] 2> 644035 T1822 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard2_replica3
[junit4] 2> 644042 T1824 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 644042 T1887 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard4_replica1
[junit4] 2> 644042 T1808 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4] 2> 644042 T1852 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 644041 T1821 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard4_replica3
[junit4] 2> 644041 T1790 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard3_replica5
[junit4] 2> 644039 T1849 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373541553324/awholynewcollection_0_shard3_replica1
[junit4] 2> 644045 T1849 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644046 T1895 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard5_replica1
[junit4] 2> 644046 T1895 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard5_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373541553324/awholynewcollection_0_shard5_replica1
[junit4] 2> 644047 T1895 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644039 T1834 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4] 2> 644039 T1823 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard3_replica3
[junit4] 2> 644039 T1810 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica4' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/awholynewcollection_0_shard3_replica4
[junit4] 2> 644038 T1791 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4] 2> 644048 T1900 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard5_replica3
[junit4] 2> 644049 T1900 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard5_replica3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard5_replica3
[junit4] 2> 644049 T1900 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644038 T1837 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/awholynewcollection_0_shard3_replica2
[junit4] 2> 644038 T1789 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644050 T1900 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 644051 T1900 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644050 T1837 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644049 T1903 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard5_replica5
[junit4] 2> 644048 T1895 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 644048 T1791 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 644048 T1810 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644048 T1901 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard5_replica4
[junit4] 2> 644048 T1852 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4] 2> 644048 T1823 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard3_replica3
[junit4] 2> 644054 T1823 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644048 T1897 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard5_replica2
[junit4] 2> 644048 T1834 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 644048 T1849 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 644047 T1851 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644047 T1824 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4] 2> 644046 T1807 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 644045 T1790 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica5' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard3_replica5
[junit4] 2> 644057 T1790 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644045 T1893 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard4_replica5
[junit4] 2> 644057 T1893 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica5' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard4_replica5
[junit4] 2> 644058 T1893 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644045 T1821 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard4_replica3
[junit4] 2> 644059 T1821 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644044 T1838 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 644044 T1808 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 644044 T1887 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373541553324/awholynewcollection_0_shard4_replica1
[junit4] 2> 644060 T1887 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644044 T1890 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard4_replica2
[junit4] 2> 644043 T1809 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for awholynewcollection_0_shard4_replica4
[junit4] 2> 644043 T1822 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644062 T1824 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644061 T1809 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica4' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/awholynewcollection_0_shard4_replica4
[junit4] 2> 644062 T1809 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644061 T1790 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 644063 T1790 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644061 T1890 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/awholynewcollection_0_shard4_replica2
[junit4] 2> 644061 T1821 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 644064 T1821 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644059 T1838 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4] 2> 644059 T1834 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4] 2> 644059 T1791 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4] 2> 644056 T1807 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4] 2> 644056 T1810 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 644066 T1810 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644056 T1823 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 644067 T1823 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644055 T1849 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644055 T1897 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard5_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/awholynewcollection_0_shard5_replica2
[junit4] 2> 644068 T1897 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644054 T1900 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard5_replica3/'
[junit4] 2> 644053 T1901 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard5_replica4' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/awholynewcollection_0_shard5_replica4
[junit4] 2> 644084 T1901 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644053 T1837 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 644085 T1837 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644052 T1895 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644052 T1903 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard5_replica5' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard5_replica5
[junit4] 2> 644086 T1903 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644051 T1789 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 644087 T1789 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644086 T1790 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard3_replica5/'
[junit4] 2> 644086 T1849 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373541553324/awholynewcollection_0_shard3_replica1/'
[junit4] 2> 644069 T1821 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard4_replica3/'
[junit4] 2> 644067 T1808 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4] 2> 644065 T1824 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard1_replica3/'
[junit4] 2> 644065 T1851 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373541553324/awholynewcollection_0_shard1_replica1/'
[junit4] 2> 644064 T1893 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 644091 T1893 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644091 T1895 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373541553324/awholynewcollection_0_shard5_replica1/'
[junit4] 2> 644064 T1890 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4] 2> 644064 T1887 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 644063 T1822 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 644062 T1852 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644093 T1822 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644092 T1887 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644092 T1897 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 644087 T1823 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard3_replica3/'
[junit4] 2> 644087 T1809 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 644096 T1809 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644095 T1897 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644097 T1901 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 644098 T1901 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644099 T1903 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 644099 T1903 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644102 T1791 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644106 T1789 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard2_replica5/'
[junit4] 2> 644108 T1852 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373541553324/awholynewcollection_0_shard2_replica1/'
[junit4] 2> 644109 T1837 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/awholynewcollection_0_shard3_replica2/'
[junit4] 2> 644109 T1838 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644110 T1890 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 644110 T1890 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644111 T1893 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard4_replica5/'
[junit4] 2> 644111 T1810 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/awholynewcollection_0_shard3_replica4/'
[junit4] 2> 644127 T1903 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard5_replica5/'
[junit4] 2> 644128 T1834 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644128 T1791 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard1_replica5/'
[junit4] 2> 644129 T1897 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/awholynewcollection_0_shard5_replica2/'
[junit4] 2> 644133 T1887 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1373541553324/awholynewcollection_0_shard4_replica1/'
[junit4] 2> 644133 T1822 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard2_replica3/'
[junit4] 2> 644134 T1807 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644135 T1809 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/awholynewcollection_0_shard4_replica4/'
[junit4] 2> 644136 T1838 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/awholynewcollection_0_shard1_replica2/'
[junit4] 2> 644137 T1808 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4] 2> 644139 T1901 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/awholynewcollection_0_shard5_replica4/'
[junit4] 2> 644141 T1807 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/awholynewcollection_0_shard1_replica4/'
[junit4] 2> 644142 T1890 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/awholynewcollection_0_shard4_replica2/'
[junit4] 2> 644143 T1808 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/awholynewcollection_0_shard2_replica4/'
[junit4] 2> 644144 T1834 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/awholynewcollection_0_shard2_replica2/'
[junit4] 2> 644239 T1790 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 644243 T1821 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 644300 T1900 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 644302 T1849 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 644303 T1895 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 644307 T1824 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 644347 T1789 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 644402 T1808 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 644477 T1897 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 644498 T1822 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 644517 T1791 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 644575 T1837 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 644597 T1893 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 644600 T1807 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 644604 T1890 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 644646 T1851 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 644698 T1790 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 644711 T1824 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 644736 T1790 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 644736 T1824 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 644739 T1903 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 644763 T1824 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica3] Schema name=test
[junit4] 2> 644790 T1808 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 644799 T1810 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 644801 T1808 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 644839 T1895 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 644843 T1852 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 644866 T1821 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 644888 T1809 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 644891 T1790 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica5] Schema name=test
[junit4] 2> 644908 T1887 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 644908 T1895 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 644918 T1821 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 644937 T1808 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica4] Schema name=test
[junit4] 2> 644965 T1849 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 644969 T1901 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 645009 T1849 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 645009 T1822 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 645032 T1822 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 645038 T1895 oass.IndexSchema.readSchema [awholynewcollection_0_shard5_replica1] Schema name=test
[junit4] 2> 645043 T1823 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 645064 T1897 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 645067 T1821 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica3] Schema name=test
[junit4] 2> 645068 T1897 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 645091 T1822 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica3] Schema name=test
[junit4] 2> 645678 T1838 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 645952 T1849 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica1] Schema name=test
[junit4] 2> ASYNC NEW_CORE C12580 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@1953bcfd url=http://127.0.0.1:39844/nodes_used_collection_shard2_replica2 node=127.0.0.1:39844_ C12580_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{state=recovering, core=nodes_used_collection_shard2_replica2, node_name=127.0.0.1:39844_, base_url=http://127.0.0.1:39844}
[junit4] 2> 646048 T1870 C12580 P39844 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:37304/nodes_used_collection_shard2_replica1/ core=nodes_used_collection_shard2_replica2 - recoveringAfterStartup=true
[junit4] 2> 646013 T1903 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 645992 T1890 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 645957 T1810 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> ASYNC NEW_CORE C12581 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@15334d42 url=http://127.0.0.1:56131/nodes_used_collection_shard1_replica2 node=127.0.0.1:56131_ C12581_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{state=recovering, core=nodes_used_collection_shard1_replica2, node_name=127.0.0.1:56131_, base_url=http://127.0.0.1:56131}
[junit4] 2> 645950 T1869 C12581 P56131 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:35561/nodes_used_collection_shard1_replica1/ core=nodes_used_collection_shard1_replica2 - recoveringAfterStartup=true
[junit4] 2> 645894 T1900 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 646734 T1852 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 645783 T1789 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 645783 T1834 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> ASYNC NEW_CORE C12582 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@15334d42 url=http://127.0.0.1:56131/nodes_used_collection_shard1_replica2 node=127.0.0.1:56131_ C12582_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{state=recovering, core=nodes_used_collection_shard1_replica2, node_name=127.0.0.1:56131_, base_url=http://127.0.0.1:56131}
[junit4] 2> 646732 T1869 C12582 P56131 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica2 url=http://127.0.0.1:56131 START replicas=[http://127.0.0.1:35561/nodes_used_collection_shard1_replica1/] nUpdates=100
[junit4] 2> 646719 T1809 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 646714 T1823 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 646692 T1807 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> ASYNC NEW_CORE C12583 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@1953bcfd url=http://127.0.0.1:39844/nodes_used_collection_shard2_replica2 node=127.0.0.1:39844_ C12583_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{state=recovering, core=nodes_used_collection_shard2_replica2, node_name=127.0.0.1:39844_, base_url=http://127.0.0.1:39844}
[junit4] 2> 646688 T1870 C12583 P39844 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:39844 START replicas=[http://127.0.0.1:37304/nodes_used_collection_shard2_replica1/] nUpdates=100
[junit4] 2> 646665 T1887 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 646660 T1893 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 646632 T1791 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 646533 T1901 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 646532 T1837 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 646051 T1851 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> ASYNC NEW_CORE C12584 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@15334d42 url=http://127.0.0.1:56131/nodes_used_collection_shard1_replica2 node=127.0.0.1:56131_ C12584_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{state=recovering, core=nodes_used_collection_shard1_replica2, node_name=127.0.0.1:56131_, base_url=http://127.0.0.1:56131}
[junit4] 2> 646845 T1869 C12584 P56131 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> ASYNC NEW_CORE C12585 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@15334d42 url=http://127.0.0.1:56131/nodes_used_collection_shard1_replica2 node=127.0.0.1:56131_ C12585_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{state=recovering, core=nodes_used_collection_shard1_replica2, node_name=127.0.0.1:56131_, base_url=http://127.0.0.1:56131}
[junit4] 2> 646933 T1869 C12585 P56131 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=nodes_used_collection_shard1_replica2
[junit4] 2> 646934 T1869 C12585 P56131 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=nodes_used_collection_shard1_replica2
[junit4] 2> 646934 T1869 C12585 P56131 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=nodes_used_collection_shard1_replica2
[junit4] 2> 646931 T1852 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 646930 T1851 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 646930 T1887 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 646912 T1837 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 646912 T1890 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 646847 T1897 oass.IndexSchema.readSchema [awholynewcollection_0_shard5_replica2] Schema name=test
[junit4] 2> 646962 T1791 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 646963 T1893 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> ASYNC NEW_CORE C12586 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@1953bcfd url=http://127.0.0.1:39844/nodes_used_collection_shard2_replica2 node=127.0.0.1:39844_ C12586_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{state=recovering, core=nodes_used_collection_shard2_replica2, node_name=127.0.0.1:39844_, base_url=http://127.0.0.1:39844}
[junit4] 2> 646845 T1870 C12586 P39844 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> ASYNC NEW_CORE C12587 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@1953bcfd url=http://127.0.0.1:39844/nodes_used_collection_shard2_replica2 node=127.0.0.1:39844_ C12587_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{state=recovering, core=nodes_used_collection_shard2_replica2, node_name=127.0.0.1:39844_, base_url=http://127.0.0.1:39844}
[junit4] 2> 646988 T1870 C12587 P39844 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=nodes_used_collection_shard2_replica2
[junit4] 2> 646988 T1870 C12587 P39844 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=nodes_used_collection_shard2_replica2
[junit4] 2> 646988 T1870 C12587 P39844 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=nodes_used_collection_shard2_replica2
[junit4] 2> 646989 T1870 C12587 P39844 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 646989 T1870 C12587 P39844 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:37304/nodes_used_collection_shard2_replica1/. core=nodes_used_collection_shard2_replica2
[junit4] 2> 646992 T1870 C12587 P39844 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 646969 T1838 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 646965 T1789 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 646964 T1903 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 646962 T1809 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 646960 T1901 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 646960 T1807 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 646960 T1810 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> ASYNC NEW_CORE C12588 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@15334d42 url=http://127.0.0.1:56131/nodes_used_collection_shard1_replica2 node=127.0.0.1:56131_ C12588_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{state=recovering, core=nodes_used_collection_shard1_replica2, node_name=127.0.0.1:56131_, base_url=http://127.0.0.1:56131}
[junit4] 2> 646955 T1869 C12588 P56131 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 647031 T1869 C12588 P56131 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:35561/nodes_used_collection_shard1_replica1/. core=nodes_used_collection_shard1_replica2
[junit4] 2> 647031 T1869 C12588 P56131 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 646938 T1823 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 646935 T1900 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 647038 T1838 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 647041 T1791 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica5] Schema name=test
[junit4] 2> 647047 T1887 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica1] Schema name=test
[junit4] 2> 647128 T1789 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica5] Schema name=test
[junit4] 2> 647203 T1807 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica4] Schema name=test
[junit4] 2> 647206 T1851 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica1] Schema name=test
[junit4] 2> 647206 T1852 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica1] Schema name=test
[junit4] 2> 647134 T1837 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica2] Schema name=test
[junit4] 2> 647136 T1810 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica4] Schema name=test
[junit4] 2> 647340 T1809 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica4] Schema name=test
[junit4] 2> 647344 T1890 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica2] Schema name=test
[junit4] 2> 647343 T1901 oass.IndexSchema.readSchema [awholynewcollection_0_shard5_replica4] Schema name=test
[junit4] 2> 647341 T1903 oass.IndexSchema.readSchema [awholynewcollection_0_shard5_replica5] Schema name=test
[junit4] 2> 647559 T1900 oass.IndexSchema.readSchema [awholynewcollection_0_shard5_replica3] Schema name=test
[junit4] 2> 647615 T1893 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica5] Schema name=test
[junit4] 2> 647617 T1838 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica2] Schema name=test
[junit4] 2> 647648 T1823 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica3] Schema name=test
[junit4] 2> 647732 T1834 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> ASYNC NEW_CORE C12589 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@52d552ab url=http://127.0.0.1:37304/nodes_used_collection_shard2_replica1 node=127.0.0.1:37304_ C12589_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{state=active, core=nodes_used_collection_shard2_replica1, node_name=127.0.0.1:37304_, base_url=http://127.0.0.1:37304, leader=true}
[junit4] 2> 647766 T1792 C12589 P37304 oasc.SolrCore.execute [nodes_used_collection_shard2_replica1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=119
[junit4] 2> 647869 T1834 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 647924 T1834 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica2] Schema name=test
[junit4] 2> ASYNC NEW_CORE C12590 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@52d552ab url=http://127.0.0.1:37304/nodes_used_collection_shard2_replica1 node=127.0.0.1:37304_ C12590_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{state=active, core=nodes_used_collection_shard2_replica1, node_name=127.0.0.1:37304_, base_url=http://127.0.0.1:37304, leader=true}
[junit4] 2> 647929 T1913 C12590 P37304 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> ASYNC NEW_CORE C12591 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore@70363442 url=http://127.0.0.1:35561/nodes_used_collection_shard1_replica1 node=127.0.0.1:35561_ C12591_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{state=active, core=nodes_used_collection_shard1_replica1, node_name=127.0.0.1:35561_, base_url=http://127.0.0.1:35561, leader=true}
[junit4] 2> 647929 T1836 C12591 P35561 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> ASYNC NEW_CORE C12592 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore@70363442 url=http://127.0.0.1:35561/nodes_used_collection_shard1_replica1 node=127.0.0.1:35561_ C12592_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{state=active, core=nodes_used_collection_shard1_replica1, node_name=127.0.0.1:35561_, base_url=http://127.0.0.1:35561, leader=true}
[junit4] 2> 648037 T1910 C12592 P35561 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=15
[junit4] 2> ASYNC NEW_CORE C12593 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@52d552ab url=http://127.0.0.1:37304/nodes_used_collection_shard2_replica1 node=127.0.0.1:37304_ C12593_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{state=active, core=nodes_used_collection_shard2_replica1, node_name=127.0.0.1:37304_, base_url=http://127.0.0.1:37304, leader=true}
[junit4] 2> 648401 T1913 C12593 P37304 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c0eeb1a lockFactory=org.apache.lucene.store.NativeFSLockFactory@7a91567),segFN=segments_1,generation=1}
[junit4] 2> ASYNC NEW_CORE C12594 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore@70363442 url=http://127.0.0.1:35561/nodes_used_collection_shard1_replica1 node=127.0.0.1:35561_ C12594_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{state=active, core=nodes_used_collection_shard1_replica1, node_name=127.0.0.1:35561_, base_url=http://127.0.0.1:35561, leader=true}
[junit4] 2> 648402 T1836 C12594 P35561 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@64a766b8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@47fae43),segFN=segments_1,generation=1}
[junit4] 2> ASYNC NEW_CORE C12595 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@52d552ab url=http://127.0.0.1:37304/nodes_used_collection_shard2_replica1 node=127.0.0.1:37304_ C12595_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{state=active, core=nodes_used_collection_shard2_replica1, node_name=127.0.0.1:37304_, base_url=http://127.0.0.1:37304, leader=true}
[junit4] 2> 648551 T1913 C12595 P37304 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 648551 T1836 C12594 P35561 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> ASYNC NEW_CORE C12596 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@52d552ab url=http://127.0.0.1:37304/nodes_used_collection_shard2_replica1 node=127.0.0.1:37304_ C12596_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{state=active, core=nodes_used_collection_shard2_replica1, node_name=127.0.0.1:37304_, base_url=http://127.0.0.1:37304, leader=true}
[junit4] 2> 648591 T1913 C12596 P37304 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> ASYNC NEW_CORE C12597 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore@70363442 url=http://127.0.0.1:35561/nodes_used_collection_shard1_replica1 node=127.0.0.1:35561_ C12597_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{state=active, core=nodes_used_collection_shard1_replica1, node_name=127.0.0.1:35561_, base_url=http://127.0.0.1:35561, leader=true}
[junit4] 2> 648592 T1836 C12597 P35561 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> ASYNC NEW_CORE C12598 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore@70363442 url=http://127.0.0.1:35561/nodes_used_collection_shard1_replica1 node=127.0.0.1:35561_ C12598_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{state=active, core=nodes_used_collection_shard1_replica1, node_name=127.0.0.1:35561_, base_url=http://127.0.0.1:35561, leader=true}
[junit4] 2> 648630 T1836 C12598 P35561 oass.SolrIndexSearcher.<init> Opening Searcher@710d3073 realtime
[junit4] 2> ASYNC NEW_CORE C12599 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@52d552ab url=http://127.0.0.1:37304/nodes_used_collection_shard2_replica1 node=127.0.0.1:37304_ C12599_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{state=active, core=nodes_used_collection_shard2_replica1, node_name=127.0.0.1:37304_, base_url=http://127.0.0.1:37304, leader=true}
[junit4] 2> 648630 T1913 C12599 P37304 oass.SolrIndexSearcher.<init> Opening Searcher@2965866d realtime
[junit4] 2> ASYNC NEW_CORE C12600 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore@70363442 url=http://127.0.0.1:35561/nodes_used_collection_shard1_replica1 node=127.0.0.1:35561_ C12600_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{state=active, core=nodes_used_collection_shard1_replica1, node_name=127.0.0.1:35561_, base_url=http://127.0.0.1:35561, leader=true}
[junit4] 2> 648651 T1836 C12600 P35561 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> ASYNC NEW_CORE C12601 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@52d552ab url=http://127.0.0.1:37304/nodes_used_collection_shard2_replica1 node=127.0.0.1:37304_ C12601_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{state=active, core=nodes_used_collection_shard2_replica1, node_name=127.0.0.1:37304_, base_url=http://127.0.0.1:37304, leader=true}
[junit4] 2> 648651 T1913 C12601 P37304 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 648658 T1836 C12600 P35561 oasup.LogUpdateProcessor.finish [nodes_used_collection_shard1_replica1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 731
[junit4] 2> 648659 T1913 C12601 P37304 oasup.LogUpdateProcessor.finish [nodes_used_collection_shard2_replica1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 758
[junit4] 2> ASYNC NEW_CORE C12602 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@1953bcfd url=http://127.0.0.1:39844/nodes_used_collection_shard2_replica2 node=127.0.0.1:39844_ C12602_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{state=recovering, core=nodes_used_collection_shard2_replica2, node_name=127.0.0.1:39844_, base_url=http://127.0.0.1:39844}
[junit4] 2> 648901 T1870 C12602 P39844 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> ASYNC NEW_CORE C12603 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@15334d42 url=http://127.0.0.1:56131/nodes_used_collection_shard1_replica2 node=127.0.0.1:56131_ C12603_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{state=recovering, core=nodes_used_collection_shard1_replica2, node_name=127.0.0.1:56131_, base_url=http://127.0.0.1:56131}
[junit4] 2> 648901 T1869 C12603 P56131 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> ASYNC NEW_CORE C12604 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@1953bcfd url=http://127.0.0.1:39844/nodes_used_collection_shard2_replica2 node=127.0.0.1:39844_ C12604_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{state=recovering, core=nodes_used_collection_shard2_replica2, node_name=127.0.0.1:39844_, base_url=http://127.0.0.1:39844}
[junit4] 2> 648928 T1870 C12604 P39844 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 648931 T1869 C12603 P56131 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> ASYNC NEW_CORE C12605 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@52d552ab url=http://127.0.0.1:37304/nodes_used_collection_shard2_replica1 node=127.0.0.1:37304_ C12605_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{state=active, core=nodes_used_collection_shard2_replica1, node_name=127.0.0.1:37304_, base_url=http://127.0.0.1:37304, leader=true}
[junit4] 2> 649659 T1913 C12605 P37304 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> ASYNC NEW_CORE C12606 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore@70363442 url=http://127.0.0.1:35561/nodes_used_collection_shard1_replica1 node=127.0.0.1:35561_ C12606_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{state=active, core=nodes_used_collection_shard1_replica1, node_name=127.0.0.1:35561_, base_url=http://127.0.0.1:35561, leader=true}
[junit4] 2> 649895 T1910 C12606 P35561 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 649923 T1910 C12606 P35561 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=812
[junit4] 2> ASYNC NEW_CORE C12607 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@52d552ab url=http://127.0.0.1:37304/nodes_used_collection_shard2_replica1 node=127.0.0.1:37304_ C12607_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{state=active, core=nodes_used_collection_shard2_replica1, node_name=127.0.0.1:37304_, base_url=http://127.0.0.1:37304, leader=true}
[junit4] 2> 649923 T1913 C12607 P37304 oasc.SolrCore.execute [nodes_used_collection_shard2_replica1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=812
[junit4] 2> ASYNC NEW_CORE C12608 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@1953bcfd url=http://127.0.0.1:39844/nodes_used_collection_shard2_replica2 node=127.0.0.1:39844_ C12608_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{state=recovering, core=nodes_used_collection_shard2_replica2, node_name=127.0.0.1:39844_, base_url=http://127.0.0.1:39844}
[junit4] 2> 649945 T1870 C12608 P39844 oasc.RecoveryStrategy.replay No replay needed. core=nodes_used_collection_shard2_replica2
[junit4] 2> 649962 T1870 C12608 P39844 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=nodes_used_collection_shard2_replica2
[junit4] 2> 649963 T1870 C12608 P39844 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=active
[junit4] 2> ASYNC NEW_CORE C12609 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@15334d42 url=http://127.0.0.1:56131/nodes_used_collection_shard1_replica2 node=127.0.0.1:56131_ C12609_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{state=recovering, core=nodes_used_collection_shard1_replica2, node_name=127.0.0.1:56131_, base_url=http://127.0.0.1:56131}
[junit4] 2> 649985 T1869 C12609 P56131 oasc.RecoveryStrategy.replay No replay needed. core=nodes_used_collection_shard1_replica2
[junit4] 2> 649987 T1869 C12609 P56131 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=nodes_used_collection_shard1_replica2
[junit4] 2> 649988 T1869 C12609 P56131 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=active
[junit4] 2> ASYNC NEW_CORE C12610 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@15334d42 url=http://127.0.0.1:56131/nodes_used_collection_shard1_replica2 node=127.0.0.1:56131_ C12610_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{state=recovering, core=nodes_used_collection_shard1_replica2, node_name=127.0.0.1:56131_, base_url=http://127.0.0.1:56131}
[junit4] 2> 650058 T1869 C12610 P56131 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=nodes_used_collection_shard1_replica2
[junit4] 2> ASYNC NEW_CORE C12611 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@1953bcfd url=http://127.0.0.1:39844/nodes_used_collection_shard2_replica2 node=127.0.0.1:39844_ C12611_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{state=recovering, core=nodes_used_collection_shard2_replica2, node_name=127.0.0.1:39844_, base_url=http://127.0.0.1:39844}
[junit4] 2> 650059 T1870 C12611 P39844 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=nodes_used_collection_shard2_replica2
[junit4] 2> 650226 T1797 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 650279 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:56131_",
[junit4] 2> "base_url":"http://127.0.0.1:56131"}
[junit4] 2> 650394 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 650496 T1801 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 650503 T1872 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 650501 T1856 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 650501 T1842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 650501 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 650500 T1796 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 650497 T1814 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 650514 T1874 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 656200 T1808 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 672327 T1776 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13fcd74c41d000e, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 672330 T1776 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13fcd74c41d0003, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 672336 T1776 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13fcd74c41d000c, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 672331 T1808 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 672352 T1776 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13fcd74c41d0008, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 672352 T1919 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=5&maxShardsPerNode=6&name=awholynewcollection_0&replicationFactor=5&action=CREATE&wt=javabin&version=2
[junit4] 2> 672352 T1808 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 672353 T1776 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13fcd74c41d000a, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 672357 T1776 oazs.NIOServerCnxnFactory.run WARN Ignoring unexpected runtime exception java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:55)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.readyOps(SelectionKeyImpl.java:69)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:187)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 672358 T1776 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13fcd74c41d0006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 672405 T1808 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 672435 T1872 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c657254 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 672435 T1872 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 672437 T1801 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33102dba name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 672437 T1801 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 672439 T1814 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17691476 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 672440 T1814 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 672439 T1874 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5eecb8c1 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 672440 T1874 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 672441 T1796 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2ff66404 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 672441 T1796 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 672441 T1856 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: null state: Disconnected type None
[junit4] 2> 672441 T1856 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ed065b1 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 672442 T1856 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 672442 T1828 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68f2efe4 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 672442 T1828 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 672442 T1842 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d3df0c7 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 672443 T1842 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 672446 T1808 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 672456 T1778 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:55)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:59)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:153)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1076)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1113)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)
[junit4] 2> at org.apache.zookeeper.server.DataTree.deleteNode(DataTree.java:594)
[junit4] 2> at org.apache.zookeeper.server.DataTree.killSession(DataTree.java:966)
[junit4] 2> at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:818)
[junit4] 2> at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)
[junit4] 2> at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:965)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:167)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:101)
[junit4] 2>
[junit4] 2> 672523 T1824 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 672524 T1824 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 672525 T1824 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 672575 T1895 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 672576 T1895 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 672582 T1824 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 672596 T1895 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 672639 T1895 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 672656 T1895 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 672686 T1824 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 672871 T1849 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 672872 T1849 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 672892 T1849 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 672905 T1822 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 672906 T1822 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 672907 T1822 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 672909 T1789 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 672910 T1789 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 672911 T1789 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 672920 T1849 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 672924 T1849 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 672929 T1822 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 672988 T1821 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 672989 T1821 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 672989 T1789 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 672990 T1821 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 672994 T1789 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 673007 T1822 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 673014 T1887 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673015 T1887 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673016 T1887 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 673045 T1887 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 673049 T1887 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 673061 T1791 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673061 T1791 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673062 T1791 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 673074 T1821 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 673078 T1791 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 673080 T1790 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673080 T1790 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673082 T1790 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 673113 T1821 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 673134 T1790 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 673159 T1810 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673166 T1810 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673168 T1810 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 673162 T1791 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 673167 T1790 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 673166 T1901 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673175 T1901 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673175 T1901 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 673191 T1823 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673192 T1823 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673203 T1900 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673204 T1900 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673246 T1823 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 673247 T1901 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 673246 T1900 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 673257 T1900 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 673261 T1900 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 673263 T1901 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 673264 T1810 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 673288 T1810 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 673306 T1852 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673306 T1852 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673319 T1809 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673320 T1809 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673326 T1823 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 673330 T1823 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 673333 T1838 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673333 T1852 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 673361 T1838 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673371 T1838 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 673361 T1809 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 673378 T1852 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 673385 T1852 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 673390 T1903 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673401 T1903 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673408 T1809 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 673411 T1838 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 673412 T1809 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 673413 T1903 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 673454 T1838 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 673460 T1903 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 673460 T1807 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673461 T1807 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673462 T1807 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 673470 T1807 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 673473 T1903 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 673497 T1807 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 673540 T1851 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673541 T1851 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673542 T1851 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 673542 T1890 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673543 T1890 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673544 T1890 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 673561 T1874 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5eecb8c1 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:Expired type:None path:null path:null type:None
[junit4] 2> 673562 T1874 oascc.ConnectionManager.process Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
[junit4] 2> 673562 T1874 oascc.DefaultConnectionStrategy.reconnect Connection expired - starting a new one...
[junit4] 2> 673574 T1801 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33102dba name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:Expired type:None path:null path:null type:None
[junit4] 2> 673574 T1801 oascc.ConnectionManager.process Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
[junit4] 2> 673574 T1890 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 673588 T1893 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673590 T1893 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673591 T1893 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 673582 T1834 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673581 T1851 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 673605 T1851 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 673576 T1874 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 673574 T1801 oascc.DefaultConnectionStrategy.reconnect Connection expired - starting a new one...
[junit4] 2> 673608 T1922 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5eecb8c1 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 673595 T1890 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 673595 T1897 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673594 T1837 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673611 T1897 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673610 T1801 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 673610 T1874 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 673612 T1874 oascc.ConnectionManager$1.update Connection with ZooKeeper reestablished.
[junit4] 2> 673612 T1897 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 673610 T1893 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 673614 T1924 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33102dba name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 673609 T1834 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673634 T1893 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 673611 T1837 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 673639 T1874 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 673640 T1837 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 673645 T1834 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 673650 T1837 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 673646 T1897 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 673650 T1801 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 673653 T1801 oascc.ConnectionManager$1.update Connection with ZooKeeper reestablished.
[junit4] 2> 673658 T1801 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 673663 T1837 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 673665 T1897 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 673664 T1834 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 673669 T1874 oascc.DefaultConnectionStrategy.reconnect Reconnected to ZooKeeper
[junit4] 2> 673671 T1801 oascc.DefaultConnectionStrategy.reconnect Reconnected to ZooKeeper
[junit4] 2> 673671 T1801 oascc.ConnectionManager.process Connected:true
[junit4] 2> 673671 T1874 oascc.ConnectionManager.process Connected:true
[junit4] 2> 673680 T1834 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 673776 T1872 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c657254 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:Expired type:None path:null path:null type:None
[junit4] 2> 673777 T1872 oascc.ConnectionManager.process Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
[junit4] 2> 673777 T1872 oascc.DefaultConnectionStrategy.reconnect Connection expired - starting a new one...
[junit4] 2> 673779 T1872 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 673782 T1926 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c657254 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 673783 T1872 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 673783 T1872 oascc.ConnectionManager$1.update Connection with ZooKeeper reestablished.
[junit4] 2> 673785 T1872 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 673790 T1872 oascc.DefaultConnectionStrategy.reconnect Reconnected to ZooKeeper
[junit4] 2> 673791 T1872 oascc.ConnectionManager.process Connected:true
[junit4] 2> 674074 T1827 oaz.ClientCnxn$SendThread.run WARN Session 0x13fcd74c41d0008 for server localhost.localdomain/127.0.0.1:41126, unexpected error, closing socket connection and attempting reconnect java.io.IOException: Broken pipe
[junit4] 2> at sun.nio.ch.FileDispatcher.write0(Native Method)
[junit4] 2> at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:29)
[junit4] 2> at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:69)
[junit4] 2> at sun.nio.ch.IOUtil.write(IOUtil.java:40)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:336)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:117)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:355)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 674167 T1814 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17691476 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:Expired type:None path:null path:null type:None
[junit4] 2> 674167 T1814 oascc.ConnectionManager.process Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
[junit4] 2> 674167 T1814 oascc.DefaultConnectionStrategy.reconnect Connection expired - starting a new one...
[junit4] 2> 674168 T1814 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 674170 T1928 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17691476 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674170 T1814 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 674170 T1814 oascc.ConnectionManager$1.update Connection with ZooKeeper reestablished.
[junit4] 2> 674171 T1814 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=down
[junit4] 2> 674186 T1814 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 674198 T1814 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56131_
[junit4] 2> 674200 T1814 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56131_
[junit4] 2> 674205 T1922 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 674205 T1924 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 674206 T1926 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 674206 T1928 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 674207 T1814 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica2 address:http://127.0.0.1:56131 collection:nodes_used_collection shard:shard1
[junit4] 2> 674207 T1814 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 674216 T1814 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 674220 T1814 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=180000
[junit4] 2> 674267 T1841 oaz.ClientCnxn$SendThread.run WARN Session 0x13fcd74c41d000a for server localhost.localdomain/127.0.0.1:41126, unexpected error, closing socket connection and attempting reconnect java.io.IOException: Broken pipe
[junit4] 2> at sun.nio.ch.FileDispatcher.write0(Native Method)
[junit4] 2> at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:29)
[junit4] 2> at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:69)
[junit4] 2> at sun.nio.ch.IOUtil.write(IOUtil.java:40)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:336)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:117)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:355)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 674269 T1809 oasc.CoreContainer.recordAndThrow ERROR Unable to create core: awholynewcollection_0_shard4_replica4 java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 674269 T1919 oasc.SolrException.log ERROR org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qn-
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:218)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:215)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:215)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.createData(DistributedQueue.java:284)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:301)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:162)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:156)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleCreateAction(CollectionsHandler.java:290)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:112)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:218)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 674267 T1807 oasc.CoreContainer.recordAndThrow ERROR Unable to create core: awholynewcollection_0_shard1_replica4 java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 674269 T1810 oasc.CoreContainer.recordAndThrow ERROR Unable to create core: awholynewcollection_0_shard3_replica4 java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 674269 T1901 oasc.CoreContainer.recordAndThrow ERROR Unable to create core: awholynewcollection_0_shard5_replica4 java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 674269 T1808 oasc.CoreContainer.recordAndThrow ERROR Unable to create core: awholynewcollection_0_shard2_replica4 java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 674279 T1807 oasc.SolrException.log ERROR org.apache.solr.common.SolrException: Error CREATEing SolrCore 'awholynewcollection_0_shard1_replica4': Unable to create core: awholynewcollection_0_shard1_replica4 Caused by: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:554)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: org.apache.solr.common.SolrException: Unable to create core: awholynewcollection_0_shard1_replica4
[junit4] 2> at org.apache.solr.core.CoreContainer.recordAndThrow(CoreContainer.java:1195)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:709)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> ... 30 more
[junit4] 2> Caused by: java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> ... 31 more
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 674279 T1901 oasc.SolrException.log ERROR null:java.lang.AssertionError: core_node24
[junit4] 2> at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 674277 T1810 oasc.SolrException.log ERROR null:java.lang.AssertionError: core_node14
[junit4] 2> at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 674273 T1919 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={numShards=5&maxShardsPerNode=6&name=awholynewcollection_0&replicationFactor=5&action=CREATE&wt=javabin&version=2} status=500 QTime=1920
[junit4] 2> 674272 T1809 oasc.SolrException.log ERROR null:java.lang.AssertionError: core_node18
[junit4] 2> at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 674283 T1919 oasc.SolrException.log ERROR null:org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qn-
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:218)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:215)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:215)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.createData(DistributedQueue.java:284)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:301)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:162)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:156)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleCreateAction(CollectionsHandler.java:290)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:112)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:218)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 674281 T1807 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard1&name=awholynewcollection_0_shard1_replica4&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=400 QTime=32255
[junit4] 2> 674281 T1808 oasc.SolrException.log ERROR null:java.lang.AssertionError: core_node8
[junit4] 2> at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 674288 T1798 oasc.OverseerCollectionProcessor.processResponse ERROR Error from shard: 127.0.0.1:56131 org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Error CREATEing SolrCore 'awholynewcollection_0_shard1_replica4': Unable to create core: awholynewcollection_0_shard1_replica4 Caused by: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:424)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:156)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:119)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 674294 T1917 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=5&maxShardsPerNode=6&name=awholynewcollection_0&replicationFactor=5&action=CREATE&wt=javabin&version=2
[junit4] 2> 674327 T1798 oasc.OverseerCollectionProcessor.processResponse ERROR Error from shard: 127.0.0.1:56131 org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:56131 returned non ok status:500, message:{msg=core_node24,trace=java.lang.AssertionError: core_node24 at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandl
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:156)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:119)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 674335 T1798 oasc.OverseerCollectionProcessor.processResponse ERROR Error from shard: 127.0.0.1:56131 org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:56131 returned non ok status:500, message:{msg=core_node8,trace=java.lang.AssertionError: core_node8 at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandle(
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:156)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:119)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 674347 T1798 oasc.OverseerCollectionProcessor.processResponse ERROR Error from shard: 127.0.0.1:56131 org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:56131 returned non ok status:500, message:{msg=core_node14,trace=java.lang.AssertionError: core_node14 at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandl
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:156)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:119)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 674348 T1798 oasc.OverseerCollectionProcessor.processResponse ERROR Error from shard: 127.0.0.1:56131 org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:56131 returned non ok status:500, message:{msg=core_node18,trace=java.lang.AssertionError: core_node18 at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandl
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:156)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:119)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 674374 T1796 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2ff66404 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674380 T1796 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 674381 T1796 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4] 2> 674410 T1797 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 674419 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:56131_",
[junit4] 2> "base_url":"http://127.0.0.1:56131"}
[junit4] 2> 674440 T1855 oaz.ClientCnxn$SendThread.run WARN Session 0x13fcd74c41d000c for server localhost.localdomain/127.0.0.1:41126, unexpected error, closing socket connection and attempting reconnect java.io.IOException: Broken pipe
[junit4] 2> at sun.nio.ch.FileDispatcher.write0(Native Method)
[junit4] 2> at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:29)
[junit4] 2> at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:69)
[junit4] 2> at sun.nio.ch.IOUtil.write(IOUtil.java:40)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:336)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:117)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:355)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 674482 T1903 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 674483 T1789 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 674484 T1791 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 674485 T1790 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 674486 T1893 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 674514 T1926 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 674515 T1922 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 674514 T1924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 674515 T1796 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 674520 T1928 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 674528 T1789 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 674534 T1791 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 674534 T1903 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 674534 T1893 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 674533 T1790 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 674554 T1903 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 674554 T1791 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 674558 T1789 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 674559 T1790 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 674560 T1893 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 674570 T1791 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 674571 T1791 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 674571 T1903 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 674573 T1903 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 674572 T1790 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 674573 T1790 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 674572 T1789 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 674574 T1789 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 674575 T1789 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 674571 T1791 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 674574 T1790 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 674573 T1903 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 674573 T1893 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 674579 T1893 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 674579 T1893 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 674583 T1791 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 674583 T1791 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 674584 T1791 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 674584 T1791 oasc.SolrCore.<init> [awholynewcollection_0_shard1_replica5] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard1_replica5/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard1_replica5/data/
[junit4] 2> 674585 T1789 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 674585 T1789 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 674585 T1791 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2820224a
[junit4] 2> 674586 T1903 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 674586 T1789 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 674585 T1790 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 674587 T1789 oasc.SolrCore.<init> [awholynewcollection_0_shard2_replica5] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard2_replica5/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard2_replica5/data/
[junit4] 2> 674587 T1791 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard1_replica5/data
[junit4] 2> 674587 T1903 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 674589 T1903 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 674590 T1903 oasc.SolrCore.<init> [awholynewcollection_0_shard5_replica5] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard5_replica5/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard5_replica5/data/
[junit4] 2> 674590 T1903 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2820224a
[junit4] 2> 674586 T1893 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 674588 T1791 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard1_replica5/data/index/
[junit4] 2> 674588 T1789 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2820224a
[junit4] 2> 674588 T1790 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 674593 T1791 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard1_replica5] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard1_replica5/data/index' doesn't exist. Creating new index...
[junit4] 2> 674592 T1903 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard5_replica5/data
[junit4] 2> 674592 T1893 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 674594 T1903 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard5_replica5/data/index/
[junit4] 2> 674594 T1791 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard1_replica5/data/index
[junit4] 2> 674594 T1789 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard2_replica5/data
[junit4] 2> 674596 T1789 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard2_replica5/data/index/
[junit4] 2> 674597 T1789 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard2_replica5] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard2_replica5/data/index' doesn't exist. Creating new index...
[junit4] 2> 674594 T1790 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 674597 T1789 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard2_replica5/data/index
[junit4] 2> 674595 T1903 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard5_replica5] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard5_replica5/data/index' doesn't exist. Creating new index...
[junit4] 2> 674595 T1893 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 674598 T1791 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3055e050 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2936a818),segFN=segments_1,generation=1}
[junit4] 2> 674600 T1791 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 674598 T1790 oasc.SolrCore.<init> [awholynewcollection_0_shard3_replica5] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard3_replica5/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard3_replica5/data/
[junit4] 2> 674600 T1789 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@38057df6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@22778f7f),segFN=segments_1,generation=1}
[junit4] 2> 674601 T1789 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 674599 T1903 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard5_replica5/data/index
[junit4] 2> 674599 T1893 oasc.SolrCore.<init> [awholynewcollection_0_shard4_replica5] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard4_replica5/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard4_replica5/data/
[junit4] 2> 674601 T1790 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2820224a
[junit4] 2> 674602 T1893 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2820224a
[junit4] 2> 674604 T1790 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard3_replica5/data
[junit4] 2> 674604 T1790 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard3_replica5/data/index/
[junit4] 2> 674604 T1893 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard4_replica5/data
[junit4] 2> 674604 T1790 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard3_replica5] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard3_replica5/data/index' doesn't exist. Creating new index...
[junit4] 2> 674605 T1893 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard4_replica5/data/index/
[junit4] 2> 674606 T1790 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard3_replica5/data/index
[junit4] 2> 674606 T1893 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard4_replica5] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard4_replica5/data/index' doesn't exist. Creating new index...
[junit4] 2> 674607 T1893 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard4_replica5/data/index
[junit4] 2> 674608 T1789 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 674609 T1789 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 674609 T1790 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@64828250 lockFactory=org.apache.lucene.store.NativeFSLockFactory@555051dc),segFN=segments_1,generation=1}
[junit4] 2> 674610 T1790 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 674610 T1893 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3c49bbe9 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5dda444),segFN=segments_1,generation=1}
[junit4] 2> 674611 T1893 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 674610 T1903 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@cf16c33 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2f939f04),segFN=segments_1,generation=1}
[junit4] 2> 674617 T1903 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 674611 T1789 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 674618 T1789 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 674619 T1789 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 674619 T1789 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 674620 T1791 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 674621 T1791 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 674622 T1791 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 674622 T1791 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 674623 T1791 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 674623 T1791 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 674623 T1791 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 674624 T1791 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 674624 T1791 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 674620 T1893 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 674626 T1789 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 674626 T1893 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 674627 T1789 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 674627 T1789 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 674628 T1791 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 674629 T1789 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 674627 T1903 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 674630 T1903 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 674631 T1903 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 674632 T1903 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 674629 T1790 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 674627 T1893 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 674635 T1789 oass.SolrIndexSearcher.<init> Opening Searcher@78480596 main
[junit4] 2> 674635 T1893 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 674635 T1903 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 674637 T1893 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 674637 T1893 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 674634 T1790 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 674666 T1791 oass.SolrIndexSearcher.<init> Opening Searcher@660f260 main
[junit4] 2> 674666 T1893 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 674637 T1903 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 674667 T1903 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 674668 T1903 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 674669 T1903 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 674636 T1789 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 674667 T1893 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 674667 T1791 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 674666 T1790 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 674670 T1791 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 674670 T1893 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 674669 T1789 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 674671 T1903 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 674671 T1790 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 674672 T1893 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 674673 T1790 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 674673 T1790 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 674674 T1790 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 674674 T1790 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 674675 T1790 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 674677 T1790 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 674677 T1893 oass.SolrIndexSearcher.<init> Opening Searcher@44245d5f main
[junit4] 2> 674678 T1893 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 674679 T1893 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 674680 T1790 oass.SolrIndexSearcher.<init> Opening Searcher@49f2b143 main
[junit4] 2> 674680 T1903 oass.SolrIndexSearcher.<init> Opening Searcher@15e2809 main
[junit4] 2> 674680 T1790 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 674681 T1790 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 674681 T1903 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 674682 T1903 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 674720 T1932 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard5_replica5] Registered new searcher Searcher@15e2809 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 674724 T1930 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard1_replica5] Registered new searcher Searcher@660f260 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 674725 T1789 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard2_replica5
[junit4] 2> 674726 T1789 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard2_replica5 address:http://127.0.0.1:37304 collection:awholynewcollection_0 shard:shard2
[junit4] 2> 674726 T1789 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 674727 T1929 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard2_replica5] Registered new searcher Searcher@78480596 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 674728 T1931 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard4_replica5] Registered new searcher Searcher@44245d5f main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 674730 T1933 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard3_replica5] Registered new searcher Searcher@49f2b143 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 674732 T1791 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard1_replica5
[junit4] 2> 674732 T1791 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard1_replica5 address:http://127.0.0.1:37304 collection:awholynewcollection_0 shard:shard1
[junit4] 2> 674733 T1791 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 674733 T1903 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard5_replica5
[junit4] 2> 674733 T1903 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard5_replica5 address:http://127.0.0.1:37304 collection:awholynewcollection_0 shard:shard5
[junit4] 2> 674734 T1903 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 674736 T1789 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leader_elect/shard2/election
[junit4] 2> 674737 T1791 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leader_elect/shard1/election
[junit4] 2> 674741 T1903 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leader_elect/shard5/election
[junit4] 2> 674746 T1893 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard4_replica5
[junit4] 2> 674747 T1893 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard4_replica5 address:http://127.0.0.1:37304 collection:awholynewcollection_0 shard:shard4
[junit4] 2> 674747 T1893 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 674750 T1790 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard3_replica5
[junit4] 2> 674752 T1790 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard3_replica5 address:http://127.0.0.1:37304 collection:awholynewcollection_0 shard:shard3
[junit4] 2> 674752 T1790 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 674760 T1790 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leader_elect/shard3/election
[junit4] 2> 674760 T1893 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leader_elect/shard4/election
[junit4] 2> 674790 T1903 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard5
[junit4] 2> 674791 T1791 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 674793 T1789 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 674802 T1903 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard5: total=5 found=1 timeoutin=179997
[junit4] 2> 674803 T1791 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard1: total=4 found=1 timeoutin=179998
[junit4] 2> 674806 T1789 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard2: total=5 found=1 timeoutin=179996
[junit4] 2> 674807 T1790 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 674810 T1893 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard4
[junit4] 2> 674819 T1790 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard3: total=5 found=1 timeoutin=179997
[junit4] 2> 674819 T1893 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard4: total=5 found=1 timeoutin=179999
[junit4] 2> 675184 T1827 oaz.ClientCnxn$SendThread.run WARN Session 0x13fcd74c41d0008 for server localhost.localdomain/127.0.0.1:41126, unexpected error, closing socket connection and attempting reconnect java.io.IOException: Broken pipe
[junit4] 2> at sun.nio.ch.FileDispatcher.write0(Native Method)
[junit4] 2> at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:29)
[junit4] 2> at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:69)
[junit4] 2> at sun.nio.ch.IOUtil.write(IOUtil.java:40)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:336)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:117)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:355)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 675851 T1842 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d3df0c7 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:Expired type:None path:null path:null type:None
[junit4] 2> 675851 T1842 oascc.ConnectionManager.process Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
[junit4] 2> 675851 T1842 oascc.DefaultConnectionStrategy.reconnect Connection expired - starting a new one...
[junit4] 2> 675852 T1842 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 675859 T1935 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d3df0c7 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 675862 T1842 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 675862 T1842 oascc.ConnectionManager$1.update Connection with ZooKeeper reestablished.
[junit4] 2> 675863 T1842 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=down
[junit4] 2> 675890 T1842 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 675914 T1842 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35561_
[junit4] 2> 675917 T1842 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35561_
[junit4] 2> 675922 T1924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4] 2> 675922 T1922 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4] 2> 675924 T1796 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 675924 T1796 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 675927 T1928 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 675927 T1928 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 675930 T1922 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 675934 T1924 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 675935 T1926 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 675935 T1926 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 675940 T1935 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 675941 T1842 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica1 address:http://127.0.0.1:35561 collection:nodes_used_collection shard:shard1
[junit4] 2> 675941 T1842 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 675950 T1842 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 675951 T1890 oasc.CoreContainer.recordAndThrow ERROR Unable to create core: awholynewcollection_0_shard4_replica2 java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 675953 T1917 oasc.SolrException.log ERROR org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qn-
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:218)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:215)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:215)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.createData(DistributedQueue.java:284)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:301)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:162)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:156)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleCreateAction(CollectionsHandler.java:290)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:112)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:218)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 675953 T1837 oasc.CoreContainer.recordAndThrow ERROR Unable to create core: awholynewcollection_0_shard3_replica2 java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 675953 T1897 oasc.CoreContainer.recordAndThrow ERROR Unable to create core: awholynewcollection_0_shard5_replica2 java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 675953 T1834 oasc.CoreContainer.recordAndThrow ERROR Unable to create core: awholynewcollection_0_shard2_replica2 java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 675953 T1838 oasc.CoreContainer.recordAndThrow ERROR Unable to create core: awholynewcollection_0_shard1_replica2 java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 675965 T1834 oasc.SolrException.log ERROR null:java.lang.AssertionError: core_node7
[junit4] 2> at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 675965 T1842 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=179999
[junit4] 2> 675963 T1897 oasc.SolrException.log ERROR null:java.lang.AssertionError: core_node22
[junit4] 2> at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 675961 T1837 oasc.SolrException.log ERROR null:java.lang.AssertionError: core_node12
[junit4] 2> at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 675959 T1917 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={numShards=5&maxShardsPerNode=6&name=awholynewcollection_0&replicationFactor=5&action=CREATE&wt=javabin&version=2} status=500 QTime=1665
[junit4] 2> 675956 T1890 oasc.SolrException.log ERROR null:java.lang.AssertionError: core_node19
[junit4] 2> at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 675970 T1917 oasc.SolrException.log ERROR null:org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qn-
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:218)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:215)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:215)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.createData(DistributedQueue.java:284)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:301)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:162)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:156)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleCreateAction(CollectionsHandler.java:290)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:112)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:218)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 675969 T1798 oasc.OverseerCollectionProcessor.processResponse ERROR Error from shard: 127.0.0.1:35561 org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:35561 returned non ok status:500, message:{msg=core_node22,trace=java.lang.AssertionError: core_node22 at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandl
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:156)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:119)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 675966 T1838 oasc.SolrException.log ERROR null:java.lang.AssertionError: core_node4
[junit4] 2> at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 675973 T1798 oasc.OverseerCollectionProcessor.processResponse ERROR Error from shard: 127.0.0.1:35561 org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:35561 returned non ok status:500, message:{msg=core_node7,trace=java.lang.AssertionError: core_node7 at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandle(
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:156)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:119)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 675976 T1798 oasc.OverseerCollectionProcessor.processResponse ERROR Error from shard: 127.0.0.1:35561 org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:35561 returned non ok status:500, message:{msg=core_node12,trace=java.lang.AssertionError: core_node12 at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandl
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:156)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:119)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 675978 T1918 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=5&maxShardsPerNode=6&name=awholynewcollection_0&replicationFactor=5&action=CREATE&wt=javabin&version=2
[junit4] 2> 675980 T1798 oasc.OverseerCollectionProcessor.processResponse ERROR Error from shard: 127.0.0.1:35561 org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:35561 returned non ok status:500, message:{msg=core_node19,trace=java.lang.AssertionError: core_node19 at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandl
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:156)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:119)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 675982 T1798 oasc.OverseerCollectionProcessor.processResponse ERROR Error from shard: 127.0.0.1:35561 org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:35561 returned non ok status:500, message:{msg=core_node4,trace=java.lang.AssertionError: core_node4 at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandle(
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:156)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:119)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 676028 T1855 oaz.ClientCnxn$SendThread.run WARN Session 0x13fcd74c41d000c for server localhost.localdomain/127.0.0.1:41126, unexpected error, closing socket connection and attempting reconnect java.io.IOException: Broken pipe
[junit4] 2> at sun.nio.ch.FileDispatcher.write0(Native Method)
[junit4] 2> at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:29)
[junit4] 2> at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:69)
[junit4] 2> at sun.nio.ch.IOUtil.write(IOUtil.java:40)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:336)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:117)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:355)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 676077 T1797 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 676142 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:35561_",
[junit4] 2> "base_url":"http://127.0.0.1:35561"}
[junit4] 2> 676171 T1926 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 676171 T1922 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 676171 T1928 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 676172 T1924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 676172 T1796 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 676174 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 677261 T1827 oaz.ClientCnxn$SendThread.run WARN Session 0x13fcd74c41d0008 for server localhost.localdomain/127.0.0.1:41126, unexpected error, closing socket connection and attempting reconnect java.io.IOException: Broken pipe
[junit4] 2> at sun.nio.ch.FileDispatcher.write0(Native Method)
[junit4] 2> at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:29)
[junit4] 2> at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:69)
[junit4] 2> at sun.nio.ch.IOUtil.write(IOUtil.java:40)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:336)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:117)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:355)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 677722 T1856 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: null state: Expired type None
[junit4] 2> 677722 T1856 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ed065b1 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:Expired type:None path:null path:null type:None
[junit4] 2> 677722 T1856 oascc.ConnectionManager.process Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
[junit4] 2> 677722 T1856 oascc.DefaultConnectionStrategy.reconnect Connection expired - starting a new one...
[junit4] 2> 677724 T1856 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 677725 T1937 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ed065b1 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 677725 T1856 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 677726 T1856 oascc.ConnectionManager$1.update Connection with ZooKeeper reestablished.
[junit4] 2> 677729 T1856 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 677733 T1856 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39240_
[junit4] 2> 677734 T1856 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39240_
[junit4] 2> 677737 T1924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 677737 T1922 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 677739 T1928 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 677739 T1928 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 677740 T1796 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 677740 T1796 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 677740 T1937 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 677742 T1856 oascc.DefaultConnectionStrategy.reconnect Reconnected to ZooKeeper
[junit4] 2> 677743 T1856 oascc.ConnectionManager.process Connected:true
[junit4] 2> 677743 T1935 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 677744 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 677744 T1926 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 677744 T1926 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 677746 T1924 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 677746 T1922 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 677822 T1851 oasc.CoreContainer.recordAndThrow ERROR Unable to create core: awholynewcollection_0_shard1_replica1 java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 677822 T1850 oasc.SolrException.log ERROR org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qnr-0000000002
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:252)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:249)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:249)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:313)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:162)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:156)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleCreateAction(CollectionsHandler.java:290)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:112)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:218)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 677824 T1851 oasc.SolrException.log ERROR null:java.lang.AssertionError: core_node1
[junit4] 2> at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 677822 T1887 oasc.CoreContainer.recordAndThrow ERROR Unable to create core: awholynewcollection_0_shard4_replica1 java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 677826 T1798 oasc.OverseerCollectionProcessor.processResponse ERROR Error from shard: 127.0.0.1:39240 org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:39240 returned non ok status:500, message:{msg=core_node1,trace=java.lang.AssertionError: core_node1 at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandle(
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:156)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:119)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 677827 T1887 oasc.SolrException.log ERROR null:java.lang.AssertionError: core_node17
[junit4] 2> at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 677822 T1849 oasc.CoreContainer.recordAndThrow ERROR Unable to create core: awholynewcollection_0_shard3_replica1 java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 677822 T1895 oasc.CoreContainer.recordAndThrow ERROR Unable to create core: awholynewcollection_0_shard5_replica1 java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 677822 T1852 oasc.CoreContainer.recordAndThrow ERROR Unable to create core: awholynewcollection_0_shard2_replica1 java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 677832 T1895 oasc.SolrException.log ERROR null:java.lang.AssertionError: core_node21
[junit4] 2> at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 677830 T1849 oasc.SolrException.log ERROR null:java.lang.AssertionError: core_node10
[junit4] 2> at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 677828 T1798 oasc.OverseerCollectionProcessor.processResponse ERROR Error from shard: 127.0.0.1:39240 org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:39240 returned non ok status:500, message:{msg=core_node17,trace=java.lang.AssertionError: core_node17 at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandl
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:156)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:119)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 677824 T1850 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={numShards=5&maxShardsPerNode=6&name=awholynewcollection_0&replicationFactor=5&action=CREATE&wt=javabin&version=2} status=500 QTime=35805
[junit4] 2> 677833 T1852 oasc.SolrException.log ERROR null:java.lang.AssertionError: core_node6
[junit4] 2> at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 677836 T1798 oasc.OverseerCollectionProcessor.processResponse ERROR Error from shard: 127.0.0.1:39240 org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:39240 returned non ok status:500, message:{msg=core_node21,trace=java.lang.AssertionError: core_node21 at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandl
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:156)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:119)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 677836 T1850 oasc.SolrException.log ERROR null:org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qnr-0000000002
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:252)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:249)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:249)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:313)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:162)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:156)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleCreateAction(CollectionsHandler.java:290)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:112)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:218)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 677838 T1798 oasc.OverseerCollectionProcessor.processResponse ERROR Error from shard: 127.0.0.1:39240 org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:39240 returned non ok status:500, message:{msg=core_node10,trace=java.lang.AssertionError: core_node10 at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandl
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:156)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:119)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 677839 T1798 oasc.OverseerCollectionProcessor.processResponse ERROR Error from shard: 127.0.0.1:39240 org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:39240 returned non ok status:500, message:{msg=core_node6,trace=java.lang.AssertionError: core_node6 at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1038) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:531) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandle(
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:156)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:119)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 678519 T1828 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68f2efe4 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:Expired type:None path:null path:null type:None
[junit4] 2> 678520 T1828 oascc.ConnectionManager.process Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
[junit4] 2> 678520 T1828 oascc.DefaultConnectionStrategy.reconnect Connection expired - starting a new one...
[junit4] 2> 678521 T1828 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 678522 T1939 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68f2efe4 name:ZooKeeperConnection Watcher:127.0.0.1:41126/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 678523 T1828 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 678523 T1828 oascc.ConnectionManager$1.update Connection with ZooKeeper reestablished.
[junit4] 2> 678523 T1828 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=down
[junit4] 2> 678526 T1828 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 678529 T1792 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node2, state: down, checkLive: null, onlyIfLeader: null
[junit4] 2> 679220 T1797 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 679222 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 679227 T1928 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 679227 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 679227 T1924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 679227 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 679227 T1926 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 679228 T1796 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 679228 T1922 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 679530 T1792 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node2, state: down, checkLive: null, onlyIfLeader: null for: 1 seconds.
[junit4] 2> 679530 T1792 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node2&state=down&nodeName=127.0.0.1:39844_&action=PREPRECOVERY&core=nodes_used_collection_shard2_replica1&wt=javabin&version=2} status=0 QTime=1001
[junit4] 2> 679535 T1828 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 679539 T1828 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39844_
[junit4] 2> 679540 T1828 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39844_
[junit4] 2> 679542 T1922 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 679543 T1924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 679548 T1926 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 679549 T1926 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4] 2> 679549 T1928 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 679549 T1928 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4] 2> 679550 T1796 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 679550 T1796 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4] 2> 679551 T1939 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 679553 T1935 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 679553 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4] 2> 679554 T1937 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 679554 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4] 2> 679554 T1828 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica2 address:http://127.0.0.1:39844 collection:nodes_used_collection shard:shard2
[junit4] 2> 679554 T1828 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 679569 T1922 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 679569 T1924 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 679578 T1828 oasc.ZkController.register We are http://127.0.0.1:39844/nodes_used_collection_shard2_replica2/ and leader is http://127.0.0.1:37304/nodes_used_collection_shard2_replica1/
[junit4] 2> 679578 T1828 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica2 baseURL=http://127.0.0.1:39844
[junit4] 2> 679578 T1828 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard2_replica2
[junit4] 2> 679578 T1828 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> ASYNC NEW_CORE C12612 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@1953bcfd url=http://127.0.0.1:39844/nodes_used_collection_shard2_replica2 node=127.0.0.1:39844_ C12612_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{state=down, core=nodes_used_collection_shard2_replica2, node_name=127.0.0.1:39844_, base_url=http://127.0.0.1:39844}
[junit4] 2> 679579 T1940 C12612 P39844 oasc.RecoveryStrategy.run Starting recovery process. core=nodes_used_collection_shard2_replica2 recoveringAfterStartup=false
[junit4] 2> 679579 T1940 C12612 P39844 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=recovering
[junit4] 2> 679579 T1828 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 679580 T1940 C12612 P39844 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 679581 T1828 oascc.DefaultConnectionStrategy.reconnect Reconnected to ZooKeeper
[junit4] 2> 679581 T1828 oascc.ConnectionManager.process Connected:true
[junit4] 2> 679583 T1792 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 680005 T1900 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 680006 T1822 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 680006 T1823 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 680007 T1824 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 680007 T1821 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 680013 T1823 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 680013 T1822 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 680013 T1900 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 680014 T1824 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 680017 T1821 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 680019 T1823 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 680020 T1900 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 680020 T1822 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 680020 T1824 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 680023 T1823 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 680023 T1821 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 680024 T1822 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 680024 T1824 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 680024 T1824 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 680023 T1823 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 680023 T1900 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 680025 T1821 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 680026 T1821 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 680025 T1823 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 680025 T1824 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 680024 T1822 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 680026 T1821 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 680025 T1900 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 680027 T1822 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 680028 T1900 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 680029 T1823 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 680029 T1823 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 680029 T1824 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 680030 T1824 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 680030 T1823 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 680031 T1821 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 680031 T1821 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 680031 T1821 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 680030 T1824 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 680032 T1821 oasc.SolrCore.<init> [awholynewcollection_0_shard4_replica3] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard4_replica3/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard4_replica3/data/
[junit4] 2> 680031 T1900 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 680031 T1822 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 680033 T1822 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 680031 T1823 oasc.SolrCore.<init> [awholynewcollection_0_shard3_replica3] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard3_replica3/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard3_replica3/data/
[junit4] 2> 680033 T1822 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 680033 T1900 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 680033 T1821 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2820224a
[junit4] 2> 680032 T1824 oasc.SolrCore.<init> [awholynewcollection_0_shard1_replica3] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard1_replica3/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard1_replica3/data/
[junit4] 2> 680034 T1900 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 680035 T1821 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard4_replica3/data
[junit4] 2> 680034 T1822 oasc.SolrCore.<init> [awholynewcollection_0_shard2_replica3] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard2_replica3/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard2_replica3/data/
[junit4] 2> 680034 T1823 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2820224a
[junit4] 2> 680036 T1822 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2820224a
[junit4] 2> 680036 T1821 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard4_replica3/data/index/
[junit4] 2> 680035 T1900 oasc.SolrCore.<init> [awholynewcollection_0_shard5_replica3] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard5_replica3/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard5_replica3/data/
[junit4] 2> 680037 T1822 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard2_replica3/data
[junit4] 2> 680035 T1824 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2820224a
[junit4] 2> 680037 T1822 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard2_replica3/data/index/
[junit4] 2> 680037 T1900 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2820224a
[junit4] 2> 680037 T1821 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard4_replica3] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard4_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> 680037 T1823 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard3_replica3/data
[junit4] 2> 680039 T1900 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard5_replica3/data
[junit4] 2> 680039 T1900 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard5_replica3/data/index/
[junit4] 2> 680040 T1900 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard5_replica3] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard5_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> 680038 T1824 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard1_replica3/data
[junit4] 2> 680038 T1822 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard2_replica3] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard2_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> 680040 T1824 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard1_replica3/data/index/
[junit4] 2> 680040 T1900 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard5_replica3/data/index
[junit4] 2> 680039 T1821 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard4_replica3/data/index
[junit4] 2> 680039 T1823 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard3_replica3/data/index/
[junit4] 2> 680041 T1824 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard1_replica3] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard1_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> 680041 T1822 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard2_replica3/data/index
[junit4] 2> 680042 T1824 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard1_replica3/data/index
[junit4] 2> 680042 T1823 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard3_replica3] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard3_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> 680043 T1821 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2e9cf74b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f2de5b8),segFN=segments_1,generation=1}
[junit4] 2> 680043 T1900 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c2ade06 lockFactory=org.apache.lucene.store.NativeFSLockFactory@d59adbf),segFN=segments_1,generation=1}
[junit4] 2> 680044 T1900 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 680044 T1821 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 680044 T1823 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard3_replica3/data/index
[junit4] 2> 680045 T1824 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@616653b3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e86b954),segFN=segments_1,generation=1}
[junit4] 2> 680046 T1824 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 680044 T1822 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1235649b lockFactory=org.apache.lucene.store.NativeFSLockFactory@676997c3),segFN=segments_1,generation=1}
[junit4] 2> 680047 T1822 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 680047 T1823 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e38914f lockFactory=org.apache.lucene.store.NativeFSLockFactory@35e30aa1),segFN=segments_1,generation=1}
[junit4] 2> 680047 T1823 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 680048 T1900 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 680049 T1900 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 680049 T1821 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 680049 T1900 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 680050 T1821 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 680050 T1900 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 680051 T1821 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 680051 T1824 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 680051 T1900 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 680052 T1900 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 680052 T1824 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 680052 T1821 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 680052 T1823 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 680053 T1821 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 680052 T1900 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 680052 T1822 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 680054 T1900 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 680054 T1822 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 680053 T1821 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 680053 T1823 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 680053 T1824 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 680055 T1821 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 680055 T1822 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 680054 T1900 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 680056 T1822 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 680056 T1821 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 680057 T1822 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 680058 T1822 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 680056 T1824 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 680056 T1823 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 680059 T1900 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 680059 T1823 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 680059 T1824 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 680059 T1823 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 680058 T1822 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 680057 T1821 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 680060 T1822 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 680060 T1823 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 680059 T1824 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 680061 T1823 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 680061 T1900 oass.SolrIndexSearcher.<init> Opening Searcher@430d075a main
[junit4] 2> 680061 T1822 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 680062 T1823 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 680062 T1824 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 680062 T1821 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 680063 T1822 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 680063 T1824 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 680063 T1823 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 680063 T1900 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 680064 T1824 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 680065 T1900 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 680066 T1823 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 680066 T1821 oass.SolrIndexSearcher.<init> Opening Searcher@1c14ae29 main
[junit4] 2> 680067 T1824 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 680067 T1822 oass.SolrIndexSearcher.<init> Opening Searcher@23930118 main
[junit4] 2> 680067 T1821 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 680068 T1821 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 680068 T1822 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 680069 T1822 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 680069 T1823 oass.SolrIndexSearcher.<init> Opening Searcher@3dbfe3fe main
[junit4] 2> 680070 T1941 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard5_replica3] Registered new searcher Searcher@430d075a main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 680070 T1824 oass.SolrIndexSearcher.<init> Opening Searcher@758e5a14 main
[junit4] 2> 680070 T1823 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 680071 T1823 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 680071 T1824 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 680071 T1824 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 680072 T1900 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard5_replica3
[junit4] 2> 680072 T1900 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard5_replica3 address:http://127.0.0.1:39844 collection:awholynewcollection_0 shard:shard5
[junit4] 2> 680073 T1900 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 680075 T1943 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard2_replica3] Registered new searcher Searcher@23930118 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 680076 T1944 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard3_replica3] Registered new searcher Searcher@3dbfe3fe main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 680076 T1942 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard4_replica3] Registered new searcher Searcher@1c14ae29 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 680078 T1823 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard3_replica3
[junit4] 2> 680078 T1823 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard3_replica3 address:http://127.0.0.1:39844 collection:awholynewcollection_0 shard:shard3
[junit4] 2> 680079 T1823 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 680082 T1821 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard4_replica3
[junit4] 2> 680082 T1821 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard4_replica3 address:http://127.0.0.1:39844 collection:awholynewcollection_0 shard:shard4
[junit4] 2> 680082 T1822 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard2_replica3
[junit4] 2> 680083 T1821 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 680083 T1822 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard2_replica3 address:http://127.0.0.1:39844 collection:awholynewcollection_0 shard:shard2
[junit4] 2> 680084 T1822 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 680084 T1945 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard1_replica3] Registered new searcher Searcher@758e5a14 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 680086 T1824 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard1_replica3
[junit4] 2> 680086 T1824 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard1_replica3 address:http://127.0.0.1:39844 collection:awholynewcollection_0 shard:shard1
[junit4] 2> 680087 T1824 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4] 2> 680741 T1797 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 680744 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 680750 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 680750 T1796 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 680750 T1926 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 680751 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 680751 T1922 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 680751 T1939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 680751 T1928 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 680752 T1924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 681584 T1792 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4] 2> 681584 T1792 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node2&state=recovering&nodeName=127.0.0.1:39844_&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard2_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2001
[junit4] 2> C12612_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{state=recovering, core=nodes_used_collection_shard2_replica2, node_name=127.0.0.1:39844_, base_url=http://127.0.0.1:39844}
[junit4] 2> 683585 T1940 C12612 P39844 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:37304/nodes_used_collection_shard2_replica1/ core=nodes_used_collection_shard2_replica2 - recoveringAfterStartup=false
[junit4] 2> 683585 T1940 C12612 P39844 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:39844 START replicas=[http://127.0.0.1:37304/nodes_used_collection_shard2_replica1/] nUpdates=100
[junit4] 2> 683586 T1940 C12612 P39844 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 683586 T1940 C12612 P39844 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=nodes_used_collection_shard2_replica2
[junit4] 2> 683586 T1940 C12612 P39844 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=nodes_used_collection_shard2_replica2
[junit4] 2> 683586 T1940 C12612 P39844 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=nodes_used_collection_shard2_replica2
[junit4] 2> 683587 T1940 C12612 P39844 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 683587 T1940 C12612 P39844 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:37304/nodes_used_collection_shard2_replica1/. core=nodes_used_collection_shard2_replica2
[junit4] 2> 683587 T1940 C12612 P39844 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> ASYNC NEW_CORE C12613 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@52d552ab url=http://127.0.0.1:37304/nodes_used_collection_shard2_replica1 node=127.0.0.1:37304_ C12613_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{state=active, core=nodes_used_collection_shard2_replica1, node_name=127.0.0.1:37304_, base_url=http://127.0.0.1:37304, leader=true}
[junit4] 2> 683587 T1792 C12613 P37304 oasc.SolrCore.execute [nodes_used_collection_shard2_replica1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4] 2> 683592 T1913 C12613 P37304 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 683592 T1913 C12613 P37304 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 683592 T1913 C12613 P37304 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 683593 T1913 C12613 P37304 oasup.LogUpdateProcessor.finish [nodes_used_collection_shard2_replica1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 1
[junit4] 2> 683593 T1940 C12612 P39844 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 683595 T1913 C12613 P37304 oasc.SolrCore.execute [nodes_used_collection_shard2_replica1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 683595 T1940 C12612 P39844 oasc.RecoveryStrategy.replay No replay needed. core=nodes_used_collection_shard2_replica2
[junit4] 2> 683595 T1940 C12612 P39844 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=nodes_used_collection_shard2_replica2
[junit4] 2> 683595 T1940 C12612 P39844 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=active
[junit4] 2> 683597 T1940 C12612 P39844 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=nodes_used_collection_shard2_replica2
[junit4] 2> 683771 T1797 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 683773 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 683780 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 683780 T1939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 683780 T1924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 683780 T1926 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 683780 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 683780 T1928 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 683780 T1922 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 683781 T1796 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 694270 T1814 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=159950
[junit4] 2> 694851 T1903 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard5: total=5 found=2 timeoutin=159948
[junit4] 2> 694852 T1791 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard1: total=4 found=2 timeoutin=159949
[junit4] 2> 694852 T1789 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard2: total=5 found=2 timeoutin=159950
[junit4] 2> 694861 T1790 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard3: total=5 found=2 timeoutin=159955
[junit4] 2> 694863 T1893 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard4: total=5 found=2 timeoutin=159955
[junit4] 2> 696012 T1842 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=159952
[junit4] 2> 705979 T1911 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=5&maxShardsPerNode=6&name=awholynewcollection_0&replicationFactor=5&action=CREATE&wt=javabin&version=2
[junit4] 2> 714317 T1814 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=139903
[junit4] 2> 714903 T1903 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard5: total=5 found=2 timeoutin=139896
[junit4] 2> 714905 T1791 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard1: total=4 found=2 timeoutin=139896
[junit4] 2> 714904 T1789 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard2: total=5 found=2 timeoutin=139898
[junit4] 2> 715062 T1790 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard3: total=5 found=2 timeoutin=139754
[junit4] 2> 715065 T1893 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard4: total=5 found=2 timeoutin=139753
[junit4] 2> 716069 T1842 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=139895
[junit4] 2> 734367 T1814 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=119853
[junit4] 2> 734961 T1903 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard5: total=5 found=2 timeoutin=119838
[junit4] 2> 734962 T1789 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard2: total=5 found=2 timeoutin=119840
[junit4] 2> 734962 T1791 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard1: total=4 found=2 timeoutin=119839
[junit4] 2> 735115 T1790 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard3: total=5 found=2 timeoutin=119701
[junit4] 2> 735121 T1893 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard4: total=5 found=2 timeoutin=119697
[junit4] 2> 735989 T1796 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work/qnr-0000000004 state: SyncConnected type NodeDeleted
[junit4] 2> 735989 T1918 oasc.SolrException.log ERROR org.apache.solr.common.SolrException: createcollection the collection time out:60s
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:175)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:156)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleCreateAction(CollectionsHandler.java:290)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:112)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:218)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 735992 T1918 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={numShards=5&maxShardsPerNode=6&name=awholynewcollection_0&replicationFactor=5&action=CREATE&wt=javabin&version=2} status=500 QTime=60014
[junit4] 2> 735992 T1918 oasc.SolrException.log ERROR null:org.apache.solr.common.SolrException: createcollection the collection time out:60s
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:175)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:156)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleCreateAction(CollectionsHandler.java:290)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:112)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:218)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 736024 T1774 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 37304
[junit4] 2> 736025 T1774 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=549098857
[junit4] 2> 736118 T1842 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=119846
[junit4] 2> 736390 T1797 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 736392 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"nodes_used_collection_shard2_replica1",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "node_name":"127.0.0.1:37304_",
[junit4] 2> "base_url":"http://127.0.0.1:37304"}
[junit4] 2> 736392 T1797 oasc.Overseer$ClusterStateUpdater.updateState shard=shard2 is already registered
[junit4] 2> 736399 T1796 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 736399 T1939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 736399 T1928 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 736399 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 736400 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 738028 T1774 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=down
[junit4] 2> 738030 T1774 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica5 state=down
[junit4] 2> 738032 T1774 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica5 state=down
[junit4] 2> 738033 T1774 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica5 state=down
[junit4] 2> 738035 T1774 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica5 state=down
[junit4] 2> 738036 T1774 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica5 state=down
[junit4] 2> 738045 T1774 oasc.SolrCore.close [nodes_used_collection_shard2_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@52d552ab
[junit4] 2> 738062 T1774 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=2,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 738062 T1774 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 738062 T1774 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 738063 T1774 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 738066 T1774 oasc.SolrCore.closeSearcher [nodes_used_collection_shard2_replica1] Closing main searcher on request.
[junit4] 2> 738067 T1774 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 738067 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/nodes_used_collection_shard2_replica1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/nodes_used_collection_shard2_replica1/data;done=false>>]
[junit4] 2> 738068 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/nodes_used_collection_shard2_replica1/data
[junit4] 2> 738068 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/nodes_used_collection_shard2_replica1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/nodes_used_collection_shard2_replica1/data/index;done=false>>]
[junit4] 2> 738068 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/nodes_used_collection_shard2_replica1/data/index
[junit4] 2> 738069 T1774 oasc.SolrCore.close [awholynewcollection_0_shard2_replica5] CLOSING SolrCore org.apache.solr.core.SolrCore@5c4c2306
[junit4] 2> 738124 T1790 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica5 state=down
[junit4] 2> 738125 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 738127 T1790 oasc.SolrException.log ERROR :org.apache.solr.common.SolrException: Fatal Error, SolrCore not found:awholynewcollection_0_shard3_replica5 in []
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:266)
[junit4] 2> at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:937)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:758)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:723)
[junit4] 2> at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:286)
[junit4] 2> at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:599)
[junit4] 2> at org.apache.solr.core.CoreContainer.register(CoreContainer.java:622)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:525)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 738128 T1774 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 738129 T1790 oasc.ElectionContext.cancelElection WARN cancelElection did not find election node to remove
[junit4] 2> 738128 T1939 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4] 2> 738129 T1939 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4] 2> 738130 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 738129 T1774 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 738130 T1893 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica5 state=down
[junit4] 2> 738130 T1939 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:39844/awholynewcollection_0_shard3_replica3/
[junit4] 2> 738130 T1774 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 738131 T1774 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 738131 T1939 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard3_replica3 url=http://127.0.0.1:39844 START replicas=[http://127.0.0.1:39240/awholynewcollection_0_shard3_replica1/, http://127.0.0.1:35561/awholynewcollection_0_shard3_replica2/, http://127.0.0.1:56131/awholynewcollection_0_shard3_replica4/, http://127.0.0.1:37304/awholynewcollection_0_shard3_replica5/] nUpdates=100
[junit4] 2> 738132 T1774 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard2_replica5] Closing main searcher on request.
[junit4] 2> 738133 T1774 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 738131 T1790 oasc.SolrException.log ERROR org.apache.solr.common.SolrException: Error CREATEing SolrCore 'awholynewcollection_0_shard3_replica5': Caused by: Fatal Error, SolrCore not found:awholynewcollection_0_shard3_replica5 in []
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:554)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: org.apache.solr.common.cloud.ZooKeeperException:
[junit4] 2> at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:309)
[junit4] 2> at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:599)
[junit4] 2> at org.apache.solr.core.CoreContainer.register(CoreContainer.java:622)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:525)
[junit4] 2> ... 30 more
[junit4] 2> Caused by: org.apache.solr.common.SolrException: Fatal Error, SolrCore not found:awholynewcollection_0_shard3_replica5 in []
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:266)
[junit4] 2> at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:937)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:758)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:723)
[junit4] 2> at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:286)
[junit4] 2> ... 33 more
[junit4] 2>
[junit4] 2> 738133 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard2_replica5/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard2_replica5/data/index;done=false>>]
[junit4] 2> 738135 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard2_replica5/data/index
[junit4] 2> 738133 T1939 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard3_replica3 url=http://127.0.0.1:39844 DONE. We have no versions. sync failed.
[junit4] 2> 738135 T1939 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 738133 T1893 oasc.SolrException.log ERROR :org.apache.solr.common.SolrException: Fatal Error, SolrCore not found:awholynewcollection_0_shard4_replica5 in []
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:266)
[junit4] 2> at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:937)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:758)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:723)
[junit4] 2> at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:286)
[junit4] 2> at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:599)
[junit4] 2> at org.apache.solr.core.CoreContainer.register(CoreContainer.java:622)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:525)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 738136 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 738135 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard2_replica5/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard2_replica5/data;done=false>>]
[junit4] 2> 738137 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard2_replica5/data
[junit4] 2> 738134 T1790 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard3&name=awholynewcollection_0_shard3_replica5&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=400 QTime=96098
[junit4] 2> 738138 T1774 oasc.SolrCore.close [awholynewcollection_0_shard1_replica5] CLOSING SolrCore org.apache.solr.core.SolrCore@23b05b78
[junit4] 2> 738137 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:39844/awholynewcollection_0_shard3_replica3/ shard3
[junit4] 2> 738172 T1939 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leaders/shard3
[junit4] 2> 738171 T1798 oasc.OverseerCollectionProcessor.processResponse ERROR Error from shard: 127.0.0.1:37304 org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Error CREATEing SolrCore 'awholynewcollection_0_shard3_replica5': Caused by: Fatal Error, SolrCore not found:awholynewcollection_0_shard3_replica5 in []
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:424)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:156)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:119)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 738138 T1893 oasc.ElectionContext.cancelElection WARN cancelElection did not find election node to remove
[junit4] 2> 738175 T1893 oasc.SolrException.log ERROR org.apache.solr.common.SolrException: Error CREATEing SolrCore 'awholynewcollection_0_shard4_replica5': Caused by: Fatal Error, SolrCore not found:awholynewcollection_0_shard4_replica5 in []
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:554)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: org.apache.solr.common.cloud.ZooKeeperException:
[junit4] 2> at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:309)
[junit4] 2> at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:599)
[junit4] 2> at org.apache.solr.core.CoreContainer.register(CoreContainer.java:622)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:525)
[junit4] 2> ... 30 more
[junit4] 2> Caused by: org.apache.solr.common.SolrException: Fatal Error, SolrCore not found:awholynewcollection_0_shard4_replica5 in []
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:266)
[junit4] 2> at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:937)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:758)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:723)
[junit4] 2> at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:286)
[junit4] 2> ... 33 more
[junit4] 2>
[junit4] 2> 738176 T1893 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard4&name=awholynewcollection_0_shard4_replica5&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=400 QTime=96134
[junit4] 2> 738179 T1798 oasc.OverseerCollectionProcessor.processResponse ERROR Error from shard: 127.0.0.1:37304 org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Error CREATEing SolrCore 'awholynewcollection_0_shard4_replica5': Caused by: Fatal Error, SolrCore not found:awholynewcollection_0_shard4_replica5 in []
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:424)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:156)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:119)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 738180 T1808 oasc.SolrException.log ERROR null:org.apache.solr.common.SolrException: SolrCore 'awholynewcollection_0_shard3_replica4' is not available due to init failure: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:903)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:250)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> ... 26 more
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 738185 T1897 oasc.SolrException.log ERROR null:org.apache.solr.common.SolrException: SolrCore 'awholynewcollection_0_shard3_replica2' is not available due to init failure: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:903)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:250)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> ... 26 more
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 738181 T1850 oasc.SolrException.log ERROR null:org.apache.solr.common.SolrException: SolrCore 'awholynewcollection_0_shard3_replica1' is not available due to init failure: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:903)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:250)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> ... 26 more
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 738191 T1774 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 738192 T1774 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 738192 T1774 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 738193 T1774 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 738193 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard4
[junit4] 2> 738193 T1774 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard1_replica5] Closing main searcher on request.
[junit4] 2> 738194 T1774 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 738194 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard1_replica5/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard1_replica5/data/index;done=false>>]
[junit4] 2> 738195 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard1_replica5/data/index
[junit4] 2> 738195 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard1_replica5/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard1_replica5/data;done=false>>]
[junit4] 2> 738196 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard1_replica5/data
[junit4] 2> 738196 T1939 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4] 2> 738196 T1939 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4] 2> 738197 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 738196 T1774 oasc.SolrCore.close [awholynewcollection_0_shard5_replica5] CLOSING SolrCore org.apache.solr.core.SolrCore@a8f8e41
[junit4] 2> 738197 T1939 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:39844/awholynewcollection_0_shard4_replica3/
[junit4] 2> 738197 T1939 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard4_replica3 url=http://127.0.0.1:39844 START replicas=[http://127.0.0.1:39240/awholynewcollection_0_shard4_replica1/, http://127.0.0.1:56131/awholynewcollection_0_shard4_replica4/, http://127.0.0.1:35561/awholynewcollection_0_shard4_replica2/, http://127.0.0.1:37304/awholynewcollection_0_shard4_replica5/] nUpdates=100
[junit4] 2> 738198 T1939 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard4_replica3 url=http://127.0.0.1:39844 DONE. We have no versions. sync failed.
[junit4] 2> 738198 T1939 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 738198 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 738199 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:39844/awholynewcollection_0_shard4_replica3/ shard4
[junit4] 2> 738199 T1939 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leaders/shard4
[junit4] 2> 738201 T1807 oasc.SolrException.log ERROR null:org.apache.solr.common.SolrException: SolrCore 'awholynewcollection_0_shard4_replica4' is not available due to init failure: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:903)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:250)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> ... 26 more
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 738202 T1909 oasc.SolrException.log ERROR null:org.apache.solr.common.SolrException: SolrCore 'awholynewcollection_0_shard4_replica1' is not available due to init failure: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:903)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:250)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> ... 26 more
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 738202 T1917 oasc.SolrException.log ERROR null:org.apache.solr.common.SolrException: SolrCore 'awholynewcollection_0_shard4_replica2' is not available due to init failure: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:903)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:250)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> ... 26 more
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 738210 T1774 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 738211 T1774 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 738211 T1774 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 738211 T1774 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 738212 T1774 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard5_replica5] Closing main searcher on request.
[junit4] 2> 738213 T1774 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 738213 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard5_replica5/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard5_replica5/data/index;done=false>>]
[junit4] 2> 738213 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard5_replica5/data/index
[junit4] 2> 738214 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard5_replica5/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard5_replica5/data;done=false>>]
[junit4] 2> 738214 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard5_replica5/data
[junit4] 2> 738214 T1774 oasc.SolrCore.close [awholynewcollection_0_shard4_replica5] CLOSING SolrCore org.apache.solr.core.SolrCore@48bf833a
[junit4] 2> 738222 T1774 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 738223 T1774 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 738223 T1774 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 738223 T1774 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 738224 T1774 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard4_replica5] Closing main searcher on request.
[junit4] 2> 738224 T1774 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 738225 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard4_replica5/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard4_replica5/data;done=false>>]
[junit4] 2> 738225 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard4_replica5/data
[junit4] 2> 738225 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard4_replica5/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard4_replica5/data/index;done=false>>]
[junit4] 2> 738226 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard4_replica5/data/index
[junit4] 2> 738226 T1774 oasc.SolrCore.close [awholynewcollection_0_shard3_replica5] CLOSING SolrCore org.apache.solr.core.SolrCore@255275fa
[junit4] 2> 738233 T1774 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 738234 T1774 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 738234 T1774 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 738234 T1774 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 738235 T1774 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard3_replica5] Closing main searcher on request.
[junit4] 2> 738235 T1774 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 738236 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard3_replica5/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard3_replica5/data/index;done=false>>]
[junit4] 2> 738236 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard3_replica5/data/index
[junit4] 2> 738236 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard3_replica5/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard3_replica5/data;done=false>>]
[junit4] 2> 738236 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1373541549354/awholynewcollection_0_shard3_replica5/data
[junit4] 2> 738472 T1903 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica5 state=down
[junit4] 2> 738473 T1791 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica5 state=down
[junit4] 2> 738474 T1789 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica5 state=down
[junit4] 2> 738475 T1903 oasc.SolrException.log ERROR :org.apache.solr.common.SolrException: Fatal Error, SolrCore not found:awholynewcollection_0_shard5_replica5 in []
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:266)
[junit4] 2> at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:937)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:758)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:723)
[junit4] 2> at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:286)
[junit4] 2> at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:599)
[junit4] 2> at org.apache.solr.core.CoreContainer.register(CoreContainer.java:622)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:525)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 738476 T1791 oasc.SolrException.log ERROR :org.apache.solr.common.SolrException: Fatal Error, SolrCore not found:awholynewcollection_0_shard1_replica5 in []
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:266)
[junit4] 2> at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:937)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:758)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:723)
[junit4] 2> at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:286)
[junit4] 2> at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:599)
[junit4] 2> at org.apache.solr.core.CoreContainer.register(CoreContainer.java:622)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:525)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 738477 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard5
[junit4] 2> 738477 T1789 oasc.SolrException.log ERROR :org.apache.solr.common.SolrException: Fatal Error, SolrCore not found:awholynewcollection_0_shard2_replica5 in []
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:266)
[junit4] 2> at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:937)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:758)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:723)
[junit4] 2> at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:286)
[junit4] 2> at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:599)
[junit4] 2> at org.apache.solr.core.CoreContainer.register(CoreContainer.java:622)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:525)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 738479 T1903 oasc.ElectionContext.cancelElection WARN cancelElection did not find election node to remove
[junit4] 2> 738480 T1791 oasc.ElectionContext.cancelElection WARN cancelElection did not find election node to remove
[junit4] 2> 738480 T1789 oasc.ElectionContext.cancelElection WARN cancelElection did not find election node to remove
[junit4] 2> 738482 T1903 oasc.SolrException.log ERROR org.apache.solr.common.SolrException: Error CREATEing SolrCore 'awholynewcollection_0_shard5_replica5': Caused by: Fatal Error, SolrCore not found:awholynewcollection_0_shard5_replica5 in []
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:554)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: org.apache.solr.common.cloud.ZooKeeperException:
[junit4] 2> at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:309)
[junit4] 2> at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:599)
[junit4] 2> at org.apache.solr.core.CoreContainer.register(CoreContainer.java:622)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:525)
[junit4] 2> ... 30 more
[junit4] 2> Caused by: org.apache.solr.common.SolrException: Fatal Error, SolrCore not found:awholynewcollection_0_shard5_replica5 in []
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:266)
[junit4] 2> at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:937)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:758)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:723)
[junit4] 2> at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:286)
[junit4] 2> ... 33 more
[junit4] 2>
[junit4] 2> 738482 T1939 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4] 2> 738483 T1789 oasc.SolrException.log ERROR org.apache.solr.common.SolrException: Error CREATEing SolrCore 'awholynewcollection_0_shard2_replica5': Caused by: Fatal Error, SolrCore not found:awholynewcollection_0_shard2_replica5 in []
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:554)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: org.apache.solr.common.cloud.ZooKeeperException:
[junit4] 2> at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:309)
[junit4] 2> at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:599)
[junit4] 2> at org.apache.solr.core.CoreContainer.register(CoreContainer.java:622)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:525)
[junit4] 2> ... 30 more
[junit4] 2> Caused by: org.apache.solr.common.SolrException: Fatal Error, SolrCore not found:awholynewcollection_0_shard2_replica5 in []
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:266)
[junit4] 2> at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:937)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:758)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:723)
[junit4] 2> at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:286)
[junit4] 2> ... 33 more
[junit4] 2>
[junit4] 2> 738483 T1791 oasc.SolrException.log ERROR org.apache.solr.common.SolrException: Error CREATEing SolrCore 'awholynewcollection_0_shard1_replica5': Caused by: Fatal Error, SolrCore not found:awholynewcollection_0_shard1_replica5 in []
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:554)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: org.apache.solr.common.cloud.ZooKeeperException:
[junit4] 2> at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:309)
[junit4] 2> at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:599)
[junit4] 2> at org.apache.solr.core.CoreContainer.register(CoreContainer.java:622)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:525)
[junit4] 2> ... 30 more
[junit4] 2> Caused by: org.apache.solr.common.SolrException: Fatal Error, SolrCore not found:awholynewcollection_0_shard1_replica5 in []
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:163)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:266)
[junit4] 2> at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:937)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:758)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:723)
[junit4] 2> at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:286)
[junit4] 2> ... 33 more
[junit4] 2>
[junit4] 2> 738483 T1939 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4] 2> 738484 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 738482 T1903 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard5&name=awholynewcollection_0_shard5_replica5&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=400 QTime=96436
[junit4] 2> 738485 T1939 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:39844/awholynewcollection_0_shard5_replica3/
[junit4] 2> 738484 T1791 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard1&name=awholynewcollection_0_shard1_replica5&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=400 QTime=96458
[junit4] 2> 738484 T1789 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard2&name=awholynewcollection_0_shard2_replica5&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=400 QTime=96451
[junit4] 2> 738485 T1939 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard5_replica3 url=http://127.0.0.1:39844 START replicas=[http://127.0.0.1:39240/awholynewcollection_0_shard5_replica1/, http://127.0.0.1:35561/awholynewcollection_0_shard5_replica2/, http://127.0.0.1:56131/awholynewcollection_0_shard5_replica4/, http://127.0.0.1:37304/awholynewcollection_0_shard5_replica5/] nUpdates=100
[junit4] 2> 738489 T1939 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard5_replica3 url=http://127.0.0.1:39844 DONE. We have no versions. sync failed.
[junit4] 2> 738489 T1939 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 738489 T1798 oasc.OverseerCollectionProcessor.processResponse ERROR Error from shard: 127.0.0.1:37304 org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Error CREATEing SolrCore 'awholynewcollection_0_shard1_replica5': Caused by: Fatal Error, SolrCore not found:awholynewcollection_0_shard1_replica5 in []
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:424)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:156)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:119)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 738492 T1838 oasc.SolrException.log ERROR null:org.apache.solr.common.SolrException: SolrCore 'awholynewcollection_0_shard5_replica2' is not available due to init failure: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:903)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:250)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> ... 26 more
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 738493 T1901 oasc.SolrException.log ERROR null:org.apache.solr.common.SolrException: SolrCore 'awholynewcollection_0_shard5_replica4' is not available due to init failure: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:903)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:250)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> ... 26 more
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 738492 T1798 oasc.OverseerCollectionProcessor.processResponse ERROR Error from shard: 127.0.0.1:37304 org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Error CREATEing SolrCore 'awholynewcollection_0_shard5_replica5': Caused by: Fatal Error, SolrCore not found:awholynewcollection_0_shard5_replica5 in []
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:424)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:156)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:119)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 738495 T1798 oasc.OverseerCollectionProcessor.processResponse ERROR Error from shard: 127.0.0.1:37304 org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Error CREATEing SolrCore 'awholynewcollection_0_shard2_replica5': Caused by: Fatal Error, SolrCore not found:awholynewcollection_0_shard2_replica5 in []
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:424)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:156)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:119)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
[junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 738492 T1851 oasc.SolrException.log ERROR null:org.apache.solr.common.SolrException: SolrCore 'awholynewcollection_0_shard5_replica1' is not available due to init failure: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:903)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:250)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> ... 26 more
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 738489 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 738498 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:39844/awholynewcollection_0_shard5_replica3/ shard5
[junit4] 2> 738498 T1939 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leaders/shard5
[junit4] 2> 738508 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 738512 T1939 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4] 2> 738512 T1939 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4] 2> 738512 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 738513 T1939 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:39844/awholynewcollection_0_shard1_replica3/
[junit4] 2> 738513 T1939 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard1_replica3 url=http://127.0.0.1:39844 START replicas=[http://127.0.0.1:39240/awholynewcollection_0_shard1_replica1/, http://127.0.0.1:35561/awholynewcollection_0_shard1_replica2/, http://127.0.0.1:37304/awholynewcollection_0_shard1_replica5/] nUpdates=100
[junit4] 2> 738514 T1939 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard1_replica3 url=http://127.0.0.1:39844 DONE. We have no versions. sync failed.
[junit4] 2> 738514 T1939 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 738514 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 738514 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:39844/awholynewcollection_0_shard1_replica3/ shard1
[junit4] 2> 738515 T1939 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leaders/shard1
[junit4] 2> 738519 T1887 oasc.SolrException.log ERROR null:org.apache.solr.common.SolrException: SolrCore 'awholynewcollection_0_shard1_replica1' is not available due to init failure: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:903)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:250)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> ... 26 more
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 738519 T1910 oasc.SolrException.log ERROR null:org.apache.solr.common.SolrException: SolrCore 'awholynewcollection_0_shard1_replica2' is not available due to init failure: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:903)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:250)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> ... 26 more
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 738527 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 738530 T1939 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4] 2> 738530 T1939 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4] 2> 738531 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 738531 T1939 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:39844/awholynewcollection_0_shard2_replica3/
[junit4] 2> 738531 T1939 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard2_replica3 url=http://127.0.0.1:39844 START replicas=[http://127.0.0.1:39240/awholynewcollection_0_shard2_replica1/, http://127.0.0.1:35561/awholynewcollection_0_shard2_replica2/, http://127.0.0.1:56131/awholynewcollection_0_shard2_replica4/, http://127.0.0.1:37304/awholynewcollection_0_shard2_replica5/] nUpdates=100
[junit4] 2> 738532 T1939 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard2_replica3 url=http://127.0.0.1:39844 DONE. We have no versions. sync failed.
[junit4] 2> 738532 T1939 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 738532 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 738532 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:39844/awholynewcollection_0_shard2_replica3/ shard2
[junit4] 2> 738532 T1939 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leaders/shard2
[junit4] 2> 738536 T1809 oasc.SolrException.log ERROR null:org.apache.solr.common.SolrException: SolrCore 'awholynewcollection_0_shard2_replica4' is not available due to init failure: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:903)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:250)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> ... 26 more
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 738539 T1852 oasc.SolrException.log ERROR null:org.apache.solr.common.SolrException: SolrCore 'awholynewcollection_0_shard2_replica1' is not available due to init failure: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:903)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:250)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> ... 26 more
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 738540 T1836 oasc.SolrException.log ERROR null:org.apache.solr.common.SolrException: SolrCore 'awholynewcollection_0_shard2_replica2' is not available due to init failure: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:903)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:250)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> Caused by: java.lang.RuntimeException: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:167)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.create(IndexSchemaFactory.java:55)
[junit4] 2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:69)
[junit4] 2> at org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:268)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:698)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:523)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:618)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:209)
[junit4] 2> ... 26 more
[junit4] 2> Caused by: java.io.IOException: Error opening /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getLines(AbstractAnalysisFactory.java:255)
[junit4] 2> at org.apache.lucene.analysis.util.AbstractAnalysisFactory.getWordSet(AbstractAnalysisFactory.java:243)
[junit4] 2> at org.apache.lucene.analysis.core.StopFilterFactory.inform(StopFilterFactory.java:66)
[junit4] 2> at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:625)
[junit4] 2> at org.apache.solr.schema.IndexSchema.<init>(IndexSchema.java:165)
[junit4] 2> ... 35 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /configs/conf1/stopwords.txt
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:201)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:198)
[junit4] 2> at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:684)
[junit4] 2> at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
[junit4] 2> ... 40 more
[junit4] 2>
[junit4] 2> 739413 T1797 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 739415 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard2_replica1",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:37304_",
[junit4] 2> "base_url":"http://127.0.0.1:37304"}
[junit4] 2> 739421 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node11",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:37304_",
[junit4] 2> "base_url":"http://127.0.0.1:37304"}
[junit4] 2> 739426 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node5",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:37304_",
[junit4] 2> "base_url":"http://127.0.0.1:37304"}
[junit4] 2> 739431 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node25",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:37304_",
[junit4] 2> "base_url":"http://127.0.0.1:37304"}
[junit4] 2> 739436 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node20",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:37304_",
[junit4] 2> "base_url":"http://127.0.0.1:37304"}
[junit4] 2> 739441 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node15",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:37304_",
[junit4] 2> "base_url":"http://127.0.0.1:37304"}
[junit4] 2> 739447 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node15",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:37304_",
[junit4] 2> "base_url":"http://127.0.0.1:37304"}
[junit4] 2> 739462 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node20",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:37304_",
[junit4] 2> "base_url":"http://127.0.0.1:37304"}
[junit4] 2> 739487 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node25",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:37304_",
[junit4] 2> "base_url":"http://127.0.0.1:37304"}
[junit4] 2> 739492 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node5",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:37304_",
[junit4] 2> "base_url":"http://127.0.0.1:37304"}
[junit4] 2> 739497 T1797 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node11",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica5",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:37304_",
[junit4] 2> "base_url":"http://127.0.0.1:37304"}
[junit4] 2> 739547 T1939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 739547 T1928 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 739547 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 739547 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 739548 T1796 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 739576 T1900 oasc.ZkController.register We are http://127.0.0.1:39844/awholynewcollection_0_shard5_replica3/ and leader is http://127.0.0.1:39844/awholynewcollection_0_shard5_replica3/
[junit4] 2> 739576 T1900 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard5_replica3 baseURL=http://127.0.0.1:39844
[junit4] 2> 739577 T1900 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 739577 T1900 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica3 state=active
[junit4] 2> 739577 T1823 oasc.ZkController.register We are http://127.0.0.1:39844/awholynewcollection_0_shard3_replica3/ and leader is http://127.0.0.1:39844/awholynewcollection_0_shard3_replica3/
[junit4] 2> 739577 T1822 oasc.ZkController.register We are http://127.0.0.1:39844/awholynewcollection_0_shard2_replica3/ and leader is http://127.0.0.1:39844/awholynewcollection_0_shard2_replica3/
[junit4] 2> 739578 T1823 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard3_replica3 baseURL=http://127.0.0.1:39844
[junit4] 2> 739578 T1823 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 739578 T1821 oasc.ZkController.register We are http://127.0.0.1:39844/awholynewcollection_0_shard4_replica3/ and leader is http://127.0.0.1:39844/awholynewcollection_0_shard4_replica3/
[junit4] 2> 739578 T1824 oasc.ZkController.register We are http://127.0.0.1:39844/awholynewcollection_0_shard1_replica3/ and leader is http://127.0.0.1:39844/awholynewcollection_0_shard1_replica3/
[junit4] 2> 739579 T1821 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard4_replica3 baseURL=http://127.0.0.1:39844
[junit4] 2> 739580 T1821 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 739579 T1823 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica3 state=active
[junit4] 2> 739578 T1822 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard2_replica3 baseURL=http://127.0.0.1:39844
[junit4] 2> 739581 T1822 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 739580 T1821 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica3 state=active
[junit4] 2> 739580 T1900 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 739579 T1824 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard1_replica3 baseURL=http://127.0.0.1:39844
[junit4] 2> 739582 T1824 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 739581 T1822 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica3 state=active
[junit4] 2> 739582 T1824 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica3 state=active
[junit4] 2> 739585 T1900 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard5&name=awholynewcollection_0_shard5_replica3&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=97540
[junit4] 2> 739587 T1821 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 739588 T1821 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard4&name=awholynewcollection_0_shard4_replica3&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=97549
[junit4] 2> 739589 T1823 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 739591 T1823 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard3&name=awholynewcollection_0_shard3_replica3&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=97556
[junit4] 2> 739592 T1824 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 739593 T1824 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard1&name=awholynewcollection_0_shard1_replica3&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=97568
[junit4] 2> 739596 T1822 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 739597 T1822 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=5&shard=shard2&name=awholynewcollection_0_shard2_replica3&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=97568
[junit4] 2> 739599 T1798 oasc.OverseerCollectionProcessor.createCollection Finished create command on all shards for collection: awholynewcollection_0
[junit4] 2> 739606 T1935 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 739606 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739608 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 739608 T1937 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 739608 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739610 T1928 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 739614 T1939 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4] 2> 739615 T1939 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4] 2> 739615 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 739615 T1939 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:39844/nodes_used_collection_shard2_replica2/
[junit4] 2> 739615 T1939 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:39844 START replicas=[http://127.0.0.1:37304/nodes_used_collection_shard2_replica1/] nUpdates=100
[junit4] 2> 739616 T1928 oasc.Overseer.start Overseer (id=90016418960834578-127.0.0.1:56131_-n_0000000005) starting
[junit4] 2> 739619 T1939 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:39844 DONE. We have no versions. sync failed.
[junit4] 2> 739620 T1939 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 739620 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 739620 T1939 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:39844/nodes_used_collection_shard2_replica2/ shard2
[junit4] 2> 739621 T1939 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard2
[junit4] 2> 739629 T1969 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 739630 T1928 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 739630 T1928 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739631 T1774 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4] 2> 739634 T1939 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 739635 T1939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739635 T1969 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000002 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "numShards":"5",
[junit4] 2> "maxShardsPerNode":"6",
[junit4] 2> "createNodeSet":null,
[junit4] 2> "name":"awholynewcollection_0",
[junit4] 2> "replicationFactor":"5"}
[junit4] 2> 739635 T1969 oasc.SolrException.log ERROR Collection createcollection of createcollection failed:org.apache.solr.common.SolrException: collection already exists: awholynewcollection_0
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.createCollection(OverseerCollectionProcessor.java:700)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.processMessage(OverseerCollectionProcessor.java:167)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:119)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 739637 T1968 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 739638 T1968 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4] 2> 739640 T1939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739640 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739640 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739640 T1928 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739649 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739649 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739649 T1939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739657 T1969 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000002 complete, response:{Operation createcollection caused exception:=org.apache.solr.common.SolrException: collection already exists: awholynewcollection_0,exception={msg=collection already exists: awholynewcollection_0,rspCode=400}}
[junit4] 2> 739660 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739660 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739660 T1939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739663 T1969 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000004 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "numShards":"5",
[junit4] 2> "maxShardsPerNode":"6",
[junit4] 2> "createNodeSet":null,
[junit4] 2> "name":"awholynewcollection_0",
[junit4] 2> "replicationFactor":"5"}
[junit4] 2> 739663 T1969 oasc.SolrException.log ERROR Collection createcollection of createcollection failed:org.apache.solr.common.SolrException: collection already exists: awholynewcollection_0
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.createCollection(OverseerCollectionProcessor.java:700)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.processMessage(OverseerCollectionProcessor.java:167)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:119)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 739667 T1969 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000004 complete, response:{Operation createcollection caused exception:=org.apache.solr.common.SolrException: collection already exists: awholynewcollection_0,exception={msg=collection already exists: awholynewcollection_0,rspCode=400}}
[junit4] 2> 739670 T1969 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000006 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "numShards":"5",
[junit4] 2> "maxShardsPerNode":"6",
[junit4] 2> "createNodeSet":null,
[junit4] 2> "name":"awholynewcollection_0",
[junit4] 2> "replicationFactor":"5"}
[junit4] 2> 739670 T1969 oasc.SolrException.log ERROR Collection createcollection of createcollection failed:org.apache.solr.common.SolrException: collection already exists: awholynewcollection_0
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.createCollection(OverseerCollectionProcessor.java:700)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.processMessage(OverseerCollectionProcessor.java:167)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:119)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 739671 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739671 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739672 T1939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739676 T1939 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work/qnr-0000000006 state: SyncConnected type NodeDataChanged
[junit4] 2> 739681 T1969 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000006 complete, response:{Operation createcollection caused exception:=org.apache.solr.common.SolrException: collection already exists: awholynewcollection_0,exception={msg=collection already exists: awholynewcollection_0,rspCode=400}}
[junit4] 2> 739683 T1774 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 56131
[junit4] 2> 739684 T1774 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1323710332
[junit4] 2> 739685 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739686 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739685 T1939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739694 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739695 T1939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739695 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739700 T1911 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={numShards=5&maxShardsPerNode=6&name=awholynewcollection_0&replicationFactor=5&action=CREATE&wt=javabin&version=2} status=400 QTime=33721
[junit4] 2> 739703 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739703 T1939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739703 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739712 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739712 T1939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739712 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739720 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739720 T1939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739720 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739728 T1968 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 739729 T1928 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 739730 T1928 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 739730 T1928 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 739732 T1968 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 739733 T1968 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node23",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 739740 T1968 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node13",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 739746 T1968 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node16",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 739752 T1968 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node9",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 739757 T1968 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 739773 T1939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739773 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739773 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 739773 T1928 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 740684 T1774 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=down
[junit4] 2> 740686 T1774 oasc.SolrCore.close [nodes_used_collection_shard1_replica2] CLOSING SolrCore org.apache.solr.core.SolrCore@15334d42
[junit4] 2> 740694 T1774 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 740694 T1774 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 740694 T1774 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 740695 T1774 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 740695 T1774 oasc.SolrCore.closeSearcher [nodes_used_collection_shard1_replica2] Closing main searcher on request.
[junit4] 2> 740696 T1774 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 740696 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/nodes_used_collection_shard1_replica2/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/nodes_used_collection_shard1_replica2/data/index;done=false>>]
[junit4] 2> 740696 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/nodes_used_collection_shard1_replica2/data/index
[junit4] 2> 740697 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/nodes_used_collection_shard1_replica2/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/nodes_used_collection_shard1_replica2/data;done=false>>]
[junit4] 2> 740697 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1373541549657/nodes_used_collection_shard1_replica2/data
[junit4] 2> 740699 T1968 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=90016418960834578-127.0.0.1:56131_-n_0000000005) am no longer a leader.
[junit4] 2> 740702 T1939 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 740702 T1939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 740703 T1937 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 740703 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 740704 T1935 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 740708 T1935 oasc.Overseer.start Overseer (id=90016418960834579-127.0.0.1:35561_-n_0000000006) starting
[junit4] 2> 740719 T1971 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 740720 T1935 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 740720 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 740723 T1970 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 740725 T1970 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 740727 T1970 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:56131_",
[junit4] 2> "base_url":"http://127.0.0.1:56131"}
[junit4] 2> 740730 T1774 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4] 2> 740734 T1939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 740734 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 740735 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 740781 T1774 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 39844
[junit4] 2> 740781 T1774 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1458021669
[junit4] 2> 740881 T1814 oasc.SolrException.log ERROR Error registering SolrCore:org.apache.solr.common.cloud.ZooKeeperException:
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:764)
[junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:214)
[junit4] 2> at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4] 2> at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4] 2> at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/nodes_used_collection/leader_elect/shard1/election/90016418960834578-core_node3-n_0000000002
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:152)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:149)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:149)
[junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:162)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:266)
[junit4] 2> at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:937)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:758)
[junit4] 2> ... 6 more
[junit4] 2>
[junit4] 2> 740882 T1814 oascc.DefaultConnectionStrategy.reconnect Reconnected to ZooKeeper
[junit4] 2> 740882 T1814 oascc.ConnectionManager.process Connected:true
[junit4] 2> 740901 T1796 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 740902 T1796 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 740902 T1796 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4] 2> 740902 T1796 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 742001 T1928 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 742001 T1928 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 742001 T1928 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 742243 T1970 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 742245 T1970 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 742246 T1970 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 742251 T1970 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node9",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 742251 T1970 oasc.Overseer$ClusterStateUpdater.updateState shard=shard2 is already registered
[junit4] 2> 742256 T1970 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node13",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 742256 T1970 oasc.Overseer$ClusterStateUpdater.updateState shard=shard3 is already registered
[junit4] 2> 742262 T1970 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node16",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 742262 T1970 oasc.Overseer$ClusterStateUpdater.updateState shard=shard4 is already registered
[junit4] 2> 742267 T1970 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node23",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 742267 T1970 oasc.Overseer$ClusterStateUpdater.updateState shard=shard5 is already registered
[junit4] 2> 742272 T1970 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 742272 T1970 oasc.Overseer$ClusterStateUpdater.updateState shard=shard2 is already registered
[junit4] 2> 742277 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 742277 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 742277 T1939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 743789 T1774 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=down
[junit4] 2> 743791 T1774 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica3 state=down
[junit4] 2> 743793 T1774 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica3 state=down
[junit4] 2> 743794 T1774 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica3 state=down
[junit4] 2> 743795 T1774 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica3 state=down
[junit4] 2> 743797 T1774 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica3 state=down
[junit4] 2> 743798 T1970 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 743799 T1774 oasc.SolrCore.close [nodes_used_collection_shard2_replica2] CLOSING SolrCore org.apache.solr.core.SolrCore@1953bcfd
[junit4] 2> 743800 T1970 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 743805 T1970 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node23",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard5",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard5_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 743806 T1774 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 743806 T1774 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 743806 T1774 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 743807 T1774 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 743808 T1774 oasc.SolrCore.closeSearcher [nodes_used_collection_shard2_replica2] Closing main searcher on request.
[junit4] 2> 743809 T1774 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 743809 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/nodes_used_collection_shard2_replica2/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/nodes_used_collection_shard2_replica2/data/index;done=false>>]
[junit4] 2> 743809 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/nodes_used_collection_shard2_replica2/data/index
[junit4] 2> 743810 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/nodes_used_collection_shard2_replica2/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/nodes_used_collection_shard2_replica2/data;done=false>>]
[junit4] 2> 743810 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/nodes_used_collection_shard2_replica2/data
[junit4] 2> 743810 T1774 oasc.SolrCore.close [awholynewcollection_0_shard5_replica3] CLOSING SolrCore org.apache.solr.core.SolrCore@25b8a8ac
[junit4] 2> 743810 T1970 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node13",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard3",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard3_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 743816 T1774 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 743817 T1774 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 743817 T1774 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 743817 T1774 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 743818 T1774 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard5_replica3] Closing main searcher on request.
[junit4] 2> 743818 T1774 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 743818 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard5_replica3/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard5_replica3/data/index;done=false>>]
[junit4] 2> 743819 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard5_replica3/data/index
[junit4] 2> 743819 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard5_replica3/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard5_replica3/data;done=false>>]
[junit4] 2> 743819 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard5_replica3/data
[junit4] 2> 743819 T1774 oasc.SolrCore.close [awholynewcollection_0_shard3_replica3] CLOSING SolrCore org.apache.solr.core.SolrCore@63da05bf
[junit4] 2> 743825 T1774 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 743826 T1774 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 743826 T1774 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 743826 T1774 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 743827 T1774 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard3_replica3] Closing main searcher on request.
[junit4] 2> 743827 T1774 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 743827 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard3_replica3/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard3_replica3/data;done=false>>]
[junit4] 2> 743828 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard3_replica3/data
[junit4] 2> 743828 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard3_replica3/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard3_replica3/data/index;done=false>>]
[junit4] 2> 743828 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard3_replica3/data/index
[junit4] 2> 743829 T1774 oasc.SolrCore.close [awholynewcollection_0_shard4_replica3] CLOSING SolrCore org.apache.solr.core.SolrCore@9ad980f
[junit4] 2> 743898 T1774 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 743898 T1774 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 743898 T1774 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 743899 T1774 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 743899 T1774 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard4_replica3] Closing main searcher on request.
[junit4] 2> 743900 T1774 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 743900 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard4_replica3/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard4_replica3/data/index;done=false>>]
[junit4] 2> 743901 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard4_replica3/data/index
[junit4] 2> 743901 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard4_replica3/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard4_replica3/data;done=false>>]
[junit4] 2> 743901 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard4_replica3/data
[junit4] 2> 743901 T1970 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node16",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard4_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 743901 T1774 oasc.SolrCore.close [awholynewcollection_0_shard2_replica3] CLOSING SolrCore org.apache.solr.core.SolrCore@4a92595f
[junit4] 2> 743907 T1970 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node9",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard2_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 743909 T1774 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 743909 T1774 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 743909 T1774 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 743910 T1774 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 743910 T1774 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard2_replica3] Closing main searcher on request.
[junit4] 2> 743911 T1774 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 743911 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard2_replica3/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard2_replica3/data;done=false>>]
[junit4] 2> 743911 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard2_replica3/data
[junit4] 2> 743911 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard2_replica3/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard2_replica3/data/index;done=false>>]
[junit4] 2> 743912 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard2_replica3/data/index
[junit4] 2> 743912 T1774 oasc.SolrCore.close [awholynewcollection_0_shard1_replica3] CLOSING SolrCore org.apache.solr.core.SolrCore@26a6ffc1
[junit4] 2> 743913 T1970 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=5 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"5",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"awholynewcollection_0_shard1_replica3",
[junit4] 2> "collection":"awholynewcollection_0",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:39844_",
[junit4] 2> "base_url":"http://127.0.0.1:39844"}
[junit4] 2> 743918 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 743919 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 743919 T1939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 743919 T1774 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 743919 T1774 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 743920 T1774 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 743920 T1774 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 743921 T1774 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard1_replica3] Closing main searcher on request.
[junit4] 2> 743921 T1774 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 743921 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard1_replica3/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard1_replica3/data;done=false>>]
[junit4] 2> 743922 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard1_replica3/data
[junit4] 2> 743922 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard1_replica3/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard1_replica3/data/index;done=false>>]
[junit4] 2> 743922 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1373541550897/awholynewcollection_0_shard1_replica3/data/index
[junit4] 2> 743928 T1937 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 743929 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4] 2> 743943 T1935 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 743943 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4] 2> 743950 T1774 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4] 2> 744001 T1774 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 35561
[junit4] 2> 744001 T1774 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=221156872
[junit4] 2> 745002 T1774 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=down
[junit4] 2> 745004 T1774 oasc.SolrCore.close [nodes_used_collection_shard1_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@70363442
[junit4] 2> 745016 T1774 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 745017 T1774 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 745018 T1774 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 745018 T1774 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 745020 T1774 oasc.SolrCore.closeSearcher [nodes_used_collection_shard1_replica1] Closing main searcher on request.
[junit4] 2> 745020 T1774 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 745020 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/nodes_used_collection_shard1_replica1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/nodes_used_collection_shard1_replica1/data/index;done=false>>]
[junit4] 2> 745021 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/nodes_used_collection_shard1_replica1/data/index
[junit4] 2> 745021 T1774 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/nodes_used_collection_shard1_replica1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/nodes_used_collection_shard1_replica1/data;done=false>>]
[junit4] 2> 745021 T1774 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1373541552116/nodes_used_collection_shard1_replica1/data
[junit4] 2> 745023 T1970 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=90016418960834579-127.0.0.1:35561_-n_0000000006) am no longer a leader.
[junit4] 2> 745027 T1937 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 745030 T1937 oasc.Overseer.start Overseer (id=90016418960834580-127.0.0.1:39240_-n_0000000007) starting
[junit4] 2> 745037 T1973 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 745037 T1937 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 745038 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 745041 T1972 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 745043 T1972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 745045 T1972 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:35561_",
[junit4] 2> "base_url":"http://127.0.0.1:35561"}
[junit4] 2> 745048 T1774 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4] 2> 745051 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 745100 T1774 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 39240
[junit4] 2> 745100 T1774 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=436495535
[junit4] 2> 745139 T1842 oasc.SolrException.log ERROR Error registering SolrCore:org.apache.solr.common.cloud.ZooKeeperException:
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:764)
[junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:214)
[junit4] 2> at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4] 2> at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4] 2> at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/nodes_used_collection/leader_elect/shard1/election/90016418960834579-core_node1-n_0000000003
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:152)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:149)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:149)
[junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:162)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:266)
[junit4] 2> at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:937)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:758)
[junit4] 2> ... 6 more
[junit4] 2>
[junit4] 2> 745140 T1842 oascc.DefaultConnectionStrategy.reconnect Reconnected to ZooKeeper
[junit4] 2> 745140 T1842 oascc.ConnectionManager.process Connected:true
[junit4] 2> 745227 T1939 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 745227 T1939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 745227 T1939 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 746103 T1972 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=90016418960834580-127.0.0.1:39240_-n_0000000007) am no longer a leader.
[junit4] 2> 746126 T1774 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4] 2> 746183 T1774 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4] 2> 746184 T1774 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:41126 41126
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=B3A3324C57B0D151 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=pt_PT -Dtests.timezone=SST -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 114s J1 | CollectionsAPIDistributedZkTest.testDistribSearch <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:39240, http://127.0.0.1:56131, http://127.0.0.1:39844, http://127.0.0.1:37304, http://127.0.0.1:35561]
[junit4] > at __randomizedtesting.SeedInfo.seed([B3A3324C57B0D151:3245BC5420EFB16D]:0)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:333)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:318)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1522)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:438)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:146)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4] > at java.lang.Thread.run(Thread.java:662)
[junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:39844
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:431)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:264)
[junit4] > ... 45 more
[junit4] > Caused by: java.net.SocketTimeoutException: Read timed out
[junit4] > at java.net.SocketInputStream.socketRead0(Native Method)
[junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:129)
[junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:166)
[junit4] > at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:90)
[junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:281)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:92)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:62)
[junit4] > at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:254)
[junit4] > at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:289)
[junit4] > at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:252)
[junit4] > at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:191)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:300)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:127)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:717)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:522)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
[junit4] > ... 47 more
[junit4] 2> 746206 T1774 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 114191 T1773 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4] 2> 746325 T1935 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 746326 T1935 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4] 2> 746326 T1935 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 747404 T1937 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 747405 T1937 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 747405 T1937 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=Lucene41, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=pt_PT, timezone=SST
[junit4] 2> NOTE: Linux 3.2.0-49-generic amd64/Sun Microsystems Inc. 1.6.0_45 (64-bit)/cpus=8,threads=2,free=440608392,total=530186240
[junit4] 2> NOTE: All tests run in this JVM: [TestManagedSchema, NoCacheHeaderTest, DisMaxRequestHandlerTest, StandardRequestHandlerTest, HdfsLockFactoryTest, HdfsUnloadDistributedZkTest, OpenExchangeRatesOrgProviderTest, RequiredFieldsTest, TestLuceneMatchVersion, TestIndexSearcher, TestInfoStreamLogging, ConvertedLegacyTest, TestAtomicUpdateErrorCases, ClusterStateTest, XmlUpdateRequestHandlerTest, TestJmxMonitoredMap, BlockCacheTest, TestAnalyzedSuggestions, DebugComponentTest, SuggesterWFSTTest, TestQueryTypes, TestOmitPositions, TestSolr4Spatial, PingRequestHandlerTest, TestCoreDiscovery, TestDistributedSearch, OpenCloseCoreStressTest, HdfsDirectoryTest, HdfsRecoveryZkTest, CoreAdminCreateDiscoverTest, TestWordDelimiterFilterFactory, TestCSVLoader, DefaultValueUpdateProcessorTest, ShardRoutingCustomTest, TestRTGBase, TestFoldingMultitermQuery, FullSolrCloudDistribCmdsTest, MultiTermTest, UpdateParamsTest, LeaderElectionIntegrationTest, HdfsBasicDistributedZkTest, TestQuerySenderNoQuery, TestSolrXmlPersistence, TestCloudManagedSchema, DocumentAnalysisRequestHandlerTest, TestStressLucene, OutputWriterTest, BasicZkTest, PathHierarchyTokenizerFactoryTest, SolrCmdDistributorTest, EchoParamsTest, URLClassifyProcessorTest, HighlighterConfigTest, IndexReaderFactoryTest, TestIndexingPerformance, TestElisionMultitermQuery, ZkNodePropsTest, IndexSchemaRuntimeFieldTest, QueryResultKeyTest, BadIndexSchemaTest, ZkSolrClientTest, SpellCheckComponentTest, TestFieldCollectionResource, TestFieldTypeCollectionResource, HdfsChaosMonkeySafeLeaderTest, ShardSplitTest, NotRequiredUniqueKeyTest, TestMultiCoreConfBootstrap, TestLazyCores, CollectionsAPIDistributedZkTest]
[junit4] Completed on J1 in 115.50s, 1 test, 1 error <<< FAILURES!
[...truncated 542 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:395: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:375: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1250: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:893: There were test failures: 318 suites, 1337 tests, 1 error, 34 ignored (6 assumptions)
Total time: 44 minutes 17 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.6.0_45 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure