You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/08/20 09:18:10 UTC
[JENKINS] Lucene-Solr-trunk-Linux (32bit/ibm-j9-jdk7) - Build #
7089 - Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/7089/
Java: 32bit/ibm-j9-jdk7 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}
2 tests failed.
REGRESSION: org.apache.solr.schema.TestCloudManagedSchemaAddField.testDistribSearch
Error Message:
Max retry count 20 exceeded after 323 ms. QUERY FAILED: xpath=/response/lst[@name='responseHeader']/int[@name='status'][.='0'] request=/schema/fields/newfield14?wt=xml response=<?xml version="1.0" encoding="UTF-8"?> <response> <lst name="responseHeader"> <int name="status">404</int> <int name="QTime">2</int> </lst> <lst name="error"> <str name="msg">Field 'newfield14' not found.</str> <int name="code">404</int> </lst> </response>
Stack Trace:
java.lang.AssertionError: Max retry count 20 exceeded after 323 ms. QUERY FAILED: xpath=/response/lst[@name='responseHeader']/int[@name='status'][.='0'] request=/schema/fields/newfield14?wt=xml response=<?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader">
<int name="status">404</int>
<int name="QTime">2</int>
</lst>
<lst name="error">
<str name="msg">Field 'newfield14' not found.</str>
<int name="code">404</int>
</lst>
</response>
at __randomizedtesting.SeedInfo.seed([B890FCA67F8ED6AE:397672BE08D1B692]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.schema.TestCloudManagedSchemaAddField.doTest(TestCloudManagedSchemaAddField.java:127)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
at java.lang.reflect.Method.invoke(Method.java:613)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:780)
FAILED: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
Server at http://127.0.0.1:55134/_uc/eu/onenodecollectioncore returned non ok status:404, message:Can not find: /_uc/eu/onenodecollectioncore/update
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:55134/_uc/eu/onenodecollectioncore returned non ok status:404, message:Can not find: /_uc/eu/onenodecollectioncore/update
at __randomizedtesting.SeedInfo.seed([B890FCA67F8ED6AE:397672BE08D1B692]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:88)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
at java.lang.reflect.Method.invoke(Method.java:613)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:780)
Build Log:
[...truncated 9744 lines...]
[junit4] Suite: org.apache.solr.schema.TestCloudManagedSchemaAddField
[junit4] 2> 766803 T1891 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /tct/as
[junit4] 2> 766807 T1891 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-TestCloudManagedSchemaAddField-1376981983573
[junit4] 2> 766808 T1891 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 766808 T1892 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 766908 T1891 oasc.ZkTestServer.run start zk server on port:56245
[junit4] 2> 766912 T1891 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 767216 T1898 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@77e289f5 name:ZooKeeperConnection Watcher:127.0.0.1:56245 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 767216 T1891 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 767217 T1891 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 767270 T1891 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 767289 T1900 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e1bba8e name:ZooKeeperConnection Watcher:127.0.0.1:56245/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 767289 T1891 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 767290 T1891 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 767334 T1891 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 767356 T1891 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 767378 T1891 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 767400 T1891 oasc.AbstractZkTestCase.putConfig put /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-managed-schema.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 767402 T1891 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 767467 T1891 oasc.AbstractZkTestCase.putConfig put /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 767469 T1891 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 767603 T1891 oasc.AbstractZkTestCase.putConfig put /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 767605 T1891 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 767783 T1891 oasc.AbstractZkTestCase.putConfig put /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 767784 T1891 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 767826 T1891 oasc.AbstractZkTestCase.putConfig put /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 767827 T1891 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 767948 T1891 oasc.AbstractZkTestCase.putConfig put /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 767949 T1891 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 768044 T1891 oasc.AbstractZkTestCase.putConfig put /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 768044 T1891 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 768483 T1891 oasc.AbstractZkTestCase.putConfig put /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 768484 T1891 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 769052 T1891 oasc.AbstractZkTestCase.putConfig put /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 769053 T1891 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 769194 T1891 oasc.AbstractZkTestCase.putConfig put /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 769195 T1891 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 769348 T1891 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 769352 T1891 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:40993
[junit4] 2> 769353 T1891 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 769354 T1891 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 769354 T1891 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376981986046
[junit4] 2> 769355 T1891 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376981986046/'
[junit4] 2> 769363 T1891 oasc.ConfigSolr.fromFile Loading container configuration from /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376981986046/solr.xml
[junit4] 2> 769394 T1891 oasc.CoreContainer.<init> New CoreContainer -1002289816
[junit4] 2> 769395 T1891 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376981986046/]
[junit4] 2> 769396 T1891 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 769397 T1891 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 769398 T1891 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 769398 T1891 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 769399 T1891 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 769399 T1891 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 769400 T1891 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 769400 T1891 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 769401 T1891 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 769402 T1891 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4] 2> 769406 T1891 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56245/solr
[junit4] 2> 769407 T1891 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 769421 T1891 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 769448 T1911 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@571b4be9 name:ZooKeeperConnection Watcher:127.0.0.1:56245 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 769448 T1891 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 769470 T1891 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 769476 T1891 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 769492 T1913 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48e8336f name:ZooKeeperConnection Watcher:127.0.0.1:56245/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 769492 T1891 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 769515 T1891 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 769559 T1891 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 769582 T1891 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 769604 T1891 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40993_tct%2Fas
[junit4] 2> 769625 T1891 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40993_tct%2Fas
[junit4] 2> 769649 T1891 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 769736 T1891 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 769759 T1891 oasc.Overseer.start Overseer (id=90241891275636739-127.0.0.1:40993_tct%2Fas-n_0000000000) starting
[junit4] 2> 769892 T1891 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 769982 T1915 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 769982 T1891 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 770026 T1891 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 770071 T1891 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 770074 T1914 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 770077 T1916 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 770077 T1916 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 772235 T1895 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 2157ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 772236 T1916 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 772237 T1914 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 772238 T1914 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "shard_state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:40993/tct/as",
[junit4] 2> "state":"down",
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "node_name":"127.0.0.1:40993_tct%2Fas",
[junit4] 2> "numShards":"1",
[junit4] 2> "shard_range":null,
[junit4] 2> "roles":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "shard":null,
[junit4] 2> "core":"collection1"}
[junit4] 2> 772238 T1914 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 772238 T1914 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 773216 T1913 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 774237 T1916 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 774238 T1916 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376981986046/collection1
[junit4] 2> 774238 T1916 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 774240 T1916 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 774241 T1916 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 774243 T1916 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376981986046/collection1/'
[junit4] 2> 774244 T1916 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376981986046/collection1/lib/README' to classloader
[junit4] 2> 774244 T1916 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376981986046/collection1/lib/classes/' to classloader
[junit4] 2> 774275 T1916 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 774303 T1916 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 774304 T1916 oass.ManagedIndexSchemaFactory.create The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
[junit4] 2> 774306 T1916 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 774312 T1916 oass.IndexSchema.readSchema [null] Schema name=test
[junit4] 2> 774624 T1916 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 774629 T1916 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 774632 T1916 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 774645 T1916 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 774649 T1916 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 774654 T1916 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 774656 T1916 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 774657 T1916 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 774657 T1916 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 774659 T1916 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 774660 T1916 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 776942 T1895 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 2274ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 776943 T1916 oass.ManagedIndexSchema.persistManagedSchemaToZooKeeper Created and persisted managed schema znode at /configs/conf1/managed-schema
[junit4] 2> 776945 T1916 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml.bak
[junit4] 2> 778785 T1916 oass.ManagedIndexSchemaFactory.zkUgradeToManagedSchema After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/conf1/schema.xml to /configs/conf1/schema.xml.bak
[junit4] 2> 778786 T1916 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4] 2> 778787 T1916 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376981986046/collection1/, dataDir=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376981986046/collection1/data/
[junit4] 2> 778787 T1916 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 778788 T1916 oasc.CachingDirectoryFactory.get return new directory for /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376981986046/collection1/data
[junit4] 2> 778789 T1916 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376981986046/collection1/data/index/
[junit4] 2> 778790 T1916 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376981986046/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 778790 T1916 oasc.CachingDirectoryFactory.get return new directory for /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376981986046/collection1/data/index
[junit4] 2> 778791 T1916 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 782409 T1916 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376981986046/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@c8f26453; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4] 2> 782411 T1916 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 782412 T1916 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 782413 T1916 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 782414 T1916 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 782414 T1916 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 782415 T1916 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 782415 T1916 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 782416 T1916 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 782418 T1916 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 782421 T1916 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 782422 T1916 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 782423 T1916 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=44, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3565358681701365]
[junit4] 2> 782424 T1916 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376981986046/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@c8f26453; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4] 2> 782425 T1916 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 782426 T1916 oass.SolrIndexSearcher.<init> Opening Searcher@b6549ae5 main
[junit4] 2> 782427 T1916 oass.ZkIndexSchemaReader.createSchemaWatcher Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema ...
[junit4] 2> 782430 T1917 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b6549ae5 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 782430 T1916 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 782431 T1916 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40993/tct/as collection:control_collection shard:shard1
[junit4] 2> 782432 T1916 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=15000&socketTimeout=30000&retry=false
[junit4] 2> 782436 T1916 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 783725 T1895 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 1286ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 785643 T1895 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 1075ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 785889 T1916 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 786831 T1916 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 786832 T1916 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 786832 T1916 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40993/tct/as/collection1/
[junit4] 2> 786833 T1916 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 786833 T1916 oasc.SyncStrategy.syncToMe http://127.0.0.1:40993/tct/as/collection1/ has no replicas
[junit4] 2> 786833 T1916 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40993/tct/as/collection1/ shard1
[junit4] 2> 786834 T1916 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 788251 T1914 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 789419 T1895 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 1166ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 792073 T1913 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 793217 T1895 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 1142ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 793403 T1916 oasc.ZkController.register We are http://127.0.0.1:40993/tct/as/collection1/ and leader is http://127.0.0.1:40993/tct/as/collection1/
[junit4] 2> 793404 T1916 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40993/tct/as
[junit4] 2> 793404 T1916 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 793404 T1916 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 793405 T1916 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 793449 T1916 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 793450 T1891 oass.SolrDispatchFilter.init user.dir=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 793451 T1891 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 793452 T1891 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 793459 T1891 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4] 2> 793463 T1891 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 793493 T1920 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bad8f69e name:ZooKeeperConnection Watcher:127.0.0.1:56245/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 793493 T1891 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 793495 T1891 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 793497 T1891 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4] 2> 793575 T1891 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 793579 T1891 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:37930
[junit4] 2> 793580 T1891 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 793580 T1891 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 793581 T1891 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376982010263
[junit4] 2> 793582 T1891 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376982010263/'
[junit4] 2> 793589 T1891 oasc.ConfigSolr.fromFile Loading container configuration from /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376982010263/solr.xml
[junit4] 2> 793627 T1891 oasc.CoreContainer.<init> New CoreContainer 1836065020
[junit4] 2> 793628 T1891 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376982010263/]
[junit4] 2> 793630 T1891 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 793630 T1891 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 793631 T1891 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 793631 T1891 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 793632 T1891 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 793633 T1891 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 793633 T1891 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 793634 T1891 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 793634 T1891 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 793635 T1891 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4] 2> 793640 T1891 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56245/solr
[junit4] 2> 793640 T1891 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 793642 T1891 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 793671 T1931 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a35c991a name:ZooKeeperConnection Watcher:127.0.0.1:56245 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 793671 T1891 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 793715 T1891 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 793721 T1891 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 793760 T1933 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@adedc8bd name:ZooKeeperConnection Watcher:127.0.0.1:56245/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 793760 T1891 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 793849 T1891 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 794852 T1891 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37930_tct%2Fas
[junit4] 2> 794893 T1891 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37930_tct%2Fas
[junit4] 2> 794894 T1914 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 794895 T1914 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "shard_state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:40993/tct/as",
[junit4] 2> "state":"active",
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "node_name":"127.0.0.1:40993_tct%2Fas",
[junit4] 2> "numShards":"1",
[junit4] 2> "shard_range":null,
[junit4] 2> "roles":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"collection1"}
[junit4] 2> 794981 T1920 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 794982 T1933 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 795115 T1933 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 795115 T1920 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 795119 T1934 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 795119 T1934 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 795204 T1934 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 795204 T1913 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 795205 T1913 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4] 2> 795206 T1913 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 796705 T1914 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 796706 T1914 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "shard_state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:37930/tct/as",
[junit4] 2> "state":"down",
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "node_name":"127.0.0.1:37930_tct%2Fas",
[junit4] 2> "numShards":"4",
[junit4] 2> "shard_range":null,
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "core":"collection1"}
[junit4] 2> 796706 T1914 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3, shard4]
[junit4] 2> 796707 T1914 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 796969 T1933 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 796969 T1913 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 796969 T1920 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 797205 T1934 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 797205 T1934 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376982010263/collection1
[junit4] 2> 797205 T1934 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 797206 T1934 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 797206 T1934 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 797208 T1934 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376982010263/collection1/'
[junit4] 2> 797208 T1934 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376982010263/collection1/lib/README' to classloader
[junit4] 2> 797209 T1934 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376982010263/collection1/lib/classes/' to classloader
[junit4] 2> 797240 T1934 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 797268 T1934 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 797270 T1934 oass.IndexSchema.readSchema Reading Solr Schema from managed-schema
[junit4] 2> 797276 T1934 oass.IndexSchema.readSchema [null] Schema name=test
[junit4] 2> 797598 T1934 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 797602 T1934 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 797604 T1934 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 797607 T1934 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 797611 T1934 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 797618 T1934 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 797619 T1934 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 797619 T1934 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 797620 T1934 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 797621 T1934 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 797621 T1934 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 797624 T1934 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4] 2> 797624 T1934 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376982010263/collection1/, dataDir=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376982010263/collection1/data/
[junit4] 2> 797624 T1934 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 797625 T1934 oasc.CachingDirectoryFactory.get return new directory for /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376982010263/collection1/data
[junit4] 2> 797625 T1934 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376982010263/collection1/data/index/
[junit4] 2> 797626 T1934 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376982010263/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 797626 T1934 oasc.CachingDirectoryFactory.get return new directory for /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376982010263/collection1/data/index
[junit4] 2> 797627 T1934 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 797843 T1934 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376982010263/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@a2dc14d5; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4] 2> 797844 T1934 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 797844 T1934 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 797845 T1934 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 797845 T1934 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 797845 T1934 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 797846 T1934 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 797846 T1934 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 797846 T1934 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 797848 T1934 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 797850 T1934 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 797850 T1934 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 797851 T1934 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=44, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3565358681701365]
[junit4] 2> 797851 T1934 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376982010263/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@a2dc14d5; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4] 2> 797852 T1934 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 797852 T1934 oass.SolrIndexSearcher.<init> Opening Searcher@b8c4bac5 main
[junit4] 2> 797853 T1934 oass.ZkIndexSchemaReader.createSchemaWatcher Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema ...
[junit4] 2> 797854 T1935 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b8c4bac5 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 797854 T1934 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 797854 T1934 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:37930/tct/as collection:collection1 shard:shard1
[junit4] 2> 797854 T1934 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=15000&socketTimeout=30000&retry=false
[junit4] 2> 797858 T1934 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 798115 T1934 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 798293 T1934 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 798294 T1934 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 798294 T1934 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:37930/tct/as/collection1/
[junit4] 2> 798295 T1934 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 798295 T1934 oasc.SyncStrategy.syncToMe http://127.0.0.1:37930/tct/as/collection1/ has no replicas
[junit4] 2> 798295 T1934 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:37930/tct/as/collection1/ shard1
[junit4] 2> 798296 T1934 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 798551 T1914 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 798917 T1933 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 798917 T1913 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 798917 T1920 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 798951 T1934 oasc.ZkController.register We are http://127.0.0.1:37930/tct/as/collection1/ and leader is http://127.0.0.1:37930/tct/as/collection1/
[junit4] 2> 798952 T1934 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:37930/tct/as
[junit4] 2> 798952 T1934 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 798952 T1934 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 798953 T1934 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 798983 T1934 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 798985 T1891 oass.SolrDispatchFilter.init user.dir=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 798987 T1891 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 798989 T1891 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 799072 T1891 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 799076 T1891 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:38194
[junit4] 2> 799076 T1891 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 799077 T1891 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 799078 T1891 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376982015760
[junit4] 2> 799078 T1891 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376982015760/'
[junit4] 2> 799086 T1891 oasc.ConfigSolr.fromFile Loading container configuration from /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376982015760/solr.xml
[junit4] 2> 799128 T1891 oasc.CoreContainer.<init> New CoreContainer -1400219042
[junit4] 2> 799129 T1891 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376982015760/]
[junit4] 2> 799130 T1891 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 799131 T1891 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 799131 T1891 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 799132 T1891 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 799133 T1891 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 799133 T1891 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 799134 T1891 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 799135 T1891 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 799135 T1891 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 799136 T1891 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4] 2> 799140 T1891 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56245/solr
[junit4] 2> 799141 T1891 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 799143 T1891 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 799171 T1947 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b584b14 name:ZooKeeperConnection Watcher:127.0.0.1:56245 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 799171 T1891 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 799193 T1891 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 799199 T1891 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 799215 T1949 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@37fa492f name:ZooKeeperConnection Watcher:127.0.0.1:56245/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 799216 T1891 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 799261 T1891 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 800265 T1891 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38194_tct%2Fas
[junit4] 2> 800348 T1891 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38194_tct%2Fas
[junit4] 2> 800371 T1949 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 800371 T1920 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 800371 T1933 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 800372 T1920 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 800372 T1933 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 800371 T1913 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 800373 T1913 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 800397 T1950 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 800397 T1950 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 800415 T1950 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 800483 T1914 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 800484 T1914 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "shard_state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:37930/tct/as",
[junit4] 2> "state":"active",
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "node_name":"127.0.0.1:37930_tct%2Fas",
[junit4] 2> "numShards":"4",
[junit4] 2> "shard_range":null,
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"collection1"}
[junit4] 2> 800727 T1914 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "shard_state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:38194/tct/as",
[junit4] 2> "state":"down",
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "node_name":"127.0.0.1:38194_tct%2Fas",
[junit4] 2> "numShards":"4",
[junit4] 2> "shard_range":null,
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "core":"collection1"}
[junit4] 2> 800727 T1914 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=4
[junit4] 2> 800728 T1914 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 801470 T1920 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 801470 T1949 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 801470 T1933 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 801470 T1913 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 802416 T1950 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 802416 T1950 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376982015760/collection1
[junit4] 2> 802417 T1950 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 802417 T1950 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 802418 T1950 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 802419 T1950 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376982015760/collection1/'
[junit4] 2> 802421 T1950 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376982015760/collection1/lib/README' to classloader
[junit4] 2> 802421 T1950 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376982015760/collection1/lib/classes/' to classloader
[junit4] 2> 802461 T1950 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 802490 T1950 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 802491 T1950 oass.IndexSchema.readSchema Reading Solr Schema from managed-schema
[junit4] 2> 802497 T1950 oass.IndexSchema.readSchema [null] Schema name=test
[junit4] 2> 802816 T1950 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 802821 T1950 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 802823 T1950 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 802826 T1950 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 802829 T1950 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 802837 T1950 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 802838 T1950 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 802838 T1950 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 802839 T1950 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 802840 T1950 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 802840 T1950 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 802843 T1950 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4] 2> 802843 T1950 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376982015760/collection1/, dataDir=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376982015760/collection1/data/
[junit4] 2> 802844 T1950 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 802844 T1950 oasc.CachingDirectoryFactory.get return new directory for /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376982015760/collection1/data
[junit4] 2> 802845 T1950 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376982015760/collection1/data/index/
[junit4] 2> 802845 T1950 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376982015760/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 802845 T1950 oasc.CachingDirectoryFactory.get return new directory for /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376982015760/collection1/data/index
[junit4] 2> 802846 T1950 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 803164 T1950 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376982015760/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@468e15c7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4] 2> 803165 T1950 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 803165 T1950 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 803166 T1950 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 803166 T1950 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 803166 T1950 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 803167 T1950 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 803167 T1950 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 803167 T1950 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 803169 T1950 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 803171 T1950 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 803172 T1950 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 803172 T1950 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=44, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3565358681701365]
[junit4] 2> 803173 T1950 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376982015760/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@468e15c7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4] 2> 803174 T1950 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 803174 T1950 oass.SolrIndexSearcher.<init> Opening Searcher@d0a22c09 main
[junit4] 2> 803174 T1950 oass.ZkIndexSchemaReader.createSchemaWatcher Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema ...
[junit4] 2> 803176 T1951 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d0a22c09 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 803176 T1950 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 803176 T1950 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:38194/tct/as collection:collection1 shard:shard2
[junit4] 2> 803177 T1950 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=15000&socketTimeout=30000&retry=false
[junit4] 2> 803181 T1950 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 803502 T1950 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 803649 T1950 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 803649 T1950 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 803650 T1950 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:38194/tct/as/collection1/
[junit4] 2> 803650 T1950 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 803650 T1950 oasc.SyncStrategy.syncToMe http://127.0.0.1:38194/tct/as/collection1/ has no replicas
[junit4] 2> 803651 T1950 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:38194/tct/as/collection1/ shard2
[junit4] 2> 803651 T1950 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 804628 T1914 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 804926 T1913 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 804926 T1933 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 804927 T1949 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 804926 T1920 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 804951 T1950 oasc.ZkController.register We are http://127.0.0.1:38194/tct/as/collection1/ and leader is http://127.0.0.1:38194/tct/as/collection1/
[junit4] 2> 804952 T1950 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38194/tct/as
[junit4] 2> 804952 T1950 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 804953 T1950 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 804953 T1950 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 804982 T1950 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 805005 T1891 oass.SolrDispatchFilter.init user.dir=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 805005 T1891 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 805006 T1891 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 805086 T1891 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 805089 T1891 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54812
[junit4] 2> 805090 T1891 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 805091 T1891 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 805092 T1891 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376982021775
[junit4] 2> 805092 T1891 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376982021775/'
[junit4] 2> 805099 T1891 oasc.ConfigSolr.fromFile Loading container configuration from /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376982021775/solr.xml
[junit4] 2> 805132 T1891 oasc.CoreContainer.<init> New CoreContainer 512969707
[junit4] 2> 805133 T1891 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376982021775/]
[junit4] 2> 805134 T1891 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 805134 T1891 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 805135 T1891 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 805136 T1891 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 805137 T1891 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 805138 T1891 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 805138 T1891 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 805139 T1891 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 805140 T1891 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 805140 T1891 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4] 2> 805145 T1891 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56245/solr
[junit4] 2> 805145 T1891 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 805147 T1891 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 805171 T1963 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@66b63361 name:ZooKeeperConnection Watcher:127.0.0.1:56245 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 805171 T1891 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 805193 T1891 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 805199 T1891 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 805215 T1965 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b9f5f52d name:ZooKeeperConnection Watcher:127.0.0.1:56245/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 805215 T1891 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 805261 T1891 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 806264 T1891 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54812_tct%2Fas
[junit4] 2> 806526 T1891 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54812_tct%2Fas
[junit4] 2> 806527 T1914 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 806528 T1914 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "shard_state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:38194/tct/as",
[junit4] 2> "state":"active",
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "node_name":"127.0.0.1:38194_tct%2Fas",
[junit4] 2> "numShards":"4",
[junit4] 2> "shard_range":null,
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"collection1"}
[junit4] 2> 806636 T1949 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 806660 T1933 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 806660 T1965 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 806660 T1933 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 806660 T1920 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 806661 T1949 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 806661 T1920 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 806880 T1920 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 806880 T1965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 806880 T1949 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 806880 T1933 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 806884 T1966 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 806885 T1966 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 807082 T1966 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 807083 T1913 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 807083 T1913 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 807084 T1913 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 808585 T1914 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 808586 T1914 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "shard_state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:54812/tct/as",
[junit4] 2> "state":"down",
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "node_name":"127.0.0.1:54812_tct%2Fas",
[junit4] 2> "numShards":"4",
[junit4] 2> "shard_range":null,
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "core":"collection1"}
[junit4] 2> 808586 T1914 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=4
[junit4] 2> 808587 T1914 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 808693 T1920 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 808693 T1933 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 808693 T1949 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 808693 T1965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 808693 T1913 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 809083 T1966 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 809083 T1966 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376982021775/collection1
[junit4] 2> 809084 T1966 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 809084 T1966 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 809085 T1966 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 809086 T1966 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376982021775/collection1/'
[junit4] 2> 809086 T1966 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376982021775/collection1/lib/README' to classloader
[junit4] 2> 809087 T1966 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376982021775/collection1/lib/classes/' to classloader
[junit4] 2> 809114 T1966 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 809149 T1966 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 809150 T1966 oass.IndexSchema.readSchema Reading Solr Schema from managed-schema
[junit4] 2> 809157 T1966 oass.IndexSchema.readSchema [null] Schema name=test
[junit4] 2> 809468 T1966 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 809472 T1966 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 809474 T1966 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 809477 T1966 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 809481 T1966 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 809490 T1966 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 809491 T1966 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 809491 T1966 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WA
[...truncated too long message...]
DATA:
[junit4] 1> {
[junit4] 1> "base_url":"http://127.0.0.1:40285/_uc/eu",
[junit4] 1> "node_name":"127.0.0.1:40285__uc%2Feu",
[junit4] 1> "core":"onenodecollectioncore"}
[junit4] 1> /solr/aliases.json (0)
[junit4] 1> /solr/live_nodes (5)
[junit4] 1> /solr/live_nodes/127.0.0.1:55891__uc%2Feu (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:51628__uc%2Feu (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:59454__uc%2Feu (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:40285__uc%2Feu (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:55134__uc%2Feu (0)
[junit4] 1> /solr/clusterstate.json (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "control_collection":{
[junit4] 1> "shards":{"shard1":{
[junit4] 1> "range":"80000000-7fffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{"core_node1":{
[junit4] 1> "base_url":"http://127.0.0.1:51628/_uc/eu",
[junit4] 1> "state":"active",
[junit4] 1> "node_name":"127.0.0.1:51628__uc%2Feu",
[junit4] 1> "core":"collection1",
[junit4] 1> "leader":"true"}}}},
[junit4] 1> "maxShardsPerNode":"1",
[junit4] 1> "router":"compositeId",
[junit4] 1> "replicationFactor":"1"},
[junit4] 1> "onenodecollection":{
[junit4] 1> "shards":{"shard1":{
[junit4] 1> "range":"80000000-7fffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{"core_node1":{
[junit4] 1> "base_url":"http://127.0.0.1:40285/_uc/eu",
[junit4] 1> "state":"active",
[junit4] 1> "node_name":"127.0.0.1:40285__uc%2Feu",
[junit4] 1> "roles":"none",
[junit4] 1> "core":"onenodecollectioncore",
[junit4] 1> "leader":"true"}}}},
[junit4] 1> "maxShardsPerNode":"1",
[junit4] 1> "router":"compositeId",
[junit4] 1> "replicationFactor":"1"},
[junit4] 1> "collection1":{
[junit4] 1> "shards":{
[junit4] 1> "shard1":{
[junit4] 1> "range":"80000000-ffffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node1":{
[junit4] 1> "base_url":"http://127.0.0.1:40285/_uc/eu",
[junit4] 1> "state":"active",
[junit4] 1> "node_name":"127.0.0.1:40285__uc%2Feu",
[junit4] 1> "core":"collection1",
[junit4] 1> "leader":"true"},
[junit4] 1> "core_node3":{
[junit4] 1> "base_url":"http://127.0.0.1:59454/_uc/eu",
[junit4] 1> "state":"active",
[junit4] 1> "node_name":"127.0.0.1:59454__uc%2Feu",
[junit4] 1> "core":"collection1"}}},
[junit4] 1> "shard2":{
[junit4] 1> "range":"0-7fffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node2":{
[junit4] 1> "base_url":"http://127.0.0.1:55134/_uc/eu",
[junit4] 1> "state":"active",
[junit4] 1> "node_name":"127.0.0.1:55134__uc%2Feu",
[junit4] 1> "core":"collection1",
[junit4] 1> "leader":"true"},
[junit4] 1> "core_node4":{
[junit4] 1> "base_url":"http://127.0.0.1:55891/_uc/eu",
[junit4] 1> "state":"active",
[junit4] 1> "node_name":"127.0.0.1:55891__uc%2Feu",
[junit4] 1> "core":"collection1"}}}},
[junit4] 1> "maxShardsPerNode":"1",
[junit4] 1> "router":"compositeId",
[junit4] 1> "replicationFactor":"1"}}
[junit4] 1> /zookeeper (1)
[junit4] 1> DATA:
[junit4] 1>
[junit4] 1>
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=B890FCA67F8ED6AE -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ro -Dtests.timezone=Africa/Bujumbura -Dtests.file.encoding=UTF-8
[junit4] ERROR 45.9s J0 | BasicDistributedZk2Test.testDistribSearch <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:55134/_uc/eu/onenodecollectioncore returned non ok status:404, message:Can not find: /_uc/eu/onenodecollectioncore/update
[junit4] > at __randomizedtesting.SeedInfo.seed([B890FCA67F8ED6AE:397672BE08D1B692]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] > at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
[junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
[junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
[junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:88)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4] > at java.lang.Thread.run(Thread.java:780)
[junit4] 2> 1050302 T2079 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 45903 T2078 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> 1051034 T2170 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1051034 T2170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1051034 T2170 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=DefaultSimilarity, locale=ro, timezone=Africa/Bujumbura
[junit4] 2> NOTE: Linux 3.2.0-51-generic x86/IBM Corporation 1.7.0 (32-bit)/cpus=8,threads=1,free=95464376,total=276758528
[junit4] 2> NOTE: All tests run in this JVM: [URLClassifyProcessorTest, TestDocSet, PolyFieldTest, SpellPossibilityIteratorTest, BlockCacheTest, OverseerTest, TermsComponentTest, HdfsBasicDistributedZk2Test, TestFunctionQuery, TestQueryUtils, FastVectorHighlighterTest, TestCopyFieldCollectionResource, PeerSyncTest, CSVRequestHandlerTest, TermVectorComponentTest, TestSolrQueryParserResource, TestValueSourceCache, SliceStateUpdateTest, TestFieldTypeCollectionResource, SampleTest, TestLRUCache, DirectUpdateHandlerOptimizeTest, TestSolrIndexConfig, MBeansHandlerTest, BinaryUpdateRequestHandlerTest, TestSolrDeletionPolicy1, DistributedQueryElevationComponentTest, HdfsRecoveryZkTest, ResponseLogComponentTest, OverseerCollectionProcessorTest, IndexSchemaTest, TestConfig, TestBadConfig, TestRandomDVFaceting, TestStressVersions, TestSolrXmlPersistence, TestSort, TestElisionMultitermQuery, ResourceLoaderTest, HdfsBasicDistributedZkTest, BlockDirectoryTest, QueryElevationComponentTest, QueryParsingTest, LukeRequestHandlerTest, MoreLikeThisHandlerTest, TestSolrQueryParser, UnloadDistributedZkTest, PrimitiveFieldTypeTest, TestMergePolicyConfig, TestSolrXMLSerializer, TestFaceting, TestTrie, HdfsUnloadDistributedZkTest, SolrCoreTest, TestSystemIdResolver, TestCharFilters, BasicDistributedZkTest, ClusterStateTest, DocValuesTest, BasicFunctionalityTest, TestFieldResource, TestPseudoReturnFields, TestDocumentBuilder, HdfsCollectionsAPIDistributedZkTest, TestSchemaVersionResource, TestRealTimeGet, TestRemoteStreaming, TestPHPSerializedResponseWriter, ZkCLITest, SoftAutoCommitTest, TestBM25SimilarityFactory, ZkControllerTest, SimpleFacetsTest, TestLFUCache, RecoveryZkTest, StressHdfsTest, TestFieldTypeResource, BasicDistributedZk2Test]
[junit4] Completed on J0 in 46.68s, 1 test, 1 error <<< FAILURES!
[...truncated 496 lines...]
BUILD FAILED
/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:389: The following error occurred while executing this line:
/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:382: The following error occurred while executing this line:
/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:181: The following error occurred while executing this line:
/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:450: The following error occurred while executing this line:
/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1230: The following error occurred while executing this line:
/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:873: There were test failures: 322 suites, 1372 tests, 1 error, 1 failure, 35 ignored (6 assumptions)
Total time: 52 minutes 36 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/ibm-j9-jdk7 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0-ea-b102) - Build
# 7091 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/7091/
Java: 64bit/jdk1.8.0-ea-b102 -XX:+UseCompressedOops -XX:+UseSerialGC
1 tests failed.
FAILED: org.apache.solr.schema.TestCloudManagedSchemaAddField.testDistribSearch
Error Message:
Max retry count 20 exceeded after 254 ms. QUERY FAILED: xpath=/response/lst[@name='responseHeader']/int[@name='status'][.='0'] request=/schema/fields/newfield12?wt=xml response=<?xml version="1.0" encoding="UTF-8"?> <response> <lst name="responseHeader"> <int name="status">404</int> <int name="QTime">1</int> </lst> <lst name="error"> <str name="msg">Field 'newfield12' not found.</str> <int name="code">404</int> </lst> </response>
Stack Trace:
java.lang.AssertionError: Max retry count 20 exceeded after 254 ms. QUERY FAILED: xpath=/response/lst[@name='responseHeader']/int[@name='status'][.='0'] request=/schema/fields/newfield12?wt=xml response=<?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader">
<int name="status">404</int>
<int name="QTime">1</int>
</lst>
<lst name="error">
<str name="msg">Field 'newfield12' not found.</str>
<int name="code">404</int>
</lst>
</response>
at __randomizedtesting.SeedInfo.seed([FB198DF08F313E23:7AFF03E8F86E5E1F]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.schema.TestCloudManagedSchemaAddField.doTest(TestCloudManagedSchemaAddField.java:127)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:491)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
Build Log:
[...truncated 9683 lines...]
[junit4] Suite: org.apache.solr.schema.TestCloudManagedSchemaAddField
[junit4] 2> 505154 T1493 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 505157 T1493 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-TestCloudManagedSchemaAddField-1376994879500
[junit4] 2> 505157 T1493 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 505157 T1494 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 505257 T1493 oasc.ZkTestServer.run start zk server on port:54548
[junit4] 2> 505258 T1493 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 505387 T1500 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14f5a9fd name:ZooKeeperConnection Watcher:127.0.0.1:54548 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 505387 T1493 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 505387 T1493 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 505443 T1493 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 505468 T1502 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a324513 name:ZooKeeperConnection Watcher:127.0.0.1:54548/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 505468 T1493 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 505468 T1493 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 505512 T1493 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 505534 T1493 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 505556 T1493 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 505579 T1493 oasc.AbstractZkTestCase.putConfig put /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-managed-schema.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 505580 T1493 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 505646 T1493 oasc.AbstractZkTestCase.putConfig put /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 505646 T1493 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 505808 T1493 oasc.AbstractZkTestCase.putConfig put /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 505809 T1493 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 505886 T1493 oasc.AbstractZkTestCase.putConfig put /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 505886 T1493 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 505913 T1493 oasc.AbstractZkTestCase.putConfig put /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 505913 T1493 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 505935 T1493 oasc.AbstractZkTestCase.putConfig put /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 505936 T1493 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 506008 T1493 oasc.AbstractZkTestCase.putConfig put /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 506009 T1493 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 506035 T1493 oasc.AbstractZkTestCase.putConfig put /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 506036 T1493 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 506057 T1493 oasc.AbstractZkTestCase.putConfig put /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 506058 T1493 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 506131 T1493 oasc.AbstractZkTestCase.putConfig put /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 506132 T1493 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 506180 T1495 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1409b4a680f0001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4] 2>
[junit4] 2> 506241 T1493 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 506251 T1493 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52513
[junit4] 2> 506255 T1493 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 506255 T1493 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 506255 T1493 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376994880523
[junit4] 2> 506256 T1493 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376994880523/'
[junit4] 2> 506264 T1493 oasc.ConfigSolr.fromFile Loading container configuration from /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376994880523/solr.xml
[junit4] 2> 506271 T1493 oasc.CoreContainer.<init> New CoreContainer 986704790
[junit4] 2> 506272 T1493 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376994880523/]
[junit4] 2> 506272 T1493 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 506272 T1493 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 506273 T1493 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 506273 T1493 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 506273 T1493 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 506274 T1493 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 506274 T1493 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 506274 T1493 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 506275 T1493 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 506275 T1493 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4] 2> 506279 T1493 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54548/solr
[junit4] 2> 506279 T1493 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 506280 T1493 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 506335 T1513 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13c73632 name:ZooKeeperConnection Watcher:127.0.0.1:54548 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 506336 T1493 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 506391 T1493 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 506393 T1493 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 506446 T1515 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@218bf517 name:ZooKeeperConnection Watcher:127.0.0.1:54548/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 506446 T1493 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 506499 T1493 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 506546 T1493 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 506569 T1493 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 506591 T1493 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52513_
[junit4] 2> 506613 T1493 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52513_
[junit4] 2> 506636 T1493 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 506724 T1493 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 506746 T1493 oasc.Overseer.start Overseer (id=90242736423108611-127.0.0.1:52513_-n_0000000000) starting
[junit4] 2> 506813 T1493 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 506858 T1517 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 506858 T1493 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 506880 T1493 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 506902 T1493 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 506904 T1516 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 506906 T1518 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 506906 T1518 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 507165 T1518 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 508407 T1516 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 508407 T1516 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"1",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"collection1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:52513_",
[junit4] 2> "base_url":"http://127.0.0.1:52513"}
[junit4] 2> 508407 T1516 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 508408 T1516 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 508679 T1515 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 509166 T1518 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 509166 T1518 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376994880523/collection1
[junit4] 2> 509166 T1518 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 509167 T1518 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 509167 T1518 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 509168 T1518 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376994880523/collection1/'
[junit4] 2> 509169 T1518 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376994880523/collection1/lib/README' to classloader
[junit4] 2> 509169 T1518 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376994880523/collection1/lib/classes/' to classloader
[junit4] 2> 509189 T1518 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 509203 T1518 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 509204 T1518 oass.ManagedIndexSchemaFactory.create The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
[junit4] 2> 509206 T1518 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 509212 T1518 oass.IndexSchema.readSchema [null] Schema name=test
[junit4] 2> 509361 T1518 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 509366 T1518 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 509368 T1518 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 509381 T1518 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 509384 T1518 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 509399 T1518 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 509400 T1518 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 509401 T1518 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 509401 T1518 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 509402 T1518 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 509402 T1518 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 509659 T1518 oass.ManagedIndexSchema.persistManagedSchemaToZooKeeper Created and persisted managed schema znode at /configs/conf1/managed-schema
[junit4] 2> 509664 T1518 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml.bak
[junit4] 2> 509936 T1518 oass.ManagedIndexSchemaFactory.zkUgradeToManagedSchema After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/conf1/schema.xml to /configs/conf1/schema.xml.bak
[junit4] 2> 509937 T1518 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4] 2> 509937 T1518 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376994880523/collection1/, dataDir=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376994880523/collection1/data/
[junit4] 2> 509937 T1518 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 509938 T1518 oasc.CachingDirectoryFactory.get return new directory for /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376994880523/collection1/data
[junit4] 2> 509938 T1518 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376994880523/collection1/data/index/
[junit4] 2> 509938 T1518 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376994880523/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 509939 T1518 oasc.CachingDirectoryFactory.get return new directory for /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376994880523/collection1/data/index
[junit4] 2> 509939 T1518 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=21, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2105940490704609]
[junit4] 2> 510439 T1518 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376994880523/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1afa6835; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4] 2> 510440 T1518 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 510440 T1518 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 510440 T1518 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 510441 T1518 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 510441 T1518 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 510441 T1518 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 510441 T1518 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 510441 T1518 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 510443 T1518 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 510444 T1518 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 510444 T1518 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 510445 T1518 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1879478255, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 510446 T1518 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-controljetty-1376994880523/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1afa6835; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4] 2> 510446 T1518 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 510447 T1518 oass.SolrIndexSearcher.<init> Opening Searcher@699b7133 main
[junit4] 2> 510449 T1518 oass.ZkIndexSchemaReader.createSchemaWatcher Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema ...
[junit4] 2> 510451 T1518 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 510451 T1519 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@699b7133 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 510452 T1518 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52513 collection:control_collection shard:shard1
[junit4] 2> 510452 T1518 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=15000&socketTimeout=30000&retry=false
[junit4] 2> 510455 T1518 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 510809 T1518 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 510895 T1518 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 510895 T1518 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 510896 T1518 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52513/collection1/
[junit4] 2> 510896 T1518 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 510896 T1518 oasc.SyncStrategy.syncToMe http://127.0.0.1:52513/collection1/ has no replicas
[junit4] 2> 510896 T1518 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52513/collection1/ shard1
[junit4] 2> 510896 T1518 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 511772 T1516 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 512270 T1515 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 512502 T1518 oasc.ZkController.register We are http://127.0.0.1:52513/collection1/ and leader is http://127.0.0.1:52513/collection1/
[junit4] 2> 512502 T1518 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52513
[junit4] 2> 512502 T1518 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 512502 T1518 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 512502 T1518 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 512601 T1518 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 512602 T1493 oass.SolrDispatchFilter.init user.dir=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 512602 T1493 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 512603 T1493 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 512605 T1493 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4] 2> 512606 T1493 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 512625 T1522 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@154657ce name:ZooKeeperConnection Watcher:127.0.0.1:54548/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 512626 T1493 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 512627 T1493 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 512629 T1493 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4] 2> 512688 T1493 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 512690 T1493 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:57181
[junit4] 2> 512691 T1493 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 512691 T1493 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 512691 T1493 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376994886972
[junit4] 2> 512691 T1493 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376994886972/'
[junit4] 2> 512699 T1493 oasc.ConfigSolr.fromFile Loading container configuration from /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376994886972/solr.xml
[junit4] 2> 512705 T1493 oasc.CoreContainer.<init> New CoreContainer 1347838737
[junit4] 2> 512706 T1493 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376994886972/]
[junit4] 2> 512706 T1493 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 512706 T1493 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 512707 T1493 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 512707 T1493 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 512707 T1493 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 512707 T1493 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 512707 T1493 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 512707 T1493 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 512708 T1493 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 512708 T1493 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4] 2> 512710 T1493 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54548/solr
[junit4] 2> 512711 T1493 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 512711 T1493 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 512926 T1533 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@42e95913 name:ZooKeeperConnection Watcher:127.0.0.1:54548 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 512926 T1493 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 513087 T1493 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 513089 T1493 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 513168 T1535 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2f7a50c2 name:ZooKeeperConnection Watcher:127.0.0.1:54548/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 513168 T1493 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 513304 T1493 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 513970 T1516 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 513970 T1516 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"collection1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:52513_",
[junit4] 2> "base_url":"http://127.0.0.1:52513"}
[junit4] 2> 514212 T1522 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 514212 T1515 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 514212 T1535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 514307 T1493 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57181_
[junit4] 2> 514464 T1493 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57181_
[junit4] 2> 514658 T1522 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 514658 T1535 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 514659 T1535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4] 2> 514658 T1522 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4] 2> 514661 T1515 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 514893 T1515 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 514895 T1536 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 514896 T1536 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 515014 T1536 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 515761 T1516 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 515762 T1516 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"4",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"collection1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:57181_",
[junit4] 2> "base_url":"http://127.0.0.1:57181"}
[junit4] 2> 515762 T1516 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3, shard4]
[junit4] 2> 515762 T1516 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 516060 T1522 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 516061 T1515 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 516061 T1535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 517015 T1536 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 517015 T1536 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376994886972/collection1
[junit4] 2> 517015 T1536 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 517016 T1536 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 517016 T1536 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 517017 T1536 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376994886972/collection1/'
[junit4] 2> 517017 T1536 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376994886972/collection1/lib/README' to classloader
[junit4] 2> 517018 T1536 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376994886972/collection1/lib/classes/' to classloader
[junit4] 2> 517045 T1536 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 517051 T1536 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 517052 T1536 oass.IndexSchema.readSchema Reading Solr Schema from managed-schema
[junit4] 2> 517057 T1536 oass.IndexSchema.readSchema [null] Schema name=test
[junit4] 2> 517195 T1536 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 517199 T1536 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 517200 T1536 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 517204 T1536 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 517207 T1536 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 517217 T1536 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 517218 T1536 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 517218 T1536 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 517218 T1536 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 517220 T1536 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 517220 T1536 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 517223 T1536 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4] 2> 517224 T1536 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376994886972/collection1/, dataDir=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376994886972/collection1/data/
[junit4] 2> 517224 T1536 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 517224 T1536 oasc.CachingDirectoryFactory.get return new directory for /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376994886972/collection1/data
[junit4] 2> 517225 T1536 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376994886972/collection1/data/index/
[junit4] 2> 517225 T1536 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376994886972/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 517225 T1536 oasc.CachingDirectoryFactory.get return new directory for /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376994886972/collection1/data/index
[junit4] 2> 517226 T1536 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=21, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2105940490704609]
[junit4] 2> 517685 T1536 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376994886972/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@72b0d132; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4] 2> 517686 T1536 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 517688 T1536 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 517689 T1536 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 517689 T1536 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 517689 T1536 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 517689 T1536 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 517689 T1536 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 517690 T1536 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 517692 T1536 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 517693 T1536 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 517693 T1536 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 517694 T1536 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1879478255, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 517695 T1536 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty1-1376994886972/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@72b0d132; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4] 2> 517695 T1536 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 517695 T1536 oass.SolrIndexSearcher.<init> Opening Searcher@4416790d main
[junit4] 2> 517695 T1536 oass.ZkIndexSchemaReader.createSchemaWatcher Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema ...
[junit4] 2> 517697 T1536 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 517697 T1537 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4416790d main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 517697 T1536 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:57181 collection:collection1 shard:shard1
[junit4] 2> 517697 T1536 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=15000&socketTimeout=30000&retry=false
[junit4] 2> 517701 T1536 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 517825 T1536 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 517870 T1536 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 517870 T1536 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 517871 T1536 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:57181/collection1/
[junit4] 2> 517871 T1536 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 517871 T1536 oasc.SyncStrategy.syncToMe http://127.0.0.1:57181/collection1/ has no replicas
[junit4] 2> 517871 T1536 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:57181/collection1/ shard1
[junit4] 2> 517871 T1536 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 519095 T1516 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 519978 T1522 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 519978 T1535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 519978 T1515 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 520013 T1536 oasc.ZkController.register We are http://127.0.0.1:57181/collection1/ and leader is http://127.0.0.1:57181/collection1/
[junit4] 2> 520013 T1536 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57181
[junit4] 2> 520013 T1536 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 520013 T1536 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 520013 T1536 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 520090 T1536 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 520091 T1493 oass.SolrDispatchFilter.init user.dir=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 520092 T1493 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 520092 T1493 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 520170 T1493 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 520172 T1493 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:48548
[junit4] 2> 520172 T1493 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 520173 T1493 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 520173 T1493 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376994894438
[junit4] 2> 520173 T1493 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376994894438/'
[junit4] 2> 520182 T1493 oasc.ConfigSolr.fromFile Loading container configuration from /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376994894438/solr.xml
[junit4] 2> 520188 T1493 oasc.CoreContainer.<init> New CoreContainer 144593800
[junit4] 2> 520188 T1493 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376994894438/]
[junit4] 2> 520189 T1493 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 520189 T1493 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 520189 T1493 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 520189 T1493 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 520190 T1493 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 520190 T1493 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 520190 T1493 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 520190 T1493 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 520191 T1493 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 520191 T1493 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4] 2> 520194 T1493 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54548/solr
[junit4] 2> 520194 T1493 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 520195 T1493 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 520246 T1549 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e23f071 name:ZooKeeperConnection Watcher:127.0.0.1:54548 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 520246 T1493 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 520363 T1493 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 520366 T1493 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 520446 T1551 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1eb22d2a name:ZooKeeperConnection Watcher:127.0.0.1:54548/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 520446 T1493 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 520660 T1493 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 521591 T1516 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 521591 T1516 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"4",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"collection1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:57181_",
[junit4] 2> "base_url":"http://127.0.0.1:57181"}
[junit4] 2> 521670 T1493 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48548_
[junit4] 2> 521692 T1493 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48548_
[junit4] 2> 521714 T1535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 521714 T1515 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 521714 T1522 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 521714 T1551 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 521759 T1551 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 521759 T1522 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 521759 T1522 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 521759 T1535 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 521760 T1535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 521783 T1515 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4] 2> 521784 T1552 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 521784 T1552 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 521803 T1552 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 521803 T1515 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 523283 T1516 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 523283 T1516 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"4",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"collection1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:48548_",
[junit4] 2> "base_url":"http://127.0.0.1:48548"}
[junit4] 2> 523284 T1516 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=4
[junit4] 2> 523284 T1516 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard4
[junit4] 2> 523489 T1522 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 523489 T1515 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 523489 T1551 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 523489 T1535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 523804 T1552 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 523804 T1552 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376994894438/collection1
[junit4] 2> 523804 T1552 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 523805 T1552 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 523805 T1552 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 523806 T1552 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376994894438/collection1/'
[junit4] 2> 523806 T1552 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376994894438/collection1/lib/README' to classloader
[junit4] 2> 523806 T1552 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376994894438/collection1/lib/classes/' to classloader
[junit4] 2> 523819 T1552 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 523823 T1552 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 523824 T1552 oass.IndexSchema.readSchema Reading Solr Schema from managed-schema
[junit4] 2> 523828 T1552 oass.IndexSchema.readSchema [null] Schema name=test
[junit4] 2> 523941 T1552 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 523943 T1552 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 523944 T1552 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 523946 T1552 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 523948 T1552 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 523954 T1552 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 523955 T1552 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 523955 T1552 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 523955 T1552 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 523956 T1552 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 523956 T1552 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 523958 T1552 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4] 2> 523958 T1552 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376994894438/collection1/, dataDir=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376994894438/collection1/data/
[junit4] 2> 523958 T1552 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 523958 T1552 oasc.CachingDirectoryFactory.get return new directory for /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376994894438/collection1/data
[junit4] 2> 523959 T1552 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376994894438/collection1/data/index/
[junit4] 2> 523959 T1552 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376994894438/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 523959 T1552 oasc.CachingDirectoryFactory.get return new directory for /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376994894438/collection1/data/index
[junit4] 2> 523959 T1552 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=21, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2105940490704609]
[junit4] 2> 524168 T1552 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376994894438/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@647ac45b; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4] 2> 524169 T1552 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 524169 T1552 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 524170 T1552 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 524170 T1552 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 524170 T1552 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 524170 T1552 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 524170 T1552 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 524170 T1552 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 524172 T1552 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 524172 T1552 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 524173 T1552 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 524173 T1552 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1879478255, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 524174 T1552 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty2-1376994894438/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@647ac45b; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4] 2> 524174 T1552 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 524174 T1552 oass.SolrIndexSearcher.<init> Opening Searcher@9f8350 main
[junit4] 2> 524174 T1552 oass.ZkIndexSchemaReader.createSchemaWatcher Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema ...
[junit4] 2> 524175 T1553 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9f8350 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 524175 T1552 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 524175 T1552 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:48548 collection:collection1 shard:shard4
[junit4] 2> 524176 T1552 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=15000&socketTimeout=30000&retry=false
[junit4] 2> 524178 T1552 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard4/election
[junit4] 2> 524389 T1552 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard4
[junit4] 2> 524479 T1552 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 524479 T1552 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 524479 T1552 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:48548/collection1/
[junit4] 2> 524479 T1552 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 524479 T1552 oasc.SyncStrategy.syncToMe http://127.0.0.1:48548/collection1/ has no replicas
[junit4] 2> 524480 T1552 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:48548/collection1/ shard4
[junit4] 2> 524480 T1552 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard4
[junit4] 2> 525036 T1516 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 525344 T1522 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 525344 T1535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 525344 T1515 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 525344 T1551 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 525414 T1552 oasc.ZkController.register We are http://127.0.0.1:48548/collection1/ and leader is http://127.0.0.1:48548/collection1/
[junit4] 2> 525414 T1552 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48548
[junit4] 2> 525414 T1552 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 525414 T1552 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 525414 T1552 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 525437 T1552 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 525438 T1493 oass.SolrDispatchFilter.init user.dir=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 525439 T1493 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 525439 T1493 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 525531 T1493 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 525532 T1493 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35718
[junit4] 2> 525533 T1493 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 525533 T1493 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 525533 T1493 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376994899785
[junit4] 2> 525534 T1493 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376994899785/'
[junit4] 2> 525542 T1493 oasc.ConfigSolr.fromFile Loading container configuration from /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376994899785/solr.xml
[junit4] 2> 525557 T1493 oasc.CoreContainer.<init> New CoreContainer 1114523441
[junit4] 2> 525557 T1493 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376994899785/]
[junit4] 2> 525557 T1493 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 525558 T1493 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 525558 T1493 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 525558 T1493 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 525558 T1493 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 525558 T1493 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 525559 T1493 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 525559 T1493 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 525559 T1493 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 525559 T1493 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4] 2> 525562 T1493 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54548/solr
[junit4] 2> 525562 T1493 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 525563 T1493 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 525645 T1565 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@407b4732 name:ZooKeeperConnection Watcher:127.0.0.1:54548 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 525646 T1493 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 525777 T1493 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 525780 T1493 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 525856 T1567 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19ffa19e name:ZooKeeperConnection Watcher:127.0.0.1:54548/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 525857 T1493 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 525982 T1493 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 526894 T1516 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 526895 T1516 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"4",
[junit4] 2> "shard":"shard4",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"collection1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:48548_",
[junit4] 2> "base_url":"http://127.0.0.1:48548"}
[junit4] 2> 527003 T1522 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 527003 T1567 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 527004 T1493 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35718_
[junit4] 2> 527003 T1515 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 527003 T1535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 527003 T1551 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 527168 T1493 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35718_
[junit4] 2> 527192 T1551 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 527192 T1535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 527192 T1515 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4] 2> 527193 T1567 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 527193 T1522 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 527194 T1522 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 527194 T1567 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4] 2> 527194 T1551 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 527202 T1515 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 527202 T1535 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 527293 T1568 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 527293 T1568 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 527359 T1568 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 528671 T1516 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 528671 T1516 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "numShards":"4",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"collection1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:35718_",
[junit4] 2> "base_url":"http://127.0.0.1:35718"}
[junit4] 2> 528672 T1516 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=4
[junit4] 2> 528672 T1516 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 530274 T1522 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 530274 T1567 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 530274 T1535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 530274 T1515 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 530274 T1551 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 530360 T1568 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 530360 T1568 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376994899785/collection1
[junit4] 2> 530360 T1568 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 530361 T1568 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 530361 T1568 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 530361 T1568 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376994899785/collection1/'
[junit4] 2> 530362 T1568 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376994899785/collection1/lib/README' to classloader
[junit4] 2> 530362 T1568 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376994899785/collection1/lib/classes/' to classloader
[junit4] 2> 530380 T1568 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 530387 T1568 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 530388 T1568 oass.IndexSchema.readSchema Reading Solr Schema from managed-schema
[junit4] 2> 530398 T1568 oass.IndexSchema.readSchema [null] Schema name=test
[junit4] 2> 530524 T1568 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 530527 T1568 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 530527 T1568 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 530530 T1568 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 530532 T1568 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 530537 T1568 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 530538 T1568 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 530538 T1568 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 530538 T1568 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 530539 T1568 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 530539 T1568 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 530541 T1568 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4] 2> 530542 T1568 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376994899785/collection1/, dataDir=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376994899785/collection1/data/
[junit4] 2> 530542 T1568 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 530542 T1568 oasc.CachingDirectoryFactory.get return new directory for /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376994899785/collection1/data
[junit4] 2> 530543 T1568 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376994899785/collection1/data/index/
[junit4] 2> 530543 T1568 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376994899785/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 530543 T1568 oasc.CachingDirectoryFactory.get return new directory for /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376994899785/collection1/data/index
[junit4] 2> 530544 T1568 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=21, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2105940490704609]
[junit4] 2> 530856 T1568 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376994899785/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1646dba7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4] 2> 530856 T1568 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 530857 T1568 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 530857 T1568 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 530858 T1568 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 530858 T1568 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 530858 T1568 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 530858 T1568 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 530859 T1568 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 530861 T1568 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 530862 T1568 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 530862 T1568 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 530863 T1568 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1879478255, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 530864 T1568 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty3-1376994899785/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1646dba7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4] 2> 530864 T1568 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 530865 T1568 oass.SolrIndexSearcher.<init> Opening Searcher@41af06cf main
[junit4] 2> 530865 T1568 oass.ZkIndexSchemaReader.createSchemaWatcher Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema ...
[junit4] 2> 530866 T1569 oasc.SolrCore.registerSearcher [collection1]
[...truncated too long message...]
unit4] 2> "core_node_name":"core_node5",
[junit4] 2> "numShards":"4",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"collection1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:45835_",
[junit4] 2> "base_url":"http://127.0.0.1:45835"}
[junit4] 2> 570308 T1675 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 570310 T1675 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 570311 T1675 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node5",
[junit4] 2> "numShards":"4",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"collection1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:45835_",
[junit4] 2> "base_url":"http://127.0.0.1:45835"}
[junit4] 2> 570392 T1493 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 570393 T1493 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 570537 T1493 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@1ebb11b7
[junit4] 2> 570537 T1675 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node6",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "core":"collection1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:41211_",
[junit4] 2> "base_url":"http://127.0.0.1:41211"}
[junit4] 2> 570537 T1493 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 570538 T1675 oasc.Overseer$ClusterStateUpdater.updateState shard=shard4 is already registered
[junit4] 2> 570538 T1493 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 570538 T1493 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 570538 T1493 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 570539 T1493 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 570539 T1493 oasc.CachingDirectoryFactory.close Closing NRTCachingDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 570539 T1493 oasc.CachingDirectoryFactory.closeCacheValue looking to close /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty8-1376994923849/collection1/data [CachedDir<<refCount=0;path=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty8-1376994923849/collection1/data;done=false>>]
[junit4] 2> 570540 T1493 oasc.CachingDirectoryFactory.close Closing directory: /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty8-1376994923849/collection1/data
[junit4] 2> 570540 T1493 oasc.CachingDirectoryFactory.closeCacheValue looking to close /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty8-1376994923849/collection1/data/index [CachedDir<<refCount=0;path=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty8-1376994923849/collection1/data/index;done=false>>]
[junit4] 2> 570540 T1493 oasc.CachingDirectoryFactory.close Closing directory: /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.schema.TestCloudManagedSchemaAddField-jetty8-1376994923849/collection1/data/index
[junit4] 2> 570821 T1652 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 570822 T1652 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 570822 T1652 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 570843 T1493 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4] 2> 570897 T1493 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4] 2> 570898 T1493 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:54548 54548
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestCloudManagedSchemaAddField -Dtests.method=testDistribSearch -Dtests.seed=FB198DF08F313E23 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_NZ -Dtests.timezone=Africa/Blantyre -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 66.0s J1 | TestCloudManagedSchemaAddField.testDistribSearch <<<
[junit4] > Throwable #1: java.lang.AssertionError: Max retry count 20 exceeded after 254 ms. QUERY FAILED: xpath=/response/lst[@name='responseHeader']/int[@name='status'][.='0'] request=/schema/fields/newfield12?wt=xml response=<?xml version="1.0" encoding="UTF-8"?>
[junit4] > <response>
[junit4] > <lst name="responseHeader">
[junit4] > <int name="status">404</int>
[junit4] > <int name="QTime">1</int>
[junit4] > </lst>
[junit4] > <lst name="error">
[junit4] > <str name="msg">Field 'newfield12' not found.</str>
[junit4] > <int name="code">404</int>
[junit4] > </lst>
[junit4] > </response>
[junit4] > at __randomizedtesting.SeedInfo.seed([FB198DF08F313E23:7AFF03E8F86E5E1F]:0)
[junit4] > at org.apache.solr.schema.TestCloudManagedSchemaAddField.doTest(TestCloudManagedSchemaAddField.java:127)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4] 2> 571195 T1493 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 66045 T1492 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Lucene42: {}, docValues:{}, sim=DefaultSimilarity, locale=en_NZ, timezone=Africa/Blantyre
[junit4] 2> NOTE: Linux 3.2.0-51-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=1,free=34639928,total=142581760
[junit4] 2> NOTE: All tests run in this JVM: [TestSolrCoreProperties, TestDistributedSearch, ChaosMonkeyNothingIsSafeTest, RAMDirectoryFactoryTest, TestSweetSpotSimilarityFactory, TestSolrJ, TestQuerySenderNoQuery, ZkSolrClientTest, CurrencyFieldXmlFileTest, OutputWriterTest, HighlighterTest, AliasIntegrationTest, TestBinaryField, DirectSolrSpellCheckerTest, CollectionsAPIDistributedZkTest, TestAnalyzedSuggestions, NumericFieldsTest, DisMaxRequestHandlerTest, PathHierarchyTokenizerFactoryTest, PluginInfoTest, TestBinaryResponseWriter, OpenCloseCoreStressTest, RequestHandlersTest, HardAutoCommitTest, SolrIndexConfigTest, TestCSVResponseWriter, QueryResultKeyTest, TestSolrDeletionPolicy2, TestStressLucene, TestClassNameShortening, SortByFunctionTest, TestStressReorder, TestManagedSchema, DefaultValueUpdateProcessorTest, CoreAdminCreateDiscoverTest, TestFoldingMultitermQuery, TestNumberUtils, TestMultiCoreConfBootstrap, CoreContainerCoreInitFailuresTest, BasicDistributedZk2Test, FileUtilsTest, TestDistributedGrouping, TestFastOutputStream, XmlUpdateRequestHandlerTest, TestCollationField, TestCodecSupport, TermVectorComponentDistributedTest, TestFiltering, SolrRequestParserTest, NoCacheHeaderTest, SpellingQueryConverterTest, SpellCheckCollatorTest, TestCloudManagedSchemaAddField]
[junit4] Completed on J1 in 66.56s, 1 test, 1 failure <<< FAILURES!
[...truncated 640 lines...]
BUILD FAILED
/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:389: The following error occurred while executing this line:
/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:369: The following error occurred while executing this line:
/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:181: The following error occurred while executing this line:
/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:450: The following error occurred while executing this line:
/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1230: The following error occurred while executing this line:
/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:873: There were test failures: 322 suites, 1372 tests, 1 failure, 39 ignored (6 assumptions)
Total time: 43 minutes 12 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0-ea-b102 -XX:+UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_25) - Build #
7090 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/7090/
Java: 32bit/jdk1.7.0_25 -server -XX:+UseConcMarkSweepGC
5 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.OverseerTest
Error Message:
ERROR: SolrZkClient opens=178 closes=107
Stack Trace:
java.lang.AssertionError: ERROR: SolrZkClient opens=178 closes=107
at __randomizedtesting.SeedInfo.seed([191735E8D323556B]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.SolrTestCaseJ4.endTrackingZkClients(SolrTestCaseJ4.java:342)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:134)
at sun.reflect.GeneratedMethodAccessor22.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.OverseerTest
Error Message:
148 threads leaked from SUITE scope at org.apache.solr.cloud.OverseerTest: 1) Thread[id=2552, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 2) Thread[id=2583, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 3) Thread[id=2616, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 4) Thread[id=2517, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 5) Thread[id=2581, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 6) Thread[id=2582, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 7) Thread[id=2579, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 8) Thread[id=2497, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 9) Thread[id=2513, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 10) Thread[id=2633, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=BLOCKED, group=TGRP-OverseerTest] at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:71) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495) 11) Thread[id=2586, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 12) Thread[id=2622, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 13) Thread[id=2522, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 14) Thread[id=2535, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 15) Thread[id=2610, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 16) Thread[id=2584, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 17) Thread[id=2525, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 18) Thread[id=2516, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 19) Thread[id=2486, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=BLOCKED, group=TGRP-OverseerTest] at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:98) at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46) at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495) 20) Thread[id=2556, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 21) Thread[id=2568, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 22) Thread[id=2631, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 23) Thread[id=2619, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 24) Thread[id=2566, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 25) Thread[id=2539, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 26) Thread[id=2533, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 27) Thread[id=2528, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 28) Thread[id=2606, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 29) Thread[id=2155, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:178) at java.lang.Thread.run(Thread.java:724) 30) Thread[id=2499, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 31) Thread[id=2607, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 32) Thread[id=2625, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 33) Thread[id=2544, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 34) Thread[id=2588, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 35) Thread[id=2559, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 36) Thread[id=2543, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 37) Thread[id=2534, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 38) Thread[id=2624, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 39) Thread[id=2531, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 40) Thread[id=2328, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=BLOCKED, group=TGRP-OverseerTest] at java.lang.Object.wait(Native Method) at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:165) at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:98) at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46) at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495) 41) Thread[id=2605, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 42) Thread[id=2565, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 43) Thread[id=2492, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 44) Thread[id=2491, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 45) Thread[id=2557, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 46) Thread[id=2509, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 47) Thread[id=2608, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 48) Thread[id=2518, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 49) Thread[id=2628, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 50) Thread[id=2593, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 51) Thread[id=2496, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 52) Thread[id=2629, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 53) Thread[id=2512, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 54) Thread[id=2489, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 55) Thread[id=2488, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 56) Thread[id=2547, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 57) Thread[id=2551, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 58) Thread[id=2527, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 59) Thread[id=2524, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 60) Thread[id=2541, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 61) Thread[id=2570, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 62) Thread[id=2508, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 63) Thread[id=2487, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 64) Thread[id=2630, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 65) Thread[id=2504, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 66) Thread[id=2567, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 67) Thread[id=2505, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 68) Thread[id=2600, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 69) Thread[id=2542, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 70) Thread[id=2493, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 71) Thread[id=2575, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 72) Thread[id=2498, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 73) Thread[id=2578, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 74) Thread[id=2495, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 75) Thread[id=2538, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 76) Thread[id=2594, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 77) Thread[id=2577, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 78) Thread[id=2554, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 79) Thread[id=2514, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 80) Thread[id=2500, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 81) Thread[id=2569, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 82) Thread[id=2511, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 83) Thread[id=2580, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 84) Thread[id=2536, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 85) Thread[id=2502, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 86) Thread[id=2510, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 87) Thread[id=2612, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 88) Thread[id=2529, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 89) Thread[id=2494, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 90) Thread[id=2548, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 91) Thread[id=2520, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 92) Thread[id=2627, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 93) Thread[id=2597, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 94) Thread[id=2635, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 95) Thread[id=2503, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 96) Thread[id=2537, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 97) Thread[id=2592, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 98) Thread[id=2156, name=SessionTracker, state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Object.wait(Native Method) at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:146) 99) Thread[id=2620, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 100) Thread[id=2530, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 101) Thread[id=2563, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 102) Thread[id=2553, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 103) Thread[id=2599, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 104) Thread[id=2574, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 105) Thread[id=2572, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 106) Thread[id=2626, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 107) Thread[id=2521, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 108) Thread[id=2587, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 109) Thread[id=2585, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 110) Thread[id=2490, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 111) Thread[id=2555, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 112) Thread[id=2623, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 113) Thread[id=2154, name=Thread-824, state=WAITING, group=TGRP-OverseerTest] at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1260) at java.lang.Thread.join(Thread.java:1334) at org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:302) at org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:107) at org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:221) 114) Thread[id=2519, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 115) Thread[id=2564, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 116) Thread[id=2617, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 117) Thread[id=2561, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 118) Thread[id=2595, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 119) Thread[id=2634, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 120) Thread[id=2540, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 121) Thread[id=2602, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 122) Thread[id=2515, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 123) Thread[id=2558, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 124) Thread[id=2589, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 125) Thread[id=2611, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 126) Thread[id=2507, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 127) Thread[id=2571, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 128) Thread[id=2598, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 129) Thread[id=2560, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 130) Thread[id=2632, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 131) Thread[id=2591, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 132) Thread[id=2523, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 133) Thread[id=2573, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 134) Thread[id=2158, name=ProcessThread(sid:0 cport:-1):, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:120) 135) Thread[id=2621, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 136) Thread[id=2609, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 137) Thread[id=2526, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 138) Thread[id=2576, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 139) Thread[id=2601, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-SendThread(localhost.localdomain:39273), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 140) Thread[id=2532, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[191735E8D323556B]-Ev
[...truncated too long message...]
grationTest-1376989567980/data_3333 [CachedDir<<refCount=0;path=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-LeaderElectionIntegrationTest-1376989567980/data_3333;done=false>>]
[junit4] 2> 1482767 T3204 oasc.CachingDirectoryFactory.close Closing directory: /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-LeaderElectionIntegrationTest-1376989567980/data_3333
[junit4] 2> 1482767 T3204 oasc.CachingDirectoryFactory.closeCacheValue looking to close /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-LeaderElectionIntegrationTest-1376989567980/data_3333/index [CachedDir<<refCount=0;path=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-LeaderElectionIntegrationTest-1376989567980/data_3333/index;done=false>>]
[junit4] 2> 1482767 T3204 oasc.CachingDirectoryFactory.close Closing directory: /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-LeaderElectionIntegrationTest-1376989567980/data_3333/index
[junit4] 2> 1482847 T3327 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1482848 T3327 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1482848 T3327 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1482848 T3332 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 1482849 T3332 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1482872 T3204 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=28240782
[junit4] 2> 1482872 T3290 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 1482873 T3290 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1483894 T3204 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1483894 T3204 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1484149 T3332 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1484585 T3204 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@116ff95
[junit4] 2> 1484586 T3291 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1484586 T3204 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 1484586 T3204 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 1484587 T3204 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 1484587 T3204 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 1484587 T3291 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node6",
[junit4] 2> "numShards":null,
[junit4] 2> "shard":"shard2",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"collection1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:3333_solr",
[junit4] 2> "base_url":"http://127.0.0.1:3333/solr"}
[junit4] 2> 1484607 T3204 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 1484607 T3204 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 1484607 T3204 oasc.CachingDirectoryFactory.closeCacheValue looking to close /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-LeaderElectionIntegrationTest-1376989567980/data_7000 [CachedDir<<refCount=0;path=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-LeaderElectionIntegrationTest-1376989567980/data_7000;done=false>>]
[junit4] 2> 1484608 T3204 oasc.CachingDirectoryFactory.close Closing directory: /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-LeaderElectionIntegrationTest-1376989567980/data_7000
[junit4] 2> 1484608 T3204 oasc.CachingDirectoryFactory.closeCacheValue looking to close /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-LeaderElectionIntegrationTest-1376989567980/data_7000/index [CachedDir<<refCount=0;path=/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-LeaderElectionIntegrationTest-1376989567980/data_7000/index;done=false>>]
[junit4] 2> 1484608 T3204 oasc.CachingDirectoryFactory.close Closing directory: /var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-LeaderElectionIntegrationTest-1376989567980/data_7000/index
[junit4] 2> 1484662 T3204 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:56917 56917
[junit4] 2> 1485052 T3204 oas.SolrTestCaseJ4.tearDown ###Ending testLeaderElectionAfterClientTimeout
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1485961 T3290 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1485961 T3290 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1485961 T3290 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1487093 T3204 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=DefaultSimilarity, locale=lv, timezone=Antarctica/McMurdo
[junit4] 2> NOTE: Linux 3.2.0-51-generic i386/Oracle Corporation 1.7.0_25 (32-bit)/cpus=8,threads=1,free=47855504,total=181678080
[junit4] 2> NOTE: All tests run in this JVM: [TestSolrQueryParserResource, ShardRoutingTest, TestPHPSerializedResponseWriter, TestDynamicFieldResource, TestLMJelinekMercerSimilarityFactory, DocValuesTest, ShowFileRequestHandlerTest, TestLRUCache, BasicFunctionalityTest, CoreAdminHandlerTest, TestCopyFieldCollectionResource, SampleTest, UUIDFieldTest, TestSchemaVersionResource, TestCoreContainer, TestFaceting, TestBadConfig, FieldMutatingUpdateProcessorTest, TestCharFilters, SolrIndexSplitterTest, ResponseLogComponentTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestSearchPerf, TestReplicationHandler, ReturnFieldsTest, SOLR749Test, AnalysisAfterCoreReloadTest, TestRandomMergePolicy, TestSort, DOMUtilTest, LeaderElectionTest, TestFieldTypeCollectionResource, TestConfig, SpellPossibilityIteratorTest, PreAnalyzedUpdateProcessorTest, SolrCoreTest, TestMaxScoreQueryParser, TestQueryUtils, ScriptEngineTest, TestTrie, TestRemoteStreaming, TestShardHandlerFactory, SolrInfoMBeanTest, SliceStateUpdateTest, HdfsLockFactoryTest, TestValueSourceCache, TestManagedSchemaFieldResource, DirectUpdateHandlerOptimizeTest, TestLuceneMatchVersion, TermsComponentTest, SystemInfoHandlerTest, StressHdfsTest, QueryElevationComponentTest, TestDocumentBuilder, SpatialFilterTest, TestSolrDeletionPolicy1, TestSerializedLuceneMatchVersion, TestLFUCache, LegacyHTMLStripCharFilterTest, TestFieldTypeResource, TestPseudoReturnFields, ZkControllerTest, TestNRTOpen, InfoHandlerTest, TestStressVersions, SearchHandlerTest, SimpleFacetsTest, EchoParamsTest, TestJoin, TestSolrXMLSerializer, SliceStateTest, FastVectorHighlighterTest, CacheHeaderTest, DateMathParserTest, PeerSyncTest, URLClassifyProcessorTest, TestSolrXmlPersistence, HdfsBasicDistributedZk2Test, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, LeaderElectionIntegrationTest]
[junit4] Completed on J0 in 325.19s, 2 tests, 1 failure <<< FAILURES!
[...truncated 12 lines...]
BUILD FAILED
/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:389: The following error occurred while executing this line:
/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:369: The following error occurred while executing this line:
/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:181: The following error occurred while executing this line:
/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:450: The following error occurred while executing this line:
/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1230: The following error occurred while executing this line:
/var/lib/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:873: There were test failures: 322 suites, 1372 tests, 3 suite-level errors, 2 failures, 647 ignored (6 assumptions)
Total time: 50 minutes 27 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_25 -server -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure