You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/01/19 15:39:16 UTC
[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b123) - Build #
9053 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/9053/
Java: 32bit/jdk1.8.0-ea-b123 -server -XX:+UseConcMarkSweepGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([F06E0276F67B6C7F:71888C6E81240C43]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertFalse(Assert.java:68)
at org.junit.Assert.assertFalse(Assert.java:79)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.deleteCollectionWithDownNodes(CollectionsAPIDistributedZkTest.java:390)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:203)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Build Log:
[...truncated 10574 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> 565551 T2978 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /h_n/co
[junit4] 2> 565553 T2978 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-CollectionsAPIDistributedZkTest-1390141108090
[junit4] 2> 565554 T2978 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 565554 T2979 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 565654 T2978 oasc.ZkTestServer.run start zk server on port:33947
[junit4] 2> 565655 T2978 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 565658 T2985 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cff059 name:ZooKeeperConnection Watcher:127.0.0.1:33947 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 565659 T2978 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 565659 T2978 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 565662 T2978 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 565663 T2987 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cec42e name:ZooKeeperConnection Watcher:127.0.0.1:33947/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 565663 T2978 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 565663 T2978 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 565665 T2978 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 565668 T2978 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 565670 T2978 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 565674 T2978 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 565675 T2978 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 565680 T2978 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 565681 T2978 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 565684 T2978 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 565684 T2978 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 565687 T2978 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 565687 T2978 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 565690 T2978 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 565690 T2978 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 565692 T2978 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 565693 T2978 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 565695 T2978 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 565695 T2978 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 565697 T2978 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 565698 T2978 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 565700 T2978 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 565701 T2978 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 565704 T2978 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 565704 T2978 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 565706 T2978 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 565707 T2978 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> Using old style solr.xml
[junit4] 2> 565710 T2980 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x143aaddef7c0001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 565711 T2978 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 565713 T2989 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a042e3 name:ZooKeeperConnection Watcher:127.0.0.1:33947 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 565713 T2978 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 565713 T2978 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 565716 T2978 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 565717 T2991 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c8d7b9 name:ZooKeeperConnection Watcher:127.0.0.1:33947/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 565717 T2978 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 565718 T2978 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf2/solrconfig.xml
[junit4] 2> 565718 T2978 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.xml
[junit4] 2> 565721 T2978 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
[junit4] 2> 565721 T2978 oascc.SolrZkClient.makePath makePath: /configs/conf2/schema.xml
[junit4] 2> 565723 T2978 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 565724 T2978 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 565725 T2978 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
[junit4] 2> 565726 T2978 oascc.SolrZkClient.makePath makePath: /configs/conf2/stopwords.txt
[junit4] 2> 565727 T2978 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
[junit4] 2> 565727 T2978 oascc.SolrZkClient.makePath makePath: /configs/conf2/protwords.txt
[junit4] 2> 565729 T2978 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
[junit4] 2> 565730 T2978 oascc.SolrZkClient.makePath makePath: /configs/conf2/currency.xml
[junit4] 2> 565731 T2978 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
[junit4] 2> 565732 T2978 oascc.SolrZkClient.makePath makePath: /configs/conf2/open-exchange-rates.json
[junit4] 2> 565733 T2978 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 565734 T2978 oascc.SolrZkClient.makePath makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 565736 T2978 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
[junit4] 2> 565736 T2978 oascc.SolrZkClient.makePath makePath: /configs/conf2/old_synonyms.txt
[junit4] 2> 565738 T2978 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
[junit4] 2> 565739 T2978 oascc.SolrZkClient.makePath makePath: /configs/conf2/synonyms.txt
[junit4] 2> 565741 T2978 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
[junit4] 2> 565741 T2978 oascc.SolrZkClient.makePath makePath: /configs/conf2/elevate.xml
[junit4] 2> 565806 T2978 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 565811 T2978 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55242
[junit4] 2> 565812 T2978 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 565813 T2978 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 565813 T2978 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390141108280
[junit4] 2> 565814 T2978 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390141108280/'
[junit4] 2> 565826 T2978 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390141108280/solr.xml
[junit4] 2> 565839 T2978 oasc.CoreContainer.<init> New CoreContainer 14077000
[junit4] 2> 565839 T2978 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390141108280/]
[junit4] 2> 565840 T2978 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 565840 T2978 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 565840 T2978 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 565840 T2978 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 565841 T2978 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 565841 T2978 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 565841 T2978 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 565842 T2978 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 565842 T2978 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 565844 T2978 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 565844 T2978 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 565844 T2978 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 565845 T2978 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:33947/solr
[junit4] 2> 565845 T2978 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 565845 T2978 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 565847 T3002 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1104201 name:ZooKeeperConnection Watcher:127.0.0.1:33947 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 565847 T2978 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 565849 T2978 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 565850 T3004 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e1fd0 name:ZooKeeperConnection Watcher:127.0.0.1:33947/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 565850 T2978 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 565852 T2978 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 565853 T2978 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 565855 T2978 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 565856 T2978 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55242_h_n%2Fco
[junit4] 2> 565856 T2978 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55242_h_n%2Fco
[junit4] 2> 565858 T2978 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 565859 T2978 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 565861 T2978 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 565862 T2978 oasc.Overseer.start Overseer (id=91104287659917317-127.0.0.1:55242_h_n%2Fco-n_0000000000) starting
[junit4] 2> 565864 T2978 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 565866 T3006 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 565866 T2978 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 565867 T3006 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 565869 T2978 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 565870 T2978 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 565871 T3005 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 565872 T2978 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 565873 T2978 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 565873 T2978 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 565874 T3009 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24e483 name:ZooKeeperConnection Watcher:127.0.0.1:33947/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 565875 T2978 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 565876 T2978 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 565877 T2978 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 565949 T2978 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 565951 T2978 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:45811
[junit4] 2> 565951 T2978 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 565952 T2978 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 565952 T2978 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390141108413
[junit4] 2> 565952 T2978 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390141108413/'
[junit4] 2> 565961 T2978 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390141108413/solr.xml
[junit4] 2> 565984 T2978 oasc.CoreContainer.<init> New CoreContainer 23116389
[junit4] 2> 565985 T2978 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390141108413/]
[junit4] 2> 565985 T2978 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 565986 T2978 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 565986 T2978 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 565986 T2978 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 565986 T2978 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 565987 T2978 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 565987 T2978 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 565987 T2978 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 565987 T2978 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 565989 T2978 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 565989 T2978 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 565990 T2978 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 565990 T2978 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:33947/solr
[junit4] 2> 565990 T2978 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 565991 T2978 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 565993 T3020 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1afb24b name:ZooKeeperConnection Watcher:127.0.0.1:33947 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 565993 T2978 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 565995 T2978 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 565997 T3022 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c49fe5 name:ZooKeeperConnection Watcher:127.0.0.1:33947/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 565997 T2978 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 566000 T2978 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 567002 T2978 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45811_h_n%2Fco
[junit4] 2> 567004 T2978 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45811_h_n%2Fco
[junit4] 2> 567006 T3004 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 567007 T3009 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 567007 T3022 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 567012 T2978 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 567012 T2978 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 567084 T2978 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 567086 T2978 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:44754
[junit4] 2> 567087 T2978 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 567087 T2978 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 567088 T2978 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390141109548
[junit4] 2> 567088 T2978 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390141109548/'
[junit4] 2> 567103 T2978 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390141109548/solr.xml
[junit4] 2> 567116 T2978 oasc.CoreContainer.<init> New CoreContainer 16232535
[junit4] 2> 567116 T2978 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390141109548/]
[junit4] 2> 567117 T2978 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 567117 T2978 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 567118 T2978 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 567118 T2978 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 567119 T2978 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 567119 T2978 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 567119 T2978 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 567120 T2978 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 567120 T2978 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 567123 T2978 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 567123 T2978 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 567124 T2978 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 567124 T2978 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:33947/solr
[junit4] 2> 567125 T2978 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 567126 T2978 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 567127 T3034 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1baa5c9 name:ZooKeeperConnection Watcher:127.0.0.1:33947 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 567128 T2978 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 567131 T2978 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 567132 T3036 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@310fbc name:ZooKeeperConnection Watcher:127.0.0.1:33947/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 567133 T2978 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 567135 T2978 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 568138 T2978 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44754_h_n%2Fco
[junit4] 2> 568140 T2978 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44754_h_n%2Fco
[junit4] 2> 568143 T3009 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 568143 T3004 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 568143 T3036 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 568143 T3022 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 568146 T2978 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 568146 T2978 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 568211 T2978 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 568213 T2978 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:45385
[junit4] 2> 568213 T2978 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 568213 T2978 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 568214 T2978 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390141110683
[junit4] 2> 568214 T2978 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390141110683/'
[junit4] 2> 568226 T2978 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390141110683/solr.xml
[junit4] 2> 568235 T2978 oasc.CoreContainer.<init> New CoreContainer 24489605
[junit4] 2> 568236 T2978 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390141110683/]
[junit4] 2> 568236 T2978 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 568236 T2978 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 568237 T2978 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 568237 T2978 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 568237 T2978 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 568238 T2978 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 568238 T2978 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 568238 T2978 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 568239 T2978 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 568240 T2978 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 568240 T2978 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 568241 T2978 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 568241 T2978 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:33947/solr
[junit4] 2> 568242 T2978 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 568242 T2978 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 568244 T3048 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1686195 name:ZooKeeperConnection Watcher:127.0.0.1:33947 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 568244 T2978 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 568247 T2978 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 568248 T3050 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a297e7 name:ZooKeeperConnection Watcher:127.0.0.1:33947/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 568248 T2978 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 568251 T2978 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 569255 T2978 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45385_h_n%2Fco
[junit4] 2> 569257 T2978 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45385_h_n%2Fco
[junit4] 2> 569259 T3022 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 569259 T3004 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 569259 T3009 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 569260 T3050 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 569260 T3036 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 569263 T2978 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 569263 T2978 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 569335 T2978 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 569337 T2978 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:45018
[junit4] 2> 569337 T2978 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 569338 T2978 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 569338 T2978 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800
[junit4] 2> 569338 T2978 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/'
[junit4] 2> 569347 T2978 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/solr.xml
[junit4] 2> 569359 T2978 oasc.CoreContainer.<init> New CoreContainer 17134532
[junit4] 2> 569359 T2978 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/]
[junit4] 2> 569360 T2978 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 569360 T2978 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 569360 T2978 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 569361 T2978 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 569361 T2978 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 569361 T2978 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 569362 T2978 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 569362 T2978 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 569362 T2978 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 569365 T2978 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 569365 T2978 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 569365 T2978 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 569366 T2978 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:33947/solr
[junit4] 2> 569366 T2978 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 569369 T2978 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 569375 T3062 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8816f6 name:ZooKeeperConnection Watcher:127.0.0.1:33947 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 569375 T2978 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 569378 T2978 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 569379 T3064 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@119b6b0 name:ZooKeeperConnection Watcher:127.0.0.1:33947/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 569380 T2978 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 569383 T2978 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 570390 T2978 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45018_h_n%2Fco
[junit4] 2> 570391 T2978 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45018_h_n%2Fco
[junit4] 2> 570396 T3004 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 570397 T3036 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 570397 T3064 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 570397 T3022 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 570397 T3050 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 570396 T3009 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 570401 T2978 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 570401 T2978 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 570414 T3015 oasha.CollectionsHandler.handleCreateAction Creating Collection : replicationFactor=2&collection.configName=conf1&router.field=myOwnField&name=solrj_collection&router.name=compositeId&action=CREATE&numShards=2&wt=javabin&version=2
[junit4] 2> 570415 T3004 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 570417 T3006 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField",
[junit4] 2> "router.name":"compositeId"}
[junit4] 2> 570417 T3006 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField",
[junit4] 2> "router.name":"compositeId"}
[junit4] 2> 570418 T3006 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/solrj_collection
[junit4] 2> 570418 T3006 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
[junit4] 2> 570422 T3004 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 570423 T3005 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 570424 T3005 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: solrj_collection
[junit4] 2> 570424 T3005 oasc.Overseer$ClusterStateUpdater.createCollection Create collection solrj_collection with shards [shard1, shard2]
[junit4] 2> 570429 T3004 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 570430 T3022 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 570430 T3009 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 570431 T3064 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 570431 T3004 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 570431 T3050 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 570431 T3036 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 570522 T3006 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2] , repFactor : 2
[junit4] 2> 570523 T3006 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of collection solrj_collection on 127.0.0.1:45385_h_n%2Fco
[junit4] 2> 570523 T3006 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of collection solrj_collection on 127.0.0.1:45811_h_n%2Fco
[junit4] 2> 570523 T3006 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of collection solrj_collection on 127.0.0.1:45018_h_n%2Fco
[junit4] 2> 570539 T3045 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica1 state=down
[junit4] 2> 570539 T3006 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of collection solrj_collection on 127.0.0.1:55242_h_n%2Fco
[junit4] 2> 570540 T3057 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica1 state=down
[junit4] 2> 570540 T3017 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica2 state=down
[junit4] 2> 570541 T3045 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 570541 T3004 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 570548 T2997 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica2 state=down
[junit4] 2> 570550 T3057 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 570550 T3017 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 570552 T3004 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 570553 T2997 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 570553 T3005 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 570556 T3005 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:45385/h_n/co",
[junit4] 2> "core":"solrj_collection_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:45385_h_n%2Fco",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 570559 T3005 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:45018/h_n/co",
[junit4] 2> "core":"solrj_collection_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:45018_h_n%2Fco",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 570561 T3004 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 570562 T3005 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:45811/h_n/co",
[junit4] 2> "core":"solrj_collection_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:45811_h_n%2Fco",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 570564 T3004 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 570565 T3005 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:55242/h_n/co",
[junit4] 2> "core":"solrj_collection_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55242_h_n%2Fco",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 570566 T3004 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 570668 T3050 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 570668 T3009 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 570669 T3022 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 570669 T3004 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 570669 T3064 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 570671 T3036 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 571542 T3045 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica1
[junit4] 2> 571543 T3045 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390141110683/solr.xml
[junit4] 2> 571543 T3045 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390141110683/solrj_collection_shard1_replica1
[junit4] 2> 571544 T3045 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 571544 T3045 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 571545 T3045 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 571546 T3045 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390141110683/solrj_collection_shard1_replica1/'
[junit4] 2> 571551 T3057 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica1
[junit4] 2> 571551 T3057 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/solr.xml
[junit4] 2> 571551 T3017 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica2
[junit4] 2> 571552 T3017 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390141108413/solr.xml
[junit4] 2> 571553 T3017 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica2' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390141108413/solrj_collection_shard1_replica2
[junit4] 2> 571553 T3017 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 571552 T3057 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica1' using instanceDir: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/solrj_collection_shard2_replica1
[junit4] 2> 571554 T3057 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 571554 T3017 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 571555 T3017 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 571555 T3057 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 571555 T3057 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 571555 T3017 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390141108413/solrj_collection_shard1_replica2/'
[junit4] 2> 571561 T2997 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica2
[junit4] 2> 571561 T3057 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/solrj_collection_shard2_replica1/'
[junit4] 2> 571562 T2997 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390141108280/solr.xml
[junit4] 2> 571562 T2997 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica2' using instanceDir: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390141108280/solrj_collection_shard2_replica2
[junit4] 2> 571562 T2997 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 571569 T2997 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 571569 T2997 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 571570 T2997 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390141108280/solrj_collection_shard2_replica2/'
[junit4] 2> 571590 T3045 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 571601 T3017 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 571663 T3057 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 571663 T2997 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 571666 T3017 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 571674 T3017 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 571677 T3045 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 571679 T3045 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 571697 T3017 oass.IndexSchema.readSchema [solrj_collection_shard1_replica2] Schema name=test
[junit4] 2> 571701 T2997 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 571704 T2997 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 571713 T3057 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 571714 T3045 oass.IndexSchema.readSchema [solrj_collection_shard1_replica1] Schema name=test
[junit4] 2> 571718 T2997 oass.IndexSchema.readSchema [solrj_collection_shard2_replica2] Schema name=test
[junit4] 2> 571732 T3057 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 572018 T3057 oass.IndexSchema.readSchema [solrj_collection_shard2_replica1] Schema name=test
[junit4] 2> 572394 T3057 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 572395 T3057 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 572395 T2997 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 572395 T3057 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 572395 T2997 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 572396 T2997 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 572405 T3017 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 572405 T3017 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 572406 T3017 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 572406 T3057 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 572407 T2997 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 572409 T3057 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 572409 T2997 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 572416 T3017 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 572422 T3017 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 572423 T3045 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 572424 T3045 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 572424 T3045 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 572429 T2997 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 572429 T3057 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 572430 T3045 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 572432 T3045 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 572433 T3057 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 572435 T3017 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 572435 T2997 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 572436 T3057 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 572438 T3017 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 572438 T3057 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 572439 T3057 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 572439 T2997 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 572439 T3057 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 572440 T3017 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 572441 T3057 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 572440 T2997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 572441 T2997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 572441 T3017 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 572441 T3057 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 572442 T3045 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 572442 T3017 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 572442 T2997 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 572443 T3017 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 572443 T3057 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 572444 T2997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 572445 T3017 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 572445 T3017 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 572445 T3045 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 572445 T2997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 572444 T3057 oasc.SolrCore.<init> [solrj_collection_shard2_replica1] Opening new SolrCore at ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/solrj_collection_shard2_replica1/, dataDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/solrj_collection_shard2_replica1/data/
[junit4] 2> 572446 T2997 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 572445 T3017 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 572446 T2997 oasc.SolrCore.<init> [solrj_collection_shard2_replica2] Opening new SolrCore at ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390141108280/solrj_collection_shard2_replica2/, dataDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390141108280/solrj_collection_shard2_replica2/data/
[junit4] 2> 572446 T3057 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@48c173
[junit4] 2> 572447 T3045 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 572447 T2997 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@48c173
[junit4] 2> 572447 T3017 oasc.SolrCore.<init> [solrj_collection_shard1_replica2] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390141108413/solrj_collection_shard1_replica2/, dataDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390141108413/solrj_collection_shard1_replica2/data/
[junit4] 2> 572448 T3045 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 572449 T3045 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 572448 T3057 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/solrj_collection_shard2_replica1/data
[junit4] 2> 572449 T3045 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 572449 T3017 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@48c173
[junit4] 2> 572449 T2997 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390141108280/solrj_collection_shard2_replica2/data
[junit4] 2> 572450 T3045 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 572451 T3045 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 572449 T3057 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/solrj_collection_shard2_replica1/data/index/
[junit4] 2> 572451 T3045 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 572450 T3017 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390141108413/solrj_collection_shard1_replica2/data
[junit4] 2> 572452 T3017 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390141108413/solrj_collection_shard1_replica2/data/index/
[junit4] 2> 572450 T2997 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390141108280/solrj_collection_shard2_replica2/data/index/
[junit4] 2> 572452 T2997 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica2] Solr index directory './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390141108280/solrj_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 572452 T3017 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica2] Solr index directory '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390141108413/solrj_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 572451 T3045 oasc.SolrCore.<init> [solrj_collection_shard1_replica1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390141110683/solrj_collection_shard1_replica1/, dataDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390141110683/solrj_collection_shard1_replica1/data/
[junit4] 2> 572451 T3057 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica1] Solr index directory './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/solrj_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 572453 T3045 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@48c173
[junit4] 2> 572453 T3017 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390141108413/solrj_collection_shard1_replica2/data/index
[junit4] 2> 572453 T2997 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390141108280/solrj_collection_shard2_replica2/data/index
[junit4] 2> 572454 T3017 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=48, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=77.41796875, floorSegmentMB=1.796875, forceMergeDeletesPctAllowed=27.71285552664774, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6586884274207914
[junit4] 2> 572454 T2997 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=48, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=77.41796875, floorSegmentMB=1.796875, forceMergeDeletesPctAllowed=27.71285552664774, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6586884274207914
[junit4] 2> 572454 T3045 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390141110683/solrj_collection_shard1_replica1/data
[junit4] 2> 572454 T3057 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/solrj_collection_shard2_replica1/data/index
[junit4] 2> 572455 T3017 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@160121f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1c26b4),segFN=segments_1,generation=1}
[junit4] 2> 572456 T3017 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 572455 T3045 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390141110683/solrj_collection_shard1_replica1/data/index/
[junit4] 2> 572456 T2997 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1a4a456 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1df0c8f),segFN=segments_1,generation=1}
[junit4] 2> 572457 T2997 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 572456 T3057 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=48, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=77.41796875, floorSegmentMB=1.796875, forceMergeDeletesPctAllowed=27.71285552664774, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6586884274207914
[junit4] 2> 572456 T3045 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica1] Solr index directory '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390141110683/solrj_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 572458 T3045 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390141110683/solrj_collection_shard1_replica1/data/index
[junit4] 2> 572458 T3017 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 572459 T3045 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=48, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=77.41796875, floorSegmentMB=1.796875, forceMergeDeletesPctAllowed=27.71285552664774, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6586884274207914
[junit4] 2> 572459 T3017 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 572459 T2997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 572460 T3017 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 572460 T3045 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@15b302 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@8a8172),segFN=segments_1,generation=1}
[junit4] 2> 572460 T3045 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 572459 T3057 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@11db5d1 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@18b9e93),segFN=segments_1,generation=1}
[junit4] 2> 572461 T3057 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 572460 T3017 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 572460 T2997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 572462 T3017 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 572462 T2997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 572463 T3045 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 572463 T2997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 572462 T3017 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 572463 T3057 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 572463 T2997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 572463 T3045 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 572464 T2997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 572464 T3057 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 572464 T3017 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 572465 T3057 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 572465 T2997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 572464 T3045 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 572466 T2997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 572470 T2997 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 572465 T3057 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 572471 T2997 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 572465 T3017 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 572471 T3017 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 572471 T2997 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 572472 T2997 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 572471 T3057 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 572466 T3045 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 572472 T3057 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 572472 T2997 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 572472 T3017 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 572473 T2997 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 572473 T3057 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 572473 T3045 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 572474 T3057 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 572475 T3057 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 572474 T2997 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 572474 T3017 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 572475 T3017 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 572475 T2997 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 572475 T3057 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 572474 T3045 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 572477 T3057 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 572478 T3057 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 572477 T2997 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 572477 T3045 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 572476 T3017 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 572479 T3045 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 572479 T3045 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 572478 T3057 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 572479 T3045 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 572479 T3017 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 572480 T3045 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 572481 T3045 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 572480 T3057 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 572480 T2997 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 572481 T3057 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 572481 T3045 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 572482 T3057 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 572480 T3017 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 572482 T3045 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 572482 T2997 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 572483 T3045 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 572483 T3057 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 572483 T3017 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 572484 T3045 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 572483 T2997 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=13, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=3.4638671875, floorSegmentMB=1.572265625, forceMergeDeletesPctAllowed=12.664782969112522, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6266181754844965
[junit4] 2> 572485 T3017 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 572485 T2997 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1a4a456 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1df0c8f),segFN=segments_1,generation=1}
[junit4] 2> 572485 T2997 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 572485 T3045 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 572485 T3057 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 572486 T3017 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 572487 T3017 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 572487 T3045 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 572487 T3057 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 572487 T3017 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=13, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=3.4638671875, floorSegmentMB=1.572265625, forceMergeDeletesPctAllowed=12.664782969112522, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6266181754844965
[junit4] 2> 572488 T3057 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=13, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=3.4638671875, floorSegmentMB=1.572265625, forceMergeDeletesPctAllowed=12.664782969112522, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6266181754844965
[junit4] 2> 572488 T2997 oass.SolrIndexSearcher.<init> Opening Searcher@f0d00c main
[junit4] 2> 572487 T3045 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 572489 T3057 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@11db5d1 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@18b9e93),segFN=segments_1,generation=1}
[junit4] 2> 572490 T3057 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 572488 T3017 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@160121f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1c26b4),segFN=segments_1,generation=1}
[junit4] 2> 572491 T3017 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 572490 T3057 oass.SolrIndexSearcher.<init> Opening Searcher@489cb9 main
[junit4] 2> 572489 T3045 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=13, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=3.4638671875, floorSegmentMB=1.572265625, forceMergeDeletesPctAllowed=12.664782969112522, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6266181754844965
[junit4] 2> 572492 T2997 oasc.CoreContainer.registerCore registering core: solrj_collection_shard2_replica2
[junit4] 2> 572492 T3045 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@15b302 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@8a8172),segFN=segments_1,generation=1}
[junit4] 2> 572491 T3017 oass.SolrIndexSearcher.<init> Opening Searcher@b98e70 main
[junit4] 2> 572491 T3070 oasc.SolrCore.registerSearcher [solrj_collection_shard2_replica2] Registered new searcher Searcher@f0d00c main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 572492 T3045 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 572492 T2997 oasc.ZkController.register Register replica - core:solrj_collection_shard2_replica2 address:http://127.0.0.1:55242/h_n/co collection:solrj_collection shard:s
[...truncated too long message...]
earcher on request.
[junit4] 2> 758554 T2978 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 758554 T2978 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/awholynewcollection_3_shard3_replica1/data/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/awholynewcollection_3_shard3_replica1/data/index;done=false>>]
[junit4] 2> 758554 T2978 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/awholynewcollection_3_shard3_replica1/data/index
[junit4] 2> 758554 T2978 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/awholynewcollection_3_shard3_replica1/data [CachedDir<<refCount=0;path=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/awholynewcollection_3_shard3_replica1/data;done=false>>]
[junit4] 2> 758555 T2978 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/awholynewcollection_3_shard3_replica1/data
[junit4] 2> 758555 T2978 oasc.SolrCore.close [awholynewcollection_3_shard1_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@79e4f4
[junit4] 2> 758559 T2978 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
[junit4] 2> 758559 T2978 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 758559 T2978 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 758559 T2978 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 758560 T2978 oasc.SolrCore.closeSearcher [awholynewcollection_3_shard1_replica1] Closing main searcher on request.
[junit4] 2> 758560 T2978 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 758560 T2978 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/awholynewcollection_3_shard1_replica1/data [CachedDir<<refCount=0;path=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/awholynewcollection_3_shard1_replica1/data;done=false>>]
[junit4] 2> 758561 T2978 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/awholynewcollection_3_shard1_replica1/data
[junit4] 2> 758561 T2978 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/awholynewcollection_3_shard1_replica1/data/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/awholynewcollection_3_shard1_replica1/data/index;done=false>>]
[junit4] 2> 758561 T2978 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390141111800/awholynewcollection_3_shard1_replica1/data/index
[junit4] 2> 758584 T2978 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/h_n/co,null}
[junit4] 2> 758637 T2978 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4] 2> 758640 T2978 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:33947 33947
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=F06E0276F67B6C7F -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=it_IT -Dtests.timezone=Australia/Adelaide -Dtests.file.encoding=ISO-8859-1
[junit4] FAILURE 193s J1 | CollectionsAPIDistributedZkTest.testDistribSearch <<<
[junit4] > Throwable #1: java.lang.AssertionError
[junit4] > at __randomizedtesting.SeedInfo.seed([F06E0276F67B6C7F:71888C6E81240C43]:0)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.deleteCollectionWithDownNodes(CollectionsAPIDistributedZkTest.java:390)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:203)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
[junit4] > at java.lang.Thread.run(Thread.java:744)
[junit4] 2> 758823 T2978 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 193277 T2977 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 4 leaked thread(s).
[junit4] 2> 759801 T3004 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 759926 T3270 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 760064 T3064 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=Lucene46: {other_tl1=PostingsFormat(name=Memory doPackFST= true), _version_=PostingsFormat(name=SimpleText), multiDefault=PostingsFormat(name=Memory doPackFST= true), a_t=PostingsFormat(name=Memory doPackFST= true), a_si=PostingsFormat(name=SimpleText), intDefault=PostingsFormat(name=Memory doPackFST= true), range_facet_sl=PostingsFormat(name=TestBloomFilteredLucene41Postings), range_facet_si=PostingsFormat(name=Memory doPackFST= true), id=PostingsFormat(name=TestBloomFilteredLucene41Postings), text=PostingsFormat(name=MockRandom), range_facet_l=PostingsFormat(name=Memory doPackFST= true), timestamp=PostingsFormat(name=Memory doPackFST= true)}, docValues:{}, sim=DefaultSimilarity, locale=it_IT, timezone=Australia/Adelaide
[junit4] 2> NOTE: Linux 3.8.0-35-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=4,free=144430696,total=290971648
[junit4] 2> NOTE: All tests run in this JVM: [LeaderElectionIntegrationTest, OpenExchangeRatesOrgProviderTest, TestPartialUpdateDeduplication, StressHdfsTest, TestSolrCoreProperties, HighlighterTest, TestAnalyzedSuggestions, DeleteReplicaTest, DistanceFunctionTest, TestQuerySenderListener, AlternateDirectoryTest, SpellingQueryConverterTest, TestSolrDeletionPolicy2, TestUtils, DocumentAnalysisRequestHandlerTest, SolrCmdDistributorTest, SuggesterWFSTTest, XmlUpdateRequestHandlerTest, HighlighterConfigTest, TestJmxIntegration, StatsComponentTest, TestFuzzyAnalyzedSuggestions, HardAutoCommitTest, CurrencyFieldXmlFileTest, TestDFRSimilarityFactory, BasicZkTest, CursorPagingTest, SpellCheckComponentTest, SolrIndexConfigTest, TestSolrXmlPersistor, XsltUpdateRequestHandlerTest, ConnectionManagerTest, TestStressReorder, DistributedSuggestComponentTest, ConvertedLegacyTest, AddBlockUpdateTest, TestZkChroot, TestQueryTypes, TestNonNRTOpen, TestStressUserVersions, TestCoreDiscovery, BJQParserTest, TestFieldTypeResource, DirectSolrConnectionTest, TestCursorMarkWithoutUniqueKey, TestDistributedGrouping, TestDynamicFieldCollectionResource, TestSolrJ, TestSchemaSimilarityResource, TestIndexSearcher, HdfsDirectoryTest, ChaosMonkeyNothingIsSafeTest, TestFastLRUCache, FullSolrCloudDistribCmdsTest, IndexBasedSpellCheckerTest, TestQuerySenderNoQuery, TestAtomicUpdateErrorCases, HdfsUnloadDistributedZkTest, TestCustomSort, TestHashPartitioner, CursorMarkTest, TestDistributedSearch, TestLazyCores, TestShardHandlerFactory, TestDefaultSearchFieldResource, TestSchemaVersionResource, TestUpdate, BadIndexSchemaTest, HdfsCollectionsAPIDistributedZkTest, TestCollationKeyRangeQueries, TestMultiCoreConfBootstrap, TermVectorComponentDistributedTest, TestSolrQueryParserDefaultOperatorResource, TestReload, TestCollationField, TestArbitraryIndexDir, MultiTermTest, PingRequestHandlerTest, TestCodecSupport, PathHierarchyTokenizerFactoryTest, RAMDirectoryFactoryTest, OutputWriterTest, DirectUpdateHandlerTest, ZkNodePropsTest, TestSolr4Spatial, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest]
[junit4] Completed on J1 in 194.55s, 1 test, 1 failure <<< FAILURES!
[...truncated 607 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:459: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:439: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:491: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1308: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:941: There were test failures: 354 suites, 1540 tests, 1 failure, 34 ignored (6 assumptions)
Total time: 53 minutes 46 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-ea-b123 -server -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.7.0_51) - Build # 9057
- Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/9057/
Java: 64bit/jdk1.7.0_51 -XX:-UseCompressedOops -XX:+UseParallelGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([5C3D2B21C78F45E0:DDDBA539B0D025DC]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertFalse(Assert.java:68)
at org.junit.Assert.assertFalse(Assert.java:79)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.deleteCollectionWithDownNodes(CollectionsAPIDistributedZkTest.java:390)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:203)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Build Log:
[...truncated 9975 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> 17793 T32 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /wzan/ik
[junit4] 2> 17799 T32 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-CollectionsAPIDistributedZkTest-1390166469975
[junit4] 2> 17802 T32 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 17804 T33 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 17904 T32 oasc.ZkTestServer.run start zk server on port:55600
[junit4] 2> 17952 T32 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 18044 T39 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4326412c name:ZooKeeperConnection Watcher:127.0.0.1:55600 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 18044 T32 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 18046 T32 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 18079 T32 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 18082 T41 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@66ba60c7 name:ZooKeeperConnection Watcher:127.0.0.1:55600/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 18082 T32 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 18086 T32 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 18092 T32 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 18096 T32 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 18100 T32 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 18105 T32 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 18114 T32 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 18120 T32 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 18121 T32 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 18125 T32 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 18126 T32 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 18130 T32 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 18131 T32 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 18135 T32 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 18136 T32 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 18140 T32 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 18140 T32 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 18144 T32 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 18144 T32 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 18148 T32 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 18149 T32 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 18152 T32 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 18153 T32 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 18157 T32 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 18157 T32 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 18161 T32 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 18161 T32 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> Using new style solr.xml
[junit4] 2> 18166 T32 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 18168 T43 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e4546f8 name:ZooKeeperConnection Watcher:127.0.0.1:55600 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 18169 T32 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 18169 T32 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 18176 T32 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 18178 T45 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@75fa563e name:ZooKeeperConnection Watcher:127.0.0.1:55600/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 18178 T32 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 18179 T32 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf2/solrconfig.xml
[junit4] 2> 18179 T32 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.xml
[junit4] 2> 18185 T32 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
[junit4] 2> 18185 T32 oascc.SolrZkClient.makePath makePath: /configs/conf2/schema.xml
[junit4] 2> 18190 T32 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 18190 T32 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 18194 T32 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
[junit4] 2> 18194 T32 oascc.SolrZkClient.makePath makePath: /configs/conf2/stopwords.txt
[junit4] 2> 18197 T32 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
[junit4] 2> 18198 T32 oascc.SolrZkClient.makePath makePath: /configs/conf2/protwords.txt
[junit4] 2> 18202 T32 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
[junit4] 2> 18202 T32 oascc.SolrZkClient.makePath makePath: /configs/conf2/currency.xml
[junit4] 2> 18205 T32 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
[junit4] 2> 18206 T32 oascc.SolrZkClient.makePath makePath: /configs/conf2/open-exchange-rates.json
[junit4] 2> 18209 T32 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 18209 T32 oascc.SolrZkClient.makePath makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 18213 T32 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
[junit4] 2> 18213 T32 oascc.SolrZkClient.makePath makePath: /configs/conf2/old_synonyms.txt
[junit4] 2> 18217 T32 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
[junit4] 2> 18217 T32 oascc.SolrZkClient.makePath makePath: /configs/conf2/synonyms.txt
[junit4] 2> 18221 T32 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
[junit4] 2> 18222 T32 oascc.SolrZkClient.makePath makePath: /configs/conf2/elevate.xml
[junit4] 2> 18427 T32 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 18510 T32 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:40716
[junit4] 2> 18524 T32 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 18525 T32 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 18525 T32 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390166470402
[junit4] 2> 18526 T32 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390166470402/'
[junit4] 2> 18550 T32 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390166470402/solr.xml
[junit4] 2> 18601 T32 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 18603 T32 oasc.CoreContainer.<init> New CoreContainer 150788628
[junit4] 2> 18604 T32 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390166470402/]
[junit4] 2> 18616 T32 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 18617 T32 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 18617 T32 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 18618 T32 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 18618 T32 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 18619 T32 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 18619 T32 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 18619 T32 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 18620 T32 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 18624 T32 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 18625 T32 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 18625 T32 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 18626 T32 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55600/solr
[junit4] 2> 18634 T32 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 18636 T32 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 18641 T57 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4ae85f19 name:ZooKeeperConnection Watcher:127.0.0.1:55600 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 18641 T32 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 18647 T32 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 18649 T59 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6b089ee3 name:ZooKeeperConnection Watcher:127.0.0.1:55600/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 18649 T32 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 18655 T32 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 18663 T32 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 18671 T32 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 18675 T32 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40716_wzan%2Fik
[junit4] 2> 18678 T32 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40716_wzan%2Fik
[junit4] 2> 18684 T32 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 18688 T32 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 18700 T32 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 18703 T32 oasc.Overseer.start Overseer (id=91105949782114309-127.0.0.1:40716_wzan%2Fik-n_0000000000) starting
[junit4] 2> 18714 T32 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 18728 T61 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 18728 T32 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 18733 T32 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 18733 T61 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 18740 T32 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 18749 T60 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 18752 T32 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390166470402
[junit4] 2> 18757 T32 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390166470402/conf/
[junit4] 2> 18795 T32 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 18796 T32 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 18796 T32 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 18822 T32 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 18824 T64 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f5579a1 name:ZooKeeperConnection Watcher:127.0.0.1:55600/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 18826 T32 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 18829 T32 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 18836 T32 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 18925 T32 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 18927 T32 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35474
[junit4] 2> 18928 T32 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 18929 T32 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 18929 T32 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390166471012
[junit4] 2> 18930 T32 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390166471012/'
[junit4] 2> 18948 T32 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390166471012/solr.xml
[junit4] 2> 18994 T32 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 18995 T32 oasc.CoreContainer.<init> New CoreContainer 1861990275
[junit4] 2> 18995 T32 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390166471012/]
[junit4] 2> 18996 T32 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 18997 T32 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 18997 T32 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 18997 T32 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 18998 T32 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 18998 T32 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 18998 T32 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 18999 T32 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 18999 T32 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 19002 T32 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 19003 T32 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 19003 T32 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 19003 T32 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55600/solr
[junit4] 2> 19004 T32 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 19004 T32 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 19006 T75 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4fcd3261 name:ZooKeeperConnection Watcher:127.0.0.1:55600 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 19007 T32 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 19010 T32 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 19012 T77 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@295fb895 name:ZooKeeperConnection Watcher:127.0.0.1:55600/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 19012 T32 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 19019 T32 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 20024 T32 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35474_wzan%2Fik
[junit4] 2> 20026 T32 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35474_wzan%2Fik
[junit4] 2> 20032 T64 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 20032 T59 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 20032 T77 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 20042 T32 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390166471012
[junit4] 2> 20044 T32 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390166471012/conf/
[junit4] 2> 20065 T32 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 20066 T32 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 20066 T32 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 20140 T32 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 20143 T32 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53435
[junit4] 2> 20143 T32 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 20144 T32 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 20144 T32 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390166472243
[junit4] 2> 20144 T32 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390166472243/'
[junit4] 2> 20156 T32 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390166472243/solr.xml
[junit4] 2> 20195 T32 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 20196 T32 oasc.CoreContainer.<init> New CoreContainer 571059610
[junit4] 2> 20196 T32 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390166472243/]
[junit4] 2> 20197 T32 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 20198 T32 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 20198 T32 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 20198 T32 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 20198 T32 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 20199 T32 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 20199 T32 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 20200 T32 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 20200 T32 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 20203 T32 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 20204 T32 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 20204 T32 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 20204 T32 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55600/solr
[junit4] 2> 20205 T32 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 20206 T32 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 20208 T89 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@29646aeb name:ZooKeeperConnection Watcher:127.0.0.1:55600 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 20209 T32 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 20311 T32 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 20315 T91 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3aafc3a2 name:ZooKeeperConnection Watcher:127.0.0.1:55600/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 20316 T32 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 20328 T32 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 21336 T32 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53435_wzan%2Fik
[junit4] 2> 21338 T32 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53435_wzan%2Fik
[junit4] 2> 21342 T64 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 21342 T91 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 21342 T77 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 21342 T59 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 21351 T32 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390166472243
[junit4] 2> 21353 T32 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390166472243/conf/
[junit4] 2> 21382 T32 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 21383 T32 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 21383 T32 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 21455 T32 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 21457 T32 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:38500
[junit4] 2> 21458 T32 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 21458 T32 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 21459 T32 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390166473560
[junit4] 2> 21459 T32 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390166473560/'
[junit4] 2> 21479 T32 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390166473560/solr.xml
[junit4] 2> 21536 T32 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 21537 T32 oasc.CoreContainer.<init> New CoreContainer 967908115
[junit4] 2> 21537 T32 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390166473560/]
[junit4] 2> 21538 T32 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 21539 T32 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 21539 T32 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 21539 T32 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 21540 T32 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 21540 T32 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 21540 T32 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 21540 T32 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 21541 T32 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 21544 T32 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 21545 T32 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 21545 T32 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 21545 T32 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55600/solr
[junit4] 2> 21546 T32 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 21546 T32 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 21548 T103 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b7d5486 name:ZooKeeperConnection Watcher:127.0.0.1:55600 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 21549 T32 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 21553 T32 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 21556 T105 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@334c3ee7 name:ZooKeeperConnection Watcher:127.0.0.1:55600/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 21556 T32 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 21568 T32 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 22577 T32 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38500_wzan%2Fik
[junit4] 2> 22579 T32 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38500_wzan%2Fik
[junit4] 2> 22583 T64 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 22584 T105 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 22584 T59 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 22584 T77 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 22583 T91 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 22591 T32 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390166473560
[junit4] 2> 22592 T32 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390166473560/conf/
[junit4] 2> 22619 T32 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 22620 T32 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 22620 T32 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 22710 T32 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 22713 T32 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:45057
[junit4] 2> 22713 T32 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 22714 T32 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 22714 T32 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390166474797
[junit4] 2> 22714 T32 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390166474797/'
[junit4] 2> 22726 T32 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390166474797/solr.xml
[junit4] 2> 22768 T32 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 22768 T32 oasc.CoreContainer.<init> New CoreContainer 798491079
[junit4] 2> 22768 T32 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390166474797/]
[junit4] 2> 22770 T32 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 22770 T32 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 22770 T32 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 22771 T32 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 22771 T32 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 22771 T32 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 22772 T32 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 22772 T32 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 22772 T32 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 22776 T32 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 22776 T32 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 22776 T32 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 22777 T32 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55600/solr
[junit4] 2> 22777 T32 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 22778 T32 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 22780 T117 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@249cc83a name:ZooKeeperConnection Watcher:127.0.0.1:55600 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 22780 T32 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 22783 T32 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 22785 T119 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6a1873a3 name:ZooKeeperConnection Watcher:127.0.0.1:55600/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 22785 T32 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 22792 T32 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 23802 T32 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45057_wzan%2Fik
[junit4] 2> 23805 T32 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45057_wzan%2Fik
[junit4] 2> 23813 T59 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 23813 T64 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 23814 T77 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 23814 T105 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 23815 T119 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 23814 T91 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 23830 T32 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390166474797
[junit4] 2> 23832 T32 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390166474797/conf/
[junit4] 2> 23866 T32 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 23867 T32 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 23867 T32 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 24084 T72 oasha.CollectionsHandler.handleCreateAction Creating Collection : version=2&replicationFactor=2&numShards=2&name=solrj_collection&wt=javabin&router.field=myOwnField&action=CREATE&router.name=compositeId&collection.configName=conf1
[junit4] 2> 24087 T59 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 24092 T61 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField",
[junit4] 2> "router.name":"compositeId"}
[junit4] 2> 24094 T61 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField",
[junit4] 2> "router.name":"compositeId"}
[junit4] 2> 24098 T61 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/solrj_collection
[junit4] 2> 24099 T61 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
[junit4] 2> 24106 T59 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 24110 T60 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 24111 T60 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: solrj_collection
[junit4] 2> 24112 T60 oasc.Overseer$ClusterStateUpdater.createCollection Create collection solrj_collection with shards [shard1, shard2]
[junit4] 2> 24123 T59 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 24125 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 24126 T105 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 24126 T91 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 24126 T119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 24125 T59 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 24125 T64 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 24207 T61 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2] , repFactor : 2
[junit4] 2> 24208 T61 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of collection solrj_collection on 127.0.0.1:45057_wzan%2Fik
[junit4] 2> 24217 T61 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of collection solrj_collection on 127.0.0.1:38500_wzan%2Fik
[junit4] 2> 24219 T61 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of collection solrj_collection on 127.0.0.1:53435_wzan%2Fik
[junit4] 2> 24220 T61 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of collection solrj_collection on 127.0.0.1:40716_wzan%2Fik
[junit4] 2> 24242 T86 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica1 state=down
[junit4] 2> 24243 T113 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica1 state=down
[junit4] 2> 24242 T101 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica2 state=down
[junit4] 2> 24242 T52 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica2 state=down
[junit4] 2> 24246 T59 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 24246 T101 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 24246 T52 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 24246 T113 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 24246 T86 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 24248 T60 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 24250 T60 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:53435/wzan/ik",
[junit4] 2> "core":"solrj_collection_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:53435_wzan%2Fik",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 24256 T59 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 24257 T60 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:45057/wzan/ik",
[junit4] 2> "core":"solrj_collection_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:45057_wzan%2Fik",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 24263 T59 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 24265 T60 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:38500/wzan/ik",
[junit4] 2> "core":"solrj_collection_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:38500_wzan%2Fik",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 24270 T59 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 24272 T60 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40716/wzan/ik",
[junit4] 2> "core":"solrj_collection_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:40716_wzan%2Fik",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 24277 T59 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 24383 T91 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 24383 T59 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 24383 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 24383 T119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 24383 T64 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 24383 T105 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 25247 T101 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica2
[junit4] 2> 25247 T52 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica2
[junit4] 2> 25248 T113 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica1
[junit4] 2> 25248 T86 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica1
[junit4] 2> 25252 T86 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390166472243/solrj_collection_shard2_replica1
[junit4] 2> 25252 T101 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica2' using instanceDir: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390166473560/solrj_collection_shard1_replica2
[junit4] 2> 25252 T52 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica2' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390166470402/solrj_collection_shard2_replica2
[junit4] 2> 25252 T113 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica1' using instanceDir: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390166474797/solrj_collection_shard1_replica1
[junit4] 2> 25253 T113 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 25253 T52 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 25252 T101 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 25252 T86 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 25254 T113 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 25255 T101 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 25255 T101 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 25254 T52 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 25256 T52 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 25255 T86 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 25256 T86 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 25255 T113 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 25257 T101 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390166473560/solrj_collection_shard1_replica2/'
[junit4] 2> 25258 T52 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390166470402/solrj_collection_shard2_replica2/'
[junit4] 2> 25259 T113 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390166474797/solrj_collection_shard1_replica1/'
[junit4] 2> 25259 T86 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390166472243/solrj_collection_shard2_replica1/'
[junit4] 2> 25355 T101 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 25362 T86 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 25363 T52 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 25367 T113 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 25431 T101 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 25433 T113 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 25433 T101 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 25436 T113 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 25438 T52 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 25441 T52 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 25446 T86 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 25449 T86 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 25459 T101 oass.IndexSchema.readSchema [solrj_collection_shard1_replica2] Schema name=test
[junit4] 2> 25471 T113 oass.IndexSchema.readSchema [solrj_collection_shard1_replica1] Schema name=test
[junit4] 2> 25475 T52 oass.IndexSchema.readSchema [solrj_collection_shard2_replica2] Schema name=test
[junit4] 2> 25488 T86 oass.IndexSchema.readSchema [solrj_collection_shard2_replica1] Schema name=test
[junit4] 2> 26066 T101 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 26067 T101 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 26070 T101 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 26084 T101 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 26089 T101 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 26123 T101 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 26128 T101 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 26133 T101 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 26135 T101 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 26135 T101 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 26136 T101 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 26137 T101 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 26138 T101 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 26138 T101 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 26139 T101 oasc.SolrCore.<init> [solrj_collection_shard1_replica2] Opening new SolrCore at ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390166473560/solrj_collection_shard1_replica2/, dataDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390166473560/solrj_collection_shard1_replica2/data/
[junit4] 2> 26148 T86 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 26149 T101 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ad5934b
[junit4] 2> 26149 T86 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 26151 T86 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 26172 T86 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 26189 T101 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390166473560/solrj_collection_shard1_replica2/data
[junit4] 2> 26190 T101 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390166473560/solrj_collection_shard1_replica2/data/index/
[junit4] 2> 26190 T101 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica2] Solr index directory './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390166473560/solrj_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 26191 T101 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390166473560/solrj_collection_shard1_replica2/data/index
[junit4] 2> 26192 T101 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=89.5087890625, floorSegmentMB=1.318359375, forceMergeDeletesPctAllowed=2.4747250264904617, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.24653459912727593
[junit4] 2> 26193 T86 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 26193 T101 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@7b545018 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4ea0397f),segFN=segments_1,generation=1}
[junit4] 2> 26194 T101 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 26216 T101 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 26220 T52 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 26221 T52 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 26224 T52 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 26225 T113 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 26226 T113 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 26228 T113 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 26242 T86 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 26245 T52 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 26249 T86 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 26251 T101 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 26251 T101 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 26252 T101 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 26252 T113 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 26250 T52 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 26252 T101 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 26261 T86 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 26262 T101 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 26263 T101 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 26264 T101 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 26264 T101 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 26262 T113 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 26264 T86 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 26267 T86 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 26268 T86 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 26268 T101 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 26270 T101 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 26270 T101 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 26271 T101 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 26272 T86 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 26273 T101 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 26274 T101 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 26276 T101 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 26273 T86 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 26278 T86 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 26278 T86 oasc.SolrCore.<init> [solrj_collection_shard2_replica1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390166472243/solrj_collection_shard2_replica1/, dataDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390166472243/solrj_collection_shard2_replica1/data/
[junit4] 2> 26279 T86 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ad5934b
[junit4] 2> 26287 T101 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 26291 T86 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390166472243/solrj_collection_shard2_replica1/data
[junit4] 2> 26291 T86 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390166472243/solrj_collection_shard2_replica1/data/index/
[junit4] 2> 26291 T86 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica1] Solr index directory '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390166472243/solrj_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 26292 T86 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390166472243/solrj_collection_shard2_replica1/data/index
[junit4] 2> 26292 T86 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=89.5087890625, floorSegmentMB=1.318359375, forceMergeDeletesPctAllowed=2.4747250264904617, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.24653459912727593
[junit4] 2> 26293 T86 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@139890ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1748bce2),segFN=segments_1,generation=1}
[junit4] 2> 26294 T86 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 26299 T101 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 26300 T101 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 26302 T101 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=87.5439453125, floorSegmentMB=2.029296875, forceMergeDeletesPctAllowed=22.159169660299366, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.608147706626239
[junit4] 2> 26303 T101 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@7b545018 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4ea0397f),segFN=segments_1,generation=1}
[junit4] 2> 26304 T101 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 26304 T101 oass.SolrIndexSearcher.<init> Opening Searcher@1ac7e317 main
[junit4] 2> 26304 T52 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 26317 T86 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 26318 T86 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 26319 T86 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 26319 T52 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 26320 T86 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 26327 T52 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 26328 T86 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 26329 T86 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 26329 T125 oasc.SolrCore.registerSearcher [solrj_collection_shard1_replica2] Registered new searcher Searcher@1ac7e317 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 26331 T86 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 26330 T52 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 26333 T52 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 26333 T52 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 26334 T113 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 26337 T52 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 26337 T52 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 26338 T52 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 26339 T52 oasc.SolrCore.<init> [solrj_collection_shard2_replica2] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390166470402/solrj_collection_shard2_replica2/, dataDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390166470402/solrj_collection_shard2_replica2/data/
[junit4] 2> 26339 T52 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ad5934b
[junit4] 2> 26342 T52 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390166470402/solrj_collection_shard2_replica2/data
[junit4] 2> 26342 T52 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390166470402/solrj_collection_shard2_replica2/data/index/
[junit4] 2> 26343 T52 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica2] Solr index directory '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390166470402/solrj_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 26342 T86 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 26343 T101 oasc.CoreContainer.registerCore registering core: solrj_collection_shard1_replica2
[junit4] 2> 26344 T52 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390166470402/solrj_collection_shard2_replica2/data/index
[junit4] 2> 26344 T101 oasc.ZkController.register Register replica - core:solrj_collection_shard1_replica2 address:http://127.0.0.1:38500/wzan/ik collection:solrj_collection shard:shard1
[junit4] 2> 26344 T86 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 26345 T113 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 26345 T52 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=89.5087890625, floorSegmentMB=1.318359375, forceMergeDeletesPctAllowed=2.4747250264904617, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.24653459912727593
[junit4] 2> 26347 T86 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 26348 T52 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@72dd5a1f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@79220f71),segFN=segments_1,generation=1}
[junit4] 2> 26349 T52 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 26349 T86 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 26350 T86 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 26351 T86 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 26352 T86 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 26353 T101 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection/leader_elect/shard1/election
[junit4] 2> 26354 T86 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 26354 T113 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 26357 T86 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 26360 T86 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 26362 T113 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 26362 T113 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 26363 T113 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 26366 T86 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 26366 T52 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 26367 T86 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 26367 T52 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 26368 T113 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 26369 T86 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=87.5439453125, floorSegmentMB=2.029296875, forceMergeDeletesPctAllowed=22.159169660299366, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.608147706626239
[junit4] 2> 26369 T52 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 26370 T86 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@139890ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1748bce2),segFN=segments_1,generation=1}
[junit4] 2> 26371 T86 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 26372 T86 oass.SolrIndexSearcher.<init> Opening Searcher@5c1be6a0 main
[junit4] 2> 26369 T113 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 26371 T52 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 26373 T113 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 26374 T52 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 26374 T113 oasc.SolrCore.<init> [solrj_collection_shard1_replica1] Opening new SolrCore at ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390166474797/solrj_collection_shard1_replica1/, dataDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390166474797/solrj_collection_shard1_replica1/data/
[junit4] 2> 26374 T52 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 26375 T101 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 26375 T52 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 26376 T52 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 26376 T52 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 26377 T52 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 26379 T52 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 26379 T52 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 26380 T52 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 26380 T101 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=179999
[junit4] 2> 26381 T52 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 26375 T113 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ad5934b
[junit4] 2> 26382 T52 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 26379 T59 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 26383 T113 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390166474797/solrj_collection_shard1_replica1/data
[junit4] 2> 26385 T113 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390166474797/solrj_collection_shard1_replica1/data/index/
[junit4] 2> 26385 T59 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 26386 T59 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 26386 T52 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 26385 T127 oasc.SolrCore.registerSearcher [solrj_collection_shard2_replica1] Registered new searcher Searcher@5c1be6a0 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 26388 T60 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 26388 T52 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 26386 T113 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica1] Solr index directory './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390166474797/solrj_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 26392 T113 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390166474797/solrj_collection_shard1_replica1/data/index
[junit4] 2> 26393 T113 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=89.5087890625, floorSegmentMB=1.318359375, forceMergeDeletesPctAllowed=2.4747250264904617, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.24653459912727593
[junit4] 2> 26394 T52 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 26394 T113 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@5fa69521 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4343c625),segFN=segments_1,generation=1}
[junit4] 2> 26396 T59 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 26395 T52 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 26396 T113 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 26398 T64 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 26398 T59 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 26398 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 26399 T119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 26399 T91 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 26399 T52 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=87.5439453125, floorSegmentMB=2.029296875, forceMergeDeletesPctAllowed=22.159169660299366, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.608147706626239
[junit4] 2> 26401 T105 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 26401 T52 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@72dd5a1f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@79220f71),segFN=segments_1,generation=1}
[junit4] 2> 26404 T52 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 26405 T52 oass.SolrIndexSearcher.<init> Opening Searcher@5ecdb1d0 main
[junit4] 2> 26408 T86 oasc.CoreContainer.registerCore registering core: solrj_collection_shard2_replica1
[junit4] 2> 26408 T86 oasc.ZkController.register Register replica - core:solrj_col
[...truncated too long message...]
, so become leader anyway
[junit4] 2> 118371 T119 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45057/wzan/ik/nodes_used_collection_shard2_replica2/ shard2
[junit4] 2> 118372 T119 oasc.SolrCore.close [nodes_used_collection_shard2_replica2] CLOSING SolrCore org.apache.solr.core.SolrCore@507104cd
[junit4] 2> 118383 T119 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
[junit4] 2> 118383 T119 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 118384 T119 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 118384 T119 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 118384 T119 oasc.SolrCore.closeSearcher [nodes_used_collection_shard2_replica2] Closing main searcher on request.
[junit4] 2> 118384 T119 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 118385 T119 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390166474797/nodes_used_collection_shard2_replica2/data/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390166474797/nodes_used_collection_shard2_replica2/data/index;done=false>>]
[junit4] 2> 118385 T119 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390166474797/nodes_used_collection_shard2_replica2/data/index
[junit4] 2> 118385 T119 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390166474797/nodes_used_collection_shard2_replica2/data [CachedDir<<refCount=0;path=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390166474797/nodes_used_collection_shard2_replica2/data;done=false>>]
[junit4] 2> 118385 T119 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390166474797/nodes_used_collection_shard2_replica2/data
[junit4] 2> 118385 T119 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard2
[junit4] 2> 118386 T119 oasc.SolrException.log ERROR There was a problem trying to register as the leader:org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:205)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:202)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:202)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:413)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:382)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:369)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:112)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:273)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 118386 T119 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/nodes_used_collection/leader_elect/shard2/election/91105949782114318-core_node2-n_0000000001
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:173)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:170)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:170)
[junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:67)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:293)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 118386 T119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 118387 T119 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 118387 T119 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 118387 T119 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=Lucene42, sim=DefaultSimilarity, locale=bg_BG, timezone=Etc/GMT-7
[junit4] 2> NOTE: Linux 3.8.0-35-generic amd64/Oracle Corporation 1.7.0_51 (64-bit)/cpus=8,threads=3,free=197604016,total=290979840
[junit4] 2> NOTE: All tests run in this JVM: [FieldAnalysisRequestHandlerTest, SpellCheckComponentTest, TestComponentsName, FileUtilsTest, DistanceFunctionTest, CollectionsAPIDistributedZkTest]
[junit4] Completed on J1 in 101.54s, 1 test, 1 failure <<< FAILURES!
[...truncated 1043 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:459: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:439: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:491: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1308: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:941: There were test failures: 354 suites, 1540 tests, 1 failure, 34 ignored (6 assumptions)
Total time: 47 minutes 16 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_51 -XX:-UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.8.0-ea-b123) - Build #
9056 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/9056/
Java: 64bit/jdk1.8.0-ea-b123 -XX:-UseCompressedOops -XX:+UseParallelGC
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.MigrateRouteKeyTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.MigrateRouteKeyTest: 1) Thread[id=3810, name=Timer-0, state=WAITING, group=TGRP-MigrateRouteKeyTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at java.util.TimerThread.mainLoop(Timer.java:526) at java.util.TimerThread.run(Timer.java:505)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.MigrateRouteKeyTest:
1) Thread[id=3810, name=Timer-0, state=WAITING, group=TGRP-MigrateRouteKeyTest]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at java.util.TimerThread.mainLoop(Timer.java:526)
at java.util.TimerThread.run(Timer.java:505)
at __randomizedtesting.SeedInfo.seed([2557C668ADCD2F5]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.MigrateRouteKeyTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=3810, name=Timer-0, state=WAITING, group=TGRP-MigrateRouteKeyTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at java.util.TimerThread.mainLoop(Timer.java:526) at java.util.TimerThread.run(Timer.java:505)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=3810, name=Timer-0, state=WAITING, group=TGRP-MigrateRouteKeyTest]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at java.util.TimerThread.mainLoop(Timer.java:526)
at java.util.TimerThread.run(Timer.java:505)
at __randomizedtesting.SeedInfo.seed([2557C668ADCD2F5]:0)
Build Log:
[...truncated 11016 lines...]
[junit4] Suite: org.apache.solr.cloud.MigrateRouteKeyTest
[junit4] 2> 1138897 T3673 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 1138900 T3673 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-MigrateRouteKeyTest-1390161332524
[junit4] 2> 1138901 T3673 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1138901 T3674 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1139002 T3673 oasc.ZkTestServer.run start zk server on port:45682
[junit4] 2> 1139003 T3673 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1139007 T3680 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c193da4 name:ZooKeeperConnection Watcher:127.0.0.1:45682 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1139008 T3673 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1139008 T3673 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1139013 T3673 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1139015 T3682 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1200a6f2 name:ZooKeeperConnection Watcher:127.0.0.1:45682/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1139015 T3673 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1139015 T3673 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1139018 T3673 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1139022 T3673 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1139024 T3673 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1139027 T3673 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1139028 T3673 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1139032 T3673 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1139033 T3673 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1139037 T3673 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1139038 T3673 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1139041 T3673 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1139042 T3673 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1139045 T3673 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1139046 T3673 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1139050 T3673 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1139051 T3673 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1139054 T3673 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1139055 T3673 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1139058 T3673 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1139059 T3673 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1139062 T3673 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1139062 T3673 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1139065 T3673 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1139065 T3673 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1139069 T3673 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1139070 T3673 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1139166 T3673 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1139172 T3673 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:39108
[junit4] 2> 1139172 T3673 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1139172 T3673 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1139173 T3673 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.MigrateRouteKeyTest-controljetty-1390161332697
[junit4] 2> 1139173 T3673 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.MigrateRouteKeyTest-controljetty-1390161332697/'
[junit4] 2> 1139188 T3673 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.MigrateRouteKeyTest-controljetty-1390161332697/solr.xml
[junit4] 2> 1139197 T3673 oasc.CoreContainer.<init> New CoreContainer 361776850
[junit4] 2> 1139197 T3673 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.MigrateRouteKeyTest-controljetty-1390161332697/]
[junit4] 2> 1139198 T3673 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1139198 T3673 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1139199 T3673 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1139199 T3673 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1139200 T3673 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1139200 T3673 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1139200 T3673 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1139201 T3673 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1139201 T3673 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1139204 T3673 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1139205 T3673 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1139205 T3673 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1139206 T3673 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45682/solr
[junit4] 2> 1139206 T3673 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1139207 T3673 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1139208 T3693 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@63f17878 name:ZooKeeperConnection Watcher:127.0.0.1:45682 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1139208 T3673 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1139211 T3673 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1139212 T3695 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c7f563 name:ZooKeeperConnection Watcher:127.0.0.1:45682/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1139212 T3673 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1139214 T3673 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1139216 T3673 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1139218 T3673 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1139219 T3673 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39108_
[junit4] 2> 1139219 T3673 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39108_
[junit4] 2> 1139221 T3673 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1139222 T3673 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1139224 T3673 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1139225 T3673 oasc.Overseer.start Overseer (id=91105613088423939-127.0.0.1:39108_-n_0000000000) starting
[junit4] 2> 1139227 T3673 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1139231 T3697 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1139232 T3673 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1139232 T3697 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 1139233 T3673 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1139234 T3673 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1139236 T3696 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1139237 T3698 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1139237 T3698 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1139239 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1139239 T3698 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1139241 T3696 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1139241 T3696 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:39108",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:39108_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1139241 T3696 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 1139242 T3696 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1139243 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1139243 T3695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1140240 T3698 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1140240 T3698 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.MigrateRouteKeyTest-controljetty-1390161332697/collection1
[junit4] 2> 1140240 T3698 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 1140241 T3698 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1140241 T3698 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1140242 T3698 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.MigrateRouteKeyTest-controljetty-1390161332697/collection1/'
[junit4] 2> 1140243 T3698 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.MigrateRouteKeyTest-controljetty-1390161332697/collection1/lib/classes/' to classloader
[junit4] 2> 1140243 T3698 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.MigrateRouteKeyTest-controljetty-1390161332697/collection1/lib/README' to classloader
[junit4] 2> 1140258 T3698 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1140266 T3698 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1140268 T3698 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1140271 T3698 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1140362 T3698 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1140363 T3698 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1140364 T3698 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1140366 T3698 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1140376 T3698 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1140376 T3698 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.MigrateRouteKeyTest-controljetty-1390161332697/collection1/, dataDir=./org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/control/data/
[junit4] 2> 1140377 T3698 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2279e22e
[junit4] 2> 1140377 T3698 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/control/data
[junit4] 2> 1140377 T3698 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/control/data/index/
[junit4] 2> 1140377 T3698 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 1140378 T3698 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/control/data/index
[junit4] 2> 1140378 T3698 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=10, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.751778200923446]
[junit4] 2> 1140378 T3698 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@671c2f25 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1dfc64d7),segFN=segments_1,generation=1}
[junit4] 2> 1140378 T3698 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1140380 T3698 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1140380 T3698 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1140380 T3698 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1140380 T3698 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1140381 T3698 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1140381 T3698 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1140381 T3698 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1140381 T3698 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1140381 T3698 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1140382 T3698 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1140382 T3698 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1140382 T3698 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1140382 T3698 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1140382 T3698 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1140383 T3698 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1140383 T3698 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1140384 T3698 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1140385 T3698 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1140385 T3698 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1140386 T3698 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=68.3408203125, floorSegmentMB=2.0224609375, forceMergeDeletesPctAllowed=12.190356296143152, segmentsPerTier=12.0, maxCFSSegmentSizeMB=1.4072265625, noCFSRatio=0.0
[junit4] 2> 1140386 T3698 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@671c2f25 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1dfc64d7),segFN=segments_1,generation=1}
[junit4] 2> 1140386 T3698 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1140386 T3698 oass.SolrIndexSearcher.<init> Opening Searcher@7dcfbcbd main
[junit4] 2> 1140387 T3699 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7dcfbcbd main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1140388 T3698 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1140388 T3673 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 1140389 T3673 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1140388 T3702 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:39108 collection:control_collection shard:shard1
[junit4] 2> 1140390 T3673 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1140390 T3702 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1140391 T3704 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e1e3f92 name:ZooKeeperConnection Watcher:127.0.0.1:45682/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1140391 T3673 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1140392 T3673 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1140393 T3673 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1140394 T3702 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1140396 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1140396 T3702 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1140396 T3702 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C3218 name=collection1 org.apache.solr.core.SolrCore@58fdc255 url=http://127.0.0.1:39108/collection1 node=127.0.0.1:39108_ C3218_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:39108, core=collection1, node_name=127.0.0.1:39108_}
[junit4] 2> 1140396 T3702 C3218 P39108 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:39108/collection1/
[junit4] 2> 1140396 T3696 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1140396 T3702 C3218 P39108 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1140397 T3702 C3218 P39108 oasc.SyncStrategy.syncToMe http://127.0.0.1:39108/collection1/ has no replicas
[junit4] 2> 1140397 T3702 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:39108/collection1/ shard1
[junit4] 2> 1140397 T3702 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1140400 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1140403 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1140405 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1140456 T3673 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1140457 T3673 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55726
[junit4] 2> 1140458 T3673 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1140458 T3673 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1140458 T3673 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.MigrateRouteKeyTest-jetty1-1390161334017
[junit4] 2> 1140458 T3673 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.MigrateRouteKeyTest-jetty1-1390161334017/'
[junit4] 2> 1140470 T3673 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.MigrateRouteKeyTest-jetty1-1390161334017/solr.xml
[junit4] 2> 1140478 T3673 oasc.CoreContainer.<init> New CoreContainer 485958724
[junit4] 2> 1140478 T3673 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.MigrateRouteKeyTest-jetty1-1390161334017/]
[junit4] 2> 1140479 T3673 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1140479 T3673 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1140479 T3673 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1140479 T3673 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1140479 T3673 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1140480 T3673 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1140480 T3673 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1140480 T3673 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1140480 T3673 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1140482 T3673 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1140482 T3673 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1140482 T3673 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1140483 T3673 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45682/solr
[junit4] 2> 1140483 T3673 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1140484 T3673 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1140486 T3715 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4245fd17 name:ZooKeeperConnection Watcher:127.0.0.1:45682 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1140487 T3673 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1140490 T3673 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1140491 T3717 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5a30e1b0 name:ZooKeeperConnection Watcher:127.0.0.1:45682/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1140492 T3673 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1140495 T3673 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1140508 T3695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1140508 T3717 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1140508 T3704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1140553 T3702 oasc.ZkController.register We are http://127.0.0.1:39108/collection1/ and leader is http://127.0.0.1:39108/collection1/
[junit4] 2> 1140554 T3702 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:39108
[junit4] 2> 1140554 T3702 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1140555 T3702 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1140555 T3702 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1140556 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1140557 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1140557 T3702 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1140557 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1140559 T3696 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1140560 T3696 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:39108",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:39108_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1140563 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1140667 T3717 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1140667 T3695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1140667 T3704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1141498 T3673 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55726_
[junit4] 2> 1141499 T3673 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55726_
[junit4] 2> 1141501 T3704 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1141501 T3717 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1141501 T3695 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1141505 T3718 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1141505 T3718 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1141506 T3718 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1141506 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1141506 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1141506 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1141507 T3696 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1141508 T3696 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:55726",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55726_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1141508 T3696 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 1141508 T3696 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 1141510 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1141612 T3704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1141612 T3695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1141612 T3717 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1142506 T3718 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1142506 T3718 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.MigrateRouteKeyTest-jetty1-1390161334017/collection1
[junit4] 2> 1142507 T3718 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1142507 T3718 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1142507 T3718 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1142508 T3718 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.MigrateRouteKeyTest-jetty1-1390161334017/collection1/'
[junit4] 2> 1142509 T3718 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.MigrateRouteKeyTest-jetty1-1390161334017/collection1/lib/classes/' to classloader
[junit4] 2> 1142509 T3718 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.MigrateRouteKeyTest-jetty1-1390161334017/collection1/lib/README' to classloader
[junit4] 2> 1142528 T3718 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1142536 T3718 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1142537 T3718 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1142541 T3718 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1142635 T3718 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1142636 T3718 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1142637 T3718 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1142639 T3718 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1142654 T3718 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1142655 T3718 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.MigrateRouteKeyTest-jetty1-1390161334017/collection1/, dataDir=./org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/jetty1/
[junit4] 2> 1142655 T3718 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2279e22e
[junit4] 2> 1142655 T3718 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/jetty1
[junit4] 2> 1142656 T3718 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/jetty1/index/
[junit4] 2> 1142656 T3718 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 1142656 T3718 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/jetty1/index
[junit4] 2> 1142657 T3718 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=10, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.751778200923446]
[junit4] 2> 1142657 T3718 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@164791bd lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@31926e0),segFN=segments_1,generation=1}
[junit4] 2> 1142657 T3718 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1142660 T3718 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1142660 T3718 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1142660 T3718 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1142660 T3718 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1142661 T3718 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1142661 T3718 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1142661 T3718 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1142661 T3718 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1142662 T3718 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1142662 T3718 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1142662 T3718 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1142662 T3718 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1142663 T3718 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1142663 T3718 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1142663 T3718 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1142663 T3718 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1142665 T3718 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1142666 T3718 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1142666 T3718 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1142666 T3718 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=68.3408203125, floorSegmentMB=2.0224609375, forceMergeDeletesPctAllowed=12.190356296143152, segmentsPerTier=12.0, maxCFSSegmentSizeMB=1.4072265625, noCFSRatio=0.0
[junit4] 2> 1142667 T3718 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@164791bd lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@31926e0),segFN=segments_1,generation=1}
[junit4] 2> 1142667 T3718 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1142667 T3718 oass.SolrIndexSearcher.<init> Opening Searcher@5345027f main
[junit4] 2> 1142669 T3719 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5345027f main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1142670 T3718 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1142670 T3673 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 1142671 T3673 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1142670 T3722 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55726 collection:collection1 shard:shard2
[junit4] 2> 1142672 T3722 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 1142677 T3722 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 1142678 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1142678 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1142678 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1142678 T3722 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1142678 T3722 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C3219 name=collection1 org.apache.solr.core.SolrCore@7069b46f url=http://127.0.0.1:55726/collection1 node=127.0.0.1:55726_ C3219_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:55726, core=collection1, node_name=127.0.0.1:55726_}
[junit4] 2> 1142679 T3722 C3219 P55726 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55726/collection1/
[junit4] 2> 1142679 T3696 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1142679 T3722 C3219 P55726 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1142679 T3722 C3219 P55726 oasc.SyncStrategy.syncToMe http://127.0.0.1:55726/collection1/ has no replicas
[junit4] 2> 1142679 T3722 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55726/collection1/ shard2
[junit4] 2> 1142680 T3722 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 1142681 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1142683 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1142684 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1142734 T3673 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1142735 T3673 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:44452
[junit4] 2> 1142736 T3673 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1142736 T3673 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1142736 T3673 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.MigrateRouteKeyTest-jetty2-1390161336294
[junit4] 2> 1142737 T3673 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.MigrateRouteKeyTest-jetty2-1390161336294/'
[junit4] 2> 1142746 T3673 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.MigrateRouteKeyTest-jetty2-1390161336294/solr.xml
[junit4] 2> 1142753 T3673 oasc.CoreContainer.<init> New CoreContainer 1211475511
[junit4] 2> 1142753 T3673 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.MigrateRouteKeyTest-jetty2-1390161336294/]
[junit4] 2> 1142753 T3673 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1142754 T3673 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1142754 T3673 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1142754 T3673 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1142754 T3673 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1142754 T3673 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1142755 T3673 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1142755 T3673 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1142755 T3673 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1142757 T3673 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1142757 T3673 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1142757 T3673 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1142758 T3673 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45682/solr
[junit4] 2> 1142758 T3673 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1142758 T3673 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1142760 T3733 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4ff47caa name:ZooKeeperConnection Watcher:127.0.0.1:45682 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1142761 T3673 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1142763 T3673 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1142764 T3735 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@64446029 name:ZooKeeperConnection Watcher:127.0.0.1:45682/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1142764 T3673 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1142766 T3673 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1142787 T3704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1142787 T3735 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1142787 T3717 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1142787 T3695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1142833 T3722 oasc.ZkController.register We are http://127.0.0.1:55726/collection1/ and leader is http://127.0.0.1:55726/collection1/
[junit4] 2> 1142834 T3722 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55726
[junit4] 2> 1142834 T3722 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1142834 T3722 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1142834 T3722 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1142835 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1142835 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1142836 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1142836 T3722 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1142836 T3696 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1142837 T3696 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:55726",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55726_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1142838 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1142940 T3704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1142940 T3735 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1142940 T3717 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1142940 T3695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1143768 T3673 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44452_
[junit4] 2> 1143769 T3673 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44452_
[junit4] 2> 1143771 T3704 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1143771 T3695 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1143771 T3717 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1143774 T3735 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1143776 T3736 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1143776 T3736 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1143778 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1143779 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1143779 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1143778 T3736 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1143780 T3696 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1143780 T3696 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:44452",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:44452_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1143781 T3696 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 1143781 T3696 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1143783 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1143886 T3704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1143886 T3735 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1143886 T3717 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1143886 T3695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1144779 T3736 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1144780 T3736 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.MigrateRouteKeyTest-jetty2-1390161336294/collection1
[junit4] 2> 1144780 T3736 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1144780 T3736 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1144781 T3736 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1144781 T3736 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.MigrateRouteKeyTest-jetty2-1390161336294/collection1/'
[junit4] 2> 1144782 T3736 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.MigrateRouteKeyTest-jetty2-1390161336294/collection1/lib/classes/' to classloader
[junit4] 2> 1144782 T3736 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.MigrateRouteKeyTest-jetty2-1390161336294/collection1/lib/README' to classloader
[junit4] 2> 1144797 T3736 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1144806 T3736 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1144807 T3736 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1144810 T3736 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1144905 T3736 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1144907 T3736 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1144907 T3736 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1144909 T3736 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1144921 T3736 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1144921 T3736 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.MigrateRouteKeyTest-jetty2-1390161336294/collection1/, dataDir=./org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/jetty2/
[junit4] 2> 1144921 T3736 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2279e22e
[junit4] 2> 1144922 T3736 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/jetty2
[junit4] 2> 1144922 T3736 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/jetty2/index/
[junit4] 2> 1144922 T3736 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 1144923 T3736 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/jetty2/index
[junit4] 2> 1144923 T3736 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=10, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.751778200923446]
[junit4] 2> 1144924 T3736 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@6b62e3ff lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@36c1d235),segFN=segments_1,generation=1}
[junit4] 2> 1144924 T3736 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1144925 T3736 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1144926 T3736 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1144926 T3736 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1144926 T3736 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1144926 T3736 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1144926 T3736 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1144927 T3736 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1144927 T3736 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1144927 T3736 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1144927 T3736 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1144928 T3736 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1144928 T3736 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1144928 T3736 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1144928 T3736 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1144928 T3736 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1144929 T3736 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1144930 T3736 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1144931 T3736 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1144931 T3736 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1144932 T3736 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=68.3408203125, floorSegmentMB=2.0224609375, forceMergeDeletesPctAllowed=12.190356296143152, segmentsPerTier=12.0, maxCFSSegmentSizeMB=1.4072265625, noCFSRatio=0.0
[junit4] 2> 1144932 T3736 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@6b62e3ff lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@36c1d235),segFN=segments_1,generation=1}
[junit4] 2> 1144932 T3736 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1144933 T3736 oass.SolrIndexSearcher.<init> Opening Searcher@18018c0f main
[junit4] 2> 1144934 T3737 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@18018c0f main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1144935 T3736 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1144936 T3673 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 1144936 T3673 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1144936 T3740 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:44452 collection:collection1 shard:shard1
[junit4] 2> 1144937 T3740 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1144940 T3740 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1144941 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1144941 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1144942 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1144942 T3740 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1144942 T3740 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C3220 name=collection1 org.apache.solr.core.SolrCore@68b63e79 url=http://127.0.0.1:44452/collection1 node=127.0.0.1:44452_ C3220_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:44452, core=collection1, node_name=127.0.0.1:44452_}
[junit4] 2> 1144942 T3740 C3220 P44452 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:44452/collection1/
[junit4] 2> 1144942 T3740 C3220 P44452 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1144942 T3740 C3220 P44452 oasc.SyncStrategy.syncToMe http://127.0.0.1:44452/collection1/ has no replicas
[junit4] 2> 1144942 T3696 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1144942 T3740 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:44452/collection1/ shard1
[junit4] 2> 1144943 T3740 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1144944 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1144945 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1144947 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1144998 T3673 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1144999 T3673 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:36833
[junit4] 2> 1145000 T3673 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1145000 T3673 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1145000 T3673 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.MigrateRouteKeyTest-jetty3-1390161338559
[junit4] 2> 1145001 T3673 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.MigrateRouteKeyTest-jetty3-1390161338559/'
[junit4] 2> 1145010 T3673 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.MigrateRouteKeyTest-jetty3-1390161338559/solr.xml
[junit4] 2> 1145017 T3673 oasc.CoreContainer.<init> New CoreContainer 661184247
[junit4] 2> 1145017 T3673 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.MigrateRouteKeyTest-jetty3-1390161338559/]
[junit4] 2> 1145017 T3673 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1145018 T3673 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1145018 T3673 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1145018 T3673 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1145018 T3673 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1145019 T3673 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1145019 T3673 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1145019 T3673 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1145019 T3673 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1145021 T3673 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1145021 T3673 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1145021 T3673 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1145022 T3673 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45682/solr
[junit4] 2> 1145022 T3673 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1145023 T3673 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1145024 T3751 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5de08c32 name:ZooKeeperConnection Watcher:127.0.0.1:45682 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1145025 T3673 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1145027 T3673 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1145027 T3753 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b5279c2 name:ZooKeeperConnection Watcher:127.0.0.1:45682/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1145028 T3673 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1145030 T3673 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1145049 T3717 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1145050 T3735 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1145049 T3704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1145049 T3695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1145050 T3753 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1145096 T3740 oasc.ZkController.register We are http://127.0.0.1:44452/collection1/ and leader is http://127.0.0.1:44452/collection1/
[junit4] 2> 1145096 T3740 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44452
[junit4] 2> 1145096 T3740 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1145096 T3740 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1145096 T3740 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1145097 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1145097 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1145097 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1145097 T3740 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1145098 T3696 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1145099 T3696 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:44452",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:44452_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 1145101 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1145202 T3704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1145202 T3753 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1145202 T3735 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1145202 T3717 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1145202 T3695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1146031 T3673 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36833_
[junit4] 2> 1146033 T3673 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36833_
[junit4] 2> 1146034 T3695 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1146035 T3753 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1146035 T3717 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1146035 T3704 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1146034 T3735 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1146038 T3754 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1146039 T3754 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1146040 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1146040 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1146040 T3754 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1146040 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1146041 T3696 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1146042 T3696 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:36833",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:36833_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1146042 T3696 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 1146042 T3696 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 1146044 T3695 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1146146 T3735 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1146146 T3695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1146146 T3717 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1146146 T3753 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1146146 T3704 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1147040 T3754 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1147041 T3754 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.MigrateRouteKeyTest-jetty3-1390161338559/collection1
[junit4] 2> 1147041 T3754 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1147042 T3754 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1147042 T3754 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1147043 T3754 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.MigrateRouteKeyTest-jetty3-1390161338559/collection1/'
[junit4] 2> 1147043 T3754 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.MigrateRouteKeyTest-jetty3-1390161338559/collection1/lib/classes/' to classloader
[junit4] 2> 1147044 T3754 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.MigrateRouteKeyTest-jetty3-1390161338559/collection1/lib/README' to classloader
[junit4] 2> 1147067 T3754 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1147078 T3754 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1147080 T3754 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1147085 T3754 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1147211 T3754 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1147213 T3754 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1147214 T3754 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1147217 T3754 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1147230 T3754 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1147230 T3754 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.MigrateRouteKeyTest-jetty3-1390161338559/collection1/, dataDir=./org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/jetty3/
[junit4] 2> 1147231 T3754 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2279e22e
[junit4] 2> 1147231 T3754 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/jetty3
[junit4] 2> 1147232 T3754 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/jetty3/index/
[junit4] 2> 1147232 T3754 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/jetty3/index' doesn't exist. Creating new index...
[junit4] 2> 1147233 T3754 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/jetty3/index
[junit4] 2> 1147233 T3754 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=10, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.751778200923446]
[junit4] 2> 1147234 T3754 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1630224 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@12da434d),segFN=segments_1,generation=1}
[junit4] 2> 1147234 T3754 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1147236 T3754 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1147237 T3754 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1147237 T3754 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1147237 T3754 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1147237 T3754 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1147238 T3754 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1147238 T3754 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1147238 T3754 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1147238 T3754 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1147239 T3754 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1147239 T3754 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1147239 T3754 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1147239 T3754 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1147240 T3754 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1147240 T3754 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1147240 T3754 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1147241 T3754 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1147243 T3754 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1147243 T3754 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1147243 T3754 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=68.3408203125, floorSegmentMB=2.0224609375, forceMergeDeletesPctAllowed=12.190356296143152, segmentsPerTier=12.0, maxCFSSegmentSizeMB=1.4072265625, noCFSRatio=0.0
[junit4] 2> 1147244 T3754 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1630224 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@12da434d),segFN=segments_1,generation=1}
[junit4] 2> 1147244 T3754 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1147244 T3754 oass.SolrIndexSearcher.<init> Opening Searcher@783dd765 main
[junit4] 2> 1147247 T3755 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@783dd765 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1147249 T3754 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1147250 T3673 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 1147250 T3673 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1147250 T3758 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36833 collection:collection1 shard:shard2
[junit4] 2> 1147253 T3758 oasc.ZkController.register We are http://127.0.0.1:36833/collection1/ and leader is http://127.0.0.1:55726/collection1/
[junit4] 2> 1147253 T3758 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36833
[junit4] 2> 1147254 T3
[...truncated too long message...]
[junit4] 2> 1184496 T3772 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=3,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=287,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=1}
[junit4] 2> 1184496 T3772 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 1184497 T3772 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 1184497 T3772 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 1184498 T3772 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 1184498 T3772 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 1184499 T3772 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/jetty4/index;done=false>>]
[junit4] 2> 1184499 T3772 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/jetty4/index
[junit4] 2> 1184499 T3772 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/jetty4;done=false>>]
[junit4] 2> 1184499 T3772 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.MigrateRouteKeyTest-1390161332524/jetty4
[junit4] 2> 1184500 T3772 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1184500 T3772 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 46538 T3672 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> 66620 T3672 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 1 thread leaked from SUITE scope at org.apache.solr.cloud.MigrateRouteKeyTest:
[junit4] 2> 1) Thread[id=3810, name=Timer-0, state=WAITING, group=TGRP-MigrateRouteKeyTest]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Object.wait(Object.java:502)
[junit4] 2> at java.util.TimerThread.mainLoop(Timer.java:526)
[junit4] 2> at java.util.TimerThread.run(Timer.java:505)
[junit4] 2> 66621 T3672 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=3810, name=Timer-0, state=WAITING, group=TGRP-MigrateRouteKeyTest]
[junit4] 2> 69622 T3672 ccr.ThreadLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=3810, name=Timer-0, state=WAITING, group=TGRP-MigrateRouteKeyTest]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Object.wait(Object.java:502)
[junit4] 2> at java.util.TimerThread.mainLoop(Timer.java:526)
[junit4] 2> at java.util.TimerThread.run(Timer.java:505)
[junit4] 2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=sr_BA, timezone=America/Manaus
[junit4] 2> NOTE: Linux 3.8.0-35-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=2,free=72989816,total=328204288
[junit4] 2> NOTE: All tests run in this JVM: [TestSolrIndexConfig, BadComponentTest, SolrCoreTest, StatelessScriptUpdateProcessorFactoryTest, TestFaceting, SolrXmlInZkTest, PreAnalyzedUpdateProcessorTest, ShardRoutingTest, ZkCLITest, ReturnFieldsTest, DistribCursorPagingTest, TestSerializedLuceneMatchVersion, AddSchemaFieldsUpdateProcessorFactoryTest, BinaryUpdateRequestHandlerTest, SOLR749Test, DocumentBuilderTest, DistributedTermsComponentTest, TermVectorComponentTest, SolrIndexSplitterTest, TestSolrQueryParser, WordBreakSolrSpellCheckerTest, QueryParsingTest, CacheHeaderTest, SyncSliceTest, TestSolrXMLSerializer, TestSort, TestHighFrequencyDictionaryFactory, PrimitiveFieldTypeTest, OverseerTest, ZkControllerTest, TestLuceneMatchVersion, TestImplicitCoreProperties, LukeRequestHandlerTest, TestCloudManagedSchema, PolyFieldTest, SynonymTokenizerTest, SoftAutoCommitTest, TestAddFieldRealTimeGet, TestClassNameShortening, QueryEqualityTest, TestElisionMultitermQuery, UnloadDistributedZkTest, TestRandomDVFaceting, SimpleFacetsTest, OverseerCollectionProcessorTest, DOMUtilTest, TestBM25SimilarityFactory, TestFreeTextSuggestions, ClusterStateUpdateTest, CopyFieldTest, TestRemoteStreaming, TestNoOpRegenerator, ShardSplitTest, ResourceLoaderTest, TestRecoveryHdfs, ScriptEngineTest, RegexBoostProcessorTest, SearchHandlerTest, BasicDistributedZkTest, TermsComponentTest, TestRealTimeGet, URLClassifyProcessorTest, ClusterStateTest, TestSearchPerf, DateMathParserTest, DistributedQueryComponentCustomSortTest, ExternalFileFieldSortTest, DocValuesMissingTest, EchoParamsTest, JsonLoaderTest, TestCloudManagedSchemaAddField, TestLFUCache, BlockCacheTest, DistributedDebugComponentTest, ResponseLogComponentTest, TestPerFieldSimilarity, SliceStateTest, TestStressVersions, CoreAdminCreateDiscoverTest, TestManagedSchemaFieldResource, TestSystemIdResolver, CSVRequestHandlerTest, TestFunctionQuery, FieldMutatingUpdateProcessorTest, TestLMJelinekMercerSimilarityFactory, SolrTestCaseJ4Test, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, AssignTest, ConnectionManagerTest, DeleteShardTest, MigrateRouteKeyTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=MigrateRouteKeyTest -Dtests.seed=2557C668ADCD2F5 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sr_BA -Dtests.timezone=America/Manaus -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | MigrateRouteKeyTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.MigrateRouteKeyTest:
[junit4] > 1) Thread[id=3810, name=Timer-0, state=WAITING, group=TGRP-MigrateRouteKeyTest]
[junit4] > at java.lang.Object.wait(Native Method)
[junit4] > at java.lang.Object.wait(Object.java:502)
[junit4] > at java.util.TimerThread.mainLoop(Timer.java:526)
[junit4] > at java.util.TimerThread.run(Timer.java:505)
[junit4] > at __randomizedtesting.SeedInfo.seed([2557C668ADCD2F5]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=3810, name=Timer-0, state=WAITING, group=TGRP-MigrateRouteKeyTest]
[junit4] > at java.lang.Object.wait(Native Method)
[junit4] > at java.lang.Object.wait(Object.java:502)
[junit4] > at java.util.TimerThread.mainLoop(Timer.java:526)
[junit4] > at java.util.TimerThread.run(Timer.java:505)
[junit4] > at __randomizedtesting.SeedInfo.seed([2557C668ADCD2F5]:0)
[junit4] Completed on J0 in 69.65s, 1 test, 2 errors <<< FAILURES!
[...truncated 10 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:459: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:439: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:491: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1308: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:941: There were test failures: 354 suites, 1540 tests, 2 suite-level errors, 34 ignored (6 assumptions)
Total time: 40 minutes 52 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0-ea-b123 -XX:-UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.7.0_51) - Build # 9055
- Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/9055/
Java: 32bit/jdk1.7.0_51 -client -XX:+UseConcMarkSweepGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
reloadcollection the collection time out:60s
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: reloadcollection the collection time out:60s
at __randomizedtesting.SeedInfo.seed([D504787C30D4163E:54E2F664478B7602]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:495)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:765)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:196)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Build Log:
[...truncated 10300 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> 355427 T960 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /ql_pg/
[junit4] 2> 355431 T960 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-CollectionsAPIDistributedZkTest-1390154525622
[junit4] 2> 355432 T960 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 355432 T961 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 355532 T960 oasc.ZkTestServer.run start zk server on port:36982
[junit4] 2> 355533 T960 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 355578 T967 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d8da72 name:ZooKeeperConnection Watcher:127.0.0.1:36982 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 355578 T960 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 355578 T960 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 355582 T960 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 355583 T969 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9be791 name:ZooKeeperConnection Watcher:127.0.0.1:36982/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 355583 T960 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 355584 T960 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 355587 T960 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 355590 T960 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 355591 T960 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 355593 T960 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 355594 T960 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 355597 T960 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 355597 T960 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 355599 T960 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 355600 T960 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 355603 T960 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 355604 T960 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 355606 T960 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 355606 T960 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 355608 T960 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 355608 T960 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 355611 T960 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 355611 T960 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 355613 T960 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 355614 T960 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 355617 T960 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 355618 T960 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 355621 T960 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 355622 T960 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 355624 T960 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 355624 T960 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> Using new style solr.xml
[junit4] 2> 355706 T960 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 355710 T960 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:47634
[junit4] 2> 355710 T960 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 355710 T960 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 355711 T960 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390154525819
[junit4] 2> 355711 T960 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390154525819/'
[junit4] 2> 355723 T960 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390154525819/solr.xml
[junit4] 2> 355776 T960 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 355776 T960 oasc.CoreContainer.<init> New CoreContainer 851931
[junit4] 2> 355776 T960 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390154525819/]
[junit4] 2> 355778 T960 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 355778 T960 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 355778 T960 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 355778 T960 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 355779 T960 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 355779 T960 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 355779 T960 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 355780 T960 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 355780 T960 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 355782 T960 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 355782 T960 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 355783 T960 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 355783 T960 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36982/solr
[junit4] 2> 355783 T960 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 355784 T960 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 355786 T980 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@171b10d name:ZooKeeperConnection Watcher:127.0.0.1:36982 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 355786 T960 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 355789 T960 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 355790 T982 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c9024 name:ZooKeeperConnection Watcher:127.0.0.1:36982/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 355790 T960 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 355791 T960 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 355794 T960 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 355796 T960 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 355798 T960 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47634_ql_pg
[junit4] 2> 355798 T960 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47634_ql_pg
[junit4] 2> 355800 T960 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 355802 T960 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 355806 T960 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 355808 T960 oasc.Overseer.start Overseer (id=91105166991360003-127.0.0.1:47634_ql_pg-n_0000000000) starting
[junit4] 2> 355810 T960 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 355813 T984 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 355814 T960 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 355814 T984 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 355816 T960 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 355818 T960 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 355820 T983 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 355821 T960 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390154525819
[junit4] 2> 355822 T960 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390154525819/conf/
[junit4] 2> 355854 T960 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 355855 T960 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 355856 T960 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 355861 T960 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 355862 T987 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48b3db name:ZooKeeperConnection Watcher:127.0.0.1:36982/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 355862 T960 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 355863 T960 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 355867 T960 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 355931 T960 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 355933 T960 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51699
[junit4] 2> 355934 T960 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 355934 T960 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 355934 T960 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390154526057
[junit4] 2> 355935 T960 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390154526057/'
[junit4] 2> 355956 T960 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390154526057/solr.xml
[junit4] 2> 356002 T960 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 356003 T960 oasc.CoreContainer.<init> New CoreContainer 19112071
[junit4] 2> 356003 T960 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390154526057/]
[junit4] 2> 356004 T960 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 356005 T960 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 356005 T960 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 356005 T960 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 356005 T960 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 356006 T960 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 356006 T960 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 356006 T960 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 356007 T960 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 356009 T960 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 356009 T960 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 356009 T960 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 356010 T960 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36982/solr
[junit4] 2> 356010 T960 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 356011 T960 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 356012 T998 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@259b name:ZooKeeperConnection Watcher:127.0.0.1:36982 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 356012 T960 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 356015 T960 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 356016 T1000 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1543855 name:ZooKeeperConnection Watcher:127.0.0.1:36982/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 356016 T960 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 356019 T960 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 357022 T960 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51699_ql_pg
[junit4] 2> 357023 T960 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51699_ql_pg
[junit4] 2> 357026 T982 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 357026 T1000 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 357026 T987 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 357031 T960 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390154526057
[junit4] 2> 357031 T960 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390154526057/conf/
[junit4] 2> 357056 T960 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 357057 T960 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 357057 T960 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 357135 T960 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 357137 T960 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:45716
[junit4] 2> 357138 T960 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 357138 T960 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 357138 T960 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390154527247
[junit4] 2> 357139 T960 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390154527247/'
[junit4] 2> 357155 T960 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390154527247/solr.xml
[junit4] 2> 357206 T960 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 357206 T960 oasc.CoreContainer.<init> New CoreContainer 27062101
[junit4] 2> 357206 T960 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390154527247/]
[junit4] 2> 357208 T960 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 357208 T960 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 357208 T960 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 357208 T960 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 357209 T960 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 357209 T960 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 357210 T960 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 357210 T960 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 357210 T960 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 357213 T960 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 357213 T960 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 357213 T960 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 357214 T960 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36982/solr
[junit4] 2> 357214 T960 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 357215 T960 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 357216 T1012 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24ea97 name:ZooKeeperConnection Watcher:127.0.0.1:36982 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 357216 T960 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 357218 T960 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 357219 T1014 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@dacd6d name:ZooKeeperConnection Watcher:127.0.0.1:36982/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 357219 T960 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 357223 T960 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 358226 T960 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45716_ql_pg
[junit4] 2> 358228 T960 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45716_ql_pg
[junit4] 2> 358230 T982 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 358230 T1000 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 358230 T987 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 358230 T1014 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 358236 T960 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390154527247
[junit4] 2> 358237 T960 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390154527247/conf/
[junit4] 2> 358275 T960 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 358276 T960 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 358276 T960 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 358342 T960 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 358344 T960 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:44674
[junit4] 2> 358345 T960 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 358345 T960 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 358346 T960 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390154528467
[junit4] 2> 358346 T960 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390154528467/'
[junit4] 2> 358359 T960 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390154528467/solr.xml
[junit4] 2> 358407 T960 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 358408 T960 oasc.CoreContainer.<init> New CoreContainer 5221531
[junit4] 2> 358408 T960 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390154528467/]
[junit4] 2> 358409 T960 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 358409 T960 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 358410 T960 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 358410 T960 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 358410 T960 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 358411 T960 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 358411 T960 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 358411 T960 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 358411 T960 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 358413 T960 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 358414 T960 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 358414 T960 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 358414 T960 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36982/solr
[junit4] 2> 358415 T960 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 358415 T960 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 358417 T1026 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ccfc7a name:ZooKeeperConnection Watcher:127.0.0.1:36982 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 358418 T960 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 358420 T960 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 358421 T1028 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f35679 name:ZooKeeperConnection Watcher:127.0.0.1:36982/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 358421 T960 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 358425 T960 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 359427 T960 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44674_ql_pg
[junit4] 2> 359428 T960 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44674_ql_pg
[junit4] 2> 359432 T1000 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 359432 T982 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 359432 T1014 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 359432 T1028 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 359432 T987 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 359439 T960 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390154528467
[junit4] 2> 359440 T960 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390154528467/conf/
[junit4] 2> 359477 T960 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 359478 T960 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 359479 T960 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 359552 T960 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 359554 T960 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58156
[junit4] 2> 359555 T960 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 359555 T960 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 359555 T960 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670
[junit4] 2> 359556 T960 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/'
[junit4] 2> 359578 T960 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/solr.xml
[junit4] 2> 359625 T960 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 359625 T960 oasc.CoreContainer.<init> New CoreContainer 28625209
[junit4] 2> 359626 T960 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/]
[junit4] 2> 359627 T960 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 359627 T960 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 359627 T960 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 359627 T960 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 359628 T960 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 359628 T960 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 359628 T960 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 359629 T960 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 359629 T960 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 359631 T960 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 359631 T960 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 359631 T960 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 359632 T960 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36982/solr
[junit4] 2> 359632 T960 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 359633 T960 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 359634 T1040 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d399 name:ZooKeeperConnection Watcher:127.0.0.1:36982 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 359635 T960 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 359637 T960 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 359638 T1042 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1411294 name:ZooKeeperConnection Watcher:127.0.0.1:36982/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 359638 T960 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 359641 T960 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 360644 T960 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58156_ql_pg
[junit4] 2> 360645 T960 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58156_ql_pg
[junit4] 2> 360649 T1000 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 360649 T1014 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 360649 T987 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 360649 T982 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 360650 T1042 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 360650 T1028 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 360656 T960 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670
[junit4] 2> 360657 T960 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/conf/
[junit4] 2> 360681 T960 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 360681 T960 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
[junit4] 2> 360681 T960 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 360691 T993 oasha.CollectionsHandler.handleCreateAction Creating Collection : name=solrj_collection&action=CREATE&router.name=compositeId&collection.configName=conf1&replicationFactor=2&router.field=myOwnField&wt=javabin&version=2&numShards=2
[junit4] 2> 360693 T982 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 360694 T984 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.name":"compositeId",
[junit4] 2> "router.field":"myOwnField"}
[junit4] 2> 360694 T984 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.name":"compositeId",
[junit4] 2> "router.field":"myOwnField"}
[junit4] 2> 360695 T984 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/solrj_collection
[junit4] 2> 360695 T984 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
[junit4] 2> 360700 T982 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 360702 T983 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 360702 T983 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: solrj_collection
[junit4] 2> 360703 T983 oasc.Overseer$ClusterStateUpdater.createCollection Create collection solrj_collection with shards [shard1, shard2]
[junit4] 2> 360705 T982 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 360706 T1014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 360706 T1000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 360706 T1042 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 360706 T987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 360706 T1028 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 360706 T982 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 360801 T984 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2] , repFactor : 2
[junit4] 2> 360801 T984 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of collection solrj_collection on 127.0.0.1:45716_ql_pg
[junit4] 2> 360802 T984 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of collection solrj_collection on 127.0.0.1:58156_ql_pg
[junit4] 2> 360802 T984 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of collection solrj_collection on 127.0.0.1:51699_ql_pg
[junit4] 2> 360803 T984 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of collection solrj_collection on 127.0.0.1:47634_ql_pg
[junit4] 2> 360807 T996 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica1 state=down
[junit4] 2> 360807 T1009 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica1 state=down
[junit4] 2> 360807 T1035 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica2 state=down
[junit4] 2> 360808 T975 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica2 state=down
[junit4] 2> 360809 T982 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 360809 T996 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 360810 T975 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 360810 T1035 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 360809 T1009 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 360811 T983 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 360811 T983 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:51699/ql_pg",
[junit4] 2> "core":"solrj_collection_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51699_ql_pg",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 360813 T982 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 360814 T983 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:45716/ql_pg",
[junit4] 2> "core":"solrj_collection_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:45716_ql_pg",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 360817 T982 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 360818 T983 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:58156/ql_pg",
[junit4] 2> "core":"solrj_collection_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:58156_ql_pg",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 360820 T982 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 360821 T983 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:47634/ql_pg",
[junit4] 2> "core":"solrj_collection_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:47634_ql_pg",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 360823 T982 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 360925 T982 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 360926 T1042 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 360926 T987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 360925 T1028 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 360925 T1014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 360925 T1000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 361810 T996 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica1
[junit4] 2> 361811 T1009 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica1
[junit4] 2> 361811 T1035 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica2
[junit4] 2> 361810 T975 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica2
[junit4] 2> 361813 T996 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica1' using instanceDir: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390154526057/solrj_collection_shard2_replica1
[junit4] 2> 361814 T996 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 361812 T1009 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390154527247/solrj_collection_shard1_replica1
[junit4] 2> 361815 T1009 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 361814 T975 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica2' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390154525819/solrj_collection_shard2_replica2
[junit4] 2> 361813 T1035 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica2' using instanceDir: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/solrj_collection_shard1_replica2
[junit4] 2> 361816 T1009 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 361818 T1009 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 361816 T975 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 361815 T996 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 361817 T1035 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 361820 T1009 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390154527247/solrj_collection_shard1_replica1/'
[junit4] 2> 361820 T975 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 361821 T975 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 361820 T996 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 361821 T1035 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 361823 T1035 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 361823 T975 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390154525819/solrj_collection_shard2_replica2/'
[junit4] 2> 361824 T996 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390154526057/solrj_collection_shard2_replica1/'
[junit4] 2> 361824 T1035 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/solrj_collection_shard1_replica2/'
[junit4] 2> 361896 T975 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 361916 T1009 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 361916 T1035 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 361937 T996 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 361986 T975 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 361987 T975 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 362003 T975 oass.IndexSchema.readSchema [solrj_collection_shard2_replica2] Schema name=test
[junit4] 2> 362006 T1009 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 362007 T1009 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 362015 T1035 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 362016 T1035 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 362017 T1009 oass.IndexSchema.readSchema [solrj_collection_shard1_replica1] Schema name=test
[junit4] 2> 362039 T1035 oass.IndexSchema.readSchema [solrj_collection_shard1_replica2] Schema name=test
[junit4] 2> 362048 T996 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 362050 T996 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 362059 T996 oass.IndexSchema.readSchema [solrj_collection_shard2_replica1] Schema name=test
[junit4] 2> 362851 T975 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 362853 T975 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 362854 T975 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 362871 T975 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 362876 T975 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 362889 T975 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 362901 T975 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 362906 T975 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 362908 T975 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 362908 T975 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 362908 T975 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 362910 T975 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 362910 T975 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 362910 T975 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 362911 T975 oasc.SolrCore.<init> [solrj_collection_shard2_replica2] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390154525819/solrj_collection_shard2_replica2/, dataDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390154525819/solrj_collection_shard2_replica2/data/
[junit4] 2> 362912 T975 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1bedde6
[junit4] 2> 362914 T975 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390154525819/solrj_collection_shard2_replica2/data
[junit4] 2> 362915 T975 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390154525819/solrj_collection_shard2_replica2/data/index/
[junit4] 2> 362915 T975 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica2] Solr index directory '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390154525819/solrj_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 362916 T975 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390154525819/solrj_collection_shard2_replica2/data/index
[junit4] 2> 362916 T975 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=32, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 362917 T975 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1986cde lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5cbee9),segFN=segments_1,generation=1}
[junit4] 2> 362918 T975 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 362929 T975 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 362929 T975 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 362930 T975 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 362930 T975 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 362931 T975 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 362931 T975 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 362931 T1035 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 362932 T975 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 362932 T1035 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 362933 T975 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 362933 T975 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 362933 T1035 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 362934 T975 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 362935 T975 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 362935 T975 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 362936 T975 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 362937 T975 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 362937 T975 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 362938 T975 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 362942 T975 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 362943 T1035 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 362946 T1009 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 362946 T1009 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 362946 T975 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 362947 T975 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 362947 T1009 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 362948 T975 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=41.060546875, floorSegmentMB=2.087890625, forceMergeDeletesPctAllowed=15.53021295655012, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6893542353157669
[junit4] 2> 362948 T1035 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 362949 T975 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1986cde lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5cbee9),segFN=segments_1,generation=1}
[junit4] 2> 362957 T975 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 362957 T975 oass.SolrIndexSearcher.<init> Opening Searcher@132da34 main
[junit4] 2> 362960 T1048 oasc.SolrCore.registerSearcher [solrj_collection_shard2_replica2] Registered new searcher Searcher@132da34 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 362962 T975 oasc.CoreContainer.registerCore registering core: solrj_collection_shard2_replica2
[junit4] 2> 362962 T975 oasc.ZkController.register Register replica - core:solrj_collection_shard2_replica2 address:http://127.0.0.1:47634/ql_pg collection:solrj_collection shard:shard2
[junit4] 2> 362962 T1009 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 362963 T996 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 362963 T996 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 362964 T975 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection/leader_elect/shard2/election
[junit4] 2> 362964 T996 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 362966 T1009 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 362971 T996 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 362973 T975 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 362974 T1035 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 362974 T996 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 362976 T982 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 362976 T982 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 362976 T982 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 362977 T975 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=180000
[junit4] 2> 362978 T983 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 362979 T1035 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 362981 T982 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 362982 T1009 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 362983 T1000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 362983 T1042 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 362984 T987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 362983 T982 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 362983 T1014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 362983 T1028 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 362985 T1035 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 362987 T1035 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 362987 T1035 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 362988 T1035 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 362989 T1035 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 362989 T1009 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 362989 T996 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 362989 T1035 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 362990 T1035 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 362991 T1035 oasc.SolrCore.<init> [solrj_collection_shard1_replica2] Opening new SolrCore at ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/solrj_collection_shard1_replica2/, dataDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/solrj_collection_shard1_replica2/data/
[junit4] 2> 362991 T1035 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1bedde6
[junit4] 2> 362992 T1035 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/solrj_collection_shard1_replica2/data
[junit4] 2> 362993 T1009 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 362993 T996 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 362993 T1035 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/solrj_collection_shard1_replica2/data/index/
[junit4] 2> 362994 T1035 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica2] Solr index directory './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/solrj_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 362994 T1009 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 362995 T1035 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/solrj_collection_shard1_replica2/data/index
[junit4] 2> 362995 T1009 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 362995 T1035 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=32, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 362995 T1009 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 362996 T1035 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@7c0ced lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@835f1f),segFN=segments_1,generation=1}
[junit4] 2> 362996 T996 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 362997 T1009 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 362997 T1009 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 362997 T1035 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 362998 T996 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 362998 T996 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 362998 T1009 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 362999 T996 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 362999 T1009 oasc.SolrCore.<init> [solrj_collection_shard1_replica1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390154527247/solrj_collection_shard1_replica1/, dataDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390154527247/solrj_collection_shard1_replica1/data/
[junit4] 2> 363000 T1009 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1bedde6
[junit4] 2> 363000 T996 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 363000 T996 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 363000 T1009 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390154527247/solrj_collection_shard1_replica1/data
[junit4] 2> 363001 T996 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 363001 T1009 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390154527247/solrj_collection_shard1_replica1/data/index/
[junit4] 2> 363001 T996 oasc.SolrCore.<init> [solrj_collection_shard2_replica1] Opening new SolrCore at ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390154526057/solrj_collection_shard2_replica1/, dataDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390154526057/solrj_collection_shard2_replica1/data/
[junit4] 2> 363001 T1009 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica1] Solr index directory '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390154527247/solrj_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 363002 T996 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1bedde6
[junit4] 2> 363002 T1009 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390154527247/solrj_collection_shard1_replica1/data/index
[junit4] 2> 363003 T1035 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 363003 T1009 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=32, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 363011 T1035 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 363011 T1009 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@fdfa61 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@11c2f28),segFN=segments_1,generation=1}
[junit4] 2> 363012 T1009 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 363003 T996 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390154526057/solrj_collection_shard2_replica1/data
[junit4] 2> 363011 T1035 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 363012 T996 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390154526057/solrj_collection_shard2_replica1/data/index/
[junit4] 2> 363013 T1035 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 363013 T996 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica1] Solr index directory './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390154526057/solrj_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 363014 T1035 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 363014 T996 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390154526057/solrj_collection_shard2_replica1/data/index
[junit4] 2> 363014 T1035 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 363015 T996 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=32, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 363015 T1035 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 363015 T1009 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 363016 T1035 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 363017 T1035 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 363016 T996 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@19ffdb4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@98e27e),segFN=segments_1,generation=1}
[junit4] 2> 363016 T1009 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 363018 T1035 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 363017 T996 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 363018 T1009 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 363019 T1035 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 363019 T1035 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 363019 T1009 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 363020 T1035 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 363020 T1009 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 363021 T1009 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 363021 T1035 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 363021 T1009 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 363021 T996 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 363022 T1009 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 363023 T1009 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 363022 T1035 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 363023 T1009 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 363022 T996 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 363024 T1035 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 363024 T996 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 363024 T1009 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 363025 T996 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 363025 T1009 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 363025 T996 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 363025 T1009 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 363026 T1035 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 363026 T996 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 363026 T1009 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 363027 T996 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 363027 T1009 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 363027 T996 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 363028 T996 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 363028 T1009 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 363029 T996 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 363029 T996 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 363029 T1009 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 363029 T1035 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 363029 T996 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 363030 T1035 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 363030 T996 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 363031 T1035 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=41.060546875, floorSegmentMB=2.087890625, forceMergeDeletesPctAllowed=15.53021295655012, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6893542353157669
[junit4] 2> 363031 T996 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 363032 T1035 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@7c0ced lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@835f1f),segFN=segments_1,generation=1}
[junit4] 2> 363032 T1009 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 363032 T996 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 363032 T1009 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 363032 T1035 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 363033 T996 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 363033 T1035 oass.SolrIndexSearcher.<init> Opening Searcher@d9b89f main
[junit4] 2> 363033 T1009 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=41.060546875, floorSegmentMB=2.087890625, forceMergeDeletesPctAllowed=15.53021295655012, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6893542353157669
[junit4] 2> 363035 T1009 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@fdfa61 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@11c2f28),segFN=segments_1,generation=1}
[junit4] 2> 363035 T996 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 363035 T1009 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 363036 T1009 oass.SolrIndexSearcher.<init> Opening Searcher@e7ffb4 main
[junit4] 2> 363037 T1050 oasc.SolrCore.registerSearcher [solrj_collection_shard1_replica2] Registered new searcher Searcher@d9b89f main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 363038 T996 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 363038 T996 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 363038 T1035 oasc.CoreContainer.registerCore registering core: solrj_collection_shard1_replica2
[junit4] 2> 363039 T996 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=41.060546875, floorSegmentMB=2.087890625, forceMergeDeletesPctAllowed=15.53021295655012, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6893542353157669
[junit4] 2> 363039 T1051 oasc.SolrCore.registerSearcher [solrj_collection_shard1_replica1] Registered new searcher Searcher@e7ffb4 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 363039 T996 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@19ffdb4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@98e27e),segFN=segments_1,generation=1}
[junit4] 2> 363040 T996 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 363039 T1035 oasc.ZkController.register Register replica - core:solrj_collection_shard1_replica2 address:http://127.0.0.1:58156/ql_pg collection:solrj_collection shard:shard1
[junit4] 2> 363040 T1009 oasc.CoreContainer.registerCore registering core: solrj_collection_shard1_replica1
[junit4] 2> 363040 T996 oass.Solr
[...truncated too long message...]
7,transaction_logs_total_number=1}
[junit4] 2> 523491 T960 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 523491 T960 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 523492 T960 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 523492 T960 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard1_replica2] Closing main searcher on request.
[junit4] 2> 523493 T960 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 523493 T960 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/awholynewcollection_0_shard1_replica2/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/awholynewcollection_0_shard1_replica2/data;done=false>>]
[junit4] 2> 523493 T960 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/awholynewcollection_0_shard1_replica2/data
[junit4] 2> 523494 T960 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/awholynewcollection_0_shard1_replica2/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/awholynewcollection_0_shard1_replica2/data/index;done=false>>]
[junit4] 2> 523494 T960 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/awholynewcollection_0_shard1_replica2/data/index
[junit4] 2> 523494 T960 oasc.SolrCore.close [awholynewcollection_0_shard2_replica3] CLOSING SolrCore org.apache.solr.core.SolrCore@4f62ab
[junit4] 2> 523504 T960 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=230,transaction_logs_total_number=1}
[junit4] 2> 523505 T960 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 523505 T960 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 523505 T960 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 523506 T960 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard2_replica3] Closing main searcher on request.
[junit4] 2> 523506 T960 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 523507 T960 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/awholynewcollection_0_shard2_replica3/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/awholynewcollection_0_shard2_replica3/data;done=false>>]
[junit4] 2> 523507 T960 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/awholynewcollection_0_shard2_replica3/data
[junit4] 2> 523507 T960 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/awholynewcollection_0_shard2_replica3/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/awholynewcollection_0_shard2_replica3/data/index;done=false>>]
[junit4] 2> 523508 T960 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390154529670/awholynewcollection_0_shard2_replica3/data/index
[junit4] 2> 523532 T960 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/ql_pg,null}
[junit4] 2> 523585 T960 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4] 2> 523587 T960 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:36982 36982
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 1> client port:0.0.0.0/0.0.0.0:36982
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=D504787C30D4163E -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_NI -Dtests.timezone=America/Edmonton -Dtests.file.encoding=US-ASCII
[junit4] ERROR 168s J1 | CollectionsAPIDistributedZkTest.testDistribSearch <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: reloadcollection the collection time out:60s
[junit4] > at __randomizedtesting.SeedInfo.seed([D504787C30D4163E:54E2F664478B7602]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:495)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:765)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:196)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
[junit4] > at java.lang.Thread.run(Thread.java:744)
[junit4] 2> 523623 T960 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 168202 T959 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 4 leaked thread(s).
[junit4] 2> 524471 T982 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 524747 T1014 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 525010 T1160 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=Appending, sim=DefaultSimilarity, locale=es_NI, timezone=America/Edmonton
[junit4] 2> NOTE: Linux 3.8.0-35-generic i386/Oracle Corporation 1.7.0_51 (32-bit)/cpus=8,threads=1,free=41186296,total=140001280
[junit4] 2> NOTE: All tests run in this JVM: [TestDFRSimilarityFactory, TestRangeQuery, NoCacheHeaderTest, TestFieldTypeCollectionResource, TestSweetSpotSimilarityFactory, SolrPluginUtilsTest, TestDefaultSearchFieldResource, TestUtils, TestFieldTypeResource, TestSolrQueryParserDefaultOperatorResource, SuggesterWFSTTest, TestNumberUtils, TestDistributedMissingSort, LeaderElectionIntegrationTest, BasicZkTest, ConvertedLegacyTest, StandardRequestHandlerTest, RequiredFieldsTest, IndexSchemaRuntimeFieldTest, OpenExchangeRatesOrgProviderTest, AlternateDirectoryTest, TestCollapseQParserPlugin, DefaultValueUpdateProcessorTest, TestHashPartitioner, TestXIncludeConfig, CachingDirectoryFactoryTest, StatsComponentTest, TestManagedSchemaFieldResource, HdfsBasicDistributedZkTest, TestSolrXmlPersistence, CoreMergeIndexesAdminHandlerTest, TestIBSimilarityFactory, TestReload, OpenCloseCoreStressTest, DirectUpdateHandlerTest, TestDefaultSimilarityFactory, ZkSolrClientTest, TestFiltering, TestInfoStreamLogging, TestSolrCoreProperties, CollectionsAPIDistributedZkTest]
[junit4] Completed on J1 in 169.74s, 1 test, 1 error <<< FAILURES!
[...truncated 694 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:459: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:439: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:491: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1308: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:941: There were test failures: 354 suites, 1540 tests, 1 error, 34 ignored (6 assumptions)
Total time: 59 minutes 6 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_51 -client -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b123) - Build #
9054 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/9054/
Java: 32bit/jdk1.8.0-ea-b123 -server -XX:+UseParallelGC
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.MigrateRouteKeyTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.MigrateRouteKeyTest: 1) Thread[id=5644, name=Timer-22, state=WAITING, group=TGRP-MigrateRouteKeyTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at java.util.TimerThread.mainLoop(Timer.java:526) at java.util.TimerThread.run(Timer.java:505)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.MigrateRouteKeyTest:
1) Thread[id=5644, name=Timer-22, state=WAITING, group=TGRP-MigrateRouteKeyTest]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at java.util.TimerThread.mainLoop(Timer.java:526)
at java.util.TimerThread.run(Timer.java:505)
at __randomizedtesting.SeedInfo.seed([D61FE655FDA0DA2B]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.MigrateRouteKeyTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=5644, name=Timer-22, state=WAITING, group=TGRP-MigrateRouteKeyTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at java.util.TimerThread.mainLoop(Timer.java:526) at java.util.TimerThread.run(Timer.java:505)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=5644, name=Timer-22, state=WAITING, group=TGRP-MigrateRouteKeyTest]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at java.util.TimerThread.mainLoop(Timer.java:526)
at java.util.TimerThread.run(Timer.java:505)
at __randomizedtesting.SeedInfo.seed([D61FE655FDA0DA2B]:0)
REGRESSION: org.apache.solr.cloud.OverseerTest.testOverseerFailure
Error Message:
KeeperErrorCode = NoNode for /collections/collection1/leader_elect/shard1/election
Stack Trace:
org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leader_elect/shard1/election
at __randomizedtesting.SeedInfo.seed([D61FE655FDA0DA2B:D21769A6EF05350A]:0)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:428)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:425)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:382)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:369)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:325)
at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:141)
at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:584)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Build Log:
[...truncated 10015 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4] 2> 43305 T389 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-OverseerTest-1390147273294
[junit4] 2> 43306 T389 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 43309 T389 oas.SolrTestCaseJ4.setUp ###Starting testPlaceholders
[junit4] 2> 43309 T389 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 43310 T390 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 43410 T389 oasc.ZkTestServer.run start zk server on port:34673
[junit4] 2> 43410 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 43478 T396 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@dfc4c9 name:ZooKeeperConnection Watcher:127.0.0.1:34673/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 43478 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 43479 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 43481 T398 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@beb69d name:ZooKeeperConnection Watcher:127.0.0.1:34673 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 43482 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 43483 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 43484 T400 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9c6313 name:ZooKeeperConnection Watcher:127.0.0.1:34673 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 43485 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 43485 T389 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 43487 T389 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 43491 T389 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 43492 T389 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 43498 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 43504 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 43506 T402 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a75c32 name:ZooKeeperConnection Watcher:127.0.0.1:34673/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 43506 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 43506 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 43508 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 43512 T396 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 43512 T402 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 43514 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 43515 T404 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10a39c3 name:ZooKeeperConnection Watcher:127.0.0.1:34673/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 43515 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 43517 T389 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 43519 T389 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 43525 T389 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 43528 T389 oasc.Overseer.start Overseer (id=91104691702923268-127.0.0.1:34673_solr-n_0000000000) starting
[junit4] 2> 43538 T389 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 43541 T389 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 43555 T389 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 43557 T406 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 43559 T406 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 43559 T405 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 43562 T405 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 43563 T405 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=12 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"12",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 43563 T405 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3, shard4, shard5, shard6, shard7, shard8, shard9, shard10, shard11, shard12]
[junit4] 2> 43571 T405 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 43574 T404 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 43579 T396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 43579 T402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 44060 T389 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 44068 T389 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 44073 T404 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 44074 T389 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 44076 T405 oasc.Overseer$ClusterStateUpdater.run WARN Solr cannot talk to ZK, exiting Overseer main queue loop org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /live_nodes
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.updateClusterState(ZkStateReader.java:389)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.updateClusterState(ZkStateReader.java:215)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:180)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 44080 T396 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 44080 T402 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 44080 T391 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x143ab3c02530003, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 44082 T389 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:34673 34673
[junit4] 2> 44296 T389 oas.SolrTestCaseJ4.tearDown ###Ending testPlaceholders
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 44301 T389 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignment
[junit4] 2> 44301 T389 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 44301 T407 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 44402 T389 oasc.ZkTestServer.run start zk server on port:38173
[junit4] 2> 44402 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 44405 T413 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@63888d name:ZooKeeperConnection Watcher:127.0.0.1:38173 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 44405 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 44423 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 44424 T415 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@276363 name:ZooKeeperConnection Watcher:127.0.0.1:38173 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 44424 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 44424 T389 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 44426 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 44427 T417 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@114f039 name:ZooKeeperConnection Watcher:127.0.0.1:38173/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 44427 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 44427 T389 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 44428 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 44429 T419 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4dab80 name:ZooKeeperConnection Watcher:127.0.0.1:38173/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 44429 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 44430 T389 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 44434 T389 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 44437 T389 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 44438 T389 oasc.Overseer.start Overseer (id=91104691768590339-127.0.0.1:38173_solr-n_0000000000) starting
[junit4] 2> 44440 T389 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 44441 T389 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 44443 T389 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 44445 T421 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 44445 T389 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 44445 T421 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 44446 T420 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 44447 T389 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 44449 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 44452 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 44453 T423 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@66924 name:ZooKeeperConnection Watcher:127.0.0.1:38173/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 44453 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 44454 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 44457 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1
[junit4] 2> 44459 T417 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 44459 T423 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 44460 T419 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 44461 T420 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 44462 T420 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 44462 T420 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 44462 T420 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 44464 T419 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 44464 T423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 44465 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 44960 T389 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 44968 T389 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 44977 T419 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 44985 T420 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 44986 T419 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 44990 T420 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core2",
[junit4] 2> "core_node_name":"node2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 44990 T420 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 44990 T420 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 44992 T419 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 45095 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 45095 T423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 45486 T389 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 45492 T389 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 45495 T419 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 45495 T419 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 45495 T419 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 45499 T419 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 45499 T420 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 45501 T420 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core3",
[junit4] 2> "core_node_name":"node3",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 45501 T420 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 45502 T420 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 45503 T419 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 45606 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 45606 T423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 45999 T389 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 46005 T389 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 46008 T419 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 46008 T419 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 46008 T419 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 46009 T419 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 46009 T420 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 46011 T420 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core4",
[junit4] 2> "core_node_name":"node4",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 46011 T420 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 46011 T420 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 46013 T419 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 46114 T423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 46114 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 46509 T389 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 46518 T419 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 46518 T419 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 46518 T419 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 46519 T420 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 46520 T420 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core5",
[junit4] 2> "core_node_name":"node5",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 46520 T420 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 46520 T420 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 46522 T419 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 46624 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 46624 T423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 47018 T389 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 47023 T419 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 47023 T419 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 47023 T419 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 47024 T420 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 47024 T420 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"127.0.0.1",
[junit4] 2> "core":"core6",
[junit4] 2> "core_node_name":"node6",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4] 2> 47025 T420 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 47025 T420 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 47026 T419 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 47128 T423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 47128 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 47523 T389 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 47529 T423 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 47531 T389 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:38173 38173
[junit4] 2> 47828 T389 oas.SolrTestCaseJ4.tearDown ###Ending testShardAssignment
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 47831 T389 oas.SolrTestCaseJ4.setUp ###Starting testDoubleAssignment
[junit4] 2> 47832 T389 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 47832 T424 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 47932 T389 oasc.ZkTestServer.run start zk server on port:53738
[junit4] 2> 47933 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 47936 T430 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a02396 name:ZooKeeperConnection Watcher:127.0.0.1:53738/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 47936 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 47936 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 47937 T432 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19e2e6f name:ZooKeeperConnection Watcher:127.0.0.1:53738 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 47938 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 47951 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 47952 T434 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15c2f66 name:ZooKeeperConnection Watcher:127.0.0.1:53738 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 47952 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 47952 T389 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 47954 T389 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 47955 T389 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 47957 T389 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 47960 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 47961 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 47963 T436 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f7880c name:ZooKeeperConnection Watcher:127.0.0.1:53738/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 47963 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 47964 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 47965 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 47967 T430 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 47967 T436 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 47967 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 47968 T438 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@116b3d7 name:ZooKeeperConnection Watcher:127.0.0.1:53738/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 47968 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 47969 T389 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 47970 T389 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 47972 T389 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 47973 T389 oasc.Overseer.start Overseer (id=91104691999539204-127.0.0.1:53738_solr-n_0000000000) starting
[junit4] 2> 47974 T389 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 47976 T389 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 47978 T389 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 47979 T440 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 47980 T439 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 47980 T440 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 47982 T439 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 47982 T439 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 47982 T439 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1]
[junit4] 2> 47982 T439 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 47984 T438 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 47984 T436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 47984 T430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 48481 T389 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 48489 T389 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 48493 T438 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 48493 T389 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 48494 T439 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 48495 T430 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 48495 T436 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 48496 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 48496 T438 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 48497 T442 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@127178c name:ZooKeeperConnection Watcher:127.0.0.1:53738/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 48497 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 48498 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 48499 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 48501 T430 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 48501 T442 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 48502 T438 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 48502 T389 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 48503 T439 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 48503 T439 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 48504 T438 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 48508 T389 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 48512 T438 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 48514 T438 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 48618 T430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 48618 T442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 48618 T389 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 48623 T442 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 48624 T430 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 48626 T389 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:53738 53738
[junit4] 2> 49030 T423 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 49118 T423 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard3/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 49118 T389 oas.SolrTestCaseJ4.tearDown ###Ending testDoubleAssignment
[junit4] 2> 49118 T423 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 49119 T439 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=91104691999539204-127.0.0.1:53738_solr-n_0000000000) am no longer a leader.
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 49122 T389 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignmentBigger
[junit4] 2> 49122 T389 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 49123 T443 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 49223 T389 oasc.ZkTestServer.run start zk server on port:36931
[junit4] 2> 49224 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49226 T449 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cc2b11 name:ZooKeeperConnection Watcher:127.0.0.1:36931 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49226 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49241 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49242 T451 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@161698c name:ZooKeeperConnection Watcher:127.0.0.1:36931 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49242 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49243 T389 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 49245 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49246 T453 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a7f47c name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49246 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49246 T389 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 49248 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49249 T455 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@230f73 name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49249 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49249 T389 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 49251 T389 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 49253 T389 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 49255 T389 oasc.Overseer.start Overseer (id=91104692084080643-127.0.0.1:36931_solr-n_0000000000) starting
[junit4] 2> 49256 T389 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 49258 T389 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 49259 T389 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 49261 T457 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 49261 T389 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 49261 T457 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 49262 T456 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 49263 T389 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 49264 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 49265 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49268 T459 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d2cc5 name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49268 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49269 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 49270 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node0
[junit4] 2> 49272 T453 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 49272 T459 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 49272 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49273 T461 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ea0d07 name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49274 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49274 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 49276 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 49278 T453 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 49278 T459 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 49278 T461 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 49278 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49280 T463 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e0772 name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49280 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49281 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 49283 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 49286 T461 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 49286 T453 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 49286 T459 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 49287 T463 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 49287 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49289 T465 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8ec29b name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49289 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49290 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 49293 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node3
[junit4] 2> 49297 T461 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 49297 T459 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 49297 T453 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 49297 T463 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 49298 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49297 T465 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 49299 T467 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@116804b name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49299 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49300 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 49303 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node4
[junit4] 2> 49308 T461 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 49308 T453 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 49309 T465 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 49308 T467 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 49308 T463 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 49308 T459 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 49309 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49310 T469 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@114321b name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49310 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49311 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 49313 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node5
[junit4] 2> 49315 T453 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 49316 T465 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 49316 T461 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 49316 T469 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 49316 T459 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 49316 T463 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 49316 T467 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 49317 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49319 T471 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@161e59c name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49319 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49320 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 49321 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node6
[junit4] 2> 49324 T471 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 49324 T465 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 49324 T453 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 49324 T461 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 49324 T469 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 49324 T463 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 49324 T459 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 49324 T467 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 49325 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49326 T473 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1657471 name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49326 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49327 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 49328 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node7
[junit4] 2> 49331 T461 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 49331 T453 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 49331 T471 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 49331 T463 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 49331 T465 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 49331 T469 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 49331 T473 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 49331 T467 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 49331 T459 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 49332 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49333 T475 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@eeba4e name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49333 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49334 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 49336 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node8
[junit4] 2> 49338 T461 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 49339 T453 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 49339 T463 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 49339 T459 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 49339 T471 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 49340 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49339 T465 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 49339 T475 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 49341 T477 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@60c5e2 name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49339 T469 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 49339 T467 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 49339 T473 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 49341 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49342 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 49344 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node9
[junit4] 2> 49345 T453 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 49346 T463 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 49346 T461 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 49346 T469 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 49346 T465 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 49346 T471 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 49347 T475 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 49347 T473 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 49346 T459 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 49346 T467 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 49346 T477 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 49347 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49349 T479 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a99d77 name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49349 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49350 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 49352 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node10
[junit4] 2> 49355 T477 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 49355 T461 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 49355 T471 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 49355 T475 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 49355 T463 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 49355 T465 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 49355 T467 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 49356 T459 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 49355 T453 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 49356 T479 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 49356 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49356 T473 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 49356 T469 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 49357 T481 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@51a76f name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49358 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49358 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 49360 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node11
[junit4] 2> 49363 T461 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 49363 T467 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 49363 T463 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 49364 T477 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 49364 T481 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 49363 T471 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 49364 T479 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 49364 T469 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 49364 T465 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 49364 T459 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 49364 T475 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 49364 T473 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 49364 T453 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 49365 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49366 T483 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19256a1 name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49366 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49368 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 49370 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node12
[junit4] 2> 49373 T453 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 49374 T461 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 49374 T473 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 49374 T467 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 49373 T481 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 49373 T459 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 49374 T463 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 49374 T471 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 49375 T479 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 49374 T475 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 49375 T483 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 49374 T477 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 49376 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49375 T469 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 49375 T465 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 49377 T485 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15bd424 name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49377 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49378 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 49380 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node13
[junit4] 2> 49383 T481 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 49383 T463 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 49383 T459 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 49384 T475 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 49384 T473 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 49384 T453 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 49384 T477 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 49384 T479 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 49385 T467 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 49385 T471 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 49385 T461 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 49385 T469 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 49385 T483 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 49385 T485 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 49385 T465 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 49386 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49387 T487 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@151bb1d name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49387 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49388 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 49390 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node14
[junit4] 2> 49392 T469 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 49392 T459 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 49394 T473 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 49394 T481 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 49394 T471 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 49394 T453 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 49394 T477 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 49394 T463 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 49394 T475 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 49394 T467 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 49394 T479 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 49395 T485 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 49394 T483 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 49394 T465 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 49394 T461 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 49395 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49397 T487 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 49397 T489 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8c0fc7 name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49397 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49398 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 49400 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node15
[junit4] 2> 49402 T469 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 49402 T467 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 49403 T479 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 49403 T459 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 49403 T465 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 49403 T463 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 49403 T483 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 49403 T453 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 49403 T477 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 49403 T475 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 49403 T485 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 49403 T473 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 49404 T487 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 49404 T481 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 49403 T471 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 49405 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49403 T461 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 49405 T489 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 49406 T491 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fc61a9 name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49406 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49407 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 49409 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node16
[junit4] 2> 49412 T467 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 49412 T465 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 49412 T473 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 49412 T459 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 49412 T471 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 49412 T469 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 49413 T463 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 49412 T485 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 49412 T483 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 49413 T491 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 49413 T487 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 49413 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49412 T477 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 49414 T489 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 49412 T461 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 49412 T453 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 49412 T481 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 49412 T475 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 49412 T479 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 49415 T493 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9b7206 name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49415 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49416 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 49418 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node17
[junit4] 2> 49422 T453 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 49423 T481 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 49422 T483 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 49423 T463 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 49423 T475 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 49423 T465 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 49423 T491 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 49424 T489 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 49423 T469 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 49423 T473 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 49424 T459 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 49424 T467 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 49424 T479 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 49424 T487 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 49424 T471 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 49424 T477 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 49423 T461 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 49423 T485 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 49427 T495 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@94a69b name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49425 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49425 T493 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 49430 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49431 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 49433 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node18
[junit4] 2> 49435 T463 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 49436 T461 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 49436 T479 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 49436 T459 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 49436 T469 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 49436 T465 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 49436 T473 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 49435 T485 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 49435 T453 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 49436 T471 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 49436 T477 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 49437 T481 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 49437 T489 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 49440 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49442 T487 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 49439 T467 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 49439 T495 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 49439 T493 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 49439 T491 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 49438 T475 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 49438 T483 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 49441 T497 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ba7d79 name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49446 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49447 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 49449 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node19
[junit4] 2> 49452 T475 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 49452 T477 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 49453 T459 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 49453 T485 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 49452 T471 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 49453 T491 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 49453 T479 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 49454 T465 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 49454 T481 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 49453 T453 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 49453 T469 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 49454 T493 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 49455 T483 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 49453 T461 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 49455 T497 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 49455 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49455 T495 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 49454 T487 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 49454 T467 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 49454 T463 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 49453 T473 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 49453 T489 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 49457 T499 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43a06e name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49457 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49458 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 49459 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node20
[junit4] 2> 49462 T477 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 49462 T481 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 49462 T463 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 49462 T467 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 49463 T459 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 49463 T485 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 49462 T453 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 49463 T489 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 49463 T491 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 49464 T493 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 49464 T465 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 49463 T471 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 49463 T479 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 49463 T461 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 49463 T473 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 49464 T495 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 49464 T497 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 49464 T487 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 49463 T469 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 49469 T475 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 49470 T483 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 49471 T499 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 49472 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49473 T501 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e5eda2 name:ZooKeeperConnection Watcher:127.0.0.1:36931/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 49473 T389 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 49474 T389 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 49476 T389 oascc.SolrZkClient.makePath makePath: /live_nodes/node21
[junit4] 2> 49478 T487 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 49479 T465 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 49479 T495 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 49479 T463 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 49479 T473 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 49479 T497 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 49479 T479 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 49480 T471 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 49480 T481 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 49479 T467 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 49479 T469 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 49479 T477 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 49479 T475 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 49479 T459 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 49480 T501 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 49481 T389 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 49480 T493 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 49480 T489 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 49480 T485 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 49479 T461 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 49479 T499 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 49479 T483 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 49479 T453 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 4947
[...truncated too long message...]
tty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.MigrateRouteKeyTest-1390148353030/jetty4;done=false>>]
[junit4] 2> 1169428 T5607 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.MigrateRouteKeyTest-1390148353030/jetty4
[junit4] 2> 1169429 T5607 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1169429 T5607 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 46651 T5507 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> 66713 T5507 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 1 thread leaked from SUITE scope at org.apache.solr.cloud.MigrateRouteKeyTest:
[junit4] 2> 1) Thread[id=5644, name=Timer-22, state=WAITING, group=TGRP-MigrateRouteKeyTest]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Object.wait(Object.java:502)
[junit4] 2> at java.util.TimerThread.mainLoop(Timer.java:526)
[junit4] 2> at java.util.TimerThread.run(Timer.java:505)
[junit4] 2> 66713 T5507 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=5644, name=Timer-22, state=WAITING, group=TGRP-MigrateRouteKeyTest]
[junit4] 2> 69715 T5507 ccr.ThreadLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=5644, name=Timer-22, state=WAITING, group=TGRP-MigrateRouteKeyTest]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Object.wait(Object.java:502)
[junit4] 2> at java.util.TimerThread.mainLoop(Timer.java:526)
[junit4] 2> at java.util.TimerThread.run(Timer.java:505)
[junit4] 2> NOTE: test params are: codec=Lucene46: {_version_=PostingsFormat(name=MockSep), n_ti=PostingsFormat(name=MockSep), id=PostingsFormat(name=Asserting)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=is, timezone=Egypt
[junit4] 2> NOTE: Linux 3.8.0-35-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=2,free=75885408,total=353107968
[junit4] 2> NOTE: All tests run in this JVM: [TestCSVLoader, TestSolr4Spatial, HighlighterConfigTest, NoCacheHeaderTest, TestSolrCoreProperties, SuggesterWFSTTest, DateFieldTest, TestFieldTypeResource, DistributedSuggestComponentTest, CursorPagingTest, IndexBasedSpellCheckerTest, TriLevelCompositeIdRoutingTest, NotRequiredUniqueKeyTest, ConvertedLegacyTest, DirectUpdateHandlerTest, DeleteReplicaTest, SuggesterTSTTest, TestJmxIntegration, LeaderElectionIntegrationTest, TestSolrJ, NumericFieldsTest, TestDistribDocBasedVersion, TestCSVResponseWriter, TestArbitraryIndexDir, BasicDistributedZk2Test, SolrPluginUtilsTest, TestFieldCollectionResource, XmlUpdateRequestHandlerTest, DocValuesMultiTest, TestSolrQueryParserDefaultOperatorResource, HdfsCollectionsAPIDistributedZkTest, TestXIncludeConfig, TestSchemaVersionResource, TestBinaryField, TestAnalyzeInfixSuggestions, TestSchemaSimilarityResource, TestCollationFieldDocValues, ChaosMonkeyNothingIsSafeTest, OpenExchangeRatesOrgProviderTest, OutputWriterTest, ParsingFieldUpdateProcessorsTest, OpenCloseCoreStressTest, TestDocBasedVersionConstraints, FieldAnalysisRequestHandlerTest, TestFiltering, SolrIndexConfigTest, TestUtils, HardAutoCommitTest, ShardRoutingCustomTest, StandardRequestHandlerTest, StressHdfsTest, SortByFunctionTest, DistanceFunctionTest, HdfsChaosMonkeySafeLeaderTest, TestSolrXmlPersistor, AlternateDirectoryTest, TestStressReorder, TestFastWriter, TestLazyCores, TestUniqueKeyFieldResource, HdfsRecoveryZkTest, SolrRequestParserTest, TestFastLRUCache, TestStressRecovery, TestRangeQuery, ZkSolrClientTest, IndexSchemaRuntimeFieldTest, MultiTermTest, CollectionsAPIDistributedZkTest, TestQuerySenderListener, TestAtomicUpdateErrorCases, TestReload, PreAnalyzedFieldTest, TestNonNRTOpen, SolrCmdDistributorTest, TestQuerySenderNoQuery, PingRequestHandlerTest, TestComponentsName, TestMultiCoreConfBootstrap, TestSolrDeletionPolicy2, StatsComponentTest, TestAnalyzedSuggestions, TestDynamicFieldResource, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, ShardRoutingTest, BasicZkTest, FullSolrCloudDistribCmdsTest, TestZkChroot, TestRandomDVFaceting, TestHashPartitioner, TestJoin, TestGroupingSearch, TestFunctionQuery, HighlighterTest, ShowFileRequestHandlerTest, CurrencyFieldOpenExchangeTest, DistributedQueryElevationComponentTest, CurrencyFieldXmlFileTest, SimplePostToolTest, TestCoreDiscovery, SignatureUpdateProcessorFactoryTest, SpellCheckCollatorTest, SuggesterTest, WordBreakSolrSpellCheckerTest, SchemaVersionSpecificBehaviorTest, TestUpdate, TestWordDelimiterFilterFactory, DefaultValueUpdateProcessorTest, XsltUpdateRequestHandlerTest, DisMaxRequestHandlerTest, TestReversedWildcardFilterFactory, TestQueryTypes, PrimitiveFieldTypeTest, RequestHandlersTest, PathHierarchyTokenizerFactoryTest, TestIndexingPerformance, TestSolrQueryParser, RegexBoostProcessorTest, ReturnFieldsTest, MBeansHandlerTest, UniqFieldsUpdateProcessorFactoryTest, BinaryUpdateRequestHandlerTest, CoreContainerCoreInitFailuresTest, TestLFUCache, ResponseLogComponentTest, SampleTest, TestSearchPerf, TestConfig, TestFuzzyAnalyzedSuggestions, TestPostingsSolrHighlighter, TestLuceneMatchVersion, TestCharFilters, EchoParamsTest, TestDFRSimilarityFactory, TestLMDirichletSimilarityFactory, TestIBSimilarityFactory, LegacyHTMLStripCharFilterTest, TestFastOutputStream, URLClassifyProcessorTest, TestSystemIdResolver, TestSuggestSpellingConverter, DOMUtilTest, TestDocumentBuilder, UUIDFieldTest, CircularListTest, SolrTestCaseJ4Test, TestDistributedMissingSort, MigrateRouteKeyTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=MigrateRouteKeyTest -Dtests.seed=D61FE655FDA0DA2B -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=is -Dtests.timezone=Egypt -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J1 | MigrateRouteKeyTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.MigrateRouteKeyTest:
[junit4] > 1) Thread[id=5644, name=Timer-22, state=WAITING, group=TGRP-MigrateRouteKeyTest]
[junit4] > at java.lang.Object.wait(Native Method)
[junit4] > at java.lang.Object.wait(Object.java:502)
[junit4] > at java.util.TimerThread.mainLoop(Timer.java:526)
[junit4] > at java.util.TimerThread.run(Timer.java:505)
[junit4] > at __randomizedtesting.SeedInfo.seed([D61FE655FDA0DA2B]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=5644, name=Timer-22, state=WAITING, group=TGRP-MigrateRouteKeyTest]
[junit4] > at java.lang.Object.wait(Native Method)
[junit4] > at java.lang.Object.wait(Object.java:502)
[junit4] > at java.util.TimerThread.mainLoop(Timer.java:526)
[junit4] > at java.util.TimerThread.run(Timer.java:505)
[junit4] > at __randomizedtesting.SeedInfo.seed([D61FE655FDA0DA2B]:0)
[junit4] Completed on J1 in 69.77s, 1 test, 2 errors <<< FAILURES!
[...truncated 11 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:459: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:439: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:491: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1308: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:941: There were test failures: 354 suites, 1540 tests, 2 suite-level errors, 1 error, 34 ignored (6 assumptions)
Total time: 43 minutes 54 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-ea-b123 -server -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure